2024-03-16T10:29:38.592 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T10:29:38.592 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377 --owner scheduled_pdonnell@teuthology --verbose -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/orig.config.yaml 2024-03-16T10:29:38.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T10:29:38.734 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377 branch: wip-batrick-testing-20240314.183243 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} email: pdonnell@redhat.com first_in_suite: false job_id: '7602377' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - slow metadata IO - SLOW_OPS - slow request sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240314.183243 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuzEP5H8SHZUjHpZ/XNFSDpHuaKT5tHEZWA89c82svb603Z6wzd2dkcgzW0lxQsByy45AqAC/BepRB3zwuT3XY= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD8C8ZB6JKYQSZOEQ/BYt2EaWJAOVOWqcWsxExKzJDp4QrX3R4bP3/hYCdHq3eCG8dZj6oOul0ADa4UVUUoBXE= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgsp1hh4JDU1bOzX8H+6zcjKfuVRdD2K8RmR7DJugvIyY8TyjN+DcX7jWOyDw7ReopySg1qzWRXgmcsjqMV6s8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-15_13:00:41 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-16T10:29:38.787 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa; will attempt to use it 2024-03-16T10:29:38.788 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks 2024-03-16T10:29:38.788 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-16T10:29:38.789 INFO:teuthology.task.internal:Checking packages... 2024-03-16T10:29:38.812 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-16T10:29:38.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-16T10:29:38.812 INFO:teuthology.packaging:ref: None 2024-03-16T10:29:38.812 INFO:teuthology.packaging:tag: None 2024-03-16T10:29:38.812 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-16T10:29:38.812 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:29:38.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-16T10:29:38.954 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162.g3d78f5ba 2024-03-16T10:29:38.956 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-16T10:29:38.964 INFO:teuthology.task.internal:no buildpackages task found 2024-03-16T10:29:38.964 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-16T10:29:38.972 INFO:teuthology.task.internal:Saving configuration 2024-03-16T10:29:38.991 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-16T10:29:38.996 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T10:29:39.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.496602', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuzEP5H8SHZUjHpZ/XNFSDpHuaKT5tHEZWA89c82svb603Z6wzd2dkcgzW0lxQsByy45AqAC/BepRB3zwuT3XY='} 2024-03-16T10:29:39.043 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.498693', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD8C8ZB6JKYQSZOEQ/BYt2EaWJAOVOWqcWsxExKzJDp4QrX3R4bP3/hYCdHq3eCG8dZj6oOul0ADa4UVUUoBXE='} 2024-03-16T10:29:39.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.497783', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgsp1hh4JDU1bOzX8H+6zcjKfuVRdD2K8RmR7DJugvIyY8TyjN+DcX7jWOyDw7ReopySg1qzWRXgmcsjqMV6s8='} 2024-03-16T10:29:39.064 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-16T10:29:39.070 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-16T10:29:39.070 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-16T10:29:39.071 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-16T10:29:39.071 INFO:teuthology.run_tasks:Running task console_log... 2024-03-16T10:29:41.952 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f398483b160>, signals=[15]) 2024-03-16T10:29:41.952 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-16T10:29:41.959 INFO:teuthology.task.internal:Opening connections... 2024-03-16T10:29:41.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:29:41.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:29:42.070 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-03-16T10:29:42.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:29:42.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-03-16T10:29:42.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:29:42.247 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-16T10:29:42.254 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-03-16T10:29:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-03-16T10:29:42.270 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-03-16T10:29:42.325 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-03-16T10:29:42.325 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T10:29:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T10:29:42.327 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-03-16T10:29:42.355 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-03-16T10:29:42.371 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-03-16T10:29:42.371 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T10:29:42.426 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T10:29:42.427 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T10:29:42.427 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-03-16T10:29:42.454 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-03-16T10:29:42.471 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-03-16T10:29:42.472 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T10:29:42.529 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-03-16T10:29:42.530 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T10:29:42.530 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T10:29:42.530 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T10:29:42.530 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-03-16T10:29:42.555 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-16T10:29:42.569 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-16T10:29:42.575 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-16T10:29:42.575 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-03-16T10:29:42.577 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-03-16T10:29:42.580 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-03-16T10:29:42.596 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-16T10:29:42.602 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-16T10:29:42.602 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-03-16T10:29:42.633 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-03-16T10:29:42.635 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-03-16T10:29:42.670 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-16T10:29:42.752 INFO:teuthology.run_tasks:Running task kernel... 2024-03-16T10:29:42.765 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-16T10:29:42.765 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-03-16T10:29:42.765 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-03-16T10:29:42.765 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T10:29:42.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:29:42.781 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-16T10:29:42.836 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-361.el9.x86_64 2024-03-16T10:29:42.836 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-361.el9.x86_64 2024-03-16T10:29:42.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-03-16T10:29:44.866 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-16T10:29:46.434 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-03-16T10:29:47.286 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-03-16T10:29:49.294 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-16T10:29:53.459 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-16T10:29:54.994 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2024-03-16T10:29:56.980 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-03-16T10:30:04.293 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-16T10:30:04.293 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-16T10:30:04.387 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-16T10:30:04.392 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-16T10:30:04.392 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-03-16T10:30:04.392 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-03-16T10:30:04.393 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:04.394 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 100 M 2024-03-16T10:30:04.394 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 123 M 2024-03-16T10:30:04.394 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-16T10:30:04.930 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 22 MB/s | 6.0 MB 00:00 2024-03-16T10:30:05.255 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 35 MB/s | 21 MB 00:00 2024-03-16T10:30:05.780 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 35 MB/s | 39 MB 00:01 2024-03-16T10:30:06.089 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 29 MB/s | 33 MB 00:01 2024-03-16T10:30:06.089 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-16T10:30:06.089 INFO:teuthology.orchestra.run.smithi017.stdout:Total 59 MB/s | 100 MB 00:01 2024-03-16T10:30:07.009 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-16T10:30:07.478 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-16T10:30:07.479 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-16T10:30:08.880 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-16T10:30:08.881 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-16T10:30:11.733 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-16T10:30:12.412 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-16T10:30:12.547 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T10:30:15.497 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T10:30:15.683 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T10:30:20.787 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T10:30:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:26.045 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:56.752 INFO:teuthology.orchestra.run.smithi017.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-16T10:30:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-16T10:30:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T10:30:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T10:30:57.661 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:57.662 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-16T10:30:58.157 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T10:30:58.310 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T10:30:58.311 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T10:30:58.311 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-16T10:30:58.311 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-16T10:30:58.311 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-16T10:30:58.311 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-16T10:30:58.311 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-03-16T10:30:58.311 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T10:30:58.438 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T10:30:58.438 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T10:30:58.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-03-16T10:30:58.476 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 68.el9 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8264254 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-03-16T10:30:58.477 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:30:58.478 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-03-16T10:30:58.479 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-16T10:30:58.479 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-427.el9.x86_64 2024-03-16T10:30:58.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-16T10:30:59.144 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-03-16T10:31:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-16T10:31:00.524 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-03-16T10:31:00.527 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-03-16T10:31:00.542 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.g9Cm1cIUEA 2024-03-16T10:31:00.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.g9Cm1cIUEA 2024-03-16T10:31:00.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.g9Cm1cIUEA 2024-03-16T10:31:00.761 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.g9Cm1cIUEA is 6KB 2024-03-16T10:31:00.811 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.g9Cm1cIUEA 2024-03-16T10:31:00.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-03-16T10:31:00.902 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-16T10:31:00.902 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-16T10:31:00.902 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-16T10:31:00.902 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-16T10:31:00.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-16T10:31:01.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-03-16T10:31:31.083 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-16T10:31:31.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:31:31.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:31:49.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-16T10:31:58.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:31:58.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:32:58.539 DEBUG:teuthology.orchestra.remote:timed out 2024-03-16T10:33:10.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:33:10.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:33:10.869 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-16T10:33:11.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:33:11.259 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-427.el9.x86_64"... 2024-03-16T10:33:11.259 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-16T10:33:11.275 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-427.el9.x86_64 2024-03-16T10:33:11.276 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-16T10:33:11.276 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-16T10:33:11.276 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-16T10:33:12.278 DEBUG:teuthology.parallel:result is None 2024-03-16T10:33:12.278 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-16T10:33:12.286 INFO:teuthology.task.internal:Creating test directory... 2024-03-16T10:33:12.286 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T10:33:12.288 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T10:33:12.292 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T10:33:12.309 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-16T10:33:12.316 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-16T10:33:12.349 INFO:teuthology.task.internal:Creating archive directory... 2024-03-16T10:33:12.350 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T10:33:12.352 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T10:33:12.354 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T10:33:12.395 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-16T10:33:12.401 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-16T10:33:12.401 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T10:33:12.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:33:12.436 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T10:33:12.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:33:12.453 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T10:33:12.455 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T10:33:12.478 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T10:33:12.512 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.530 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.536 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.544 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.553 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.576 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T10:33:12.578 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-16T10:33:12.585 INFO:teuthology.task.internal:Configuring sudo... 2024-03-16T10:33:12.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T10:33:12.587 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T10:33:12.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T10:33:12.625 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-16T10:33:12.634 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-16T10:33:12.634 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T10:33:12.657 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T10:33:12.659 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T10:33:12.681 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:12.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:12.805 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:12.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:12.931 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:33:12.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T10:33:13.000 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:13.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:13.096 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:13.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:13.223 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:33:13.223 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T10:33:13.291 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:13.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T10:33:13.396 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:13.434 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T10:33:13.484 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:33:13.485 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T10:33:13.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-03-16T10:33:13.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-03-16T10:33:13.558 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-03-16T10:33:13.593 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:33:13.596 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:33:13.635 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:33:13.938 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-16T10:33:13.947 INFO:teuthology.task.internal:Starting timer... 2024-03-16T10:33:13.947 INFO:teuthology.run_tasks:Running task pcp... 2024-03-16T10:33:13.959 INFO:teuthology.run_tasks:Running task selinux... 2024-03-16T10:33:13.967 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-16T10:33:13.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-03-16T10:33:14.020 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-03-16T10:33:14.022 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2024-03-16T10:33:14.080 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2024-03-16T10:33:14.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-03-16T10:33:14.136 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-03-16T10:33:14.137 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-16T10:33:14.138 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-03-16T10:33:14.155 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-03-16T10:33:14.155 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2024-03-16T10:33:14.177 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2024-03-16T10:33:14.177 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-03-16T10:33:14.196 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-03-16T10:33:14.197 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-03-16T10:33:14.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:33:14.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:33:14.225 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:33:14.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:33:14.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:33:14.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:33:14.282 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-16T10:33:14.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-03-16T10:33:14.315 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2024-03-16T10:33:14.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-03-16T10:33:14.382 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-16T10:33:14.392 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-16T10:33:14.397 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-16T10:33:14.521 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-16T10:33:14.535 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-16T10:33:14.537 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi111.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-16T10:37:38.650 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-03-16T10:37:38.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:37:38.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:37:38.742 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-16T10:37:38.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-16T10:37:38.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-16T10:37:38.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:37:38.901 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-03-16T10:37:38.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-16T10:37:38.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-03-16T10:37:38.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T10:37:39.060 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-03-16T10:37:39.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-03-16T10:37:39.130 INFO:teuthology.run_tasks:Running task clock... 2024-03-16T10:37:39.141 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-16T10:37:39.141 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T10:37:39.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:37:39.144 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T10:37:39.144 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:37:39.147 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T10:37:39.147 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:37:39.173 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T10:37:39.176 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T10:37:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T10:37:39.193 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T10:37:39.203 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T10:37:39.219 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-03-16T10:37:39.220 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T10:37:39.222 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2024-03-16T10:37:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-03-16T10:37:39.235 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2024-03-16T10:37:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T10:37:39.251 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-03-16T10:37:39.252 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T10:37:39.264 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-03-16T10:37:39.265 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T10:37:39.270 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T10:37:39.281 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T10:37:39.297 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T10:37:39.311 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:37:39.314 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:37:39.314 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-03-16T10:37:39.315 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.315 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.315 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.315 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.321 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.341 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.345 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:37:39.345 INFO:teuthology.run_tasks:Running task install... 2024-03-16T10:37:39.353 DEBUG:teuthology.task.install:project ceph 2024-03-16T10:37:39.353 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-16T10:37:39.353 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-16T10:37:39.354 INFO:teuthology.task.install:Using flavor: default 2024-03-16T10:37:39.361 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-16T10:37:39.361 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-16T10:37:39.361 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-16T10:37:39.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:37:39.363 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-16T10:37:39.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:37:39.364 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-16T10:37:39.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:37:39.506 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-16T10:37:39.506 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-16T10:37:39.579 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-16T10:37:39.579 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-16T10:37:39.596 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-16T10:37:39.596 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-16T10:37:39.617 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T10:37:39.617 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:37:39.617 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T10:37:39.651 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T10:37:39.651 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T10:37:39.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T10:37:39.747 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T10:37:39.747 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:37:39.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T10:37:39.763 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T10:37:39.764 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:37:39.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T10:37:39.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T10:37:39.774 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T10:37:39.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T10:37:39.792 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T10:37:39.798 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T10:37:39.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T10:37:39.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T10:37:39.864 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-03-16T10:37:39.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-03-16T10:37:39.922 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T10:37:39.938 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T10:37:39.988 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-03-16T10:37:39.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-03-16T10:37:40.004 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-03-16T10:37:40.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-03-16T10:37:40.098 INFO:teuthology.orchestra.run.smithi111.stdout:74 files removed 2024-03-16T10:37:40.125 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T10:37:40.230 INFO:teuthology.orchestra.run.smithi017.stdout:74 files removed 2024-03-16T10:37:40.242 INFO:teuthology.orchestra.run.smithi174.stdout:74 files removed 2024-03-16T10:37:40.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T10:37:40.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T10:37:40.815 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 207 kB/s | 83 kB 00:00 2024-03-16T10:37:40.960 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 208 kB/s | 83 kB 00:00 2024-03-16T10:37:41.053 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 175 kB/s | 83 kB 00:00 2024-03-16T10:37:41.132 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 36 kB/s | 10 kB 00:00 2024-03-16T10:37:41.369 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-03-16T10:37:41.412 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 33 kB/s | 10 kB 00:00 2024-03-16T10:37:41.516 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-03-16T10:37:41.728 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-03-16T10:37:41.854 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-03-16T10:37:42.060 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-16T10:37:42.197 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-16T10:37:42.324 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-16T10:37:43.560 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-03-16T10:37:43.614 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2024-03-16T10:37:43.766 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-16T10:37:44.422 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-03-16T10:37:44.718 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-03-16T10:37:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-03-16T10:37:48.144 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 19 MB 00:02 2024-03-16T10:37:48.924 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-03-16T10:37:52.445 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.1 MB 00:00 2024-03-16T10:37:53.192 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.1 MB 00:00 2024-03-16T10:37:53.912 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2024-03-16T10:37:54.751 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2024-03-16T10:37:55.491 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-16T10:37:56.554 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-16T10:38:00.413 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-16T10:38:01.711 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-16T10:38:02.958 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:02.959 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:02.971 INFO:teuthology.orchestra.run.smithi111.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T10:38:02.971 INFO:teuthology.orchestra.run.smithi111.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T10:38:02.972 INFO:teuthology.orchestra.run.smithi111.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T10:38:02.973 INFO:teuthology.orchestra.run.smithi111.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:02.975 INFO:teuthology.orchestra.run.smithi111.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:02.978 INFO:teuthology.orchestra.run.smithi111.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T10:38:02.979 INFO:teuthology.orchestra.run.smithi111.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T10:38:03.058 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-03-16T10:38:03.078 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================================ 2024-03-16T10:38:03.078 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-03-16T10:38:03.078 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================================ 2024-03-16T10:38:03.078 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-16T10:38:03.079 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T10:38:03.080 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T10:38:03.081 INFO:teuthology.orchestra.run.smithi111.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T10:38:03.082 INFO:teuthology.orchestra.run.smithi111.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-16T10:38:03.083 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-16T10:38:03.084 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T10:38:03.085 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T10:38:03.086 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T10:38:03.087 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T10:38:03.088 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T10:38:03.089 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T10:38:03.090 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout:Installing weak dependencies: 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================================ 2024-03-16T10:38:03.091 INFO:teuthology.orchestra.run.smithi111.stdout:Install 150 Packages 2024-03-16T10:38:03.092 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 24 Packages 2024-03-16T10:38:03.092 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:03.092 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 224 M 2024-03-16T10:38:03.092 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-03-16T10:38:03.881 INFO:teuthology.orchestra.run.smithi111.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-03-16T10:38:04.198 INFO:teuthology.orchestra.run.smithi111.stdout:(2/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 9.8 MB/s | 5.4 MB 00:00 2024-03-16T10:38:04.248 INFO:teuthology.orchestra.run.smithi111.stdout:(3/174): ceph-immutable-object-cache-19.0.0-216 2.8 MB/s | 145 kB 00:00 2024-03-16T10:38:04.314 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:04.315 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:04.328 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T10:38:04.329 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T10:38:04.329 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T10:38:04.330 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:04.332 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:04.335 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T10:38:04.336 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T10:38:04.374 INFO:teuthology.orchestra.run.smithi111.stdout:(4/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.8 MB/s | 890 kB 00:00 2024-03-16T10:38:04.416 INFO:teuthology.orchestra.run.smithi111.stdout:(5/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 14 MB/s | 2.4 MB 00:00 2024-03-16T10:38:04.420 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-16T10:38:04.436 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-16T10:38:04.437 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-16T10:38:04.438 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T10:38:04.439 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T10:38:04.440 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-16T10:38:04.441 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T10:38:04.442 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T10:38:04.443 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T10:38:04.444 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T10:38:04.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T10:38:04.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T10:38:04.447 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T10:38:04.448 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================ 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:Install 150 Packages 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 24 Packages 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 224 M 2024-03-16T10:38:04.449 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-16T10:38:04.716 INFO:teuthology.orchestra.run.smithi111.stdout:(6/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 16 MB/s | 4.7 MB 00:00 2024-03-16T10:38:04.917 INFO:teuthology.orchestra.run.smithi111.stdout:(7/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-03-16T10:38:05.354 INFO:teuthology.orchestra.run.smithi017.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-03-16T10:38:05.717 INFO:teuthology.orchestra.run.smithi111.stdout:(8/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x86 17 MB/s | 17 MB 00:00 2024-03-16T10:38:05.737 INFO:teuthology.orchestra.run.smithi017.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 2.3 MB/s | 890 kB 00:00 2024-03-16T10:38:05.792 INFO:teuthology.orchestra.run.smithi111.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 336 kB/s | 25 kB 00:00 2024-03-16T10:38:05.837 INFO:teuthology.orchestra.run.smithi017.stdout:(3/174): ceph-immutable-object-cache-19.0.0-216 1.4 MB/s | 145 kB 00:00 2024-03-16T10:38:06.629 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 913 kB/s | 19 MB 00:21 2024-03-16T10:38:06.671 INFO:teuthology.orchestra.run.smithi017.stdout:(4/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 3.1 MB/s | 5.4 MB 00:01 2024-03-16T10:38:07.021 INFO:teuthology.orchestra.run.smithi017.stdout:(5/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-03-16T10:38:07.108 INFO:teuthology.orchestra.run.smithi111.stdout:(10/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el 4.5 MB/s | 9.8 MB 00:02 2024-03-16T10:38:07.113 INFO:teuthology.orchestra.run.smithi017.stdout:(6/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 3.4 MB/s | 1.5 MB 00:00 2024-03-16T10:38:07.200 INFO:teuthology.orchestra.run.smithi111.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 2.4 MB/s | 221 kB 00:00 2024-03-16T10:38:07.292 INFO:teuthology.orchestra.run.smithi111.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 296 kB/s | 27 kB 00:00 2024-03-16T10:38:07.501 INFO:teuthology.orchestra.run.smithi111.stdout:(13/174): ceph-common-19.0.0-2162.g3d78f5ba.el9 5.4 MB/s | 21 MB 00:03 2024-03-16T10:38:07.526 INFO:teuthology.orchestra.run.smithi111.stdout:(14/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 136 kB/s | 32 kB 00:00 2024-03-16T10:38:07.618 INFO:teuthology.orchestra.run.smithi111.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.7 MB/s | 163 kB 00:00 2024-03-16T10:38:07.652 INFO:teuthology.orchestra.run.smithi111.stdout:(16/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 4.9 MB/s | 747 kB 00:00 2024-03-16T10:38:07.702 INFO:teuthology.orchestra.run.smithi111.stdout:(17/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.5 MB/s | 127 kB 00:00 2024-03-16T10:38:07.811 INFO:teuthology.orchestra.run.smithi111.stdout:(18/174): libradosstriper1-19.0.0-2162.g3d78f5b 3.1 MB/s | 501 kB 00:00 2024-03-16T10:38:07.895 INFO:teuthology.orchestra.run.smithi111.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 541 kB/s | 45 kB 00:00 2024-03-16T10:38:07.986 INFO:teuthology.orchestra.run.smithi111.stdout:(20/174): python3-ceph-common-19.0.0-2162.g3d78 1.4 MB/s | 131 kB 00:00 2024-03-16T10:38:08.070 INFO:teuthology.orchestra.run.smithi111.stdout:(21/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 1.9 MB/s | 162 kB 00:00 2024-03-16T10:38:08.170 INFO:teuthology.orchestra.run.smithi111.stdout:(22/174): python3-rados-19.0.0-2162.g3d78f5ba.e 3.1 MB/s | 320 kB 00:00 2024-03-16T10:38:08.270 INFO:teuthology.orchestra.run.smithi111.stdout:(23/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 2.9 MB/s | 298 kB 00:00 2024-03-16T10:38:08.362 INFO:teuthology.orchestra.run.smithi111.stdout:(24/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.1 MB/s | 99 kB 00:00 2024-03-16T10:38:08.454 INFO:teuthology.orchestra.run.smithi111.stdout:(25/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 930 kB/s | 85 kB 00:00 2024-03-16T10:38:08.505 INFO:teuthology.orchestra.run.smithi017.stdout:(7/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-03-16T10:38:08.530 INFO:teuthology.orchestra.run.smithi111.stdout:(26/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 6.2 MB/s | 5.1 MB 00:00 2024-03-16T10:38:08.622 INFO:teuthology.orchestra.run.smithi111.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 1.8 MB/s | 170 kB 00:00 2024-03-16T10:38:08.713 INFO:teuthology.orchestra.run.smithi111.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2162.g 372 kB/s | 34 kB 00:00 2024-03-16T10:38:08.805 INFO:teuthology.orchestra.run.smithi111.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 1.5 MB/s | 139 kB 00:00 2024-03-16T10:38:09.064 INFO:teuthology.orchestra.run.smithi111.stdout:(30/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 5.1 MB/s | 3.1 MB 00:00 2024-03-16T10:38:09.156 INFO:teuthology.orchestra.run.smithi111.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 5.1 MB/s | 1.8 MB 00:00 2024-03-16T10:38:09.256 INFO:teuthology.orchestra.run.smithi111.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 2.4 MB/s | 248 kB 00:00 2024-03-16T10:38:09.348 INFO:teuthology.orchestra.run.smithi111.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 538 kB/s | 49 kB 00:00 2024-03-16T10:38:09.440 INFO:teuthology.orchestra.run.smithi111.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 179 kB/s | 16 kB 00:00 2024-03-16T10:38:09.541 INFO:teuthology.orchestra.run.smithi111.stdout:(35/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 2.6 MB/s | 264 kB 00:00 2024-03-16T10:38:09.733 INFO:teuthology.orchestra.run.smithi111.stdout:(36/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 3.8 MB/s | 748 kB 00:00 2024-03-16T10:38:09.825 INFO:teuthology.orchestra.run.smithi111.stdout:(37/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 199 kB/s | 18 kB 00:00 2024-03-16T10:38:09.863 INFO:teuthology.orchestra.run.smithi017.stdout:(8/174): ceph-common-19.0.0-2162.g3d78f5ba.el9. 4.2 MB/s | 21 MB 00:04 2024-03-16T10:38:09.955 INFO:teuthology.orchestra.run.smithi017.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 275 kB/s | 25 kB 00:00 2024-03-16T10:38:09.983 INFO:teuthology.orchestra.run.smithi111.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 662 kB 00:00 2024-03-16T10:38:10.042 INFO:teuthology.orchestra.run.smithi111.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-16T10:38:10.075 INFO:teuthology.orchestra.run.smithi111.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-16T10:38:10.117 INFO:teuthology.orchestra.run.smithi111.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-16T10:38:10.151 INFO:teuthology.orchestra.run.smithi111.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 947 kB/s | 32 kB 00:00 2024-03-16T10:38:10.260 INFO:teuthology.orchestra.run.smithi111.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-16T10:38:10.352 INFO:teuthology.orchestra.run.smithi111.stdout:(44/174): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-03-16T10:38:10.377 INFO:teuthology.orchestra.run.smithi111.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 146 kB/s | 17 kB 00:00 2024-03-16T10:38:10.402 INFO:teuthology.orchestra.run.smithi111.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-16T10:38:10.427 INFO:teuthology.orchestra.run.smithi111.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T10:38:10.447 INFO:teuthology.orchestra.run.smithi017.stdout:(10/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x8 5.0 MB/s | 17 MB 00:03 2024-03-16T10:38:10.453 INFO:teuthology.orchestra.run.smithi111.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-03-16T10:38:10.486 INFO:teuthology.orchestra.run.smithi111.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-16T10:38:10.512 INFO:teuthology.orchestra.run.smithi111.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-03-16T10:38:10.522 INFO:teuthology.orchestra.run.smithi017.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 2.9 MB/s | 221 kB 00:00 2024-03-16T10:38:10.537 INFO:teuthology.orchestra.run.smithi111.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 940 kB/s | 46 kB 00:00 2024-03-16T10:38:10.562 INFO:teuthology.orchestra.run.smithi111.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-16T10:38:10.579 INFO:teuthology.orchestra.run.smithi111.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-03-16T10:38:10.581 INFO:teuthology.orchestra.run.smithi017.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 465 kB/s | 27 kB 00:00 2024-03-16T10:38:10.596 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-16T10:38:10.604 INFO:teuthology.orchestra.run.smithi111.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-03-16T10:38:10.630 INFO:teuthology.orchestra.run.smithi111.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2024-03-16T10:38:10.648 INFO:teuthology.orchestra.run.smithi017.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 476 kB/s | 32 kB 00:00 2024-03-16T10:38:10.739 INFO:teuthology.orchestra.run.smithi111.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-03-16T10:38:10.781 INFO:teuthology.orchestra.run.smithi111.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-03-16T10:38:10.805 INFO:teuthology.orchestra.run.smithi111.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-03-16T10:38:10.814 INFO:teuthology.orchestra.run.smithi017.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 4.4 MB/s | 747 kB 00:00 2024-03-16T10:38:10.831 INFO:teuthology.orchestra.run.smithi111.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2024-03-16T10:38:10.906 INFO:teuthology.orchestra.run.smithi017.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.7 MB/s | 163 kB 00:00 2024-03-16T10:38:10.948 INFO:teuthology.orchestra.run.smithi111.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-16T10:38:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.9 MB/s | 127 kB 00:00 2024-03-16T10:38:10.982 INFO:teuthology.orchestra.run.smithi111.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-16T10:38:11.015 INFO:teuthology.orchestra.run.smithi111.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-16T10:38:11.099 INFO:teuthology.orchestra.run.smithi017.stdout:(17/174): libradosstriper1-19.0.0-2162.g3d78f5b 3.9 MB/s | 501 kB 00:00 2024-03-16T10:38:11.132 INFO:teuthology.orchestra.run.smithi111.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2024-03-16T10:38:11.149 INFO:teuthology.orchestra.run.smithi111.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-03-16T10:38:11.166 INFO:teuthology.orchestra.run.smithi111.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 542 kB/s | 18 kB 00:00 2024-03-16T10:38:11.199 INFO:teuthology.orchestra.run.smithi111.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-16T10:38:11.216 INFO:teuthology.orchestra.run.smithi111.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2024-03-16T10:38:11.291 INFO:teuthology.orchestra.run.smithi017.stdout:(18/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el 3.5 MB/s | 9.8 MB 00:02 2024-03-16T10:38:11.317 INFO:teuthology.orchestra.run.smithi111.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-03-16T10:38:11.342 INFO:teuthology.orchestra.run.smithi111.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-16T10:38:11.366 INFO:teuthology.orchestra.run.smithi017.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 604 kB/s | 45 kB 00:00 2024-03-16T10:38:11.368 INFO:teuthology.orchestra.run.smithi111.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-16T10:38:11.393 INFO:teuthology.orchestra.run.smithi111.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-16T10:38:11.418 INFO:teuthology.orchestra.run.smithi111.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 820 kB/s | 41 kB 00:00 2024-03-16T10:38:11.441 INFO:teuthology.orchestra.run.smithi017.stdout:(20/174): python3-ceph-common-19.0.0-2162.g3d78 1.7 MB/s | 131 kB 00:00 2024-03-16T10:38:11.444 INFO:teuthology.orchestra.run.smithi111.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-16T10:38:11.461 INFO:teuthology.orchestra.run.smithi111.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-03-16T10:38:11.486 INFO:teuthology.orchestra.run.smithi111.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2024-03-16T10:38:11.511 INFO:teuthology.orchestra.run.smithi111.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 947 kB/s | 47 kB 00:00 2024-03-16T10:38:11.516 INFO:teuthology.orchestra.run.smithi017.stdout:(21/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 2.1 MB/s | 162 kB 00:00 2024-03-16T10:38:11.537 INFO:teuthology.orchestra.run.smithi111.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 851 kB/s | 43 kB 00:00 2024-03-16T10:38:11.633 INFO:teuthology.orchestra.run.smithi017.stdout:(22/174): python3-rados-19.0.0-2162.g3d78f5ba.e 2.7 MB/s | 320 kB 00:00 2024-03-16T10:38:11.734 INFO:teuthology.orchestra.run.smithi017.stdout:(23/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 2.9 MB/s | 298 kB 00:00 2024-03-16T10:38:11.801 INFO:teuthology.orchestra.run.smithi017.stdout:(24/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.5 MB/s | 99 kB 00:00 2024-03-16T10:38:11.884 INFO:teuthology.orchestra.run.smithi017.stdout:(25/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 6.5 MB/s | 5.1 MB 00:00 2024-03-16T10:38:11.909 INFO:teuthology.orchestra.run.smithi017.stdout:(26/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 786 kB/s | 85 kB 00:00 2024-03-16T10:38:11.968 INFO:teuthology.orchestra.run.smithi017.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.9 MB/s | 170 kB 00:00 2024-03-16T10:38:11.980 INFO:teuthology.orchestra.run.smithi111.stdout:(78/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 7.7 MB/s | 48 MB 00:06 2024-03-16T10:38:12.021 INFO:teuthology.orchestra.run.smithi111.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 80 kB/s | 39 kB 00:00 2024-03-16T10:38:12.051 INFO:teuthology.orchestra.run.smithi017.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2162.g 408 kB/s | 34 kB 00:00 2024-03-16T10:38:12.119 INFO:teuthology.orchestra.run.smithi017.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 2.0 MB/s | 139 kB 00:00 2024-03-16T10:38:12.230 INFO:teuthology.orchestra.run.smithi111.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-03-16T10:38:12.231 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-03-16T10:38:12.255 INFO:teuthology.orchestra.run.smithi111.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 150 kB/s | 41 kB 00:00 2024-03-16T10:38:12.280 INFO:teuthology.orchestra.run.smithi111.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-03-16T10:38:12.305 INFO:teuthology.orchestra.run.smithi111.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 757 kB/s | 56 kB 00:00 2024-03-16T10:38:12.319 INFO:teuthology.orchestra.run.smithi017.stdout:(30/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 7.1 MB/s | 3.1 MB 00:00 2024-03-16T10:38:12.330 INFO:teuthology.orchestra.run.smithi111.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-16T10:38:12.355 INFO:teuthology.orchestra.run.smithi111.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-16T10:38:12.380 INFO:teuthology.orchestra.run.smithi111.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-16T10:38:12.406 INFO:teuthology.orchestra.run.smithi111.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T10:38:12.439 INFO:teuthology.orchestra.run.smithi111.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-16T10:38:12.465 INFO:teuthology.orchestra.run.smithi111.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-16T10:38:12.486 INFO:teuthology.orchestra.run.smithi017.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 4.9 MB/s | 1.8 MB 00:00 2024-03-16T10:38:12.490 INFO:teuthology.orchestra.run.smithi111.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-16T10:38:12.515 INFO:teuthology.orchestra.run.smithi111.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-16T10:38:12.603 INFO:teuthology.orchestra.run.smithi017.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 2.1 MB/s | 248 kB 00:00 2024-03-16T10:38:12.657 INFO:teuthology.orchestra.run.smithi111.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 978 kB/s | 187 kB 00:00 2024-03-16T10:38:12.670 INFO:teuthology.orchestra.run.smithi017.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 743 kB/s | 49 kB 00:00 2024-03-16T10:38:12.682 INFO:teuthology.orchestra.run.smithi111.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-16T10:38:12.708 INFO:teuthology.orchestra.run.smithi111.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-16T10:38:12.720 INFO:teuthology.orchestra.run.smithi017.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 328 kB/s | 16 kB 00:00 2024-03-16T10:38:12.750 INFO:teuthology.orchestra.run.smithi111.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-03-16T10:38:12.800 INFO:teuthology.orchestra.run.smithi111.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 183 kB/s | 21 kB 00:00 2024-03-16T10:38:12.829 INFO:teuthology.orchestra.run.smithi017.stdout:(35/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 2.4 MB/s | 264 kB 00:00 2024-03-16T10:38:12.842 INFO:teuthology.orchestra.run.smithi111.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 190 kB/s | 25 kB 00:00 2024-03-16T10:38:12.959 INFO:teuthology.orchestra.run.smithi111.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-03-16T10:38:13.012 INFO:teuthology.orchestra.run.smithi017.stdout:(36/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 4.0 MB/s | 748 kB 00:00 2024-03-16T10:38:13.017 INFO:teuthology.orchestra.run.smithi111.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-03-16T10:38:13.042 INFO:teuthology.orchestra.run.smithi111.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.5 MB/s | 216 kB 00:00 2024-03-16T10:38:13.071 INFO:teuthology.orchestra.run.smithi017.stdout:(37/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 313 kB/s | 18 kB 00:00 2024-03-16T10:38:13.076 INFO:teuthology.orchestra.run.smithi111.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 597 kB/s | 35 kB 00:00 2024-03-16T10:38:13.101 INFO:teuthology.orchestra.run.smithi111.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 759 kB/s | 44 kB 00:00 2024-03-16T10:38:13.135 INFO:teuthology.orchestra.run.smithi111.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-16T10:38:13.186 INFO:teuthology.orchestra.run.smithi111.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-03-16T10:38:13.269 INFO:teuthology.orchestra.run.smithi111.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 8.0 MB/s | 4.1 MB 00:00 2024-03-16T10:38:13.271 INFO:teuthology.orchestra.run.smithi017.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 7.8 MB/s | 7.4 MB 00:00 2024-03-16T10:38:13.297 INFO:teuthology.orchestra.run.smithi017.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 662 kB 00:00 2024-03-16T10:38:13.319 INFO:teuthology.orchestra.run.smithi111.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-03-16T10:38:13.347 INFO:teuthology.orchestra.run.smithi017.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-03-16T10:38:13.372 INFO:teuthology.orchestra.run.smithi017.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-16T10:38:13.397 INFO:teuthology.orchestra.run.smithi017.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-16T10:38:13.403 INFO:teuthology.orchestra.run.smithi111.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 234 kB/s | 19 kB 00:00 2024-03-16T10:38:13.422 INFO:teuthology.orchestra.run.smithi017.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 639 kB/s | 32 kB 00:00 2024-03-16T10:38:13.428 INFO:teuthology.orchestra.run.smithi111.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-03-16T10:38:13.479 INFO:teuthology.orchestra.run.smithi111.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-03-16T10:38:13.498 INFO:teuthology.orchestra.run.smithi017.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-16T10:38:13.504 INFO:teuthology.orchestra.run.smithi111.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-03-16T10:38:13.523 INFO:teuthology.orchestra.run.smithi017.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 175 kB/s | 17 kB 00:00 2024-03-16T10:38:13.529 INFO:teuthology.orchestra.run.smithi111.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-03-16T10:38:13.546 INFO:teuthology.orchestra.run.smithi111.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-16T10:38:13.548 INFO:teuthology.orchestra.run.smithi017.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-16T10:38:13.574 INFO:teuthology.orchestra.run.smithi017.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T10:38:13.588 INFO:teuthology.orchestra.run.smithi111.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-03-16T10:38:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-16T10:38:13.624 INFO:teuthology.orchestra.run.smithi017.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-16T10:38:13.649 INFO:teuthology.orchestra.run.smithi017.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-16T10:38:13.667 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-16T10:38:13.675 INFO:teuthology.orchestra.run.smithi017.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 46 kB 00:00 2024-03-16T10:38:13.700 INFO:teuthology.orchestra.run.smithi017.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-16T10:38:13.705 INFO:teuthology.orchestra.run.smithi111.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-03-16T10:38:13.725 INFO:teuthology.orchestra.run.smithi017.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-16T10:38:13.738 INFO:teuthology.orchestra.run.smithi111.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-03-16T10:38:13.751 INFO:teuthology.orchestra.run.smithi017.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-16T10:38:13.764 INFO:teuthology.orchestra.run.smithi111.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-03-16T10:38:13.776 INFO:teuthology.orchestra.run.smithi017.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-03-16T10:38:13.789 INFO:teuthology.orchestra.run.smithi111.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-03-16T10:38:13.814 INFO:teuthology.orchestra.run.smithi111.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-03-16T10:38:13.840 INFO:teuthology.orchestra.run.smithi111.stdout:(119/174): python3-asyncssh-2.13.2-4.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-03-16T10:38:13.865 INFO:teuthology.orchestra.run.smithi111.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-16T10:38:13.868 INFO:teuthology.orchestra.run.smithi017.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-03-16T10:38:13.893 INFO:teuthology.orchestra.run.smithi111.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.5 MB/s | 358 kB 00:00 2024-03-16T10:38:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2024-03-16T10:38:13.918 INFO:teuthology.orchestra.run.smithi111.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 671 kB/s | 35 kB 00:00 2024-03-16T10:38:13.935 INFO:teuthology.orchestra.run.smithi017.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-03-16T10:38:13.943 INFO:teuthology.orchestra.run.smithi111.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-03-16T10:38:13.960 INFO:teuthology.orchestra.run.smithi017.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2024-03-16T10:38:13.968 INFO:teuthology.orchestra.run.smithi111.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-16T10:38:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-03-16T10:38:14.019 INFO:teuthology.orchestra.run.smithi111.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-03-16T10:38:14.045 INFO:teuthology.orchestra.run.smithi111.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-03-16T10:38:14.070 INFO:teuthology.orchestra.run.smithi111.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-03-16T10:38:14.077 INFO:teuthology.orchestra.run.smithi017.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-16T10:38:14.087 INFO:teuthology.orchestra.run.smithi111.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 463 kB/s | 19 kB 00:00 2024-03-16T10:38:14.111 INFO:teuthology.orchestra.run.smithi017.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-16T10:38:14.136 INFO:teuthology.orchestra.run.smithi017.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-16T10:38:14.137 INFO:teuthology.orchestra.run.smithi111.stdout:(130/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-03-16T10:38:14.154 INFO:teuthology.orchestra.run.smithi111.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2024-03-16T10:38:14.188 INFO:teuthology.orchestra.run.smithi111.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-16T10:38:14.205 INFO:teuthology.orchestra.run.smithi111.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 690 kB/s | 46 kB 00:00 2024-03-16T10:38:14.230 INFO:teuthology.orchestra.run.smithi111.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-16T10:38:14.255 INFO:teuthology.orchestra.run.smithi111.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 858 kB/s | 58 kB 00:00 2024-03-16T10:38:14.263 INFO:teuthology.orchestra.run.smithi017.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2024-03-16T10:38:14.280 INFO:teuthology.orchestra.run.smithi111.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-16T10:38:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 166 kB/s | 24 kB 00:00 2024-03-16T10:38:14.306 INFO:teuthology.orchestra.run.smithi111.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-16T10:38:14.312 INFO:teuthology.orchestra.run.smithi017.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 375 kB/s | 18 kB 00:00 2024-03-16T10:38:14.323 INFO:teuthology.orchestra.run.smithi111.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-16T10:38:14.329 INFO:teuthology.orchestra.run.smithi017.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-16T10:38:14.348 INFO:teuthology.orchestra.run.smithi111.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-03-16T10:38:14.354 INFO:teuthology.orchestra.run.smithi017.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 759 kB/s | 32 kB 00:00 2024-03-16T10:38:14.373 INFO:teuthology.orchestra.run.smithi111.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 457 kB/s | 31 kB 00:00 2024-03-16T10:38:14.398 INFO:teuthology.orchestra.run.smithi111.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-03-16T10:38:14.424 INFO:teuthology.orchestra.run.smithi111.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-03-16T10:38:14.446 INFO:teuthology.orchestra.run.smithi017.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-03-16T10:38:14.449 INFO:teuthology.orchestra.run.smithi111.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-16T10:38:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2024-03-16T10:38:14.474 INFO:teuthology.orchestra.run.smithi111.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-03-16T10:38:14.491 INFO:teuthology.orchestra.run.smithi111.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-03-16T10:38:14.496 INFO:teuthology.orchestra.run.smithi017.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-16T10:38:14.517 INFO:teuthology.orchestra.run.smithi111.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-03-16T10:38:14.522 INFO:teuthology.orchestra.run.smithi017.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-16T10:38:14.539 INFO:teuthology.orchestra.run.smithi017.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 983 kB/s | 41 kB 00:00 2024-03-16T10:38:14.542 INFO:teuthology.orchestra.run.smithi111.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-03-16T10:38:14.564 INFO:teuthology.orchestra.run.smithi017.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-03-16T10:38:14.567 INFO:teuthology.orchestra.run.smithi111.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-03-16T10:38:14.589 INFO:teuthology.orchestra.run.smithi017.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-16T10:38:14.592 INFO:teuthology.orchestra.run.smithi111.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-16T10:38:14.615 INFO:teuthology.orchestra.run.smithi017.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-16T10:38:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-16T10:38:14.634 INFO:teuthology.orchestra.run.smithi111.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-03-16T10:38:14.649 INFO:teuthology.orchestra.run.smithi017.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-03-16T10:38:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 391 kB/s | 39 kB 00:00 2024-03-16T10:38:14.834 INFO:teuthology.orchestra.run.smithi111.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.1 MB/s | 321 kB 00:00 2024-03-16T10:38:14.958 INFO:teuthology.orchestra.run.smithi017.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-16T10:38:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 184 kB/s | 41 kB 00:00 2024-03-16T10:38:15.000 INFO:teuthology.orchestra.run.smithi017.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-03-16T10:38:15.016 INFO:teuthology.orchestra.run.smithi017.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-03-16T10:38:15.033 INFO:teuthology.orchestra.run.smithi017.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-16T10:38:15.050 INFO:teuthology.orchestra.run.smithi017.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-16T10:38:15.076 INFO:teuthology.orchestra.run.smithi017.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-16T10:38:15.101 INFO:teuthology.orchestra.run.smithi017.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T10:38:15.135 INFO:teuthology.orchestra.run.smithi017.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-16T10:38:15.160 INFO:teuthology.orchestra.run.smithi017.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-16T10:38:15.185 INFO:teuthology.orchestra.run.smithi017.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-16T10:38:15.210 INFO:teuthology.orchestra.run.smithi017.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-16T10:38:15.243 INFO:teuthology.orchestra.run.smithi111.stdout:(152/174): librados2-19.0.0-2162.g3d78f5ba.el9. 5.0 MB/s | 3.4 MB 00:00 2024-03-16T10:38:15.443 INFO:teuthology.orchestra.run.smithi111.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2024-03-16T10:38:15.502 INFO:teuthology.orchestra.run.smithi111.stdout:(154/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-03-16T10:38:15.527 INFO:teuthology.orchestra.run.smithi111.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 507 kB/s | 42 kB 00:00 2024-03-16T10:38:15.577 INFO:teuthology.orchestra.run.smithi111.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-16T10:38:15.628 INFO:teuthology.orchestra.run.smithi111.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 729 kB/s | 36 kB 00:00 2024-03-16T10:38:15.669 INFO:teuthology.orchestra.run.smithi111.stdout:(158/174): NetworkManager-tui-1.46.0-1.el9.x86_ 1.5 MB/s | 248 kB 00:00 2024-03-16T10:38:15.686 INFO:teuthology.orchestra.run.smithi017.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 374 kB/s | 187 kB 00:00 2024-03-16T10:38:15.720 INFO:teuthology.orchestra.run.smithi111.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 192 kB 00:00 2024-03-16T10:38:15.728 INFO:teuthology.orchestra.run.smithi017.stdout:(92/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-03-16T10:38:15.754 INFO:teuthology.orchestra.run.smithi111.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-16T10:38:15.863 INFO:teuthology.orchestra.run.smithi111.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 162 kB/s | 23 kB 00:00 2024-03-16T10:38:15.963 INFO:teuthology.orchestra.run.smithi111.stdout:(162/174): NetworkManager-libnm-1.46.0-1.el9.x8 2.5 MB/s | 1.8 MB 00:00 2024-03-16T10:38:15.988 INFO:teuthology.orchestra.run.smithi111.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 463 kB/s | 108 kB 00:00 2024-03-16T10:38:16.013 INFO:teuthology.orchestra.run.smithi111.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 155 kB 00:00 2024-03-16T10:38:16.039 INFO:teuthology.orchestra.run.smithi111.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-03-16T10:38:16.056 INFO:teuthology.orchestra.run.smithi111.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 136 kB 00:00 2024-03-16T10:38:16.081 INFO:teuthology.orchestra.run.smithi111.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 427 kB/s | 29 kB 00:00 2024-03-16T10:38:16.248 INFO:teuthology.orchestra.run.smithi111.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-03-16T10:38:16.278 INFO:teuthology.orchestra.run.smithi017.stdout:(93/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 7.5 MB/s | 48 MB 00:06 2024-03-16T10:38:16.331 INFO:teuthology.orchestra.run.smithi111.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-03-16T10:38:16.362 INFO:teuthology.orchestra.run.smithi017.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 263 kB/s | 21 kB 00:00 2024-03-16T10:38:16.382 INFO:teuthology.orchestra.run.smithi111.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 623 kB/s | 31 kB 00:00 2024-03-16T10:38:16.404 INFO:teuthology.orchestra.run.smithi017.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 612 kB/s | 25 kB 00:00 2024-03-16T10:38:16.421 INFO:teuthology.orchestra.run.smithi017.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 266 kB/s | 195 kB 00:00 2024-03-16T10:38:16.440 INFO:teuthology.orchestra.run.smithi111.stdout:(171/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.6 MB/s | 2.2 MB 00:00 2024-03-16T10:38:16.479 INFO:teuthology.orchestra.run.smithi017.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-03-16T10:38:16.566 INFO:teuthology.orchestra.run.smithi111.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 594 kB/s | 74 kB 00:00 2024-03-16T10:38:16.599 INFO:teuthology.orchestra.run.smithi111.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2024-03-16T10:38:16.613 INFO:teuthology.orchestra.run.smithi017.stdout:(98/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 20 MB/s | 4.1 MB 00:00 2024-03-16T10:38:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-16T10:38:16.663 INFO:teuthology.orchestra.run.smithi017.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 216 kB 00:00 2024-03-16T10:38:16.674 INFO:teuthology.orchestra.run.smithi111.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.9 MB/s | 2.3 MB 00:00 2024-03-16T10:38:16.679 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-03-16T10:38:16.679 INFO:teuthology.orchestra.run.smithi111.stdout:Total 17 MB/s | 224 MB 00:13 2024-03-16T10:38:16.689 INFO:teuthology.orchestra.run.smithi017.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 696 kB/s | 35 kB 00:00 2024-03-16T10:38:16.714 INFO:teuthology.orchestra.run.smithi017.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-16T10:38:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 955 kB/s | 248 kB 00:00 2024-03-16T10:38:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-16T10:38:17.023 INFO:teuthology.orchestra.run.smithi017.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-03-16T10:38:17.140 INFO:teuthology.orchestra.run.smithi017.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-03-16T10:38:17.157 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-03-16T10:38:17.165 INFO:teuthology.orchestra.run.smithi017.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-03-16T10:38:17.190 INFO:teuthology.orchestra.run.smithi017.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-03-16T10:38:17.316 INFO:teuthology.orchestra.run.smithi017.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-03-16T10:38:17.383 INFO:teuthology.orchestra.run.smithi017.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-03-16T10:38:17.400 INFO:teuthology.orchestra.run.smithi017.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 598 kB/s | 49 kB 00:00 2024-03-16T10:38:17.429 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-03-16T10:38:17.429 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-03-16T10:38:17.458 INFO:teuthology.orchestra.run.smithi017.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-03-16T10:38:17.483 INFO:teuthology.orchestra.run.smithi017.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-03-16T10:38:17.592 INFO:teuthology.orchestra.run.smithi017.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.2 MB/s | 838 kB 00:00 2024-03-16T10:38:17.626 INFO:teuthology.orchestra.run.smithi017.stdout:(115/174): python3-asyncssh-2.13.2-4.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-03-16T10:38:17.659 INFO:teuthology.orchestra.run.smithi017.stdout:(116/174): protobuf-compiler-3.14.0-13.el9.x86_ 939 kB/s | 863 kB 00:00 2024-03-16T10:38:17.693 INFO:teuthology.orchestra.run.smithi017.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2024-03-16T10:38:17.718 INFO:teuthology.orchestra.run.smithi017.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-03-16T10:38:17.744 INFO:teuthology.orchestra.run.smithi017.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-03-16T10:38:17.777 INFO:teuthology.orchestra.run.smithi017.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-16T10:38:17.802 INFO:teuthology.orchestra.run.smithi017.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-16T10:38:17.844 INFO:teuthology.orchestra.run.smithi017.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-03-16T10:38:17.861 INFO:teuthology.orchestra.run.smithi017.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 424 kB/s | 35 kB 00:00 2024-03-16T10:38:17.886 INFO:teuthology.orchestra.run.smithi017.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-16T10:38:17.945 INFO:teuthology.orchestra.run.smithi017.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-03-16T10:38:17.970 INFO:teuthology.orchestra.run.smithi017.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-03-16T10:38:17.995 INFO:teuthology.orchestra.run.smithi017.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-03-16T10:38:18.021 INFO:teuthology.orchestra.run.smithi017.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-03-16T10:38:18.063 INFO:teuthology.orchestra.run.smithi017.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-03-16T10:38:18.088 INFO:teuthology.orchestra.run.smithi017.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-16T10:38:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-03-16T10:38:18.164 INFO:teuthology.orchestra.run.smithi017.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-16T10:38:18.188 INFO:teuthology.orchestra.run.smithi017.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 618 kB/s | 46 kB 00:00 2024-03-16T10:38:18.214 INFO:teuthology.orchestra.run.smithi017.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-03-16T10:38:18.239 INFO:teuthology.orchestra.run.smithi017.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-03-16T10:38:18.306 INFO:teuthology.orchestra.run.smithi017.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-16T10:38:18.331 INFO:teuthology.orchestra.run.smithi017.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-03-16T10:38:18.356 INFO:teuthology.orchestra.run.smithi017.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-03-16T10:38:18.381 INFO:teuthology.orchestra.run.smithi017.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-03-16T10:38:18.415 INFO:teuthology.orchestra.run.smithi017.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-03-16T10:38:18.440 INFO:teuthology.orchestra.run.smithi017.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-16T10:38:18.466 INFO:teuthology.orchestra.run.smithi017.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-03-16T10:38:18.499 INFO:teuthology.orchestra.run.smithi017.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 429 kB/s | 36 kB 00:00 2024-03-16T10:38:18.524 INFO:teuthology.orchestra.run.smithi017.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 611 kB/s | 51 kB 00:00 2024-03-16T10:38:18.550 INFO:teuthology.orchestra.run.smithi017.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-16T10:38:18.575 INFO:teuthology.orchestra.run.smithi017.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-16T10:38:18.600 INFO:teuthology.orchestra.run.smithi017.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-16T10:38:18.625 INFO:teuthology.orchestra.run.smithi017.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-03-16T10:38:18.631 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-16T10:38:18.742 INFO:teuthology.orchestra.run.smithi017.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-03-16T10:38:18.776 INFO:teuthology.orchestra.run.smithi017.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-03-16T10:38:18.818 INFO:teuthology.orchestra.run.smithi017.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-16T10:38:19.136 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-03-16T10:38:19.136 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-03-16T10:38:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:(152/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 6.0 MB/s | 3.1 MB 00:00 2024-03-16T10:38:19.394 INFO:teuthology.orchestra.run.smithi017.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 4.0 MB/s | 2.3 MB 00:00 2024-03-16T10:38:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:(154/174): librados2-19.0.0-2162.g3d78f5ba.el9. 4.1 MB/s | 3.4 MB 00:00 2024-03-16T10:38:19.685 INFO:teuthology.orchestra.run.smithi017.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 146 kB/s | 42 kB 00:00 2024-03-16T10:38:19.828 INFO:teuthology.orchestra.run.smithi017.stdout:(156/174): NetworkManager-tui-1.46.0-1.el9.x86_ 728 kB/s | 248 kB 00:00 2024-03-16T10:38:19.869 INFO:teuthology.orchestra.run.smithi017.stdout:(157/174): NetworkManager-libnm-1.46.0-1.el9.x8 3.0 MB/s | 1.8 MB 00:00 2024-03-16T10:38:19.995 INFO:teuthology.orchestra.run.smithi017.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 231 kB/s | 71 kB 00:00 2024-03-16T10:38:20.087 INFO:teuthology.orchestra.run.smithi017.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 141 kB/s | 36 kB 00:00 2024-03-16T10:38:20.237 INFO:teuthology.orchestra.run.smithi017.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 564 kB/s | 192 kB 00:00 2024-03-16T10:38:20.329 INFO:teuthology.orchestra.run.smithi017.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 95 kB/s | 23 kB 00:00 2024-03-16T10:38:20.362 INFO:teuthology.orchestra.run.smithi017.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 696 kB/s | 256 kB 00:00 2024-03-16T10:38:20.538 INFO:teuthology.orchestra.run.smithi017.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 361 kB/s | 108 kB 00:00 2024-03-16T10:38:20.688 INFO:teuthology.orchestra.run.smithi017.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 432 kB/s | 155 kB 00:00 2024-03-16T10:38:20.805 INFO:teuthology.orchestra.run.smithi017.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 307 kB/s | 136 kB 00:00 2024-03-16T10:38:20.847 INFO:teuthology.orchestra.run.smithi017.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 207 kB/s | 64 kB 00:00 2024-03-16T10:38:21.047 INFO:teuthology.orchestra.run.smithi017.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 80 kB/s | 29 kB 00:00 2024-03-16T10:38:21.103 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:21.104 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T10:38:21.118 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T10:38:21.119 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T10:38:21.120 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T10:38:21.121 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:21.123 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T10:38:21.126 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T10:38:21.127 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T10:38:21.207 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-16T10:38:21.228 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T10:38:21.229 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-16T10:38:21.230 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T10:38:21.231 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T10:38:21.232 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-16T10:38:21.233 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T10:38:21.234 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T10:38:21.235 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T10:38:21.236 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T10:38:21.237 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T10:38:21.238 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-16T10:38:21.239 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T10:38:21.240 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T10:38:21.241 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T10:38:21.242 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T10:38:21.243 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T10:38:21.244 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T10:38:21.245 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:Install 150 Packages 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 24 Packages 2024-03-16T10:38:21.246 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:38:21.247 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 224 M 2024-03-16T10:38:21.247 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-03-16T10:38:21.264 INFO:teuthology.orchestra.run.smithi017.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 2.8 MB/s | 1.2 MB 00:00 2024-03-16T10:38:21.398 INFO:teuthology.orchestra.run.smithi017.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 3.9 MB/s | 2.2 MB 00:00 2024-03-16T10:38:21.581 INFO:teuthology.orchestra.run.smithi017.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.3 MB/s | 2.3 MB 00:00 2024-03-16T10:38:21.673 INFO:teuthology.orchestra.run.smithi017.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 114 kB/s | 31 kB 00:00 2024-03-16T10:38:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:(172/174): util-linux-core-2.37.4-18.el9.x86_64 1.0 MB/s | 465 kB 00:00 2024-03-16T10:38:21.783 INFO:teuthology.orchestra.run.smithi174.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-03-16T10:38:21.823 INFO:teuthology.orchestra.run.smithi017.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 496 kB/s | 74 kB 00:00 2024-03-16T10:38:22.032 INFO:teuthology.orchestra.run.smithi017.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 2.4 MB/s | 1.1 MB 00:00 2024-03-16T10:38:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-16T10:38:22.037 INFO:teuthology.orchestra.run.smithi017.stdout:Total 13 MB/s | 224 MB 00:17 2024-03-16T10:38:22.091 INFO:teuthology.orchestra.run.smithi174.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 2.8 MB/s | 890 kB 00:00 2024-03-16T10:38:22.175 INFO:teuthology.orchestra.run.smithi174.stdout:(3/174): ceph-immutable-object-cache-19.0.0-216 1.7 MB/s | 145 kB 00:00 2024-03-16T10:38:22.242 INFO:teuthology.orchestra.run.smithi174.stdout:(4/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 8.5 MB/s | 5.4 MB 00:00 2024-03-16T10:38:22.409 INFO:teuthology.orchestra.run.smithi174.stdout:(5/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-03-16T10:38:22.495 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-16T10:38:22.751 INFO:teuthology.orchestra.run.smithi174.stdout:(6/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 4.1 MB/s | 2.4 MB 00:00 2024-03-16T10:38:22.826 INFO:teuthology.orchestra.run.smithi174.stdout:(7/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 11 MB/s | 4.7 MB 00:00 2024-03-16T10:38:22.831 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-16T10:38:22.831 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-16T10:38:23.768 INFO:teuthology.orchestra.run.smithi174.stdout:(8/174): ceph-common-19.0.0-2162.g3d78f5ba.el9. 9.6 MB/s | 21 MB 00:02 2024-03-16T10:38:23.876 INFO:teuthology.orchestra.run.smithi174.stdout:(9/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el9 9.4 MB/s | 9.8 MB 00:01 2024-03-16T10:38:23.902 INFO:teuthology.orchestra.run.smithi174.stdout:(10/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el 189 kB/s | 25 kB 00:00 2024-03-16T10:38:23.968 INFO:teuthology.orchestra.run.smithi174.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 3.3 MB/s | 221 kB 00:00 2024-03-16T10:38:24.037 INFO:teuthology.orchestra.run.smithi174.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 406 kB/s | 27 kB 00:00 2024-03-16T10:38:24.102 INFO:teuthology.orchestra.run.smithi174.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 475 kB/s | 32 kB 00:00 2024-03-16T10:38:24.244 INFO:teuthology.orchestra.run.smithi174.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 5.2 MB/s | 747 kB 00:00 2024-03-16T10:38:24.311 INFO:teuthology.orchestra.run.smithi174.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 2.4 MB/s | 163 kB 00:00 2024-03-16T10:38:24.378 INFO:teuthology.orchestra.run.smithi174.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.9 MB/s | 127 kB 00:00 2024-03-16T10:38:24.462 INFO:teuthology.orchestra.run.smithi174.stdout:(17/174): libradosstriper1-19.0.0-2162.g3d78f5b 5.9 MB/s | 501 kB 00:00 2024-03-16T10:38:24.954 INFO:teuthology.orchestra.run.smithi174.stdout:(18/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 10 MB/s | 5.1 MB 00:00 2024-03-16T10:38:24.956 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-16T10:38:24.957 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-16T10:38:25.021 INFO:teuthology.orchestra.run.smithi174.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 679 kB/s | 45 kB 00:00 2024-03-16T10:38:25.096 INFO:teuthology.orchestra.run.smithi174.stdout:(20/174): python3-ceph-common-19.0.0-2162.g3d78 1.7 MB/s | 131 kB 00:00 2024-03-16T10:38:25.163 INFO:teuthology.orchestra.run.smithi174.stdout:(21/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 2.4 MB/s | 162 kB 00:00 2024-03-16T10:38:25.238 INFO:teuthology.orchestra.run.smithi174.stdout:(22/174): python3-rados-19.0.0-2162.g3d78f5ba.e 4.2 MB/s | 320 kB 00:00 2024-03-16T10:38:25.313 INFO:teuthology.orchestra.run.smithi174.stdout:(23/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 3.9 MB/s | 298 kB 00:00 2024-03-16T10:38:25.380 INFO:teuthology.orchestra.run.smithi174.stdout:(24/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.5 MB/s | 99 kB 00:00 2024-03-16T10:38:25.447 INFO:teuthology.orchestra.run.smithi174.stdout:(25/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.2 MB/s | 85 kB 00:00 2024-03-16T10:38:25.773 INFO:teuthology.orchestra.run.smithi174.stdout:(26/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 9.5 MB/s | 3.1 MB 00:00 2024-03-16T10:38:25.848 INFO:teuthology.orchestra.run.smithi174.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.2 MB/s | 170 kB 00:00 2024-03-16T10:38:26.007 INFO:teuthology.orchestra.run.smithi174.stdout:(28/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x8 5.2 MB/s | 17 MB 00:03 2024-03-16T10:38:26.031 INFO:teuthology.orchestra.run.smithi174.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2162.g 185 kB/s | 34 kB 00:00 2024-03-16T10:38:26.074 INFO:teuthology.orchestra.run.smithi174.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 2.0 MB/s | 139 kB 00:00 2024-03-16T10:38:26.179 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-03-16T10:38:26.216 INFO:teuthology.orchestra.run.smithi174.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 9.8 MB/s | 1.8 MB 00:00 2024-03-16T10:38:26.283 INFO:teuthology.orchestra.run.smithi174.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 3.6 MB/s | 248 kB 00:00 2024-03-16T10:38:26.303 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T10:38:26.337 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T10:38:26.341 INFO:teuthology.orchestra.run.smithi174.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 847 kB/s | 49 kB 00:00 2024-03-16T10:38:26.368 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:26.378 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:26.400 INFO:teuthology.orchestra.run.smithi174.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 282 kB/s | 16 kB 00:00 2024-03-16T10:38:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T10:38:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T10:38:26.483 INFO:teuthology.orchestra.run.smithi174.stdout:(35/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 3.1 MB/s | 264 kB 00:00 2024-03-16T10:38:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T10:38:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T10:38:26.572 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T10:38:26.575 INFO:teuthology.orchestra.run.smithi174.stdout:(36/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 8.0 MB/s | 748 kB 00:00 2024-03-16T10:38:26.642 INFO:teuthology.orchestra.run.smithi174.stdout:(37/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 273 kB/s | 18 kB 00:00 2024-03-16T10:38:26.776 INFO:teuthology.orchestra.run.smithi174.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2024-03-16T10:38:26.834 INFO:teuthology.orchestra.run.smithi174.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-16T10:38:26.868 INFO:teuthology.orchestra.run.smithi174.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-16T10:38:26.892 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T10:38:26.956 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:27.060 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:27.091 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:27.164 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:27.194 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:38:27.237 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T10:38:27.284 INFO:teuthology.orchestra.run.smithi174.stdout:(41/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 14 MB/s | 48 MB 00:03 2024-03-16T10:38:27.309 INFO:teuthology.orchestra.run.smithi174.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 698 kB/s | 307 kB 00:00 2024-03-16T10:38:27.334 INFO:teuthology.orchestra.run.smithi174.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 644 kB/s | 32 kB 00:00 2024-03-16T10:38:27.393 INFO:teuthology.orchestra.run.smithi174.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-03-16T10:38:27.418 INFO:teuthology.orchestra.run.smithi174.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 214 kB/s | 17 kB 00:00 2024-03-16T10:38:27.444 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T10:38:27.444 INFO:teuthology.orchestra.run.smithi174.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-16T10:38:27.469 INFO:teuthology.orchestra.run.smithi174.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T10:38:27.494 INFO:teuthology.orchestra.run.smithi174.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-16T10:38:27.509 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T10:38:27.528 INFO:teuthology.orchestra.run.smithi174.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-16T10:38:27.538 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:27.561 INFO:teuthology.orchestra.run.smithi174.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-03-16T10:38:27.586 INFO:teuthology.orchestra.run.smithi174.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 46 kB 00:00 2024-03-16T10:38:27.612 INFO:teuthology.orchestra.run.smithi174.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-16T10:38:27.641 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:27.645 INFO:teuthology.orchestra.run.smithi174.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-16T10:38:27.663 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:27.671 INFO:teuthology.orchestra.run.smithi174.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-03-16T10:38:27.687 INFO:teuthology.orchestra.run.smithi174.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 824 kB/s | 34 kB 00:00 2024-03-16T10:38:27.727 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:27.767 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T10:38:27.790 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:27.796 INFO:teuthology.orchestra.run.smithi174.stdout:(56/174): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-03-16T10:38:27.805 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:27.863 INFO:teuthology.orchestra.run.smithi174.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-03-16T10:38:27.905 INFO:teuthology.orchestra.run.smithi174.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 7.1 MB/s | 1.5 MB 00:00 2024-03-16T10:38:27.939 INFO:teuthology.orchestra.run.smithi174.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 5.7 MB/s | 811 kB 00:00 2024-03-16T10:38:27.964 INFO:teuthology.orchestra.run.smithi174.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-03-16T10:38:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:28.031 INFO:teuthology.orchestra.run.smithi174.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-03-16T10:38:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T10:38:28.106 INFO:teuthology.orchestra.run.smithi174.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-16T10:38:28.131 INFO:teuthology.orchestra.run.smithi174.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 464 kB/s | 78 kB 00:00 2024-03-16T10:38:28.153 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T10:38:28.232 INFO:teuthology.orchestra.run.smithi174.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2024-03-16T10:38:28.257 INFO:teuthology.orchestra.run.smithi174.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 199 kB/s | 24 kB 00:00 2024-03-16T10:38:28.264 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:28.282 INFO:teuthology.orchestra.run.smithi174.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 122 kB/s | 18 kB 00:00 2024-03-16T10:38:28.307 INFO:teuthology.orchestra.run.smithi174.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-16T10:38:28.333 INFO:teuthology.orchestra.run.smithi174.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-03-16T10:38:28.333 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:28.405 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:28.433 INFO:teuthology.orchestra.run.smithi174.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-16T10:38:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:28.458 INFO:teuthology.orchestra.run.smithi174.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-16T10:38:28.483 INFO:teuthology.orchestra.run.smithi174.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-03-16T10:38:28.509 INFO:teuthology.orchestra.run.smithi174.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 918 kB/s | 69 kB 00:00 2024-03-16T10:38:28.534 INFO:teuthology.orchestra.run.smithi174.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 822 kB/s | 41 kB 00:00 2024-03-16T10:38:28.559 INFO:teuthology.orchestra.run.smithi174.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-16T10:38:28.584 INFO:teuthology.orchestra.run.smithi174.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-16T10:38:28.609 INFO:teuthology.orchestra.run.smithi174.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-03-16T10:38:28.634 INFO:teuthology.orchestra.run.smithi174.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-16T10:38:28.647 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:28.660 INFO:teuthology.orchestra.run.smithi174.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-03-16T10:38:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T10:38:28.852 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T10:38:28.888 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T10:38:28.923 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T10:38:28.959 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T10:38:28.960 INFO:teuthology.orchestra.run.smithi174.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-16T10:38:28.985 INFO:teuthology.orchestra.run.smithi174.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 127 kB/s | 41 kB 00:00 2024-03-16T10:38:29.010 INFO:teuthology.orchestra.run.smithi174.stdout:(81/174): python3-toml-0.10.2-6.el9.noarch.rpm 111 kB/s | 39 kB 00:00 2024-03-16T10:38:29.034 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T10:38:29.044 INFO:teuthology.orchestra.run.smithi174.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-03-16T10:38:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 677 kB/s | 56 kB 00:00 2024-03-16T10:38:29.090 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T10:38:29.094 INFO:teuthology.orchestra.run.smithi174.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-16T10:38:29.120 INFO:teuthology.orchestra.run.smithi174.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-16T10:38:29.125 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T10:38:29.145 INFO:teuthology.orchestra.run.smithi174.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-16T10:38:29.179 INFO:teuthology.orchestra.run.smithi174.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-03-16T10:38:29.188 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T10:38:29.212 INFO:teuthology.orchestra.run.smithi174.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-16T10:38:29.232 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T10:38:29.237 INFO:teuthology.orchestra.run.smithi174.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-03-16T10:38:29.263 INFO:teuthology.orchestra.run.smithi174.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-16T10:38:29.276 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T10:38:29.288 INFO:teuthology.orchestra.run.smithi174.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-16T10:38:29.309 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T10:38:29.337 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T10:38:29.405 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T10:38:29.441 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-16T10:38:29.485 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-16T10:38:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-16T10:38:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T10:38:29.630 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T10:38:29.702 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T10:38:29.837 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T10:38:29.890 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T10:38:30.055 INFO:teuthology.orchestra.run.smithi174.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 229 kB/s | 187 kB 00:00 2024-03-16T10:38:30.138 INFO:teuthology.orchestra.run.smithi174.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-03-16T10:38:30.305 INFO:teuthology.orchestra.run.smithi174.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 129 kB/s | 21 kB 00:00 2024-03-16T10:38:30.397 INFO:teuthology.orchestra.run.smithi174.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 388 kB/s | 25 kB 00:00 2024-03-16T10:38:30.408 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T10:38:30.485 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T10:38:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T10:38:30.614 INFO:teuthology.orchestra.run.smithi174.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 19 MB/s | 4.1 MB 00:00 2024-03-16T10:38:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T10:38:30.682 INFO:teuthology.orchestra.run.smithi174.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-03-16T10:38:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T10:38:30.740 INFO:teuthology.orchestra.run.smithi174.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-03-16T10:38:30.741 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-16T10:38:30.770 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T10:38:30.799 INFO:teuthology.orchestra.run.smithi174.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 216 kB 00:00 2024-03-16T10:38:30.866 INFO:teuthology.orchestra.run.smithi174.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 524 kB/s | 35 kB 00:00 2024-03-16T10:38:30.891 INFO:teuthology.orchestra.run.smithi174.stdout:(101/174): python3-requests-2.25.1-8.el9.noarch 149 kB/s | 125 kB 00:00 2024-03-16T10:38:30.916 INFO:teuthology.orchestra.run.smithi174.stdout:(102/174): libgfortran-11.4.1-3.el9.x86_64.rpm 493 kB/s | 803 kB 00:01 2024-03-16T10:38:30.942 INFO:teuthology.orchestra.run.smithi174.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 598 kB/s | 44 kB 00:00 2024-03-16T10:38:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T10:38:31.084 INFO:teuthology.orchestra.run.smithi174.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 488 kB/s | 94 kB 00:00 2024-03-16T10:38:31.109 INFO:teuthology.orchestra.run.smithi174.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 116 kB/s | 22 kB 00:00 2024-03-16T10:38:31.158 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T10:38:31.206 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T10:38:31.241 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T10:38:31.309 INFO:teuthology.orchestra.run.smithi174.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-03-16T10:38:31.377 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T10:38:31.428 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T10:38:31.484 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T10:38:31.556 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T10:38:31.587 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T10:38:31.623 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T10:38:31.684 INFO:teuthology.orchestra.run.smithi174.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 52 kB/s | 19 kB 00:00 2024-03-16T10:38:31.760 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T10:38:31.810 INFO:teuthology.orchestra.run.smithi174.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 441 kB/s | 309 kB 00:00 2024-03-16T10:38:31.852 INFO:teuthology.orchestra.run.smithi174.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 714 kB/s | 548 kB 00:00 2024-03-16T10:38:31.919 INFO:teuthology.orchestra.run.smithi174.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-03-16T10:38:31.977 INFO:teuthology.orchestra.run.smithi174.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-03-16T10:38:31.991 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T10:38:32.035 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T10:38:32.036 INFO:teuthology.orchestra.run.smithi174.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-03-16T10:38:32.077 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T10:38:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-16T10:38:32.216 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T10:38:32.264 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T10:38:32.278 INFO:teuthology.orchestra.run.smithi174.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-03-16T10:38:32.294 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T10:38:32.303 INFO:teuthology.orchestra.run.smithi174.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2024-03-16T10:38:32.304 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-16T10:38:32.336 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T10:38:32.387 INFO:teuthology.orchestra.run.smithi174.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-03-16T10:38:32.403 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T10:38:32.412 INFO:teuthology.orchestra.run.smithi174.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-03-16T10:38:32.430 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T10:38:32.438 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T10:38:32.469 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T10:38:32.471 INFO:teuthology.orchestra.run.smithi174.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-03-16T10:38:32.484 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:32.493 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:32.496 INFO:teuthology.orchestra.run.smithi174.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-03-16T10:38:32.509 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T10:38:32.530 INFO:teuthology.orchestra.run.smithi174.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-16T10:38:32.535 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T10:38:32.540 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T10:38:32.560 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T10:38:32.592 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T10:38:32.613 INFO:teuthology.orchestra.run.smithi174.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-03-16T10:38:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T10:38:32.632 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T10:38:32.638 INFO:teuthology.orchestra.run.smithi174.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-03-16T10:38:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T10:38:32.664 INFO:teuthology.orchestra.run.smithi174.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 263 kB/s | 35 kB 00:00 2024-03-16T10:38:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T10:38:32.739 INFO:teuthology.orchestra.run.smithi174.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-03-16T10:38:32.752 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T10:38:32.798 INFO:teuthology.orchestra.run.smithi174.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-03-16T10:38:32.823 INFO:teuthology.orchestra.run.smithi174.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 911 kB/s | 144 kB 00:00 2024-03-16T10:38:32.848 INFO:teuthology.orchestra.run.smithi174.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-03-16T10:38:32.852 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T10:38:32.901 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T10:38:32.907 INFO:teuthology.orchestra.run.smithi174.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-03-16T10:38:32.932 INFO:teuthology.orchestra.run.smithi174.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-03-16T10:38:32.950 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T10:38:32.957 INFO:teuthology.orchestra.run.smithi174.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-03-16T10:38:33.005 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T10:38:33.016 INFO:teuthology.orchestra.run.smithi174.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-03-16T10:38:33.052 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T10:38:33.066 INFO:teuthology.orchestra.run.smithi174.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 427 kB/s | 46 kB 00:00 2024-03-16T10:38:33.113 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:33.125 INFO:teuthology.orchestra.run.smithi174.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-03-16T10:38:33.158 INFO:teuthology.orchestra.run.smithi174.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-03-16T10:38:33.183 INFO:teuthology.orchestra.run.smithi174.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2024-03-16T10:38:33.190 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T10:38:33.234 INFO:teuthology.orchestra.run.smithi174.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-03-16T10:38:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:33.238 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T10:38:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:33.267 INFO:teuthology.orchestra.run.smithi174.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-03-16T10:38:33.301 INFO:teuthology.orchestra.run.smithi174.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 765 kB/s | 90 kB 00:00 2024-03-16T10:38:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:33.360 INFO:teuthology.orchestra.run.smithi174.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-03-16T10:38:33.369 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T10:38:33.385 INFO:teuthology.orchestra.run.smithi174.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-03-16T10:38:33.390 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:38:33.412 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T10:38:33.418 INFO:teuthology.orchestra.run.smithi174.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-03-16T10:38:33.442 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T10:38:33.446 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T10:38:33.469 INFO:teuthology.orchestra.run.smithi174.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-03-16T10:38:33.474 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T10:38:33.494 INFO:teuthology.orchestra.run.smithi174.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-03-16T10:38:33.503 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T10:38:33.528 INFO:teuthology.orchestra.run.smithi174.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-03-16T10:38:33.537 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T10:38:33.576 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T10:38:33.578 INFO:teuthology.orchestra.run.smithi174.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-16T10:38:33.603 INFO:teuthology.orchestra.run.smithi174.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-03-16T10:38:33.607 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T10:38:33.636 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T10:38:33.638 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T10:38:33.662 INFO:teuthology.orchestra.run.smithi174.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-03-16T10:38:33.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T10:38:33.687 INFO:teuthology.orchestra.run.smithi174.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 183 kB/s | 20 kB 00:00 2024-03-16T10:38:33.711 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:33.712 INFO:teuthology.orchestra.run.smithi174.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-03-16T10:38:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T10:38:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:33.877 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:33.879 INFO:teuthology.orchestra.run.smithi174.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-03-16T10:38:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T10:38:33.921 INFO:teuthology.orchestra.run.smithi174.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-16T10:38:33.927 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T10:38:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:34.038 INFO:teuthology.orchestra.run.smithi174.stdout:(152/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 9.7 MB/s | 3.1 MB 00:00 2024-03-16T10:38:34.074 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T10:38:34.151 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T10:38:34.156 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:34.188 INFO:teuthology.orchestra.run.smithi174.stdout:(153/174): librados2-19.0.0-2162.g3d78f5ba.el9. 6.8 MB/s | 3.4 MB 00:00 2024-03-16T10:38:34.191 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T10:38:34.252 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T10:38:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T10:38:34.372 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T10:38:34.445 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T10:38:34.487 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T10:38:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T10:38:34.534 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T10:38:34.632 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T10:38:34.678 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T10:38:34.739 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:34.844 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:34.880 INFO:teuthology.orchestra.run.smithi174.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 64 kB/s | 42 kB 00:00 2024-03-16T10:38:34.897 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:35.123 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:35.231 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T10:38:35.327 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T10:38:35.369 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T10:38:35.396 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T10:38:35.416 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T10:38:35.431 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T10:38:35.468 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T10:38:35.502 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T10:38:35.508 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T10:38:35.559 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T10:38:35.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T10:38:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T10:38:35.647 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T10:38:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T10:38:35.686 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T10:38:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T10:38:35.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T10:38:35.780 INFO:teuthology.orchestra.run.smithi174.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 276 kB/s | 248 kB 00:00 2024-03-16T10:38:35.790 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T10:38:35.817 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T10:38:35.863 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T10:38:35.890 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T10:38:35.892 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T10:38:35.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-16T10:38:35.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-16T10:38:35.978 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T10:38:36.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-16T10:38:36.078 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T10:38:36.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T10:38:36.196 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T10:38:36.332 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T10:38:36.389 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T10:38:36.447 INFO:teuthology.orchestra.run.smithi174.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 107 kB/s | 71 kB 00:00 2024-03-16T10:38:36.619 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T10:38:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T10:38:36.922 INFO:teuthology.orchestra.run.smithi174.stdout:(157/174): NetworkManager-libnm-1.46.0-1.el9.x8 645 kB/s | 1.8 MB 00:02 2024-03-16T10:38:36.948 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T10:38:37.027 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T10:38:37.064 INFO:teuthology.orchestra.run.smithi174.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 59 kB/s | 36 kB 00:00 2024-03-16T10:38:37.128 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T10:38:37.178 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:37.186 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:37.224 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T10:38:37.268 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T10:38:37.306 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-16T10:38:37.336 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T10:38:37.464 INFO:teuthology.orchestra.run.smithi174.stdout:(159/174): NetworkManager-1.46.0-1.el9.x86_64.r 662 kB/s | 2.3 MB 00:03 2024-03-16T10:38:37.612 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T10:38:37.773 INFO:teuthology.orchestra.run.smithi174.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 226 kB/s | 192 kB 00:00 2024-03-16T10:38:37.809 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T10:38:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T10:38:37.932 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T10:38:37.949 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T10:38:37.981 INFO:teuthology.orchestra.run.smithi174.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 279 kB/s | 256 kB 00:00 2024-03-16T10:38:38.048 INFO:teuthology.orchestra.run.smithi174.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-03-16T10:38:38.051 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T10:38:38.071 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T10:38:38.082 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T10:38:38.113 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T10:38:38.142 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T10:38:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T10:38:38.378 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T10:38:38.450 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T10:38:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T10:38:38.486 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T10:38:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:38:38.515 INFO:teuthology.orchestra.run.smithi174.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 146 kB/s | 108 kB 00:00 2024-03-16T10:38:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T10:38:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T10:38:38.578 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:38:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T10:38:38.609 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-16T10:38:38.645 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T10:38:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T10:38:38.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T10:38:38.799 INFO:teuthology.orchestra.run.smithi174.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 189 kB/s | 155 kB 00:00 2024-03-16T10:38:38.824 INFO:teuthology.orchestra.run.smithi174.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 175 kB/s | 136 kB 00:00 2024-03-16T10:38:38.830 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T10:38:38.879 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T10:38:38.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T10:38:38.952 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T10:38:39.048 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T10:38:39.085 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T10:38:39.109 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T10:38:39.125 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T10:38:39.132 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:38:39.150 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T10:38:39.174 INFO:teuthology.orchestra.run.smithi174.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 97 kB/s | 64 kB 00:00 2024-03-16T10:38:39.175 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T10:38:39.187 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:38:39.209 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-16T10:38:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T10:38:39.380 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T10:38:39.391 INFO:teuthology.orchestra.run.smithi174.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 48 kB/s | 29 kB 00:00 2024-03-16T10:38:39.486 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T10:38:39.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T10:38:39.600 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T10:38:39.657 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T10:38:39.852 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T10:38:39.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T10:38:40.036 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T10:38:40.086 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T10:38:40.118 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T10:38:40.157 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T10:38:40.185 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T10:38:40.219 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T10:38:40.258 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T10:38:40.290 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T10:38:40.320 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T10:38:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T10:38:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T10:38:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T10:38:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T10:38:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T10:38:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T10:38:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T10:38:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T10:38:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T10:38:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T10:38:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T10:38:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T10:38:41.142 INFO:teuthology.orchestra.run.smithi174.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 535 kB/s | 1.2 MB 00:02 2024-03-16T10:38:41.466 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:41.505 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:41.760 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T10:38:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T10:38:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T10:38:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T10:38:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T10:38:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T10:38:42.039 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:42.076 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:38:42.157 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:38:42.157 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T10:38:42.158 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T10:38:42.158 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:42.185 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:38:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T10:38:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T10:38:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T10:38:42.350 INFO:teuthology.orchestra.run.smithi174.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 385 kB/s | 465 kB 00:01 2024-03-16T10:38:42.501 INFO:teuthology.orchestra.run.smithi174.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 664 kB/s | 2.2 MB 00:03 2024-03-16T10:38:42.909 INFO:teuthology.orchestra.run.smithi174.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 665 kB/s | 2.3 MB 00:03 2024-03-16T10:38:42.943 INFO:teuthology.orchestra.run.smithi174.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 53 kB/s | 31 kB 00:00 2024-03-16T10:38:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T10:38:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T10:38:43.109 INFO:teuthology.orchestra.run.smithi174.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 372 kB/s | 74 kB 00:00 2024-03-16T10:38:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T10:38:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T10:38:44.484 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T10:38:44.493 INFO:teuthology.orchestra.run.smithi174.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 552 kB/s | 1.1 MB 00:01 2024-03-16T10:38:44.499 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-03-16T10:38:44.499 INFO:teuthology.orchestra.run.smithi174.stdout:Total 9.6 MB/s | 224 MB 00:23 2024-03-16T10:38:44.515 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T10:38:44.543 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T10:38:44.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T10:38:44.897 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:38:44.975 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-03-16T10:38:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:38:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-16T10:38:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T10:38:45.250 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-03-16T10:38:45.250 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-03-16T10:38:45.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T10:38:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:38:45.622 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:38:45.644 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-16T10:38:46.973 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-03-16T10:38:46.974 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-03-16T10:38:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:48.533 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:38:48.569 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:38:48.645 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:38:48.646 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T10:38:48.646 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T10:38:48.646 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:38:48.679 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:38:53.954 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:38:53.954 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2024-03-16T10:38:53.954 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /root 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2024-03-16T10:38:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:54.094 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-03-16T10:38:54.122 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:38:54.138 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:38:54.138 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:54.138 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T10:38:54.138 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:54.247 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T10:38:54.289 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T10:38:54.328 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:54.338 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T10:38:54.378 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T10:38:54.431 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T10:38:54.465 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T10:38:54.491 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T10:38:54.532 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T10:38:54.853 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T10:38:54.908 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:55.029 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:38:55.059 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:55.150 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:38:55.180 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:38:55.216 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T10:38:55.403 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T10:38:55.452 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T10:38:55.480 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:55.583 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:38:55.606 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:55.609 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:38:55.634 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:38:55.634 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:55.634 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T10:38:55.634 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:38:55.634 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:38:55.635 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:55.662 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-16T10:38:55.702 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T10:38:55.725 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:55.740 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T10:38:55.860 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:38:55.882 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:55.890 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:55.922 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T10:38:55.962 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T10:38:56.059 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T10:38:56.164 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:56.225 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T10:38:56.293 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:56.319 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:38:56.341 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:56.367 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:56.428 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T10:38:56.580 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T10:38:56.698 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T10:38:56.800 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T10:38:56.804 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:38:56.836 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:38:56.838 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T10:38:56.868 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-16T10:38:56.873 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T10:38:56.917 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T10:38:56.927 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-16T10:38:56.950 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:38:56.991 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T10:38:57.045 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T10:38:57.084 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T10:38:57.173 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T10:38:57.184 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:38:57.208 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T10:38:57.218 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:38:57.251 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T10:38:57.284 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T10:38:57.320 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T10:38:57.389 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T10:38:57.425 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-16T10:38:57.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-16T10:38:57.497 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-16T10:38:57.566 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T10:38:57.612 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T10:38:57.684 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T10:38:57.818 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T10:38:57.872 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T10:38:58.180 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:38:58.210 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:38:58.312 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:38:58.398 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T10:38:58.464 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-16T10:38:58.484 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T10:38:58.495 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:38:58.518 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:38:58.518 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:58.518 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T10:38:58.518 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:38:58.518 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:38:58.519 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:58.554 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T10:38:58.554 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:38:58.565 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:38:58.603 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-16T10:38:58.612 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:58.619 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T10:38:58.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T10:38:58.701 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T10:38:58.739 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-16T10:38:58.768 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T10:38:59.020 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T10:38:59.236 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T10:38:59.312 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T10:38:59.356 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T10:38:59.477 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T10:38:59.496 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T10:38:59.523 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:38:59.546 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:59.548 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T10:38:59.591 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:38:59.602 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T10:38:59.612 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:38:59.612 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:59.612 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T10:38:59.612 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:59.658 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:38:59.674 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T10:38:59.680 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:38:59.680 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:38:59.680 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T10:38:59.680 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:38:59.680 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:38:59.681 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:38:59.706 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T10:38:59.752 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T10:38:59.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T10:38:59.842 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T10:38:59.886 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T10:38:59.928 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T10:38:59.992 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:00.015 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:39:00.061 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T10:39:00.100 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T10:39:00.130 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T10:39:00.172 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T10:39:00.264 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T10:39:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T10:39:00.353 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T10:39:00.379 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T10:39:00.403 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T10:39:00.475 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-03-16T10:39:00.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:00.595 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T10:39:00.696 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T10:39:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T10:39:00.750 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:39:00.764 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:39:00.765 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:00.765 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T10:39:00.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:00.793 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T10:39:00.849 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T10:39:01.034 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T10:39:01.074 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T10:39:01.203 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T10:39:01.247 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T10:39:01.278 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T10:39:01.309 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T10:39:01.346 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T10:39:01.380 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T10:39:01.419 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T10:39:01.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T10:39:01.481 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T10:39:01.556 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T10:39:01.591 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T10:39:01.624 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T10:39:01.674 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T10:39:01.717 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T10:39:01.806 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T10:39:01.901 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T10:39:01.948 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T10:39:01.979 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T10:39:02.026 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T10:39:02.132 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T10:39:02.189 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T10:39:02.304 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:39:02.329 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:02.563 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:39:02.585 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:39:02.585 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:02.585 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T10:39:02.585 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:39:02.586 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:39:02.586 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:02.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T10:39:02.952 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T10:39:02.986 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T10:39:03.034 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T10:39:03.047 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:39:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:39:03.069 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:03.069 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T10:39:03.070 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:39:03.070 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:39:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:03.124 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T10:39:03.166 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T10:39:03.170 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T10:39:03.347 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T10:39:03.384 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T10:39:03.462 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T10:39:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:39:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:39:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-16T10:39:03.686 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-16T10:39:03.713 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:39:03.959 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:39:03.997 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:39:04.101 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T10:39:04.215 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T10:39:04.454 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:04.495 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-16T10:39:04.526 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-16T10:39:04.553 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T10:39:04.737 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-16T10:39:04.852 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T10:39:04.901 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-16T10:39:04.976 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T10:39:05.014 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:39:05.026 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T10:39:05.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:39:05.069 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T10:39:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-16T10:39:05.142 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T10:39:05.144 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:39:05.172 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T10:39:05.235 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T10:39:05.305 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T10:39:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-16T10:39:05.337 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T10:39:05.341 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:39:05.363 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:39:05.364 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:05.364 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T10:39:05.364 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:39:05.364 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:39:05.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:05.409 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:39:05.419 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:39:05.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T10:39:05.469 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-16T10:39:05.509 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T10:39:05.540 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T10:39:05.571 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T10:39:05.599 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T10:39:05.898 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:05.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T10:39:05.935 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:05.937 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:39:05.955 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:06.027 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-16T10:39:06.058 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-16T10:39:06.094 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T10:39:06.389 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T10:39:06.427 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:39:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:39:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:39:06.516 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:06.516 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T10:39:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:06.553 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T10:39:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:06.584 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:06.584 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T10:39:06.584 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:39:06.584 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:39:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:06.589 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:39:06.644 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-16T10:39:06.675 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-16T10:39:06.770 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-16T10:39:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T10:39:06.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:06.903 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T10:39:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:06.918 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:06.918 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T10:39:06.918 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:06.919 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:06.985 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T10:39:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T10:39:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T10:39:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T10:39:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T10:39:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:07.183 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:07.221 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T10:39:07.221 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:07.298 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:07.324 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T10:39:07.357 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T10:39:07.382 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T10:39:07.407 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T10:39:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T10:39:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T10:39:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T10:39:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T10:39:07.563 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T10:39:07.588 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:07.613 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T10:39:07.620 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:07.620 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:07.799 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:07.799 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:07.890 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:07.915 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:07.941 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T10:39:07.973 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T10:39:08.000 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T10:39:08.063 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:08.846 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:39:08.879 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:39:09.415 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-16T10:39:09.457 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:39:09.521 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-16T10:39:09.522 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T10:39:09.522 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T10:39:09.522 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:09.550 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:39:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-16T10:39:11.722 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-16T10:39:11.749 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T10:39:11.947 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-16T10:39:12.073 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T10:39:12.115 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-16T10:39:12.168 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T10:39:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T10:39:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T10:39:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-16T10:39:12.348 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T10:39:12.377 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T10:39:12.446 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T10:39:12.503 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T10:39:12.534 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T10:39:12.879 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-16T10:39:12.880 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-16T10:39:12.881 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T10:39:12.882 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T10:39:12.883 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T10:39:12.884 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T10:39:12.885 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T10:39:12.886 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T10:39:12.887 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T10:39:12.888 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T10:39:12.889 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T10:39:12.890 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T10:39:12.891 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T10:39:12.892 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T10:39:12.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T10:39:13.101 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:13.149 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:13.168 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:14.042 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-16T10:39:14.129 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T10:39:14.196 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T10:39:14.281 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T10:39:14.308 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T10:39:14.333 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T10:39:14.359 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T10:39:14.385 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T10:39:14.385 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:14.494 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T10:39:14.494 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:14.570 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:14.597 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T10:39:14.630 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T10:39:14.655 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T10:39:14.680 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T10:39:14.715 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T10:39:14.762 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T10:39:14.793 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T10:39:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T10:39:14.844 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T10:39:14.869 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:14.894 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T10:39:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:15.081 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:15.081 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:15.172 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:15.197 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:15.222 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T10:39:15.256 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T10:39:15.281 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T10:39:15.350 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T10:39:15.961 INFO:teuthology.orchestra.run.smithi111.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.962 INFO:teuthology.orchestra.run.smithi111.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.963 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.964 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: jq-1.6-16.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.965 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T10:39:15.966 INFO:teuthology.orchestra.run.smithi111.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T10:39:15.967 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T10:39:15.968 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T10:39:15.969 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T10:39:15.970 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T10:39:15.971 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T10:39:15.972 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-16T10:39:15.973 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-03-16T10:39:16.464 DEBUG:teuthology.parallel:result is None 2024-03-16T10:39:20.097 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:20.097 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-16T10:39:20.097 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-16T10:39:20.097 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-16T10:39:20.098 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-16T10:39:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T10:39:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T10:39:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T10:39:20.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T10:39:20.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T10:39:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T10:39:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T10:39:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T10:39:20.107 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T10:39:20.108 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T10:39:20.109 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T10:39:20.110 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T10:39:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-03-16T10:39:21.293 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-03-16T10:39:21.294 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-03-16T10:39:21.294 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:21.454 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:39:21.469 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-16T10:39:21.469 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:21.469 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T10:39:21.470 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:22.947 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:39:22.973 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-16T10:39:22.973 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:22.973 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T10:39:22.973 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:39:22.974 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T10:39:22.974 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:23.060 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T10:39:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.063 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.064 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T10:39:23.065 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-16.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.066 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T10:39:23.067 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T10:39:23.068 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T10:39:23.069 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T10:39:23.070 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T10:39:23.071 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T10:39:23.072 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T10:39:23.073 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T10:39:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T10:39:23.075 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T10:39:23.075 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:39:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-16T10:39:23.206 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:39:23.229 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-16T10:39:23.229 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:23.229 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T10:39:23.229 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:39:23.229 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T10:39:23.230 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:23.521 DEBUG:teuthology.parallel:result is None 2024-03-16T10:39:23.683 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T10:39:23.706 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:23.810 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T10:39:24.160 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:39:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-16T10:39:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-16T10:39:24.284 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-16T10:39:24.323 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:39:24.555 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-16T10:39:24.590 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:39:25.549 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-16T10:39:25.582 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:39:25.682 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-16T10:39:25.845 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-16T10:39:25.876 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T10:39:25.899 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:25.943 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:39:25.954 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-16T10:39:25.999 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-16T10:39:26.868 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T10:39:26.895 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T10:39:26.918 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:26.971 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:39:26.993 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-16T10:39:26.993 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:26.993 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T10:39:26.993 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:27.060 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:27.060 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T10:39:27.060 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:39:27.061 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T10:39:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:27.372 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:27.394 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-16T10:39:27.394 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T10:39:27.394 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T10:39:27.395 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:27.395 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T10:39:27.395 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:31.834 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:31.875 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-16T10:39:31.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-16T10:39:31.941 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T10:39:32.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-16T10:39:32.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T10:39:32.281 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-16T10:39:32.320 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T10:39:32.372 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T10:39:32.416 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T10:39:32.440 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-16T10:39:32.472 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T10:39:32.502 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T10:39:32.568 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T10:39:32.624 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T10:39:32.667 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T10:39:33.255 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:33.289 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:33.308 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T10:39:34.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-16T10:39:34.217 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T10:39:34.257 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T10:39:34.338 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T10:39:34.371 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T10:39:34.396 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T10:39:34.421 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T10:39:34.447 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T10:39:34.448 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T10:39:34.565 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T10:39:34.565 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:34.658 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T10:39:34.684 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T10:39:34.717 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T10:39:34.743 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T10:39:34.767 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T10:39:34.800 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T10:39:34.840 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T10:39:34.872 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T10:39:34.898 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T10:39:34.923 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T10:39:34.956 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:34.981 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T10:39:34.988 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:34.988 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:35.168 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T10:39:35.168 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:35.251 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T10:39:35.275 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:35.300 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T10:39:35.334 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T10:39:35.360 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T10:39:35.424 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-16T10:39:40.098 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-16T10:39:40.099 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-16T10:39:40.100 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T10:39:40.101 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T10:39:40.102 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T10:39:40.103 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T10:39:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T10:39:40.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T10:39:40.106 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T10:39:40.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T10:39:40.108 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T10:39:40.109 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T10:39:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T10:39:40.111 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T10:39:40.112 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T10:39:43.059 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T10:39:43.059 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:43.059 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-03-16T10:39:43.059 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:43.059 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T10:39:43.061 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.062 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T10:39:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.6-16.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T10:39:43.064 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T10:39:43.065 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T10:39:43.066 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T10:39:43.067 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T10:39:43.068 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T10:39:43.069 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T10:39:43.070 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.071 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:39:43.072 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-03-16T10:39:43.529 DEBUG:teuthology.parallel:result is None 2024-03-16T10:39:43.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:43.675 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T10:39:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:43.701 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:43.701 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-16T10:39:43.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:43.839 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T10:39:43.865 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:43.865 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:43.865 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-16T10:39:43.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:44.078 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T10:39:44.099 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:44.099 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-16T10:39:44.099 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-16T10:39:44.101 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-16T10:39:44.101 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:39:44.101 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T10:39:44.135 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:39:44.135 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T10:39:44.169 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:39:44.169 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T10:39:44.198 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-16T10:39:44.198 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:39:44.198 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T10:39:44.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T10:39:44.300 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:39:44.300 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T10:39:44.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T10:39:44.402 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:39:44.402 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T10:39:44.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T10:39:44.496 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-16T10:39:44.496 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:39:44.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T10:39:44.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T10:39:44.597 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:39:44.597 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T10:39:44.629 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T10:39:44.697 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:39:44.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T10:39:44.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T10:39:44.789 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-16T10:39:44.790 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:39:44.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T10:39:44.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T10:39:44.882 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:39:44.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T10:39:44.909 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T10:39:44.978 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:39:44.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T10:39:45.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T10:39:45.071 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-16T10:39:45.161 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-16T10:39:45.162 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:45.162 INFO:tasks.cephadm:Cluster fsid is 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:39:45.162 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-16T10:39:45.162 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.111', 'mon.c': '172.21.15.174'} 2024-03-16T10:39:45.163 INFO:tasks.cephadm:First mon is mon.a on smithi017 2024-03-16T10:39:45.163 INFO:tasks.cephadm:First mgr is x 2024-03-16T10:39:45.163 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-16T10:39:45.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-03-16T10:39:45.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2024-03-16T10:39:45.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-03-16T10:39:45.243 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-16T10:39:45.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:45.457 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77658/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2162-g3d78f5ba', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2162.g3d78f5ba'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-15 01:33:04.210510', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240314.183243', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-16T10:39:45.594 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-batrick-testing-20240314.183243, sha1 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:39:45.596 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/x86_64/flavors/default/cephadm 2024-03-16T10:39:45.596 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:46.303 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 767536 Mar 16 10:39 /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:46.303 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:47.468 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-r--r--. 1 ubuntu ubuntu 767536 Mar 16 10:39 /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:47.468 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:48.744 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 767536 Mar 16 10:39 /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:48.744 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:48.763 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:48.781 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-16T10:39:48.816 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af on all hosts... 2024-03-16T10:39:48.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af pull 2024-03-16T10:39:48.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af pull 2024-03-16T10:39:48.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af pull 2024-03-16T10:39:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af... 2024-03-16T10:39:49.659 INFO:teuthology.orchestra.run.smithi111.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af... 2024-03-16T10:39:49.733 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af... 2024-03-16T10:40:23.736 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae", 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513" 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-03-16T10:40:23.737 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-03-16T10:40:25.768 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "image_id": "be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae", 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "repo_digests": [ 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513" 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-03-16T10:40:25.769 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae", 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513" 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:40:36.627 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:40:36.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-03-16T10:40:36.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2024-03-16T10:40:36.740 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-03-16T10:40:36.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-03-16T10:40:36.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2024-03-16T10:40:36.831 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-03-16T10:40:36.862 INFO:tasks.cephadm:Writing seed config... 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-03-16T10:40:36.863 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-16T10:40:36.864 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-16T10:40:36.865 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-16T10:40:36.866 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-03-16T10:40:36.867 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:40:36.867 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-16T10:40:36.882 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 811ebd0c-e381-11ee-95c9-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-16T10:40:36.882 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service 2024-03-16T10:40:36.924 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x.service 2024-03-16T10:40:36.966 INFO:tasks.cephadm:Bootstrapping... 2024-03-16T10:40:36.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af -v bootstrap --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:40:37.164 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-16T10:40:37.164 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', '-v', 'bootstrap', '--fsid', '811ebd0c-e381-11ee-95c9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-03-16T10:40:37.188 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T10:40:37.188 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-16T10:40:37.188 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-03-16T10:40:37.211 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T10:40:37.211 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-03-16T10:40:37.211 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-03-16T10:40:37.218 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-16T10:40:37.219 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-16T10:40:37.224 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-16T10:40:37.224 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:40:37.231 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-03-16T10:40:37.237 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-03-16T10:40:37.237 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-03-16T10:40:37.237 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-03-16T10:40:37.260 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-16T10:40:37.260 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-16T10:40:37.260 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-03-16T10:40:37.260 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-03-16T10:40:37.266 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-16T10:40:37.266 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-16T10:40:37.272 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-16T10:40:37.272 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:40:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140525869989312 on /run/cephadm/811ebd0c-e381-11ee-95c9-87774f69a715.lock 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140525869989312 acquired on /run/cephadm/811ebd0c-e381-11ee-95c9-87774f69a715.lock 2024-03-16T10:40:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-03-16T10:40:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-03-16T10:40:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-03-16T10:40:37.289 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-03-16T10:40:37.289 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-03-16T10:40:37.291 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-16T10:40:37.291 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-16T10:40:37.291 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-16T10:40:37.294 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-16T10:40:37.295 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-03-16T10:40:37.295 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-03-16T10:40:37.295 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-16T10:40:37.295 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-16T10:40:37.296 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af... 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af... 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:66487374cb611c95435850c17b53ebb64c22ed9555f72cd43d678b60262a12b1 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:f58b4670ef4403d11d1c912aa26a4dbcf73447df5302e9dc66f6a7fc0d9d1e47 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae 2024-03-16T10:40:37.788 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-16T10:40:38.726 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev) 2024-03-16T10:40:38.726 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev) 2024-03-16T10:40:38.726 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-03-16T10:40:39.582 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-03-16T10:40:39.582 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-03-16T10:40:40.429 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQAnd/Vl/oMZNRAA9XThCOK2ueomLA8k6HsjZA== 2024-03-16T10:40:41.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQAod/Vl1uoCLBAAPTltrDbNDNOLiEiSpcR6Cg== 2024-03-16T10:40:42.178 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQApd/Vllu0EJhAALJDEHJ90+KUcDv4PriqwzA== 2024-03-16T10:40:42.178 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-03-16T10:40:43.074 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:40:43.075 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-03-16T10:40:44.022 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2024-03-16T10:40:44.229 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-16T10:40:44.388 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-16T10:40:44.560 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target. 2024-03-16T10:40:44.561 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target. 2024-03-16T10:40:44.805 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a 2024-03-16T10:40:44.805 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service: Unit ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service not loaded. 2024-03-16T10:40:44.978 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target.wants/ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service → /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715@.service. 2024-03-16T10:40:45.511 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T10:40:45.512 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-03-16T10:40:45.518 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T10:40:45.518 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:40:45.518 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-03-16T10:40:45.519 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-03-16T10:40:45.519 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-03-16T10:40:45.519 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-03-16T10:40:45.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:45 smithi017 systemd[1]: Started Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:40:46.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-16T10:40:46.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: monmap epoch 1 2024-03-16T10:40:46.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:46.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: last_changed 2024-03-16T10:40:42.508418+0000 2024-03-16T10:40:46.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: created 2024-03-16T10:40:42.508418+0000 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: min_mon_release 19 (squid) 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: election_strategy: 1 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: fsmap 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: osdmap e1: 0 total, 0 up, 0 in 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: mgrmap e1: no daemons active 2024-03-16T10:40:46.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:46 smithi017 ceph-mon[31707]: from='client.? 172.21.15.17:0/1874687666' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-16T10:40:46.574 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.516848s) 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-16T10:40:46.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.916+0000 7f8f4b795700 1 Processor -- start 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.916+0000 7f8f4b795700 1 -- start start 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f4b795700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f4b795700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4407be10 con 0x7f8f44108710 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f49531700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f49531700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41640/0 (socket says 172.21.15.17:41640) 2024-03-16T10:40:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f49531700 1 -- 172.21.15.17:0/1005385367 learned_addr learned my addr 172.21.15.17:0/1005385367 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.917+0000 7f8f49531700 1 -- 172.21.15.17:0/1005385367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4410b040 con 0x7f8f44108710 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f49531700 1 --2- 172.21.15.17:0/1005385367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009e80 tx=0x7f8f4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b0b669b28192d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f3bfff700 1 -- 172.21.15.17:0/1005385367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x7f8f44108710 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f3bfff700 1 -- 172.21.15.17:0/1005385367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40003a20 con 0x7f8f44108710 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f3bfff700 1 -- 172.21.15.17:0/1005385367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f40003d20 con 0x7f8f44108710 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 -- 172.21.15.17:0/1005385367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 msgr2=0x7f8f4410ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 --2- 172.21.15.17:0/1005385367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009e80 tx=0x7f8f4000b330 comp rx=0 tx=0).stop 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 -- 172.21.15.17:0/1005385367 shutdown_connections 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 --2- 172.21.15.17:0/1005385367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4410ab00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 -- 172.21.15.17:0/1005385367 >> 172.21.15.17:0/1005385367 conn(0x7f8f44102060 msgr2=0x7f8f441044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 -- 172.21.15.17:0/1005385367 shutdown_connections 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.918+0000 7f8f4b795700 1 -- 172.21.15.17:0/1005385367 wait complete. 2024-03-16T10:40:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f4b795700 1 Processor -- start 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f4b795700 1 -- start start 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f4b795700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f4b795700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4410b450 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f49531700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f49531700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41652/0 (socket says 172.21.15.17:41652) 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.919+0000 7f8f49531700 1 -- 172.21.15.17:0/1874687666 learned_addr learned my addr 172.21.15.17:0/1874687666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f49531700 1 -- 172.21.15.17:0/1874687666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4419b920 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f49531700 1 --2- 172.21.15.17:0/1874687666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8f4407b250 tx=0x7f8f40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f40022020 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40018040 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4419bbb0 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x7f8f44108710 2024-03-16T10:40:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4419e8a0 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f40025020 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.920+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8f4000f050 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.921+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f44063900 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.923+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8f4002c030 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.996+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f8f4402dd00 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f3a7fc700 1 -- 172.21.15.17:0/1874687666 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f8f4001e480 con 0x7f8f44108710 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 msgr2=0x7f8f4419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f4b795700 1 --2- 172.21.15.17:0/1874687666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8f4407b250 tx=0x7f8f40004ad0 comp rx=0 tx=0).stop 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 shutdown_connections 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f4b795700 1 --2- 172.21.15.17:0/1874687666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f44108710 0x7f8f4419b3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.997+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 >> 172.21.15.17:0/1874687666 conn(0x7f8f44102060 msgr2=0x7f8f44104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.998+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 shutdown_connections 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:45.998+0000 7f8f4b795700 1 -- 172.21.15.17:0/1874687666 wait complete. 2024-03-16T10:40:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-03-16T10:40:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-03-16T10:40:47.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:47 smithi017 ceph-mon[31707]: from='client.? 172.21.15.17:0/3379825795' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-16T10:40:47.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:47 smithi017 ceph-mon[31707]: from='client.? 172.21.15.17:0/3379825795' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-16T10:40:47.662 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.010+0000 7f2f6117b700 1 Processor -- start 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f6117b700 1 -- start start 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f6117b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f6117b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c108600 con 0x7f2f5c107ca0 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41656/0 (socket says 172.21.15.17:41656) 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f5ad9d700 1 -- 172.21.15.17:0/3476978390 learned_addr learned my addr 172.21.15.17:0/3476978390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f5ad9d700 1 -- 172.21.15.17:0/3476978390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c108780 con 0x7f2f5c107ca0 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.011+0000 7f2f5ad9d700 1 --2- 172.21.15.17:0/3476978390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098a0 tx=0x7f2f50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ddf759efbfed92 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f59d9b700 1 -- 172.21.15.17:0/3476978390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f50004160 con 0x7f2f5c107ca0 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f59d9b700 1 -- 172.21.15.17:0/3476978390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f50004300 con 0x7f2f5c107ca0 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f59d9b700 1 -- 172.21.15.17:0/3476978390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f500036a0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 -- 172.21.15.17:0/3476978390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 msgr2=0x7f2f5c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 --2- 172.21.15.17:0/3476978390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098a0 tx=0x7f2f50009bb0 comp rx=0 tx=0).stop 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 -- 172.21.15.17:0/3476978390 shutdown_connections 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 --2- 172.21.15.17:0/3476978390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c1080c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 -- 172.21.15.17:0/3476978390 >> 172.21.15.17:0/3476978390 conn(0x7f2f5c1032c0 msgr2=0x7f2f5c105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 -- 172.21.15.17:0/3476978390 shutdown_connections 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.012+0000 7f2f6117b700 1 -- 172.21.15.17:0/3476978390 wait complete. 2024-03-16T10:40:47.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f6117b700 1 Processor -- start 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f6117b700 1 -- start start 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f6117b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f6117b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c109100 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41670/0 (socket says 172.21.15.17:41670) 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.013+0000 7f2f5ad9d700 1 -- 172.21.15.17:0/3379825795 learned_addr learned my addr 172.21.15.17:0/3379825795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f5ad9d700 1 -- 172.21.15.17:0/3379825795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c07e0b0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f5ad9d700 1 --2- 172.21.15.17:0/3379825795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c00 tx=0x7f2f50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f50003db0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f50011630 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c07c2a0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f50011950 con 0x7f2f5c107ca0 2024-03-16T10:40:47.665 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c07c7e0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f5001a460 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.014+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f5001b780 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.015+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c063900 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.017+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2f5001ba20 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.088+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2f5c194930 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.091+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f2f5001bc00 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.092+0000 7f2f43fff700 1 -- 172.21.15.17:0/3379825795 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f5001bde0 con 0x7f2f5c107ca0 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.092+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 msgr2=0x7f2f5c07db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.092+0000 7f2f6117b700 1 --2- 172.21.15.17:0/3379825795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2f50000c00 tx=0x7f2f50004750 comp rx=0 tx=0).stop 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.093+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 shutdown_connections 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.093+0000 7f2f6117b700 1 --2- 172.21.15.17:0/3379825795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107ca0 0x7f2f5c07db70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.093+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 >> 172.21.15.17:0/3379825795 conn(0x7f2f5c1032c0 msgr2=0x7f2f5c191f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:47.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.093+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 shutdown_connections 2024-03-16T10:40:47.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:47.093+0000 7f2f6117b700 1 -- 172.21.15.17:0/3379825795 wait complete. 2024-03-16T10:40:47.667 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0fa307700 1 Processor -- start 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0fa307700 1 -- start start 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0fa307700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0fa307700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f407be50 con 0x7fc0f41086e0 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41672/0 (socket says 172.21.15.17:41672) 2024-03-16T10:40:48.642 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0f3fff700 1 -- 172.21.15.17:0/2257709807 learned_addr learned my addr 172.21.15.17:0/2257709807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.054+0000 7fc0f3fff700 1 -- 172.21.15.17:0/2257709807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f410b010 con 0x7fc0f41086e0 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0f3fff700 1 --2- 172.21.15.17:0/2257709807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098a0 tx=0x7fc0e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec22e3e61ce1a04 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0f2ffd700 1 -- 172.21.15.17:0/2257709807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4004160 con 0x7fc0f41086e0 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0f2ffd700 1 -- 172.21.15.17:0/2257709807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0e4004300 con 0x7fc0f41086e0 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0f2ffd700 1 -- 172.21.15.17:0/2257709807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4011b50 con 0x7fc0f41086e0 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0fa307700 1 -- 172.21.15.17:0/2257709807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 msgr2=0x7fc0f410aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0fa307700 1 --2- 172.21.15.17:0/2257709807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098a0 tx=0x7fc0e4009bb0 comp rx=0 tx=0).stop 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0fa307700 1 -- 172.21.15.17:0/2257709807 shutdown_connections 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0fa307700 1 --2- 172.21.15.17:0/2257709807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f410aad0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.055+0000 7fc0fa307700 1 -- 172.21.15.17:0/2257709807 >> 172.21.15.17:0/2257709807 conn(0x7fc0f4102070 msgr2=0x7fc0f41044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 -- 172.21.15.17:0/2257709807 shutdown_connections 2024-03-16T10:40:48.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 -- 172.21.15.17:0/2257709807 wait complete. 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 Processor -- start 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 -- start start 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0fa307700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f410bfe0 con 0x7fc0f41086e0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41686/0 (socket says 172.21.15.17:41686) 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.056+0000 7fc0f3fff700 1 -- 172.21.15.17:0/1304573451 learned_addr learned my addr 172.21.15.17:0/1304573451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f3fff700 1 -- 172.21.15.17:0/1304573451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f419c100 con 0x7fc0f41086e0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f3fff700 1 --2- 172.21.15.17:0/1304573451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4011b60 tx=0x7fc0e4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4003b20 con 0x7fc0f41086e0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0e4003cc0 con 0x7fc0f41086e0 2024-03-16T10:40:48.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f419c390 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4024840 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f419f080 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0e4022020 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.057+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0e4011e00 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.058+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f4063900 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.060+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc0e402d3f0 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.131+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc0f4106810 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.131+0000 7fc0f17fa700 1 -- 172.21.15.17:0/1304573451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fc0e4032030 con 0x7fc0f41086e0 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 msgr2=0x7fc0f419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 --2- 172.21.15.17:0/1304573451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4011b60 tx=0x7fc0e4011c40 comp rx=0 tx=0).stop 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 shutdown_connections 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 --2- 172.21.15.17:0/1304573451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0f41086e0 0x7fc0f419bbc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 >> 172.21.15.17:0/1304573451 conn(0x7fc0f4102070 msgr2=0x7fc0f4102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:48.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 shutdown_connections 2024-03-16T10:40:48.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:48.132+0000 7fc0fa307700 1 -- 172.21.15.17:0/1304573451 wait complete. 2024-03-16T10:40:48.646 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-03-16T10:40:48.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:48 smithi017 ceph-mon[31707]: from='client.? 172.21.15.17:0/1304573451' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:40:48.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:48 smithi017 systemd[1]: Stopping Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:40:49.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[31703]: 2024-03-16T10:40:48.911+0000 7efffbf34700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:40:49.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[31703]: 2024-03-16T10:40:48.911+0000 7efffbf34700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-16T10:40:49.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:48 smithi017 podman[31954]: 2024-03-16 10:40:48.983471526 +0000 UTC m=+0.178277854 container died 61737e50d889a4771ebb0a5f5b89485d27404ae5d0944c18f4af41e7d52620c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS) 2024-03-16T10:40:49.487 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 podman[31954]: 2024-03-16 10:40:49.270052697 +0000 UTC m=+0.464859024 container cleanup 61737e50d889a4771ebb0a5f5b89485d27404ae5d0944c18f4af41e7d52620c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:40:49.487 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 bash[31954]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a 2024-03-16T10:40:49.825 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 podman[31968]: 2024-03-16 10:40:49.487429752 +0000 UTC m=+0.507418610 container remove 61737e50d889a4771ebb0a5f5b89485d27404ae5d0944c18f4af41e7d52620c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:40:49.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 systemd[1]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-16T10:40:49.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 systemd[1]: Stopped Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:40:49.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 systemd[1]: Starting Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 podman[32059]: 2024-03-16 10:40:49.728360878 +0000 UTC m=+0.017481185 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:49 smithi017 podman[32059]: 2024-03-16 10:40:49.846971225 +0000 UTC m=+0.136091533 container create c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 podman[32059]: 2024-03-16 10:40:50.032413302 +0000 UTC m=+0.321533607 container init c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307) 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 podman[32059]: 2024-03-16 10:40:50.035242627 +0000 UTC m=+0.324362932 container start c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: set uid:gid to 167:167 (ceph:ceph) 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev), process ceph-mon, pid 2 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: pidfile_write: ignore empty --pid-file 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: load: jerasure load: lrc 2024-03-16T10:40:50.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: RocksDB version: 7.9.2 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Git sha 0 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Compile date 2024-03-15 00:33:34 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: DB SUMMARY 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: DB Session ID: 6D68IJMZ4HD524ZWQWDW 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: CURRENT file: CURRENT 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: IDENTITY file: IDENTITY 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-16T10:40:50.092 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104338 ; 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.error_if_exists: 0 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.create_if_missing: 0 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.paranoid_checks: 1 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.env: 0x562ea4acfc60 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.fs: PosixFileSystem 2024-03-16T10:40:50.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.info_log: 0x562ea5f79ac0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_file_opening_threads: 16 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.statistics: (nil) 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.use_fsync: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_log_file_size: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.keep_log_file_num: 1000 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.recycle_log_file_num: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_fallocate: 1 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_mmap_reads: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_mmap_writes: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.use_direct_reads: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-16T10:40:50.094 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.create_missing_column_families: 0 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.db_log_dir: 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.wal_dir: 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.advise_random_on_open: 1 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.db_write_buffer_size: 0 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.write_buffer_manager: 0x562ea5f4c1e0 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-16T10:40:50.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.rate_limiter: (nil) 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.wal_recovery_mode: 2 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enable_thread_tracking: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enable_pipelined_write: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.unordered_write: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.row_cache: None 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.wal_filter: None 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-16T10:40:50.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_ingest_behind: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.two_write_queues: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.manual_wal_flush: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.wal_compression: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.atomic_flush: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.log_readahead_size: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.best_efforts_recovery: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.allow_data_in_errors: 0 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.db_host_id: __hostname__ 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-16T10:40:50.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_background_jobs: 2 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_background_compactions: -1 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_subcompactions: 1 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_total_wal_size: 0 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_open_files: -1 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bytes_per_sync: 0 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-16T10:40:50.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_readahead_size: 0 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_background_flushes: -1 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Compression algorithms supported: 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kZSTD supported: 0 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kXpressCompression supported: 0 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kLZ4HCCompression supported: 1 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kZlibCompression supported: 1 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kSnappyCompression supported: 1 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kLZ4Compression supported: 1 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: kBZip2Compression supported: 0 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.merge_operator: 2024-03-16T10:40:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_filter: None 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_filter_factory: None 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.sst_partitioner_factory: None 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562ea5f79bc0) 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2024-03-16T10:40:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x562ea5f7f090 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2024-03-16T10:40:50.101 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-03-16T10:40:50.102 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.write_buffer_size: 33554432 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_write_buffer_number: 2 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression: NoCompression 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression: Disabled 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.prefix_extractor: nullptr 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.num_levels: 7 2024-03-16T10:40:50.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.level: 32767 2024-03-16T10:40:50.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.strategy: 0 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.enabled: false 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.target_file_size_base: 67108864 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-16T10:40:50.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.arena_block_size: 1048576 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-16T10:40:50.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.disable_auto_compactions: 0 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.table_properties_collectors: 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.inplace_update_support: 0 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-16T10:40:50.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-16T10:40:50.108 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-16T10:40:50.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-16T10:40:50.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.bloom_locality: 0 2024-03-16T10:40:50.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.max_successive_merges: 0 2024-03-16T10:40:50.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-16T10:40:50.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.paranoid_file_checks: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.force_consistency_checks: 1 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.report_bg_io_stats: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.ttl: 2592000 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enable_blob_files: false 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.min_blob_size: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_file_size: 268435456 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.blob_file_starting_level: 0 2024-03-16T10:40:50.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0e60ee07-9a83-4050-98e8-fdcf2a99c603 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710585650062902, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710585650063892, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99505, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97477, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13975, "raw_average_key_size": 49, "raw_value_size": 89848, "raw_average_value_size": 319, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710585650, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0e60ee07-9a83-4050-98e8-fdcf2a99c603", "db_session_id": "6D68IJMZ4HD524ZWQWDW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710585650063985, "job": 1, "event": "recovery_finished"} 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562ea6072000 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: DB pointer 0x562ea605c000 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-16T10:40:50.110 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 99.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 99.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.111 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-16T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 32.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 32.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x562ea5f7f090#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???) e1 preinit fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).mds e1 new map 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).mds e1 print_map 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-03-16T10:40:50.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 bash[32059]: c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb 2024-03-16T10:40:50.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 systemd[1]: Started Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:40:50.410 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: monmap epoch 1 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: last_changed 2024-03-16T10:40:42.508418+0000 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: created 2024-03-16T10:40:42.508418+0000 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: min_mon_release 19 (squid) 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: election_strategy: 1 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: fsmap 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: osdmap e1: 0 total, 0 up, 0 in 2024-03-16T10:40:50.411 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:50 smithi017 ceph-mon[32078]: mgrmap e1: no daemons active 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.512+0000 7f5f27334700 1 Processor -- start 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f27334700 1 -- start start 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f27334700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f27334700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201074f0 con 0x7f5f20106b00 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f250d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f250d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59742/0 (socket says 172.21.15.17:59742) 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.513+0000 7f5f250d0700 1 -- 172.21.15.17:0/2145129727 learned_addr learned my addr 172.21.15.17:0/2145129727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.514+0000 7f5f250d0700 1 -- 172.21.15.17:0/2145129727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f20107d00 con 0x7f5f20106b00 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.514+0000 7f5f250d0700 1 --2- 172.21.15.17:0/2145129727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098a0 tx=0x7f5f1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a30d89fb10e75b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.514+0000 7f5f17fff700 1 -- 172.21.15.17:0/2145129727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c004160 con 0x7f5f20106b00 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.514+0000 7f5f17fff700 1 -- 172.21.15.17:0/2145129727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f1c004300 con 0x7f5f20106b00 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.514+0000 7f5f17fff700 1 -- 172.21.15.17:0/2145129727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c011b50 con 0x7f5f20106b00 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- 172.21.15.17:0/2145129727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 msgr2=0x7f5f20106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 --2- 172.21.15.17:0/2145129727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0098a0 tx=0x7f5f1c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- 172.21.15.17:0/2145129727 shutdown_connections 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 --2- 172.21.15.17:0/2145129727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f20106f20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- 172.21.15.17:0/2145129727 >> 172.21.15.17:0/2145129727 conn(0x7f5f20102060 msgr2=0x7f5f201044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- 172.21.15.17:0/2145129727 shutdown_connections 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- 172.21.15.17:0/2145129727 wait complete. 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 Processor -- start 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.515+0000 7f5f27334700 1 -- start start 2024-03-16T10:40:51.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f27334700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f27334700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2010b0b0 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f250d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f250d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59748/0 (socket says 172.21.15.17:59748) 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f250d0700 1 -- 172.21.15.17:0/2691146414 learned_addr learned my addr 172.21.15.17:0/2691146414 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f250d0700 1 -- 172.21.15.17:0/2691146414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2019c1c0 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f250d0700 1 --2- 172.21.15.17:0/2691146414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009fb0 tx=0x7f5f1c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c0038b0 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f1c011e50 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2019c450 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c019550 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.516+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2019f140 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.517+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5f1c019be0 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.517+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5f1c024730 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.517+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f20063900 con 0x7f5f20106b00 2024-03-16T10:40:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.520+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5f1c003a50 con 0x7f5f20106b00 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.590+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f5f2002de30 con 0x7f5f20106b00 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.592+0000 7f5f167fc700 1 -- 172.21.15.17:0/2691146414 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f5f1c024930 con 0x7f5f20106b00 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 msgr2=0x7f5f2019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 --2- 172.21.15.17:0/2691146414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009fb0 tx=0x7f5f1c011bf0 comp rx=0 tx=0).stop 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 shutdown_connections 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 --2- 172.21.15.17:0/2691146414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f20106b00 0x7f5f2019bc80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 >> 172.21.15.17:0/2691146414 conn(0x7f5f20102060 msgr2=0x7f5f20102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 shutdown_connections 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:50.593+0000 7f5f27334700 1 -- 172.21.15.17:0/2691146414 wait complete. 2024-03-16T10:40:51.198 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-16T10:40:51.221 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:40:51.221 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-03-16T10:40:51.222 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-16T10:40:51.222 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-16T10:40:51.478 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x 2024-03-16T10:40:51.478 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x.service: Unit ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x.service not loaded. 2024-03-16T10:40:51.621 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715.target.wants/ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-811ebd0c-e381-11ee-95c9-87774f69a715@.service. 2024-03-16T10:40:51.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:51 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2691146414' entity='client.admin' 2024-03-16T10:40:51.849 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:51 smithi017 systemd[1]: Starting Ceph mgr.x for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:40:52.108 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T10:40:52.108 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-03-16T10:40:52.116 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T10:40:52.116 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:40:52.116 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-03-16T10:40:52.116 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-03-16T10:40:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T10:40:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-03-16T10:40:52.132 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T10:40:52.132 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:40:52.132 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-03-16T10:40:52.132 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-16T10:40:52.132 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-03-16T10:40:52.133 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:51 smithi017 podman[32292]: 2024-03-16 10:40:51.849012287 +0000 UTC m=+0.110810093 container create a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux ) 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:51 smithi017 podman[32292]: 2024-03-16 10:40:51.756062712 +0000 UTC m=+0.017860525 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 podman[32292]: 2024-03-16 10:40:52.034660748 +0000 UTC m=+0.296458554 container init a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=) 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 podman[32292]: 2024-03-16 10:40:52.037354489 +0000 UTC m=+0.299152303 container start a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 bash[32292]: a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 2024-03-16T10:40:52.236 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 systemd[1]: Started Ceph mgr.x for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:40:52.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1742967562' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T10:40:52.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:52.625+0000 7f4555cd1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T10:40:52.841 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:52 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:52.721+0000 7f4555cd1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T10:40:53.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:53.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T10:40:53.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T10:40:53.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T10:40:53.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T10:40:53.181 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.182 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.183 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T10:40:45.482694+0000", 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.487+0000 7fc378008700 1 Processor -- start 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.487+0000 7fc378008700 1 -- start start 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc378008700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc378008700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc370107500 con 0x7fc370106b10 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc375da4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc375da4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59792/0 (socket says 172.21.15.17:59792) 2024-03-16T10:40:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc375da4700 1 -- 172.21.15.17:0/31824320 learned_addr learned my addr 172.21.15.17:0/31824320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc375da4700 1 -- 172.21.15.17:0/31824320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370107d10 con 0x7fc370106b10 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.488+0000 7fc375da4700 1 --2- 172.21.15.17:0/31824320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098a0 tx=0x7fc36c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b2dc4e2e7363a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc374da2700 1 -- 172.21.15.17:0/31824320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36c004160 con 0x7fc370106b10 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc374da2700 1 -- 172.21.15.17:0/31824320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc36c004300 con 0x7fc370106b10 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc374da2700 1 -- 172.21.15.17:0/31824320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36c004160 con 0x7fc370106b10 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc378008700 1 -- 172.21.15.17:0/31824320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 msgr2=0x7fc370106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc378008700 1 --2- 172.21.15.17:0/31824320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098a0 tx=0x7fc36c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc378008700 1 -- 172.21.15.17:0/31824320 shutdown_connections 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.489+0000 7fc378008700 1 --2- 172.21.15.17:0/31824320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc370106f30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 -- 172.21.15.17:0/31824320 >> 172.21.15.17:0/31824320 conn(0x7fc370102090 msgr2=0x7fc3701044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 -- 172.21.15.17:0/31824320 shutdown_connections 2024-03-16T10:40:53.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 -- 172.21.15.17:0/31824320 wait complete. 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 Processor -- start 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 -- start start 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.490+0000 7fc378008700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc37010b0c0 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc375da4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc375da4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59806/0 (socket says 172.21.15.17:59806) 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc375da4700 1 -- 172.21.15.17:0/1742967562 learned_addr learned my addr 172.21.15.17:0/1742967562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc375da4700 1 -- 172.21.15.17:0/1742967562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37019c170 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc375da4700 1 --2- 172.21.15.17:0/1742967562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc36c011850 tx=0x7fc36c011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36c0038b0 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc36c003a50 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36c01a430 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc378008700 1 -- 172.21.15.17:0/1742967562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37019c400 con 0x7fc370106b10 2024-03-16T10:40:53.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.491+0000 7fc378008700 1 -- 172.21.15.17:0/1742967562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37019f0a0 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.492+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc36c01aac0 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.492+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc36c0198c0 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.493+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370063900 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.495+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc36c043dd0 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.568+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc370062ee0 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.568+0000 7fc366ffd700 1 -- 172.21.15.17:0/1742967562 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fc36c032020 con 0x7fc370106b10 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 msgr2=0x7fc37019bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 --2- 172.21.15.17:0/1742967562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc36c011850 tx=0x7fc36c011a70 comp rx=0 tx=0).stop 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 shutdown_connections 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 --2- 172.21.15.17:0/1742967562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc370106b10 0x7fc37019bc30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 >> 172.21.15.17:0/1742967562 conn(0x7fc370102090 msgr2=0x7fc370102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 shutdown_connections 2024-03-16T10:40:53.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:52.570+0000 7fc364ff9700 1 -- 172.21.15.17:0/1742967562 wait complete. 2024-03-16T10:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-03-16T10:40:53.486 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:53 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:53.390+0000 7f4555cd1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T10:40:53.486 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:53 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:53.485+0000 7f4555cd1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T10:40:53.811 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:53 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:53.628+0000 7f4555cd1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T10:40:53.811 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:53 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:53.725+0000 7f4555cd1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T10:40:53.811 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:53 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:53.810+0000 7f4555cd1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T10:40:54.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:54.076+0000 7f4555cd1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T10:40:54.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:54.188+0000 7f4555cd1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T10:40:54.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:54.276+0000 7f4555cd1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T10:40:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:54.372+0000 7f4555cd1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T10:40:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:54.549+0000 7f4555cd1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T10:40:55.632 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:55 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:55.555+0000 7f4555cd1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T10:40:56.040 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:55 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2483077560' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T10:40:56.040 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:55 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:55.700+0000 7f4555cd1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T10:40:56.040 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:56 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:56.039+0000 7f4555cd1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T10:40:56.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:56 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:56.131+0000 7f4555cd1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T10:40:56.333 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:56 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:56.332+0000 7f4555cd1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:40:56.590 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:56 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:56.522+0000 7f4555cd1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T10:40:57.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:56 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:56.813+0000 7f4555cd1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:40:57.075 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:57 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:57.074+0000 7f4555cd1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T10:40:57.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:57 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:57.316+0000 7f4555cd1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T10:40:58.590 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:58 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:58.146+0000 7f4555cd1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T10:40:59.052 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:58 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:58.728+0000 7f4555cd1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T10:40:59.052 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:58 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:58.829+0000 7f4555cd1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T10:40:59.053 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:40:59.051+0000 7f4555cd1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T10:40:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: Activating manager daemon x 2024-03-16T10:40:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: mgrmap e2: x(active, starting, since 0.00299069s) 2024-03-16T10:40:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T10:40:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: Manager daemon x is now available 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' 2024-03-16T10:40:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:40:59 smithi017 ceph-mon[32078]: from='mgr.14100 172.21.15.17:0/2129073801' entity='mgr.x' 2024-03-16T10:40:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:40:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:40:59.619 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:59.620 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.621 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T10:40:59.622 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T10:40:45.482694+0000", 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:40:59.623 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.550+0000 7f7fb15cd700 1 Processor -- start 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.550+0000 7f7fb15cd700 1 -- start start 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.550+0000 7f7fb15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.550+0000 7f7fb15cd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac107500 con 0x7f7fac106b10 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59818/0 (socket says 172.21.15.17:59818) 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7faaffd700 1 -- 172.21.15.17:0/3096715215 learned_addr learned my addr 172.21.15.17:0/3096715215 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7faaffd700 1 -- 172.21.15.17:0/3096715215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac107d10 con 0x7f7fac106b10 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7faaffd700 1 --2- 172.21.15.17:0/3096715215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0098a0 tx=0x7f7f9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a5912af925a46c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7fa9ffb700 1 -- 172.21.15.17:0/3096715215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c004160 con 0x7f7fac106b10 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7fa9ffb700 1 -- 172.21.15.17:0/3096715215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f9c004300 con 0x7f7fac106b10 2024-03-16T10:40:59.624 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.551+0000 7f7fa9ffb700 1 -- 172.21.15.17:0/3096715215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c011b50 con 0x7f7fac106b10 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 -- 172.21.15.17:0/3096715215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 msgr2=0x7f7fac106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 --2- 172.21.15.17:0/3096715215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0098a0 tx=0x7f7f9c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 -- 172.21.15.17:0/3096715215 shutdown_connections 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 --2- 172.21.15.17:0/3096715215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac106f30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 -- 172.21.15.17:0/3096715215 >> 172.21.15.17:0/3096715215 conn(0x7f7fac102090 msgr2=0x7f7fac1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 -- 172.21.15.17:0/3096715215 shutdown_connections 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.552+0000 7f7fb15cd700 1 -- 172.21.15.17:0/3096715215 wait complete. 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7fb15cd700 1 Processor -- start 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7fb15cd700 1 -- start start 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7fb15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7fb15cd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac10b0c0 con 0x7f7fac106b10 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59822/0 (socket says 172.21.15.17:59822) 2024-03-16T10:40:59.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.553+0000 7f7faaffd700 1 -- 172.21.15.17:0/2483077560 learned_addr learned my addr 172.21.15.17:0/2483077560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7faaffd700 1 -- 172.21.15.17:0/2483077560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac19b010 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7faaffd700 1 --2- 172.21.15.17:0/2483077560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c011670 tx=0x7f7f9c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c0039c0 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fac19b2a0 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f9c011e50 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c01a5c0 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.554+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fac19b700 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.555+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f9c01ac50 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.555+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7f9c019700 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.555+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac063900 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.557+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7f9c003b60 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.630+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7fac07b2e0 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.631+0000 7f7f93fff700 1 -- 172.21.15.17:0/2483077560 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7f9c0199a0 con 0x7f7fac106b10 2024-03-16T10:40:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.632+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 msgr2=0x7f7fac19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.632+0000 7f7fb15cd700 1 --2- 172.21.15.17:0/2483077560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c011670 tx=0x7f7f9c011b60 comp rx=0 tx=0).stop 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.635+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 shutdown_connections 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.635+0000 7f7fb15cd700 1 --2- 172.21.15.17:0/2483077560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac106b10 0x7f7fac19aad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.635+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 >> 172.21.15.17:0/2483077560 conn(0x7f7fac102090 msgr2=0x7f7fac102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.635+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 shutdown_connections 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:40:55.635+0000 7f7fb15cd700 1 -- 172.21.15.17:0/2483077560 wait complete. 2024-03-16T10:40:59.627 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-03-16T10:41:01.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:01 smithi017 ceph-mon[32078]: mgrmap e3: x(active, since 1.00714s) 2024-03-16T10:41:03.219 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:03 smithi017 ceph-mon[32078]: mgrmap e4: x(active, since 3s) 2024-03-16T10:41:03.219 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:03 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4248813849' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-16T10:41:03.492 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:41:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-16T10:41:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-16T10:41:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-16T10:41:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-16T10:41:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-03-16T10:41:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-03-16T10:40:45.482694+0000", 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd96127b700 1 Processor -- start 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd96127b700 1 -- start start 2024-03-16T10:41:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd96127b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd96127b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c07bdd0 con 0x7fd95c108760 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd95affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.629+0000 7fd95affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47446/0 (socket says 172.21.15.17:47446) 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd95affd700 1 -- 172.21.15.17:0/3510114920 learned_addr learned my addr 172.21.15.17:0/3510114920 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd95affd700 1 -- 172.21.15.17:0/3510114920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c10b090 con 0x7fd95c108760 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd95affd700 1 --2- 172.21.15.17:0/3510114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098a0 tx=0x7fd94c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7652d9c419640045 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd959ffb700 1 -- 172.21.15.17:0/3510114920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c004160 con 0x7fd95c108760 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd959ffb700 1 -- 172.21.15.17:0/3510114920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd94c004300 con 0x7fd95c108760 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.630+0000 7fd959ffb700 1 -- 172.21.15.17:0/3510114920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c011b50 con 0x7fd95c108760 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 -- 172.21.15.17:0/3510114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 msgr2=0x7fd95c10ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 --2- 172.21.15.17:0/3510114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0098a0 tx=0x7fd94c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 -- 172.21.15.17:0/3510114920 shutdown_connections 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 --2- 172.21.15.17:0/3510114920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c10ab50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 -- 172.21.15.17:0/3510114920 >> 172.21.15.17:0/3510114920 conn(0x7fd95c102070 msgr2=0x7fd95c1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 -- 172.21.15.17:0/3510114920 shutdown_connections 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 -- 172.21.15.17:0/3510114920 wait complete. 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.631+0000 7fd96127b700 1 Processor -- start 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd96127b700 1 -- start start 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd96127b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd96127b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c10bff0 con 0x7fd95c108760 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd95affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd95affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47458/0 (socket says 172.21.15.17:47458) 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd95affd700 1 -- 172.21.15.17:0/4248813849 learned_addr learned my addr 172.21.15.17:0/4248813849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd95affd700 1 -- 172.21.15.17:0/4248813849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c19c110 con 0x7fd95c108760 2024-03-16T10:41:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd95affd700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd94c011670 tx=0x7fd94c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c0039c0 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd94c011e50 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.632+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c19c3a0 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.633+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94c01a5c0 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.633+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c19f090 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.633+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46095+0+0 (secure 0 0 0) 0x7fd94c01a870 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.634+0000 7fd943fff700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 0x7fd94403b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.634+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd94c04d050 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.634+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c063900 con 0x7fd95c108760 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.634+0000 7fd95a7fc700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 0x7fd94403b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.634+0000 7fd95a7fc700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 0x7fd94403b390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd950006fd0 tx=0x7fd950006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.639+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd94c020240 con 0x7fd95c108760 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.929+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd95c19f680 con 0x7fd95c108760 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.929+0000 7fd943fff700 1 -- 172.21.15.17:0/4248813849 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd94c02cc00 con 0x7fd95c108760 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 msgr2=0x7fd94403b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 0x7fd94403b390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd950006fd0 tx=0x7fd950006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 msgr2=0x7fd95c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd94c011670 tx=0x7fd94c011b60 comp rx=0 tx=0).stop 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 shutdown_connections 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7fd944038ed0 0x7fd94403b390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 --2- 172.21.15.17:0/4248813849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95c108760 0x7fd95c19bbd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:03.510 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.931+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 >> 172.21.15.17:0/4248813849 conn(0x7fd95c102070 msgr2=0x7fd95c102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:03.511 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.932+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 shutdown_connections 2024-03-16T10:41:03.511 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:02.932+0000 7fd96127b700 1 -- 172.21.15.17:0/4248813849 wait complete. 2024-03-16T10:41:03.511 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-03-16T10:41:04.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:04 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2902138114' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-16T10:41:04.560 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:41:04.560 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-03-16T10:41:04.560 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-16T10:41:04.561 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f6190f8a700 1 Processor -- start 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f6190f8a700 1 -- start start 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f6190f8a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f6190f8a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f618c107510 con 0x7f618c106b20 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f618a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f618a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47472/0 (socket says 172.21.15.17:47472) 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f618a59c700 1 -- 172.21.15.17:0/2500940339 learned_addr learned my addr 172.21.15.17:0/2500940339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.897+0000 7f618a59c700 1 -- 172.21.15.17:0/2500940339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c107d20 con 0x7f618c106b20 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f618a59c700 1 --2- 172.21.15.17:0/2500940339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098a0 tx=0x7f617c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740c05f6b288ddae server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f618959a700 1 -- 172.21.15.17:0/2500940339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c004160 con 0x7f618c106b20 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f618959a700 1 -- 172.21.15.17:0/2500940339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f617c004300 con 0x7f618c106b20 2024-03-16T10:41:04.562 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f618959a700 1 -- 172.21.15.17:0/2500940339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c011b50 con 0x7f618c106b20 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 -- 172.21.15.17:0/2500940339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 msgr2=0x7f618c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2500940339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f617c0098a0 tx=0x7f617c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 -- 172.21.15.17:0/2500940339 shutdown_connections 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2500940339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c106f40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 -- 172.21.15.17:0/2500940339 >> 172.21.15.17:0/2500940339 conn(0x7f618c102080 msgr2=0x7f618c104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 -- 172.21.15.17:0/2500940339 shutdown_connections 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.898+0000 7f6190f8a700 1 -- 172.21.15.17:0/2500940339 wait complete. 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f6190f8a700 1 Processor -- start 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f6190f8a700 1 -- start start 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f6190f8a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f6190f8a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f618c10b0d0 con 0x7f618c106b20 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f618a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:04.563 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f618a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47488/0 (socket says 172.21.15.17:47488) 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.899+0000 7f618a59c700 1 -- 172.21.15.17:0/2902138114 learned_addr learned my addr 172.21.15.17:0/2902138114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f618a59c700 1 -- 172.21.15.17:0/2902138114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c19c150 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f618a59c700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f617c011670 tx=0x7f617c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c0039c0 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c19c3e0 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f617c011e50 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f617c01a5c0 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.900+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c19f0d0 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46095+0+0 (secure 0 0 0) 0x7f617c01a8c0 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f617b7fe700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 0x7f617403b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f617c04d530 con 0x7f618c106b20 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f6189d9b700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 0x7f617403b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:04.564 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c063900 con 0x7f618c106b20 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.901+0000 7f6189d9b700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 0x7f617403b340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:03.906+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f617c019c70 con 0x7f618c106b20 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.109+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f618c02dda0 con 0x7f618c106b20 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.110+0000 7f617b7fe700 1 -- 172.21.15.17:0/2902138114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f617c032030 con 0x7f618c106b20 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 msgr2=0x7f617403b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 0x7f617403b340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6180006fd0 tx=0x7f6180006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 msgr2=0x7f618c19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f617c011670 tx=0x7f617c011b60 comp rx=0 tx=0).stop 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 shutdown_connections 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f6174038e80 0x7f617403b340 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 --2- 172.21.15.17:0/2902138114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f618c106b20 0x7f618c19bc10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 >> 172.21.15.17:0/2902138114 conn(0x7f618c102080 msgr2=0x7f618c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:04.565 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 shutdown_connections 2024-03-16T10:41:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.112+0000 7f6190f8a700 1 -- 172.21.15.17:0/2902138114 wait complete. 2024-03-16T10:41:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-03-16T10:41:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:05 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3566910945' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-16T10:41:05.590 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: ignoring --setuser ceph since I am not root 2024-03-16T10:41:05.590 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: ignoring --setgroup ceph since I am not root 2024-03-16T10:41:05.865 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:05.847+0000 7fe694995200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T10:41:05.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.953+0000 7f84272a5700 1 Processor -- start 2024-03-16T10:41:05.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.953+0000 7f84272a5700 1 -- start start 2024-03-16T10:41:05.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.953+0000 7f84272a5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.953+0000 7f84272a5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f842007be70 con 0x7f84201064b0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f8425041700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f8425041700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47498/0 (socket says 172.21.15.17:47498) 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f8425041700 1 -- 172.21.15.17:0/3340639355 learned_addr learned my addr 172.21.15.17:0/3340639355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f8425041700 1 -- 172.21.15.17:0/3340639355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420106e10 con 0x7f84201064b0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f8425041700 1 --2- 172.21.15.17:0/3340639355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8418009e80 tx=0x7f841800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339678bc69481434 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f841ffff700 1 -- 172.21.15.17:0/3340639355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8418017070 con 0x7f84201064b0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f841ffff700 1 -- 172.21.15.17:0/3340639355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f841800b8c0 con 0x7f84201064b0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.954+0000 7f841ffff700 1 -- 172.21.15.17:0/3340639355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84180045c0 con 0x7f84201064b0 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- 172.21.15.17:0/3340639355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 msgr2=0x7f84201068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 --2- 172.21.15.17:0/3340639355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8418009e80 tx=0x7f841800b330 comp rx=0 tx=0).stop 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- 172.21.15.17:0/3340639355 shutdown_connections 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 --2- 172.21.15.17:0/3340639355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f84201068d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:05.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- 172.21.15.17:0/3340639355 >> 172.21.15.17:0/3340639355 conn(0x7f84201020b0 msgr2=0x7f84201044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:05.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- 172.21.15.17:0/3340639355 shutdown_connections 2024-03-16T10:41:05.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- 172.21.15.17:0/3340639355 wait complete. 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 Processor -- start 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.955+0000 7f84272a5700 1 -- start start 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f84272a5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f84272a5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8420107ea0 con 0x7f84201064b0 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f8425041700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f8425041700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47502/0 (socket says 172.21.15.17:47502) 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f8425041700 1 -- 172.21.15.17:0/3566910945 learned_addr learned my addr 172.21.15.17:0/3566910945 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:05.877 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f8425041700 1 -- 172.21.15.17:0/3566910945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842019e2f0 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f8425041700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8418009e50 tx=0x7f841800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8418020020 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8418003b50 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842019e580 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8418017040 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.956+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a1230 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.957+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 46095+0+0 (secure 0 0 0) 0x7f8418023020 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.957+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420063900 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.957+0000 7f841e7fc700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 0x7f840803b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.957+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f841800f050 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.958+0000 7f8424840700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 0x7f840803b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.958+0000 7f8424840700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 0x7f840803b390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:04.962+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f841802a020 con 0x7f84201064b0 2024-03-16T10:41:05.878 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.223+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f842002dea0 con 0x7f84201064b0 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.274+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f841804c990 con 0x7f84201064b0 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.276+0000 7f841e7fc700 1 -- 172.21.15.17:0/3566910945 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 5) ==== 46106+0+0 (secure 0 0 0) 0x7f8418025400 con 0x7f84201064b0 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 msgr2=0x7f840803b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 0x7f840803b390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 msgr2=0x7f842019ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8418009e50 tx=0x7f841800bd30 comp rx=0 tx=0).stop 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 shutdown_connections 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f8408038ed0 0x7f840803b390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 --2- 172.21.15.17:0/3566910945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84201064b0 0x7f842019ddb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 >> 172.21.15.17:0/3566910945 conn(0x7f84201020b0 msgr2=0x7f8420194a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 shutdown_connections 2024-03-16T10:41:05.879 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:05.277+0000 7f84272a5700 1 -- 172.21.15.17:0/3566910945 wait complete. 2024-03-16T10:41:06.117 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:05.954+0000 7fe694995200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T10:41:06.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3566910945' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-16T10:41:06.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-mon[32078]: mgrmap e5: x(active, since 6s) 2024-03-16T10:41:06.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:06.633+0000 7fe694995200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T10:41:06.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:06.729+0000 7fe694995200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T10:41:07.279 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:06.872+0000 7fe694995200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T10:41:07.279 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:06.970+0000 7fe694995200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T10:41:07.279 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.055+0000 7fe694995200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T10:41:07.530 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1975602901' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-16T10:41:07.530 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.329+0000 7fe694995200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T10:41:07.530 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.441+0000 7fe694995200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T10:41:07.530 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.528+0000 7fe694995200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T10:41:07.805 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.626+0000 7fe694995200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T10:41:08.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:07.804+0000 7fe694995200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T10:41:09.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:08.793+0000 7fe694995200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T10:41:09.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:08.927+0000 7fe694995200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T10:41:09.560 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:09.266+0000 7fe694995200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T10:41:09.560 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:09.358+0000 7fe694995200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T10:41:09.560 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:09.559+0000 7fe694995200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:41:09.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:09.749+0000 7fe694995200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T10:41:09.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:41:09.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-16T10:41:09.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T10:41:09.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-16T10:41:09.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.291+0000 7f07028bc700 1 Processor -- start 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.291+0000 7f07028bc700 1 -- start start 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.291+0000 7f07028bc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.291+0000 7f07028bc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc07be30 con 0x7f06fc108700 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47534/0 (socket says 172.21.15.17:47534) 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06fbfff700 1 -- 172.21.15.17:0/3413468903 learned_addr learned my addr 172.21.15.17:0/3413468903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06fbfff700 1 -- 172.21.15.17:0/3413468903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc10b030 con 0x7f06fc108700 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06fbfff700 1 --2- 172.21.15.17:0/3413468903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0098a0 tx=0x7f06ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6041161e212369a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06faffd700 1 -- 172.21.15.17:0/3413468903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec004160 con 0x7f06fc108700 2024-03-16T10:41:09.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06faffd700 1 -- 172.21.15.17:0/3413468903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06ec004300 con 0x7f06fc108700 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.292+0000 7f06faffd700 1 -- 172.21.15.17:0/3413468903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec011b50 con 0x7f06fc108700 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 -- 172.21.15.17:0/3413468903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 msgr2=0x7f06fc10aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 --2- 172.21.15.17:0/3413468903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0098a0 tx=0x7f06ec009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 -- 172.21.15.17:0/3413468903 shutdown_connections 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 --2- 172.21.15.17:0/3413468903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc10aaf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 -- 172.21.15.17:0/3413468903 >> 172.21.15.17:0/3413468903 conn(0x7f06fc102090 msgr2=0x7f06fc1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 -- 172.21.15.17:0/3413468903 shutdown_connections 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.293+0000 7f07028bc700 1 -- 172.21.15.17:0/3413468903 wait complete. 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f07028bc700 1 Processor -- start 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f07028bc700 1 -- start start 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f07028bc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f07028bc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc10bff0 con 0x7f06fc108700 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f06fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:09.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f06fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47540/0 (socket says 172.21.15.17:47540) 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.294+0000 7f06fbfff700 1 -- 172.21.15.17:0/1975602901 learned_addr learned my addr 172.21.15.17:0/1975602901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f06fbfff700 1 -- 172.21.15.17:0/1975602901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc1084c0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f06fbfff700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f06ec011670 tx=0x7f06ec011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec0039c0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc1066b0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06ec011e50 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec01a5c0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.295+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc106bf0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc063900 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46106+0+0 (secure 0 0 0) 0x7f06ec01a8c0 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f06f97fa700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 0x7f06e403b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06ec04d190 con 0x7f06fc108700 2024-03-16T10:41:09.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f06fb7fe700 1 -- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 msgr2=0x7f06e403b390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.296+0000 7f06fb7fe700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 0x7f06e403b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.305+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f06ec019c70 con 0x7f06fc108700 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.497+0000 7f06fb7fe700 1 -- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 msgr2=0x7f06e403b390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.497+0000 7f06fb7fe700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 0x7f06e403b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.566+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f06fc106dc0 con 0x7f06fc108700 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.566+0000 7f06f97fa700 1 -- 172.21.15.17:0/1975602901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f06fc106dc0 con 0x7f06fc108700 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 msgr2=0x7f06e403b390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 0x7f06e403b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 msgr2=0x7f06fc107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f06ec011670 tx=0x7f06ec011b60 comp rx=0 tx=0).stop 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 shutdown_connections 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7f06e4038ed0 0x7f06e403b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 --2- 172.21.15.17:0/1975602901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06fc108700 0x7f06fc107f80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:09.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 >> 172.21.15.17:0/1975602901 conn(0x7f06fc102090 msgr2=0x7f06fc102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:09.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 shutdown_connections 2024-03-16T10:41:09.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:06.570+0000 7f07028bc700 1 -- 172.21.15.17:0/1975602901 wait complete. 2024-03-16T10:41:09.967 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-03-16T10:41:09.967 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-03-16T10:41:10.248 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:10.067+0000 7fe694995200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:41:10.555 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:10.335+0000 7fe694995200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T10:41:10.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:10.582+0000 7fe694995200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T10:41:11.757 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:11.408+0000 7fe694995200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T10:41:12.091 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:11.989+0000 7fe694995200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T10:41:12.381 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:12.089+0000 7fe694995200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T10:41:12.381 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:12.311+0000 7fe694995200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: Active manager daemon x restarted 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: Activating manager daemon x 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: osdmap e2: 0 total, 0 up, 0 in 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: mgrmap e6: x(active, starting, since 0.00333825s) 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: Manager daemon x is now available 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:12.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:12.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:12.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:12.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:12 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:13.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: Found migration_current of "None". Setting to last migration. 2024-03-16T10:41:13.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T10:41:13.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T10:41:13.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:13.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:13.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:13 smithi017 ceph-mon[32078]: mgrmap e7: x(active, since 1.00507s) 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.348+0000 7ff6d016e700 1 Processor -- start 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.348+0000 7ff6d016e700 1 -- start start 2024-03-16T10:41:14.346 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.348+0000 7ff6d016e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.348+0000 7ff6d016e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c807be70 con 0x7ff6c81086c0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6cdf0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6cdf0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33914/0 (socket says 172.21.15.17:33914) 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6cdf0a700 1 -- 172.21.15.17:0/3414826751 learned_addr learned my addr 172.21.15.17:0/3414826751 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6cdf0a700 1 -- 172.21.15.17:0/3414826751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c810aff0 con 0x7ff6c81086c0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6cdf0a700 1 --2- 172.21.15.17:0/3414826751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0098a0 tx=0x7ff6bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737e2df87401320b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6ccf08700 1 -- 172.21.15.17:0/3414826751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc004160 con 0x7ff6c81086c0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6ccf08700 1 -- 172.21.15.17:0/3414826751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6bc004300 con 0x7ff6c81086c0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.349+0000 7ff6ccf08700 1 -- 172.21.15.17:0/3414826751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc011b50 con 0x7ff6c81086c0 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 -- 172.21.15.17:0/3414826751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 msgr2=0x7ff6c810aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 --2- 172.21.15.17:0/3414826751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0098a0 tx=0x7ff6bc009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 -- 172.21.15.17:0/3414826751 shutdown_connections 2024-03-16T10:41:14.347 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 --2- 172.21.15.17:0/3414826751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c810aab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 -- 172.21.15.17:0/3414826751 >> 172.21.15.17:0/3414826751 conn(0x7ff6c8102090 msgr2=0x7ff6c81044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 -- 172.21.15.17:0/3414826751 shutdown_connections 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.350+0000 7ff6d016e700 1 -- 172.21.15.17:0/3414826751 wait complete. 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6d016e700 1 Processor -- start 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6d016e700 1 -- start start 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6d016e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6d016e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c810c010 con 0x7ff6c81086c0 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6cdf0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6cdf0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33922/0 (socket says 172.21.15.17:33922) 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6cdf0a700 1 -- 172.21.15.17:0/234731922 learned_addr learned my addr 172.21.15.17:0/234731922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.351+0000 7ff6cdf0a700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c819c0d0 con 0x7ff6c81086c0 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6cdf0a700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc011b60 tx=0x7ff6bc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:14.348 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc003b20 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6bc003cc0 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc024840 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c819c360 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.352+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c819f050 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 46106+0+0 (secure 0 0 0) 0x7ff6bc022020 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6baffd700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff6b403bb40 con 0x7ff6b4038f70 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff6bc011e00 con 0x7ff6c81086c0 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6cd709700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 msgr2=0x7ff6b403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.353+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.554+0000 7ff6cd709700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 msgr2=0x7ff6b403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.554+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.955+0000 7ff6cd709700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 msgr2=0x7ff6b403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:14.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:10.955+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:11.756+0000 7ff6cd709700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 msgr2=0x7ff6b403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3497137081 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:11.756+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:12.326+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) ==== 45873+0+0 (secure 0 0 0) 0x7ff6bc04b9f0 con 0x7ff6c81086c0 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:12.326+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 msgr2=0x7ff6b403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:12.326+0000 7ff6baffd700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.327+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) ==== 46000+0+0 (secure 0 0 0) 0x7ff6bc018c90 con 0x7ff6c81086c0 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.327+0000 7ff6baffd700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 0x7ff6b403ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.327+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff6b403bb40 con 0x7ff6b403c860 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.327+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 0x7ff6b403ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.328+0000 7ff6cd709700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 0x7ff6b403ec50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4003a10 tx=0x7ff6c40092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.329+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff6b403bb40 con 0x7ff6b403c860 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.340+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff6c8063900 con 0x7ff6b403c860 2024-03-16T10:41:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.340+0000 7ff6baffd700 1 -- 172.21.15.17:0/234731922 <== mgr.14118 v2:172.21.15.17:6800/1123613371 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff6c8063900 con 0x7ff6b403c860 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 msgr2=0x7ff6b403ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 0x7ff6b403ec50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4003a10 tx=0x7ff6c40092b0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 msgr2=0x7ff6c819bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc011b60 tx=0x7ff6bc011c40 comp rx=0 tx=0).stop 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 shutdown_connections 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7ff6b403c860 0x7ff6b403ec50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6c81086c0 0x7ff6c819bb90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 --2- 172.21.15.17:0/234731922 >> [v2:172.21.15.17:6800/3497137081,v1:172.21.15.17:6801/3497137081] conn(0x7ff6b4038f70 0x7ff6b403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 >> 172.21.15.17:0/234731922 conn(0x7ff6c8102090 msgr2=0x7ff6c8102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 shutdown_connections 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:13.341+0000 7ff6d016e700 1 -- 172.21.15.17:0/234731922 wait complete. 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-03-16T10:41:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-03-16T10:41:14.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:13] ENGINE Bus STARTING 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:13] ENGINE Serving on http://172.21.15.17:8765 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:13] ENGINE Serving on https://172.21.15.17:7150 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:13] ENGINE Bus STARTED 2024-03-16T10:41:14.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:14 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:15.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:15 smithi017 ceph-mon[32078]: mgrmap e8: x(active, since 2s) 2024-03-16T10:41:15.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:15 smithi017 ceph-mon[32078]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:15.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:15 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:15.576 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:15 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:15.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.763+0000 7f9161dbb700 1 Processor -- start 2024-03-16T10:41:15.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.763+0000 7f9161dbb700 1 -- start start 2024-03-16T10:41:15.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f9161dbb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:15.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f9161dbb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f915c108600 con 0x7f915c107ca0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34014/0 (socket says 172.21.15.17:34014) 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915b7fe700 1 -- 172.21.15.17:0/1108162420 learned_addr learned my addr 172.21.15.17:0/1108162420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915b7fe700 1 -- 172.21.15.17:0/1108162420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c108780 con 0x7f915c107ca0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915b7fe700 1 --2- 172.21.15.17:0/1108162420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098a0 tx=0x7f914c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1447baa691713df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915a7fc700 1 -- 172.21.15.17:0/1108162420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c004160 con 0x7f915c107ca0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915a7fc700 1 -- 172.21.15.17:0/1108162420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f914c004300 con 0x7f915c107ca0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.764+0000 7f915a7fc700 1 -- 172.21.15.17:0/1108162420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c011b50 con 0x7f915c107ca0 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 -- 172.21.15.17:0/1108162420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 msgr2=0x7f915c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1108162420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098a0 tx=0x7f914c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 -- 172.21.15.17:0/1108162420 shutdown_connections 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1108162420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c1080c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:15.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 -- 172.21.15.17:0/1108162420 >> 172.21.15.17:0/1108162420 conn(0x7f915c103320 msgr2=0x7f915c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 -- 172.21.15.17:0/1108162420 shutdown_connections 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.765+0000 7f9161dbb700 1 -- 172.21.15.17:0/1108162420 wait complete. 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f9161dbb700 1 Processor -- start 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f9161dbb700 1 -- start start 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f9161dbb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f9161dbb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f915c10c0c0 con 0x7f915c107ca0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f915b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f915b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34026/0 (socket says 172.21.15.17:34026) 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f915b7fe700 1 -- 172.21.15.17:0/1782525727 learned_addr learned my addr 172.21.15.17:0/1782525727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f915b7fe700 1 -- 172.21.15.17:0/1782525727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c19c100 con 0x7f915c107ca0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.766+0000 7f915b7fe700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f914c009fb0 tx=0x7f914c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.767+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c0038b0 con 0x7f915c107ca0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.767+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f914c011e50 con 0x7f915c107ca0 2024-03-16T10:41:15.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.767+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c19c390 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.767+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914c019420 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.767+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c19f080 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f914c019740 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915c063900 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f9158ff9700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 0x7f914403b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f914c04d0d0 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f915affd700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 0x7f914403b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.768+0000 7f915affd700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 0x7f914403b390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9150006fd0 tx=0x7f9150006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.773+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f914c003b00 con 0x7f915c107ca0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:14.998+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f915c104500 con 0x7f9144038ed0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.004+0000 7f9158ff9700 1 -- 172.21.15.17:0/1782525727 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f915c104500 con 0x7f9144038ed0 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 msgr2=0x7f914403b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 0x7f914403b390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9150006fd0 tx=0x7f9150006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:15.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 msgr2=0x7f915c19bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f914c009fb0 tx=0x7f914c011bf0 comp rx=0 tx=0).stop 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 shutdown_connections 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f9144038ed0 0x7f914403b390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 --2- 172.21.15.17:0/1782525727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f915c107ca0 0x7f915c19bbc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 >> 172.21.15.17:0/1782525727 conn(0x7f915c103320 msgr2=0x7f915c103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 shutdown_connections 2024-03-16T10:41:15.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:15.006+0000 7f9161dbb700 1 -- 172.21.15.17:0/1782525727 wait complete. 2024-03-16T10:41:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:16 smithi017 ceph-mon[32078]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.028+0000 7f3a7df1c700 1 Processor -- start 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.028+0000 7f3a7df1c700 1 -- start start 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a7df1c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a7df1c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7807beb0 con 0x7f3a78108680 2024-03-16T10:41:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34040/0 (socket says 172.21.15.17:34040) 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a777fe700 1 -- 172.21.15.17:0/1682426366 learned_addr learned my addr 172.21.15.17:0/1682426366 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a777fe700 1 -- 172.21.15.17:0/1682426366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7810afb0 con 0x7f3a78108680 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a777fe700 1 --2- 172.21.15.17:0/1682426366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695ee83006416234 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.029+0000 7f3a767fc700 1 -- 172.21.15.17:0/1682426366 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68004160 con 0x7f3a78108680 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a767fc700 1 -- 172.21.15.17:0/1682426366 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a68004300 con 0x7f3a78108680 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a767fc700 1 -- 172.21.15.17:0/1682426366 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68011b50 con 0x7f3a78108680 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1682426366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 msgr2=0x7f3a7810aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1682426366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1682426366 shutdown_connections 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1682426366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a7810aa70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1682426366 >> 172.21.15.17:0/1682426366 conn(0x7f3a78102090 msgr2=0x7f3a781044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.030+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1682426366 shutdown_connections 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.031+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1682426366 wait complete. 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.031+0000 7f3a7df1c700 1 Processor -- start 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.031+0000 7f3a7df1c700 1 -- start start 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.031+0000 7f3a7df1c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.031+0000 7f3a7df1c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7810bfe0 con 0x7f3a78108680 2024-03-16T10:41:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34050/0 (socket says 172.21.15.17:34050) 2024-03-16T10:41:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a777fe700 1 -- 172.21.15.17:0/1658661368 learned_addr learned my addr 172.21.15.17:0/1658661368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a777fe700 1 -- 172.21.15.17:0/1658661368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a78108440 con 0x7f3a78108680 2024-03-16T10:41:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a777fe700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a68011670 tx=0x7f3a68011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680039c0 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a68011e50 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a78106630 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a6801a5c0 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.032+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a78106b70 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.033+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f3a6801a8c0 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.033+0000 7f3a74ff9700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 0x7f3a6003b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.033+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3a6804e240 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.033+0000 7f3a76ffd700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 0x7f3a6003b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.033+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a78063900 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.034+0000 7f3a76ffd700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 0x7f3a6003b390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006fd0 tx=0x7f3a6c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.039+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f3a68019c70 con 0x7f3a78108680 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.246+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f3a78107280 con 0x7f3a60038ed0 2024-03-16T10:41:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.247+0000 7f3a74ff9700 1 -- 172.21.15.17:0/1658661368 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f3a78107280 con 0x7f3a60038ed0 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 msgr2=0x7f3a6003b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 0x7f3a6003b390 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006fd0 tx=0x7f3a6c006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 msgr2=0x7f3a78107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a68011670 tx=0x7f3a68011b60 comp rx=0 tx=0).stop 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 shutdown_connections 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f3a60038ed0 0x7f3a6003b390 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 --2- 172.21.15.17:0/1658661368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a78108680 0x7f3a78107f00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 >> 172.21.15.17:0/1658661368 conn(0x7f3a78102090 msgr2=0x7f3a78102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 shutdown_connections 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:16.249+0000 7f3a7df1c700 1 -- 172.21.15.17:0/1658661368 wait complete. 2024-03-16T10:41:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: Generating public/private rsa key pair. 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: Your identification has been saved in /tmp/tmps64vvoni/key. 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: Your public key has been saved in /tmp/tmps64vvoni/key.pub. 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: The key fingerprint is: 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: SHA256:EpMR79GxotDxvEQU3Dl13tEoFiepQQBnJvV8y8x2e/M ceph-811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: The key's randomart image is: 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: +---[RSA 3072]----+ 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | **X=oo+ooo.| 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | . &.+=o+=..o| 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | . = B ==... .| 2024-03-16T10:41:17.952 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | . * +.= . | 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | o S * . | 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | . . . . | 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | ...| 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | .o| 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: | E| 2024-03-16T10:41:17.953 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: +----[SHA256]-----+ 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.243+0000 7f0060ecd700 1 Processor -- start 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f0060ecd700 1 -- start start 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f0060ecd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f0060ecd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f005c108600 con 0x7f005c107ca0 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f005a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f005a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34060/0 (socket says 172.21.15.17:34060) 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f005a59c700 1 -- 172.21.15.17:0/3340483035 learned_addr learned my addr 172.21.15.17:0/3340483035 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.244+0000 7f005a59c700 1 -- 172.21.15.17:0/3340483035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c108780 con 0x7f005c107ca0 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f005a59c700 1 --2- 172.21.15.17:0/3340483035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00500098a0 tx=0x7f0050009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147ae3e54e24a780 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f005959a700 1 -- 172.21.15.17:0/3340483035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050004160 con 0x7f005c107ca0 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f005959a700 1 -- 172.21.15.17:0/3340483035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0050004300 con 0x7f005c107ca0 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f005959a700 1 -- 172.21.15.17:0/3340483035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050011b50 con 0x7f005c107ca0 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f0060ecd700 1 -- 172.21.15.17:0/3340483035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 msgr2=0x7f005c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3340483035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00500098a0 tx=0x7f0050009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f0060ecd700 1 -- 172.21.15.17:0/3340483035 shutdown_connections 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3340483035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c1080c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.245+0000 7f0060ecd700 1 -- 172.21.15.17:0/3340483035 >> 172.21.15.17:0/3340483035 conn(0x7f005c1032c0 msgr2=0x7f005c105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.246+0000 7f0060ecd700 1 -- 172.21.15.17:0/3340483035 shutdown_connections 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.246+0000 7f0060ecd700 1 -- 172.21.15.17:0/3340483035 wait complete. 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.246+0000 7f0060ecd700 1 Processor -- start 2024-03-16T10:41:18.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.246+0000 7f0060ecd700 1 -- start start 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f0060ecd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f0060ecd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f005c10c0c0 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f005a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f005a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34066/0 (socket says 172.21.15.17:34066) 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f005a59c700 1 -- 172.21.15.17:0/3085948641 learned_addr learned my addr 172.21.15.17:0/3085948641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f005a59c700 1 -- 172.21.15.17:0/3085948641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c19c140 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f005a59c700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0050009fb0 tx=0x7f0050011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00500038b0 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0050011e50 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c19c3d0 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0050019420 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.247+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c19f0c0 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.248+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f00500196d0 con 0x7f005c107ca0 2024-03-16T10:41:18.105 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.248+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005c063900 con 0x7f005c107ca0 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.248+0000 7f004b7fe700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 0x7f004403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.249+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f005004d120 con 0x7f005c107ca0 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.249+0000 7f0059d9b700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 0x7f004403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.249+0000 7f0059d9b700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 0x7f004403b3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.254+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f005000bc70 con 0x7f005c107ca0 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.460+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f005c1044e0 con 0x7f0044038f20 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.609+0000 7f004b7fe700 1 -- 172.21.15.17:0/3085948641 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f005c1044e0 con 0x7f0044038f20 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 msgr2=0x7f004403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 0x7f004403b3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 msgr2=0x7f005c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0050009fb0 tx=0x7f0050011bf0 comp rx=0 tx=0).stop 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 shutdown_connections 2024-03-16T10:41:18.106 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f0044038f20 0x7f004403b3e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 --2- 172.21.15.17:0/3085948641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f005c107ca0 0x7f005c19bc00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 >> 172.21.15.17:0/3085948641 conn(0x7f005c1032c0 msgr2=0x7f005c103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 shutdown_connections 2024-03-16T10:41:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:17.611+0000 7f0060ecd700 1 -- 172.21.15.17:0/3085948641 wait complete. 2024-03-16T10:41:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:18 smithi017 ceph-mon[32078]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:18 smithi017 ceph-mon[32078]: Generating ssh key... 2024-03-16T10:41:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:18 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:18 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.511+0000 7efff9473700 1 Processor -- start 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.511+0000 7efff9473700 1 -- start start 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.511+0000 7efff9473700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.511+0000 7efff9473700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efff407c820 con 0x7efff407dd70 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34068/0 (socket says 172.21.15.17:34068) 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff2ffd700 1 -- 172.21.15.17:0/3171059435 learned_addr learned my addr 172.21.15.17:0/3171059435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff2ffd700 1 -- 172.21.15.17:0/3171059435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff407c9a0 con 0x7efff407dd70 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff2ffd700 1 --2- 172.21.15.17:0/3171059435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7effe4009e80 tx=0x7effe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0554401fa751e95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff1ffb700 1 -- 172.21.15.17:0/3171059435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4017070 con 0x7efff407dd70 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff1ffb700 1 -- 172.21.15.17:0/3171059435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effe400b8c0 con 0x7efff407dd70 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.512+0000 7efff1ffb700 1 -- 172.21.15.17:0/3171059435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe40045c0 con 0x7efff407dd70 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 -- 172.21.15.17:0/3171059435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 msgr2=0x7efff407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 --2- 172.21.15.17:0/3171059435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7effe4009e80 tx=0x7effe400b330 comp rx=0 tx=0).stop 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 -- 172.21.15.17:0/3171059435 shutdown_connections 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 --2- 172.21.15.17:0/3171059435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff407c2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 -- 172.21.15.17:0/3171059435 >> 172.21.15.17:0/3171059435 conn(0x7efff41032b0 msgr2=0x7efff41056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 -- 172.21.15.17:0/3171059435 shutdown_connections 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.513+0000 7efff9473700 1 -- 172.21.15.17:0/3171059435 wait complete. 2024-03-16T10:41:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff9473700 1 Processor -- start 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff9473700 1 -- start start 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff9473700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff9473700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efff410e100 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34080/0 (socket says 172.21.15.17:34080) 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff2ffd700 1 -- 172.21.15.17:0/129608667 learned_addr learned my addr 172.21.15.17:0/129608667 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.514+0000 7efff2ffd700 1 -- 172.21.15.17:0/129608667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff419e230 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7efff2ffd700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7effe4004350 tx=0x7effe400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4020020 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff419e4c0 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effe4003c10 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4017040 con 0x7efff407dd70 2024-03-16T10:41:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.515+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff41a11a0 con 0x7efff407dd70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7effe4023020 con 0x7efff407dd70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7effebfff700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 0x7effe003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7effe400f050 con 0x7efff407dd70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7efff27fc700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 0x7effe003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff4063900 con 0x7efff407dd70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.516+0000 7efff27fc700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 0x7effe003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc006fd0 tx=0x7effdc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.521+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7effe402a020 con 0x7efff407dd70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.726+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7efff4104450 con 0x7effe0038f70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.727+0000 7effebfff700 1 -- 172.21.15.17:0/129608667 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7efff4104450 con 0x7effe0038f70 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 msgr2=0x7effe003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 0x7effe003b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc006fd0 tx=0x7effdc006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 msgr2=0x7efff419dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7effe4004350 tx=0x7effe400bd50 comp rx=0 tx=0).stop 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 shutdown_connections 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7effe0038f70 0x7effe003b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 --2- 172.21.15.17:0/129608667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efff407dd70 0x7efff419dcf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 >> 172.21.15.17:0/129608667 conn(0x7efff41032b0 msgr2=0x7efff4103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 shutdown_connections 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:18.729+0000 7efff9473700 1 -- 172.21.15.17:0/129608667 wait complete. 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-03-16T10:41:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-03-16T10:41:19.713 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:19 smithi017 ceph-mon[32078]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:20.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:20 smithi017 ceph-mon[32078]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:21 smithi017 ceph-mon[32078]: Deploying cephadm binary to smithi017 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.824+0000 7fea9fb95700 1 Processor -- start 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.824+0000 7fea9fb95700 1 -- start start 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.824+0000 7fea9fb95700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.824+0000 7fea9fb95700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fea9807be70 con 0x7fea981086b0 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9d931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9d931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33878/0 (socket says 172.21.15.17:33878) 2024-03-16T10:41:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9d931700 1 -- 172.21.15.17:0/1086819805 learned_addr learned my addr 172.21.15.17:0/1086819805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9d931700 1 -- 172.21.15.17:0/1086819805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9810afe0 con 0x7fea981086b0 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9d931700 1 --2- 172.21.15.17:0/1086819805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e80 tx=0x7fea8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5e0f030ae14ac7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9c92f700 1 -- 172.21.15.17:0/1086819805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88017070 con 0x7fea981086b0 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9c92f700 1 -- 172.21.15.17:0/1086819805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea8800b8c0 con 0x7fea981086b0 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.825+0000 7fea9c92f700 1 -- 172.21.15.17:0/1086819805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea880045c0 con 0x7fea981086b0 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 -- 172.21.15.17:0/1086819805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 msgr2=0x7fea9810aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1086819805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e80 tx=0x7fea8800b330 comp rx=0 tx=0).stop 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 -- 172.21.15.17:0/1086819805 shutdown_connections 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1086819805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9810aaa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 -- 172.21.15.17:0/1086819805 >> 172.21.15.17:0/1086819805 conn(0x7fea98102060 msgr2=0x7fea981044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 -- 172.21.15.17:0/1086819805 shutdown_connections 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.826+0000 7fea9fb95700 1 -- 172.21.15.17:0/1086819805 wait complete. 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9fb95700 1 Processor -- start 2024-03-16T10:41:24.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9fb95700 1 -- start start 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9fb95700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9fb95700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fea9810c000 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9d931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9d931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33884/0 (socket says 172.21.15.17:33884) 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9d931700 1 -- 172.21.15.17:0/1163754087 learned_addr learned my addr 172.21.15.17:0/1163754087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9d931700 1 -- 172.21.15.17:0/1163754087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9819c0d0 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9d931700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea8800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88020020 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea88003b50 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.827+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9819c360 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.828+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea88017040 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.828+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9819f050 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7fea88023020 con 0x7fea981086b0 2024-03-16T10:41:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98063900 con 0x7fea981086b0 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea96ffd700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 0x7fea8003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea8800f050 con 0x7fea981086b0 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea9d130700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 0x7fea8003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.829+0000 7fea9d130700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 0x7fea8003b3e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006fd0 tx=0x7fea8c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:19.834+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fea8802a020 con 0x7fea981086b0 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:20.043+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) -- 0x7fea981032d0 con 0x7fea80038f20 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.405+0000 7fea96ffd700 1 -- 172.21.15.17:0/1163754087 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fea981032d0 con 0x7fea80038f20 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 msgr2=0x7fea8003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 0x7fea8003b3e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006fd0 tx=0x7fea8c006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 msgr2=0x7fea9819bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea8800bd30 comp rx=0 tx=0).stop 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 shutdown_connections 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fea80038f20 0x7fea8003b3e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 --2- 172.21.15.17:0/1163754087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea981086b0 0x7fea9819bb90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:24.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 >> 172.21.15.17:0/1163754087 conn(0x7fea98102060 msgr2=0x7fea98102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:24.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 shutdown_connections 2024-03-16T10:41:24.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:24.407+0000 7fea9fb95700 1 -- 172.21.15.17:0/1163754087 wait complete. 2024-03-16T10:41:24.922 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2024-03-16T10:41:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:25 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:25 smithi017 ceph-mon[32078]: Added host smithi017 2024-03-16T10:41:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:25 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:26.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:26 smithi017 ceph-mon[32078]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:26.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:26 smithi017 ceph-mon[32078]: Saving service mon spec with placement count:5 2024-03-16T10:41:26.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:26 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-16T10:41:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.400+0000 7f4dd6229700 1 Processor -- start 2024-03-16T10:41:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.400+0000 7f4dd6229700 1 -- start start 2024-03-16T10:41:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.400+0000 7f4dd6229700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.400+0000 7f4dd6229700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0107500 con 0x7f4dd0106b10 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33898/0 (socket says 172.21.15.17:33898) 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dcf7fe700 1 -- 172.21.15.17:0/842405818 learned_addr learned my addr 172.21.15.17:0/842405818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dcf7fe700 1 -- 172.21.15.17:0/842405818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd0107d10 con 0x7f4dd0106b10 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dcf7fe700 1 --2- 172.21.15.17:0/842405818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908017845111f991 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dce7fc700 1 -- 172.21.15.17:0/842405818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0017070 con 0x7f4dd0106b10 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dce7fc700 1 -- 172.21.15.17:0/842405818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4dc000b8c0 con 0x7f4dd0106b10 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.401+0000 7f4dce7fc700 1 -- 172.21.15.17:0/842405818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc00045c0 con 0x7f4dd0106b10 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 -- 172.21.15.17:0/842405818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 msgr2=0x7f4dd0106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 --2- 172.21.15.17:0/842405818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e80 tx=0x7f4dc000b330 comp rx=0 tx=0).stop 2024-03-16T10:41:27.226 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 -- 172.21.15.17:0/842405818 shutdown_connections 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 --2- 172.21.15.17:0/842405818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0106f30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 -- 172.21.15.17:0/842405818 >> 172.21.15.17:0/842405818 conn(0x7f4dd0102090 msgr2=0x7f4dd01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 -- 172.21.15.17:0/842405818 shutdown_connections 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 -- 172.21.15.17:0/842405818 wait complete. 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.402+0000 7f4dd6229700 1 Processor -- start 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dd6229700 1 -- start start 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dd6229700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dd6229700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd007afd0 con 0x7f4dd0106b10 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33902/0 (socket says 172.21.15.17:33902) 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dcf7fe700 1 -- 172.21.15.17:0/2089087778 learned_addr learned my addr 172.21.15.17:0/2089087778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dcf7fe700 1 -- 172.21.15.17:0/2089087778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd0199eb0 con 0x7f4dd0106b10 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.403+0000 7f4dcf7fe700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00072a0 tx=0x7f4dc000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:27.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.405+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0020020 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.405+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4dc0003b50 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.405+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0017040 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.405+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd019a140 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.405+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd019ce30 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.406+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f4dc0023020 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.406+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd0063900 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.406+0000 7f4dccff9700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 0x7f4dbc03d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.406+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4dc000f050 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.407+0000 7f4dceffd700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 0x7f4dbc03d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.407+0000 7f4dceffd700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 0x7f4dbc03d5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.411+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4dc002a020 con 0x7f4dd0106b10 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.649+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4dd0062710 con 0x7f4dbc03b130 2024-03-16T10:41:27.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.653+0000 7f4dccff9700 1 -- 172.21.15.17:0/2089087778 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4dd0062710 con 0x7f4dbc03b130 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.655+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 msgr2=0x7f4dbc03d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.655+0000 7f4dd6229700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 0x7f4dbc03d5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.655+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 msgr2=0x7f4dd0199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.655+0000 7f4dd6229700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00072a0 tx=0x7f4dc000bd50 comp rx=0 tx=0).stop 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 shutdown_connections 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f4dbc03b130 0x7f4dbc03d5f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 --2- 172.21.15.17:0/2089087778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dd0106b10 0x7f4dd0199970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 >> 172.21.15.17:0/2089087778 conn(0x7f4dd0102090 msgr2=0x7f4dd018ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 shutdown_connections 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:25.656+0000 7f4dd6229700 1 -- 172.21.15.17:0/2089087778 wait complete. 2024-03-16T10:41:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2024-03-16T10:41:28.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:27 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:28.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:27 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeba8a3700 1 Processor -- start 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeba8a3700 1 -- start start 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeba8a3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeba8a3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb41074f0 con 0x7fdeb4106b00 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33908/0 (socket says 172.21.15.17:33908) 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.665+0000 7fdeb3fff700 1 -- 172.21.15.17:0/2859907632 learned_addr learned my addr 172.21.15.17:0/2859907632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.666+0000 7fdeb3fff700 1 -- 172.21.15.17:0/2859907632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb4107d00 con 0x7fdeb4106b00 2024-03-16T10:41:28.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.666+0000 7fdeb3fff700 1 --2- 172.21.15.17:0/2859907632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdea40098a0 tx=0x7fdea4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96efaffdc85a3fca server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.666+0000 7fdeb2ffd700 1 -- 172.21.15.17:0/2859907632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea4004160 con 0x7fdeb4106b00 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.666+0000 7fdeb2ffd700 1 -- 172.21.15.17:0/2859907632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4004300 con 0x7fdeb4106b00 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.666+0000 7fdeb2ffd700 1 -- 172.21.15.17:0/2859907632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea4011b20 con 0x7fdeb4106b00 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- 172.21.15.17:0/2859907632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 msgr2=0x7fdeb4106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/2859907632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdea40098a0 tx=0x7fdea4009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- 172.21.15.17:0/2859907632 shutdown_connections 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/2859907632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb4106f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- 172.21.15.17:0/2859907632 >> 172.21.15.17:0/2859907632 conn(0x7fdeb4102060 msgr2=0x7fdeb41044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- 172.21.15.17:0/2859907632 shutdown_connections 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- 172.21.15.17:0/2859907632 wait complete. 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 Processor -- start 2024-03-16T10:41:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.667+0000 7fdeba8a3700 1 -- start start 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeba8a3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeba8a3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb410b0b0 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33916/0 (socket says 172.21.15.17:33916) 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb3fff700 1 -- 172.21.15.17:0/1461474172 learned_addr learned my addr 172.21.15.17:0/1461474172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb3fff700 1 -- 172.21.15.17:0/1461474172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb419c130 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb3fff700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdea40116a0 tx=0x7fdea4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.668+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea4003a40 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.669+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4003be0 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.669+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb419c3c0 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.669+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea401a720 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.669+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb419c820 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.669+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb4063900 con 0x7fdeb4106b00 2024-03-16T10:41:28.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.670+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7fdea4024aa0 con 0x7fdeb4106b00 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.670+0000 7fdeb17fa700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 0x7fde9c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.670+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdea404d370 con 0x7fdeb4106b00 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.670+0000 7fdeb37fe700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 0x7fde9c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.670+0000 7fdeb37fe700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 0x7fde9c03b3e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.675+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fdea4011e20 con 0x7fdeb4106b00 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.894+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fdeb4062710 con 0x7fde9c038f20 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.899+0000 7fdeb17fa700 1 -- 172.21.15.17:0/1461474172 <== mgr.14118 v2:172.21.15.17:6800/1123613371 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdeb4062710 con 0x7fde9c038f20 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 msgr2=0x7fde9c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 0x7fde9c03b3e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 msgr2=0x7fdeb419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdea40116a0 tx=0x7fdea4011ba0 comp rx=0 tx=0).stop 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 shutdown_connections 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fde9c038f20 0x7fde9c03b3e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:28.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 --2- 172.21.15.17:0/1461474172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb4106b00 0x7fdeb419bbf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:28.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 >> 172.21.15.17:0/1461474172 conn(0x7fdeb4102060 msgr2=0x7fdeb4102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:28.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 shutdown_connections 2024-03-16T10:41:28.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:27.901+0000 7fdeba8a3700 1 -- 172.21.15.17:0/1461474172 wait complete. 2024-03-16T10:41:29.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:28 smithi017 ceph-mon[32078]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:29.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:28 smithi017 ceph-mon[32078]: Saving service mgr spec with placement count:2 2024-03-16T10:41:29.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:28 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:30.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:30 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1520805866' entity='client.admin' 2024-03-16T10:41:30.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:30 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:30.382 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.857+0000 7f5f9c71a700 1 Processor -- start 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.857+0000 7f5f9c71a700 1 -- start start 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.857+0000 7f5f9c71a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9c71a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f94109bc0 con 0x7f5f941091d0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9a4b6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9a4b6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33932/0 (socket says 172.21.15.17:33932) 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9a4b6700 1 -- 172.21.15.17:0/702107944 learned_addr learned my addr 172.21.15.17:0/702107944 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9a4b6700 1 -- 172.21.15.17:0/702107944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f94109d40 con 0x7f5f941091d0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f9a4b6700 1 --2- 172.21.15.17:0/702107944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098a0 tx=0x7f5f90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fcb94baddfcc2d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f994b4700 1 -- 172.21.15.17:0/702107944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90004160 con 0x7f5f941091d0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f994b4700 1 -- 172.21.15.17:0/702107944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f90004300 con 0x7f5f941091d0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.858+0000 7f5f994b4700 1 -- 172.21.15.17:0/702107944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90011b20 con 0x7f5f941091d0 2024-03-16T10:41:30.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 -- 172.21.15.17:0/702107944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 msgr2=0x7f5f941095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/702107944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f900098a0 tx=0x7f5f90009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 -- 172.21.15.17:0/702107944 shutdown_connections 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/702107944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941095f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 -- 172.21.15.17:0/702107944 >> 172.21.15.17:0/702107944 conn(0x7f5f94101850 msgr2=0x7f5f94103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 -- 172.21.15.17:0/702107944 shutdown_connections 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.859+0000 7f5f9c71a700 1 -- 172.21.15.17:0/702107944 wait complete. 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9c71a700 1 Processor -- start 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9c71a700 1 -- start start 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9c71a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9c71a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9410c1a0 con 0x7f5f941091d0 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9a4b6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9a4b6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33944/0 (socket says 172.21.15.17:33944) 2024-03-16T10:41:30.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9a4b6700 1 -- 172.21.15.17:0/1520805866 learned_addr learned my addr 172.21.15.17:0/1520805866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9a4b6700 1 -- 172.21.15.17:0/1520805866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f94108d30 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f9a4b6700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f900117e0 tx=0x7f5f90011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.860+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90003bf0 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.861+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f9001a910 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.861+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90024970 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.861+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f94106f20 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.861+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f941073e0 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.861+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f5f90022020 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.862+0000 7f5f8b7fe700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 0x7f5f8003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.862+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5f9004d590 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.862+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f94063900 con 0x7f5f941091d0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.862+0000 7f5f99cb5700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 0x7f5f8003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.862+0000 7f5f99cb5700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 0x7f5f8003b3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006fd0 tx=0x7f5f84006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:30.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:28.867+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5f900172b0 con 0x7f5f941091d0 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.079+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5f94107bf0 con 0x7f5f941091d0 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.082+0000 7f5f8b7fe700 1 -- 172.21.15.17:0/1520805866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f5f900320d0 con 0x7f5f941091d0 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 msgr2=0x7f5f8003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 0x7f5f8003b3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006fd0 tx=0x7f5f84006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 msgr2=0x7f5f941087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f900117e0 tx=0x7f5f90011ba0 comp rx=0 tx=0).stop 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 shutdown_connections 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f5f80038f20 0x7f5f8003b3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 --2- 172.21.15.17:0/1520805866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f941091d0 0x7f5f941087f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 >> 172.21.15.17:0/1520805866 conn(0x7f5f94101850 msgr2=0x7f5f94102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 shutdown_connections 2024-03-16T10:41:30.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:29.084+0000 7f5f9c71a700 1 -- 172.21.15.17:0/1520805866 wait complete. 2024-03-16T10:41:31.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.977+0000 7fa4388b9700 1 Processor -- start 2024-03-16T10:41:31.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.977+0000 7fa4388b9700 1 -- start start 2024-03-16T10:41:31.797 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa4388b9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa4388b9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa43407beb0 con 0x7fa434108680 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa43259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa43259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36318/0 (socket says 172.21.15.17:36318) 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa43259c700 1 -- 172.21.15.17:0/3662726171 learned_addr learned my addr 172.21.15.17:0/3662726171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa43259c700 1 -- 172.21.15.17:0/3662726171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43410afb0 con 0x7fa434108680 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.978+0000 7fa43259c700 1 --2- 172.21.15.17:0/3662726171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098a0 tx=0x7fa424009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7536da81f3ad700e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.979+0000 7fa43159a700 1 -- 172.21.15.17:0/3662726171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa424004160 con 0x7fa434108680 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.979+0000 7fa43159a700 1 -- 172.21.15.17:0/3662726171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa424004300 con 0x7fa434108680 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.979+0000 7fa43159a700 1 -- 172.21.15.17:0/3662726171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa424011b20 con 0x7fa434108680 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.979+0000 7fa4388b9700 1 -- 172.21.15.17:0/3662726171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 msgr2=0x7fa43410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.979+0000 7fa4388b9700 1 --2- 172.21.15.17:0/3662726171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098a0 tx=0x7fa424009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- 172.21.15.17:0/3662726171 shutdown_connections 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 --2- 172.21.15.17:0/3662726171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa43410aa70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- 172.21.15.17:0/3662726171 >> 172.21.15.17:0/3662726171 conn(0x7fa434102090 msgr2=0x7fa4341044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- 172.21.15.17:0/3662726171 shutdown_connections 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- 172.21.15.17:0/3662726171 wait complete. 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 Processor -- start 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- start start 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.980+0000 7fa4388b9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa43410c020 con 0x7fa434108680 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa43259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa43259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36324/0 (socket says 172.21.15.17:36324) 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa43259c700 1 -- 172.21.15.17:0/2183998254 learned_addr learned my addr 172.21.15.17:0/2183998254 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa43259c700 1 -- 172.21.15.17:0/2183998254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa434108440 con 0x7fa434108680 2024-03-16T10:41:31.799 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa43259c700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4240117e0 tx=0x7fa424011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa424003bf0 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa42401a910 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa424024970 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa434106630 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.981+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa434106a30 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.982+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7fa424022020 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.982+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa434063900 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.982+0000 7fa4237fe700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 0x7fa41c03b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.982+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa42404d1b0 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.982+0000 7fa431d9b700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 0x7fa41c03b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.983+0000 7fa431d9b700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 0x7fa41c03b390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:30.987+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa424011e20 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.196+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa434107310 con 0x7fa434108680 2024-03-16T10:41:31.800 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.198+0000 7fa4237fe700 1 -- 172.21.15.17:0/2183998254 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa42400ba30 con 0x7fa434108680 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 msgr2=0x7fa41c03b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 0x7fa41c03b390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa428006fd0 tx=0x7fa428006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 msgr2=0x7fa434107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4240117e0 tx=0x7fa424011c10 comp rx=0 tx=0).stop 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 shutdown_connections 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fa41c038ed0 0x7fa41c03b390 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 --2- 172.21.15.17:0/2183998254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434108680 0x7fa434107f00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 >> 172.21.15.17:0/2183998254 conn(0x7fa434102090 msgr2=0x7fa434102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 shutdown_connections 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:31.202+0000 7fa4388b9700 1 -- 172.21.15.17:0/2183998254 wait complete. 2024-03-16T10:41:31.801 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-03-16T10:41:32.366 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:32 smithi017 ceph-mon[32078]: from='mgr.14118 172.21.15.17:0/2974998887' entity='mgr.x' 2024-03-16T10:41:32.366 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:32 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2183998254' entity='client.admin' 2024-03-16T10:41:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:33 smithi017 ceph-mon[32078]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:41:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:33 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1092803662' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-16T10:41:33.590 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: ignoring --setuser ceph since I am not root 2024-03-16T10:41:33.591 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: ignoring --setgroup ceph since I am not root 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d844f700 1 Processor -- start 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d844f700 1 -- start start 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d844f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d844f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52d007beb0 con 0x7f52d0108680 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d61eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d61eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36336/0 (socket says 172.21.15.17:36336) 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.212+0000 7f52d61eb700 1 -- 172.21.15.17:0/3770084179 learned_addr learned my addr 172.21.15.17:0/3770084179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.213+0000 7f52d61eb700 1 -- 172.21.15.17:0/3770084179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d010afb0 con 0x7f52d0108680 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.213+0000 7f52d61eb700 1 --2- 172.21.15.17:0/3770084179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098a0 tx=0x7f52cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76942c5a19bcb09 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.213+0000 7f52d51e9700 1 -- 172.21.15.17:0/3770084179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52cc004160 con 0x7f52d0108680 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.213+0000 7f52d51e9700 1 -- 172.21.15.17:0/3770084179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc004300 con 0x7f52d0108680 2024-03-16T10:41:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.213+0000 7f52d51e9700 1 -- 172.21.15.17:0/3770084179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52cc011b20 con 0x7f52d0108680 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 -- 172.21.15.17:0/3770084179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 msgr2=0x7f52d010aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 --2- 172.21.15.17:0/3770084179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0098a0 tx=0x7f52cc009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 -- 172.21.15.17:0/3770084179 shutdown_connections 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 --2- 172.21.15.17:0/3770084179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d010aa70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 -- 172.21.15.17:0/3770084179 >> 172.21.15.17:0/3770084179 conn(0x7f52d0102090 msgr2=0x7f52d01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 -- 172.21.15.17:0/3770084179 shutdown_connections 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.214+0000 7f52d844f700 1 -- 172.21.15.17:0/3770084179 wait complete. 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d844f700 1 Processor -- start 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d844f700 1 -- start start 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d844f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d844f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52d010c020 con 0x7f52d0108680 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d61eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d61eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36346/0 (socket says 172.21.15.17:36346) 2024-03-16T10:41:33.945 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d61eb700 1 -- 172.21.15.17:0/1092803662 learned_addr learned my addr 172.21.15.17:0/1092803662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.215+0000 7f52d61eb700 1 -- 172.21.15.17:0/1092803662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d019c080 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52d61eb700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0117e0 tx=0x7f52cc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52cc003bf0 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d019c310 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc01a910 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52cc024970 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.216+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d019c770 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.217+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) ==== 46106+0+0 (secure 0 0 0) 0x7f52cc022020 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.217+0000 7f52c77fe700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 0x7f52bc03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.217+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f52cc04d1f0 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.217+0000 7f52d59ea700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 0x7f52bc03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.217+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d0063900 con 0x7f52d0108680 2024-03-16T10:41:33.946 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.218+0000 7f52d59ea700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 0x7f52bc03b3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.222+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f52cc011e20 con 0x7f52d0108680 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:32.497+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f52d019f0a0 con 0x7f52d0108680 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.336+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f52cc00ba30 con 0x7f52d0108680 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.338+0000 7f52c77fe700 1 -- 172.21.15.17:0/1092803662 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 9) ==== 46119+0+0 (secure 0 0 0) 0x7f52cc01a430 con 0x7f52d0108680 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 msgr2=0x7f52bc03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 0x7f52bc03b3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 msgr2=0x7f52d019bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0117e0 tx=0x7f52cc011c10 comp rx=0 tx=0).stop 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 shutdown_connections 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f52bc038f20 0x7f52bc03b3e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 --2- 172.21.15.17:0/1092803662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d0108680 0x7f52d019bb40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 >> 172.21.15.17:0/1092803662 conn(0x7f52d0102090 msgr2=0x7f52d0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 shutdown_connections 2024-03-16T10:41:33.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:33.340+0000 7f52d844f700 1 -- 172.21.15.17:0/1092803662 wait complete. 2024-03-16T10:41:34.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:33.924+0000 7f013ff05200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T10:41:34.187 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:34.028+0000 7f013ff05200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T10:41:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1092803662' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-16T10:41:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-mon[32078]: mgrmap e9: x(active, since 21s) 2024-03-16T10:41:34.943 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:34.698+0000 7f013ff05200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T10:41:34.943 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:34.797+0000 7f013ff05200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T10:41:34.943 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:34.942+0000 7f013ff05200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T10:41:35.209 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.040+0000 7f013ff05200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T10:41:35.209 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.127+0000 7f013ff05200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T10:41:35.211 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:41:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7cabcfb700 1 Processor -- start 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7cabcfb700 1 -- start start 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7cabcfb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7cabcfb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca4107500 con 0x7f7ca4106b10 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7ca9a97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7ca9a97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36374/0 (socket says 172.21.15.17:36374) 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.422+0000 7f7ca9a97700 1 -- 172.21.15.17:0/3004109407 learned_addr learned my addr 172.21.15.17:0/3004109407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7ca9a97700 1 -- 172.21.15.17:0/3004109407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca4107d10 con 0x7f7ca4106b10 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7ca9a97700 1 --2- 172.21.15.17:0/3004109407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00098a0 tx=0x7f7ca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f210e2ba9cf60c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7ca8a95700 1 -- 172.21.15.17:0/3004109407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca0004160 con 0x7f7ca4106b10 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7ca8a95700 1 -- 172.21.15.17:0/3004109407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca0004300 con 0x7f7ca4106b10 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7ca8a95700 1 -- 172.21.15.17:0/3004109407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca0011b20 con 0x7f7ca4106b10 2024-03-16T10:41:35.219 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7cabcfb700 1 -- 172.21.15.17:0/3004109407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 msgr2=0x7f7ca4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.423+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/3004109407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00098a0 tx=0x7f7ca0009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- 172.21.15.17:0/3004109407 shutdown_connections 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/3004109407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca4106f30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- 172.21.15.17:0/3004109407 >> 172.21.15.17:0/3004109407 conn(0x7f7ca4102090 msgr2=0x7f7ca41044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- 172.21.15.17:0/3004109407 shutdown_connections 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- 172.21.15.17:0/3004109407 wait complete. 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 Processor -- start 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- start start 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.424+0000 7f7cabcfb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca410b0c0 con 0x7f7ca4106b10 2024-03-16T10:41:35.220 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7ca9a97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7ca9a97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36388/0 (socket says 172.21.15.17:36388) 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7ca9a97700 1 -- 172.21.15.17:0/2842468452 learned_addr learned my addr 172.21.15.17:0/2842468452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7ca9a97700 1 -- 172.21.15.17:0/2842468452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca419e2e0 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7ca9a97700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00117e0 tx=0x7f7ca0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca0003bf0 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca001a910 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca419e570 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca00249a0 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.425+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca41a1220 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46119+0+0 (secure 0 0 0) 0x7f7ca0022020 con 0x7f7ca4106b10 2024-03-16T10:41:35.221 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca4063900 con 0x7f7ca4106b10 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7c9affd700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 0x7f7c9003b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7ca004d1e0 con 0x7f7ca4106b10 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7ca9296700 1 -- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 msgr2=0x7f7c9003b440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.426+0000 7f7ca9296700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 0x7f7c9003b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.431+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f7ca0011e20 con 0x7f7ca4106b10 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.627+0000 7f7ca9296700 1 -- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 msgr2=0x7f7c9003b440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.627+0000 7f7ca9296700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 0x7f7c9003b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.696+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7ca402de40 con 0x7f7ca4106b10 2024-03-16T10:41:35.222 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.696+0000 7f7c9affd700 1 -- 172.21.15.17:0/2842468452 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7ca0004300 con 0x7f7ca4106b10 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 msgr2=0x7f7c9003b440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 0x7f7c9003b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 msgr2=0x7f7ca419dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00117e0 tx=0x7f7ca0011c10 comp rx=0 tx=0).stop 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 shutdown_connections 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7f7c90038f80 0x7f7c9003b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 --2- 172.21.15.17:0/2842468452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca4106b10 0x7f7ca419dda0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 >> 172.21.15.17:0/2842468452 conn(0x7f7ca4102090 msgr2=0x7f7ca4102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 shutdown_connections 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:34.698+0000 7f7cabcfb700 1 -- 172.21.15.17:0/2842468452 wait complete. 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-03-16T10:41:35.223 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-03-16T10:41:35.519 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2842468452' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-16T10:41:35.520 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.402+0000 7f013ff05200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T10:41:35.520 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.518+0000 7f013ff05200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T10:41:35.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.609+0000 7f013ff05200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T10:41:35.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.709+0000 7f013ff05200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T10:41:36.253 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:35.888+0000 7f013ff05200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T10:41:37.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:36.876+0000 7f013ff05200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T10:41:37.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:37.010+0000 7f013ff05200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T10:41:37.647 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:37.351+0000 7f013ff05200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T10:41:37.647 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:37.444+0000 7f013ff05200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T10:41:37.647 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:37.646+0000 7f013ff05200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:41:38.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:37.837+0000 7f013ff05200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T10:41:38.394 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:38.131+0000 7f013ff05200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:41:38.656 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:38.392+0000 7f013ff05200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T10:41:38.656 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:38.636+0000 7f013ff05200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T10:41:39.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:39.469+0000 7f013ff05200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T10:41:40.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:40.051+0000 7f013ff05200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T10:41:40.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:40.153+0000 7f013ff05200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T10:41:40.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:41:40.378+0000 7f013ff05200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T10:41:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: Active manager daemon x restarted 2024-03-16T10:41:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: Activating manager daemon x 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: osdmap e3: 0 total, 0 up, 0 in 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: mgrmap e10: x(active, starting, since 0.00345685s) 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: Manager daemon x is now available 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:40.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:41.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-16T10:41:41.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-16T10:41:41.694 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:41] ENGINE Bus STARTING 2024-03-16T10:41:41.694 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:41] ENGINE Serving on http://172.21.15.17:8765 2024-03-16T10:41:41.694 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-16T10:41:41.694 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:41 smithi017 ceph-mon[32078]: mgrmap e11: x(active, since 1.00582s) 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb469dab700 1 Processor -- start 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb469dab700 1 -- start start 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb469dab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb469dab700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb46407be70 con 0x7fb4641086c0 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36394/0 (socket says 172.21.15.17:36394) 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.645+0000 7fb4637fe700 1 -- 172.21.15.17:0/2003562101 learned_addr learned my addr 172.21.15.17:0/2003562101 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.646+0000 7fb4637fe700 1 -- 172.21.15.17:0/2003562101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46410aff0 con 0x7fb4641086c0 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.646+0000 7fb4637fe700 1 --2- 172.21.15.17:0/2003562101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb454009e80 tx=0x7fb45400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d6ac362c30c1f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.646+0000 7fb4627fc700 1 -- 172.21.15.17:0/2003562101 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454017070 con 0x7fb4641086c0 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.646+0000 7fb4627fc700 1 -- 172.21.15.17:0/2003562101 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb45400b8c0 con 0x7fb4641086c0 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.646+0000 7fb4627fc700 1 -- 172.21.15.17:0/2003562101 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4540045c0 con 0x7fb4641086c0 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- 172.21.15.17:0/2003562101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 msgr2=0x7fb46410aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 --2- 172.21.15.17:0/2003562101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb454009e80 tx=0x7fb45400b330 comp rx=0 tx=0).stop 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- 172.21.15.17:0/2003562101 shutdown_connections 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 --2- 172.21.15.17:0/2003562101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb46410aab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- 172.21.15.17:0/2003562101 >> 172.21.15.17:0/2003562101 conn(0x7fb464102090 msgr2=0x7fb4641044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- 172.21.15.17:0/2003562101 shutdown_connections 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- 172.21.15.17:0/2003562101 wait complete. 2024-03-16T10:41:42.395 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 Processor -- start 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.647+0000 7fb469dab700 1 -- start start 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb469dab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb469dab700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410c050 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36404/0 (socket says 172.21.15.17:36404) 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb4637fe700 1 -- 172.21.15.17:0/854194363 learned_addr learned my addr 172.21.15.17:0/854194363 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb4637fe700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb464108480 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb4637fe700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b7b0 tx=0x7fb45400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454020020 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb454003d90 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb464106670 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454017040 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.648+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb464106bb0 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.649+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) ==== 46119+0+0 (secure 0 0 0) 0x7fb454023020 con 0x7fb4641086c0 2024-03-16T10:41:42.396 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.650+0000 7fb460ff9700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.650+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb44c03baf0 con 0x7fb44c038f20 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.650+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb45400f050 con 0x7fb4641086c0 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.650+0000 7fb462ffd700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.650+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.851+0000 7fb462ffd700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:35.851+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:36.252+0000 7fb462ffd700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:36.252+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:37.053+0000 7fb462ffd700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:37.053+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:38.654+0000 7fb462ffd700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1123613371 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:38.654+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:40.393+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) ==== 45886+0+0 (secure 0 0 0) 0x7fb45401c6c0 con 0x7fb4641086c0 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:40.393+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 msgr2=0x7fb44c03b3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:40.393+0000 7fb460ff9700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.394+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) ==== 46013+0+0 (secure 0 0 0) 0x7fb45404e630 con 0x7fb4641086c0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.395+0000 7fb460ff9700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 0x7fb44c03ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.395+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb454010950 con 0x7fb44c03c9a0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.395+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 0x7fb44c03ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.396+0000 7fb462ffd700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 0x7fb44c03ed90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb458003a10 tx=0x7fb458009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.396+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7fb454010950 con 0x7fb44c03c9a0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.403+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb464063900 con 0x7fb44c03c9a0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.403+0000 7fb460ff9700 1 -- 172.21.15.17:0/854194363 <== mgr.14150 v2:172.21.15.17:6800/3813203524 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fb464063900 con 0x7fb44c03c9a0 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 msgr2=0x7fb44c03ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 0x7fb44c03ed90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb458003a10 tx=0x7fb458009270 comp rx=0 tx=0).stop 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 msgr2=0x7fb464107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b7b0 tx=0x7fb45400bd50 comp rx=0 tx=0).stop 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 shutdown_connections 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb44c03c9a0 0x7fb44c03ed90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:42.398 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4641086c0 0x7fb464107f40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 --2- 172.21.15.17:0/854194363 >> [v2:172.21.15.17:6800/1123613371,v1:172.21.15.17:6801/1123613371] conn(0x7fb44c038f20 0x7fb44c03b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 >> 172.21.15.17:0/854194363 conn(0x7fb464102090 msgr2=0x7fb464102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 shutdown_connections 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:41.404+0000 7fb469dab700 1 -- 172.21.15.17:0/854194363 wait complete. 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-03-16T10:41:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-03-16T10:41:43.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:43 smithi017 ceph-mon[32078]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-16T10:41:43.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:43 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:41] ENGINE Serving on https://172.21.15.17:7150 2024-03-16T10:41:43.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:43 smithi017 ceph-mon[32078]: [16/Mar/2024:10:41:41] ENGINE Bus STARTED 2024-03-16T10:41:43.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.822+0000 7ff84b523700 1 Processor -- start 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff84b523700 1 -- start start 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff84b523700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff84b523700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff84407be70 con 0x7ff8441086c0 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff8492bf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff8492bf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33918/0 (socket says 172.21.15.17:33918) 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff8492bf700 1 -- 172.21.15.17:0/608385576 learned_addr learned my addr 172.21.15.17:0/608385576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.823+0000 7ff8492bf700 1 -- 172.21.15.17:0/608385576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84410aff0 con 0x7ff8441086c0 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff8492bf700 1 --2- 172.21.15.17:0/608385576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8400098a0 tx=0x7ff840009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4399ce8d42d64a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:43.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff837fff700 1 -- 172.21.15.17:0/608385576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff840004160 con 0x7ff8441086c0 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff837fff700 1 -- 172.21.15.17:0/608385576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840004300 con 0x7ff8441086c0 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff837fff700 1 -- 172.21.15.17:0/608385576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff840011b20 con 0x7ff8441086c0 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff84b523700 1 -- 172.21.15.17:0/608385576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 msgr2=0x7ff84410aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.824+0000 7ff84b523700 1 --2- 172.21.15.17:0/608385576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8400098a0 tx=0x7ff840009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- 172.21.15.17:0/608385576 shutdown_connections 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 --2- 172.21.15.17:0/608385576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff84410aab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- 172.21.15.17:0/608385576 >> 172.21.15.17:0/608385576 conn(0x7ff8441020b0 msgr2=0x7ff8441044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- 172.21.15.17:0/608385576 shutdown_connections 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- 172.21.15.17:0/608385576 wait complete. 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 Processor -- start 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- start start 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.825+0000 7ff84b523700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff84410c050 con 0x7ff8441086c0 2024-03-16T10:41:43.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8492bf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8492bf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33936/0 (socket says 172.21.15.17:33936) 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8492bf700 1 -- 172.21.15.17:0/3567142644 learned_addr learned my addr 172.21.15.17:0/3567142644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8492bf700 1 -- 172.21.15.17:0/3567142644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff844108480 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8492bf700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8400116a0 tx=0x7ff840011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff840003a40 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff844106670 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff840003be0 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84001a750 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.826+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff844106b30 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.827+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 11) ==== 46013+0+0 (secure 0 0 0) 0x7ff84001aa40 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.827+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff844063900 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.828+0000 7ff8367fc700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 0x7ff83003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.828+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff84004d3a0 con 0x7ff8441086c0 2024-03-16T10:41:43.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.828+0000 7ff848abe700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 0x7ff83003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.828+0000 7ff848abe700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 0x7ff83003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff838006fd0 tx=0x7ff838006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:42.833+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff840011e20 con 0x7ff8441086c0 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.042+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7ff844107440 con 0x7ff830038e60 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.060+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 12) ==== 46119+0+0 (secure 0 0 0) 0x7ff84002d910 con 0x7ff8441086c0 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.131+0000 7ff8367fc700 1 -- 172.21.15.17:0/3567142644 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ff844107440 con 0x7ff830038e60 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 msgr2=0x7ff83003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 0x7ff83003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff838006fd0 tx=0x7ff838006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 msgr2=0x7ff844107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8400116a0 tx=0x7ff840011ba0 comp rx=0 tx=0).stop 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 shutdown_connections 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff830038e60 0x7ff83003b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 --2- 172.21.15.17:0/3567142644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8441086c0 0x7ff844107f40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:43.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 >> 172.21.15.17:0/3567142644 conn(0x7ff8441020b0 msgr2=0x7ff844102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:43.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 shutdown_connections 2024-03-16T10:41:43.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:43.133+0000 7ff84b523700 1 -- 172.21.15.17:0/3567142644 wait complete. 2024-03-16T10:41:43.703 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-03-16T10:41:44.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:44 smithi017 ceph-mon[32078]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:44.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:44 smithi017 ceph-mon[32078]: mgrmap e12: x(active, since 2s) 2024-03-16T10:41:44.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:44.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:44.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$BklML8.7/BK51fTp5JgrZOBFhIh9dhGzTI5OjKDjfBrZiRy0lv6Ja", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1710585704, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.088+0000 7f6f684a6700 1 Processor -- start 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.088+0000 7f6f684a6700 1 -- start start 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.088+0000 7f6f684a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.088+0000 7f6f684a6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601068f0 con 0x7f6f60105f00 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f66242700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f66242700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33942/0 (socket says 172.21.15.17:33942) 2024-03-16T10:41:45.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f66242700 1 -- 172.21.15.17:0/2703348046 learned_addr learned my addr 172.21.15.17:0/2703348046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f66242700 1 -- 172.21.15.17:0/2703348046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f60108e90 con 0x7f6f60105f00 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f66242700 1 --2- 172.21.15.17:0/2703348046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f580098a0 tx=0x7f6f58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc05f40b659e4279 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f65240700 1 -- 172.21.15.17:0/2703348046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58004160 con 0x7f6f60105f00 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f65240700 1 -- 172.21.15.17:0/2703348046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f58004300 con 0x7f6f60105f00 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.089+0000 7f6f65240700 1 -- 172.21.15.17:0/2703348046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58011b20 con 0x7f6f60105f00 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 -- 172.21.15.17:0/2703348046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 msgr2=0x7f6f60106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 --2- 172.21.15.17:0/2703348046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f580098a0 tx=0x7f6f58009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 -- 172.21.15.17:0/2703348046 shutdown_connections 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 --2- 172.21.15.17:0/2703348046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f60106320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 -- 172.21.15.17:0/2703348046 >> 172.21.15.17:0/2703348046 conn(0x7f6f60101850 msgr2=0x7f6f60103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 -- 172.21.15.17:0/2703348046 shutdown_connections 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.090+0000 7f6f684a6700 1 -- 172.21.15.17:0/2703348046 wait complete. 2024-03-16T10:41:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f684a6700 1 Processor -- start 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f684a6700 1 -- start start 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f684a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f684a6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6010c240 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f66242700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f66242700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33954/0 (socket says 172.21.15.17:33954) 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.091+0000 7f6f66242700 1 -- 172.21.15.17:0/1556214830 learned_addr learned my addr 172.21.15.17:0/1556214830 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f66242700 1 -- 172.21.15.17:0/1556214830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6019c0c0 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f66242700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f580117e0 tx=0x7f6f58011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58003bf0 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f5801a910 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6019c350 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6019c7b0 con 0x7f6f60105f00 2024-03-16T10:41:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.092+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f580249a0 con 0x7f6f60105f00 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.093+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f60063900 con 0x7f6f60105f00 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.093+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46119+0+0 (secure 0 0 0) 0x7f6f58022020 con 0x7f6f60105f00 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.094+0000 7f6f5f7fe700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 0x7f6f4803b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.094+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6f5804d2a0 con 0x7f6f60105f00 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.094+0000 7f6f65a41700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 0x7f6f4803b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.094+0000 7f6f65a41700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 0x7f6f4803b440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f54006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.102+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f6f58011e20 con 0x7f6f60105f00 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.332+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f6f6019f1e0 con 0x7f6f48038f80 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.578+0000 7f6f5f7fe700 1 -- 172.21.15.17:0/1556214830 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f6f6019f1e0 con 0x7f6f48038f80 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 msgr2=0x7f6f4803b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 0x7f6f4803b440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f54006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 msgr2=0x7f6f6019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f580117e0 tx=0x7f6f58011c10 comp rx=0 tx=0).stop 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 shutdown_connections 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6f48038f80 0x7f6f4803b440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 --2- 172.21.15.17:0/1556214830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f60105f00 0x7f6f6019bb80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 >> 172.21.15.17:0/1556214830 conn(0x7f6f60101850 msgr2=0x7f6f60102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 shutdown_connections 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:44.581+0000 7f6f684a6700 1 -- 172.21.15.17:0/1556214830 wait complete. 2024-03-16T10:41:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-03-16T10:41:45.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:45 smithi017 ceph-mon[32078]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:45.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:46.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:46 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/573971636' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.626+0000 7f47fcd6a700 1 Processor -- start 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.626+0000 7f47fcd6a700 1 -- start start 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.626+0000 7f47fcd6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.626+0000 7f47fcd6a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8108660 con 0x7f47f8107d00 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.628+0000 7f47f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.628+0000 7f47f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33964/0 (socket says 172.21.15.17:33964) 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.628+0000 7f47f659c700 1 -- 172.21.15.17:0/1059038779 learned_addr learned my addr 172.21.15.17:0/1059038779 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:46.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.628+0000 7f47f659c700 1 -- 172.21.15.17:0/1059038779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81087e0 con 0x7f47f8107d00 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.628+0000 7f47f659c700 1 --2- 172.21.15.17:0/1059038779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47e80098a0 tx=0x7f47e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fe504ae89b4892 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.629+0000 7f47f559a700 1 -- 172.21.15.17:0/1059038779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e8004160 con 0x7f47f8107d00 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.629+0000 7f47f559a700 1 -- 172.21.15.17:0/1059038779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e8004300 con 0x7f47f8107d00 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.629+0000 7f47f559a700 1 -- 172.21.15.17:0/1059038779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e8011b20 con 0x7f47f8107d00 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.629+0000 7f47fcd6a700 1 -- 172.21.15.17:0/1059038779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 msgr2=0x7f47f8108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.629+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/1059038779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47e80098a0 tx=0x7f47e8009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 -- 172.21.15.17:0/1059038779 shutdown_connections 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/1059038779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f8108120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 -- 172.21.15.17:0/1059038779 >> 172.21.15.17:0/1059038779 conn(0x7f47f8103360 msgr2=0x7f47f8105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 -- 172.21.15.17:0/1059038779 shutdown_connections 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 -- 172.21.15.17:0/1059038779 wait complete. 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 Processor -- start 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 -- start start 2024-03-16T10:41:46.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.630+0000 7f47fcd6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47fcd6a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47f810c120 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33972/0 (socket says 172.21.15.17:33972) 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47f659c700 1 -- 172.21.15.17:0/573971636 learned_addr learned my addr 172.21.15.17:0/573971636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47f659c700 1 -- 172.21.15.17:0/573971636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f819e260 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47f659c700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47e80117e0 tx=0x7f47e8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e8003ba0 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e801a910 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e80248f0 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.631+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f819e4f0 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.632+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f819e950 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.632+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f8063900 con 0x7f47f8107d00 2024-03-16T10:41:46.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.633+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46119+0+0 (secure 0 0 0) 0x7f47e8022020 con 0x7f47f8107d00 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.633+0000 7f47e77fe700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 0x7f47e003b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.633+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f47e804d3c0 con 0x7f47f8107d00 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.633+0000 7f47f5d9b700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 0x7f47e003b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.634+0000 7f47f5d9b700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 0x7f47e003b490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47ec006fd0 tx=0x7f47ec006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.642+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f47e801ab70 con 0x7f47f8107d00 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.850+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f47f81a13b0 con 0x7f47f8107d00 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.851+0000 7f47e77fe700 1 -- 172.21.15.17:0/573971636 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f47e802d3f0 con 0x7f47f8107d00 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 msgr2=0x7f47e003b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 0x7f47e003b490 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47ec006fd0 tx=0x7f47ec006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 msgr2=0x7f47f819dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47e80117e0 tx=0x7f47e8011ba0 comp rx=0 tx=0).stop 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 shutdown_connections 2024-03-16T10:41:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f47e0038fd0 0x7f47e003b490 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:46.647 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 --2- 172.21.15.17:0/573971636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f8107d00 0x7f47f819dd20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:46.647 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 >> 172.21.15.17:0/573971636 conn(0x7f47f8103360 msgr2=0x7f47f8103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:46.647 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 shutdown_connections 2024-03-16T10:41:46.647 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:45.853+0000 7f47fcd6a700 1 -- 172.21.15.17:0/573971636 wait complete. 2024-03-16T10:41:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-16T10:41:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-03-16T10:41:46.656 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-16T10:41:46.656 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-03-16T10:41:46.656 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-03-16T10:41:46.656 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: Password: o8779xuzm0 2024-03-16T10:41:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:46.659 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config directory 2024-03-16T10:41:46.659 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling autotune for osd_memory_target 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.051+0000 7fa4f4e1c700 1 Processor -- start 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.051+0000 7fa4f4e1c700 1 -- start start 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4f4e1c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4f4e1c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01085a0 con 0x7fa4f0107c40 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33980/0 (socket says 172.21.15.17:33980) 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ee59c700 1 -- 172.21.15.17:0/2219097814 learned_addr learned my addr 172.21.15.17:0/2219097814 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ee59c700 1 -- 172.21.15.17:0/2219097814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f0108720 con 0x7fa4f0107c40 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ee59c700 1 --2- 172.21.15.17:0/2219097814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098a0 tx=0x7fa4e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46ebf2a53d8c80e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ed59a700 1 -- 172.21.15.17:0/2219097814 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0004160 con 0x7fa4f0107c40 2024-03-16T10:41:47.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ed59a700 1 -- 172.21.15.17:0/2219097814 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0004300 con 0x7fa4f0107c40 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.052+0000 7fa4ed59a700 1 -- 172.21.15.17:0/2219097814 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0011b20 con 0x7fa4f0107c40 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2219097814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 msgr2=0x7fa4f0108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2219097814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098a0 tx=0x7fa4e0009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2219097814 shutdown_connections 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2219097814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f0108060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2219097814 >> 172.21.15.17:0/2219097814 conn(0x7fa4f01032a0 msgr2=0x7fa4f01056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2219097814 shutdown_connections 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.053+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2219097814 wait complete. 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4f4e1c700 1 Processor -- start 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4f4e1c700 1 -- start start 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4f4e1c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4f4e1c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f010c0b0 con 0x7fa4f0107c40 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:47.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33988/0 (socket says 172.21.15.17:33988) 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4ee59c700 1 -- 172.21.15.17:0/2540028783 learned_addr learned my addr 172.21.15.17:0/2540028783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.054+0000 7fa4ee59c700 1 -- 172.21.15.17:0/2540028783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f019c0c0 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4ee59c700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00116a0 tx=0x7fa4e0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0003a40 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0003be0 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f019c350 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e001a750 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.055+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f019c7b0 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) ==== 46119+0+0 (secure 0 0 0) 0x7fa4e0024430 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0063900 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4df7fe700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 0x7fa4d803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa4e004d660 con 0x7fa4f0107c40 2024-03-16T10:41:47.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4edd9b700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 0x7fa4d803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.056+0000 7fa4edd9b700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 0x7fa4d803b3e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.061+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa4e0011e20 con 0x7fa4f0107c40 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.067+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fa4e002d3f0 con 0x7fa4f0107c40 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.267+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fa4f019f040 con 0x7fa4f0107c40 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.267+0000 7fa4df7fe700 1 -- 172.21.15.17:0/2540028783 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fa4e000fd00 con 0x7fa4f0107c40 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 msgr2=0x7fa4d803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 0x7fa4d803b3e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 msgr2=0x7fa4f019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00116a0 tx=0x7fa4e0011ba0 comp rx=0 tx=0).stop 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 shutdown_connections 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4d8038f20 0x7fa4d803b3e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 --2- 172.21.15.17:0/2540028783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0107c40 0x7fa4f019bb80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 >> 172.21.15.17:0/2540028783 conn(0x7fa4f01032a0 msgr2=0x7fa4f0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 shutdown_connections 2024-03-16T10:41:47.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:47.269+0000 7fa4f4e1c700 1 -- 172.21.15.17:0/2540028783 wait complete. 2024-03-16T10:41:48.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:48 smithi017 ceph-mon[32078]: mgrmap e13: x(active, since 6s) 2024-03-16T10:41:49.026 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.162+0000 7f4550dd5700 1 Processor -- start 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.162+0000 7f4550dd5700 1 -- start start 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f4550dd5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f4550dd5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f454c07be30 con 0x7f454c1086f0 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34002/0 (socket says 172.21.15.17:34002) 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454a59c700 1 -- 172.21.15.17:0/2965881307 learned_addr learned my addr 172.21.15.17:0/2965881307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:49.032 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454a59c700 1 -- 172.21.15.17:0/2965881307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c10b020 con 0x7f454c1086f0 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454a59c700 1 --2- 172.21.15.17:0/2965881307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f453c0098a0 tx=0x7f453c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1965da16760b6d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454959a700 1 -- 172.21.15.17:0/2965881307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c004160 con 0x7f454c1086f0 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.163+0000 7f454959a700 1 -- 172.21.15.17:0/2965881307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f453c004300 con 0x7f454c1086f0 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f454959a700 1 -- 172.21.15.17:0/2965881307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c011b20 con 0x7f454c1086f0 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 -- 172.21.15.17:0/2965881307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 msgr2=0x7f454c10aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2965881307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f453c0098a0 tx=0x7f453c009bb0 comp rx=0 tx=0).stop 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 -- 172.21.15.17:0/2965881307 shutdown_connections 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2965881307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c10aae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 -- 172.21.15.17:0/2965881307 >> 172.21.15.17:0/2965881307 conn(0x7f454c102060 msgr2=0x7f454c1044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 -- 172.21.15.17:0/2965881307 shutdown_connections 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.164+0000 7f4550dd5700 1 -- 172.21.15.17:0/2965881307 wait complete. 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f4550dd5700 1 Processor -- start 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f4550dd5700 1 -- start start 2024-03-16T10:41:49.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f4550dd5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f4550dd5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f454c10c020 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f454a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f454a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34016/0 (socket says 172.21.15.17:34016) 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.165+0000 7f454a59c700 1 -- 172.21.15.17:0/2697889534 learned_addr learned my addr 172.21.15.17:0/2697889534 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f454a59c700 1 -- 172.21.15.17:0/2697889534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c19c0c0 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f454a59c700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f453c011b60 tx=0x7f453c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c003b60 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c19c350 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f453c01a910 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c024930 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.166+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c19c7b0 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f453c022020 con 0x7f454c1086f0 2024-03-16T10:41:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f45437fe700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 0x7f453803b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c063900 con 0x7f454c1086f0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f453c04d340 con 0x7f454c1086f0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f4549d9b700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 0x7f453803b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.167+0000 7f4549d9b700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 0x7f453803b4d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.172+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f453c0151c0 con 0x7f454c1086f0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.492+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f454c19f180 con 0x7f454c1086f0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.494+0000 7f45437fe700 1 -- 172.21.15.17:0/2697889534 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f453c02d3f0 con 0x7f454c1086f0 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 msgr2=0x7f453803b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 0x7f453803b4d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 msgr2=0x7f454c19bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f453c011b60 tx=0x7f453c011c40 comp rx=0 tx=0).stop 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 shutdown_connections 2024-03-16T10:41:49.035 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4538039010 0x7f453803b4d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 --2- 172.21.15.17:0/2697889534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f454c1086f0 0x7f454c19bb80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.496+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 >> 172.21.15.17:0/2697889534 conn(0x7f454c102060 msgr2=0x7f454c102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.497+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 shutdown_connections 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-03-16T10:41:48.497+0000 7f4550dd5700 1 -- 172.21.15.17:0/2697889534 wait complete. 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.036 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:41:49.037 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-03-16T10:41:49.072 INFO:tasks.cephadm:Fetching config... 2024-03-16T10:41:49.072 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:41:49.072 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-16T10:41:49.087 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-16T10:41:49.087 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:41:49.087 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-16T10:41:49.141 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-16T10:41:49.141 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:41:49.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-16T10:41:49.208 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-16T10:41:49.208 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:41:49.208 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-16T10:41:49.263 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-16T10:41:49.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T10:41:49.342 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:49.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T10:41:49.402 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:49.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-16T10:41:49.465 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv38PiFLdVzN2CI5isgk+KAsBJoxByadpimMgl203UhcqSDJe1xcQzw7wAmHwZb4/A73qX9v9p/kEU6nb8mrf5WaxI6khWMC+bW0TjoXWPkv1i1fk7BaMfMKVl9/8Z3mJ5gZcBuP2/XlYEDsdDVNTfu9kH3DWH9EkW1cjaE4WcLbSdQiukqe/W0Oqei68T8DTW8Ok2a6tsPEiWzNR2xuumnSFei1O+OAJlKv8rU+mBhra8fLc8nNwXABsGXzFOfWpATZ2nmU+DnXjad8kPusi8t7Ts53pOboGLagAn+X5bHEV8396PKkt/Smsz+lhWZPUH3TmEqVjaFT1oh8l+h1KQmz1Qoin3rRy7gVjO6WC2f9JEZVOk3tAbvIW+iSHYiV3vUZcLOpvB0oy66MH2SkAm3EB44iSWUL0IMS2RYdW9g6ik5wt07DUI6guc99GOKgA21+j/h+AiJnfhTN5v+RIONliMg7tS37/VUR3az9vivZ9RHSrk98HNUDvjhKfmFRk= ceph-811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:41:49.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-16T10:41:49.577 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:49 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2697889534' entity='client.admin' 2024-03-16T10:41:49.721 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:41:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/3787351423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 msgr2=0x7fbdbc102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/3787351423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc102140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009910 tx=0x7fbdb0009c20 comp rx=0 tx=0).stop 2024-03-16T10:41:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/3787351423 shutdown_connections 2024-03-16T10:41:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/3787351423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc102140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/3787351423 >> 172.21.15.17:0/3787351423 conn(0x7fbdbc0fd2c0 msgr2=0x7fbdbc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/3787351423 shutdown_connections 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.024+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/3787351423 wait complete. 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc2c8a700 1 Processor -- start 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc2c8a700 1 -- start start 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc2c8a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc2c8a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc107db0 con 0x7fbdbc101d20 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc0a26700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc0a26700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50650/0 (socket says 172.21.15.17:50650) 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.025+0000 7fbdc0a26700 1 -- 172.21.15.17:0/2093617488 learned_addr learned my addr 172.21.15.17:0/2093617488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:52.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdc0a26700 1 -- 172.21.15.17:0/2093617488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc0764d0 con 0x7fbdbc101d20 2024-03-16T10:41:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdc0a26700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0006010 tx=0x7fbdb0005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb0027070 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb000be40 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc0746c0 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb000f460 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.026+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc074c00 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.027+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fbdb002a070 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.027+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc108530 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.027+0000 7fbdb9ffb700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 0x7fbdac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.027+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbdb001e030 con 0x7fbdbc101d20 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.028+0000 7fbdbbfff700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 0x7fbdac03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.028+0000 7fbdbbfff700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 0x7fbdac03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:52.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.032+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbdb0013070 con 0x7fbdbc101d20 2024-03-16T10:41:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.241+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fbdbc190830 con 0x7fbdbc101d20 2024-03-16T10:41:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.243+0000 7fbdb9ffb700 1 -- 172.21.15.17:0/2093617488 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fbdb0031070 con 0x7fbdbc101d20 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 msgr2=0x7fbdac03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 0x7fbdac03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 msgr2=0x7fbdbc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0006010 tx=0x7fbdb0005050 comp rx=0 tx=0).stop 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 shutdown_connections 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbdac038fc0 0x7fbdac03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 --2- 172.21.15.17:0/2093617488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdbc101d20 0x7fbdbc075f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 >> 172.21.15.17:0/2093617488 conn(0x7fbdbc0fd2c0 msgr2=0x7fbdbc0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 shutdown_connections 2024-03-16T10:41:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:52.246+0000 7fbdc2c8a700 1 -- 172.21.15.17:0/2093617488 wait complete. 2024-03-16T10:41:52.911 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-16T10:41:52.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-16T10:41:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:41:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:53 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2093617488' entity='client.admin' 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:54.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 -- 172.21.15.17:0/1245231683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 msgr2=0x7f7348102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 --2- 172.21.15.17:0/1245231683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f7348102140 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f733800b0a0 tx=0x7f733800b3b0 comp rx=0 tx=0).stop 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 -- 172.21.15.17:0/1245231683 shutdown_connections 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 --2- 172.21.15.17:0/1245231683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f7348102140 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 -- 172.21.15.17:0/1245231683 >> 172.21.15.17:0/1245231683 conn(0x7f73480fd2c0 msgr2=0x7f73480ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 -- 172.21.15.17:0/1245231683 shutdown_connections 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.072+0000 7f7350152700 1 -- 172.21.15.17:0/1245231683 wait complete. 2024-03-16T10:41:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f7350152700 1 Processor -- start 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f7350152700 1 -- start start 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f7350152700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f7350152700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7348107db0 con 0x7f7348101d20 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f734deee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f734deee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50664/0 (socket says 172.21.15.17:50664) 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f734deee700 1 -- 172.21.15.17:0/992575480 learned_addr learned my addr 172.21.15.17:0/992575480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:55.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f734deee700 1 -- 172.21.15.17:0/992575480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7348197900 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.073+0000 7f734deee700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7338007890 tx=0x7f733800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338017040 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7338022070 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7348197b90 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f733801d5b0 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734819a880 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.074+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f7338004000 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.075+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7348108530 con 0x7f7348101d20 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.075+0000 7f7346ffd700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 0x7f733003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:55.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.075+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f733800f050 con 0x7f7348101d20 2024-03-16T10:41:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.075+0000 7f734d6ed700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 0x7f733003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:55.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.075+0000 7f734d6ed700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 0x7f733003b4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:55.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.080+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f7338007e20 con 0x7f7348101d20 2024-03-16T10:41:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.290+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f734802dc80 con 0x7f7330039000 2024-03-16T10:41:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.294+0000 7f7346ffd700 1 -- 172.21.15.17:0/992575480 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f734802dc80 con 0x7f7330039000 2024-03-16T10:41:55.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 msgr2=0x7f733003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:55.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 0x7f733003b4c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c006e40 comp rx=0 tx=0).stop 2024-03-16T10:41:55.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 msgr2=0x7f73481973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:55.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7338007890 tx=0x7f733800bd40 comp rx=0 tx=0).stop 2024-03-16T10:41:55.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 shutdown_connections 2024-03-16T10:41:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7330039000 0x7f733003b4c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 --2- 172.21.15.17:0/992575480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7348101d20 0x7f73481973c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 >> 172.21.15.17:0/992575480 conn(0x7f73480fd2c0 msgr2=0x7f73480fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 shutdown_connections 2024-03-16T10:41:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:55.296+0000 7f7350152700 1 -- 172.21.15.17:0/992575480 wait complete. 2024-03-16T10:41:56.081 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi111 2024-03-16T10:41:56.082 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:41:56.082 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.conf 2024-03-16T10:41:56.101 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:41:56.101 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:41:56.158 INFO:tasks.cephadm:Adding host smithi111 to orchestrator... 2024-03-16T10:41:56.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch host add smithi111 2024-03-16T10:41:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:41:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:41:56.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:41:56.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: Updating smithi017:/etc/ceph/ceph.conf 2024-03-16T10:41:56.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:56.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:56.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:41:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:41:57.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:57 smithi017 ceph-mon[32078]: Updating smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:41:57.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:57 smithi017 ceph-mon[32078]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:41:57.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:57 smithi017 ceph-mon[32078]: Updating smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- 172.21.15.17:0/906801879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 msgr2=0x7fbc2c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 --2- 172.21.15.17:0/906801879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c1011f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009910 tx=0x7fbc1c009c20 comp rx=0 tx=0).stop 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- 172.21.15.17:0/906801879 shutdown_connections 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 --2- 172.21.15.17:0/906801879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c1011f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- 172.21.15.17:0/906801879 >> 172.21.15.17:0/906801879 conn(0x7fbc2c0fc6a0 msgr2=0x7fbc2c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- 172.21.15.17:0/906801879 shutdown_connections 2024-03-16T10:41:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- 172.21.15.17:0/906801879 wait complete. 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 Processor -- start 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.895+0000 7fbc327d1700 1 -- start start 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc327d1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc327d1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c10b1e0 con 0x7fbc2c100e10 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc2bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50688/0 (socket says 172.21.15.17:50688) 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc2bfff700 1 -- 172.21.15.17:0/843538692 learned_addr learned my addr 172.21.15.17:0/843538692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc2bfff700 1 -- 172.21.15.17:0/843538692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c19d970 con 0x7fbc2c100e10 2024-03-16T10:41:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc2bfff700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c005850 tx=0x7fbc1c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1c026070 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c00bbd0 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.896+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c19dc60 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.897+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc1c003970 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.897+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c1975f0 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.897+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fbc1c029070 con 0x7fbc2c100e10 2024-03-16T10:41:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.898+0000 7fbc297fa700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 0x7fbc1803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:41:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.898+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbc1c01e070 con 0x7fbc2c100e10 2024-03-16T10:41:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.898+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c1022f0 con 0x7fbc2c100e10 2024-03-16T10:41:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.898+0000 7fbc2b7fe700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 0x7fbc1803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:41:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.898+0000 7fbc2b7fe700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 0x7fbc1803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc14006fd0 tx=0x7fbc14006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:41:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:57.903+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbc1c030070 con 0x7fbc2c100e10 2024-03-16T10:41:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:41:58.112+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}) -- 0x7fbc2c063900 con 0x7fbc18038fc0 2024-03-16T10:41:58.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:58 smithi017 ceph-mon[32078]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:41:59.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:41:59 smithi017 ceph-mon[32078]: Deploying cephadm binary to smithi111 2024-03-16T10:42:00.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:00 smithi017 ceph-mon[32078]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.476+0000 7fbc297fa700 1 -- 172.21.15.17:0/843538692 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbc2c063900 con 0x7fbc18038fc0 2024-03-16T10:42:02.478 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi111' with addr '172.21.15.111' 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 msgr2=0x7fbc1803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 0x7fbc1803b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc14006fd0 tx=0x7fbc14006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 msgr2=0x7fbc2c19d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c005850 tx=0x7fbc1c005030 comp rx=0 tx=0).stop 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 shutdown_connections 2024-03-16T10:42:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc18038fc0 0x7fbc1803b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 --2- 172.21.15.17:0/843538692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc2c100e10 0x7fbc2c19d430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 >> 172.21.15.17:0/843538692 conn(0x7fbc2c0fc6a0 msgr2=0x7fbc2c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 shutdown_connections 2024-03-16T10:42:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:02.479+0000 7fbc327d1700 1 -- 172.21.15.17:0/843538692 wait complete. 2024-03-16T10:42:02.737 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:02 smithi017 ceph-mon[32078]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:03.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch host ls --format=json 2024-03-16T10:42:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:03.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:03 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:03.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:03 smithi017 ceph-mon[32078]: Added host smithi111 2024-03-16T10:42:03.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:03 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:03.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:03 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:04.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:04.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:04 smithi017 ceph-mon[32078]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:04.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- 172.21.15.17:0/209902600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 msgr2=0x7f20781011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:04.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 --2- 172.21.15.17:0/209902600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781011f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2068009910 tx=0x7f2068009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:04.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- 172.21.15.17:0/209902600 shutdown_connections 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 --2- 172.21.15.17:0/209902600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781011f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- 172.21.15.17:0/209902600 >> 172.21.15.17:0/209902600 conn(0x7f20780fc6c0 msgr2=0x7f20780feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- 172.21.15.17:0/209902600 shutdown_connections 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- 172.21.15.17:0/209902600 wait complete. 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 Processor -- start 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.790+0000 7f207e38e700 1 -- start start 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f207e38e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:04.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f207e38e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f207810b1e0 con 0x7f2078100e10 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f2077fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f2077fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55714/0 (socket says 172.21.15.17:55714) 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f2077fff700 1 -- 172.21.15.17:0/4181085938 learned_addr learned my addr 172.21.15.17:0/4181085938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f2077fff700 1 -- 172.21.15.17:0/4181085938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078196c30 con 0x7f2078100e10 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f2077fff700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2068005850 tx=0x7f2068005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068026070 con 0x7f2078100e10 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2078196f20 con 0x7f2078100e10 2024-03-16T10:42:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.791+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f206800bbd0 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.792+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068003970 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.792+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207819afc0 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.792+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f2068029070 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.792+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20781022f0 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.793+0000 7f20757fa700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 0x7f206003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.793+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f206801e070 con 0x7f2078100e10 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.793+0000 7f20777fe700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 0x7f206003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.793+0000 7f20777fe700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 0x7f206003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f206c006fd0 tx=0x7f206c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:04.798+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f2068013070 con 0x7f2078100e10 2024-03-16T10:42:05.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.007+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2078197a50 con 0x7f2060038fc0 2024-03-16T10:42:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.008+0000 7f20757fa700 1 -- 172.21.15.17:0/4181085938 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f2078197a50 con 0x7f2060038fc0 2024-03-16T10:42:05.010 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:42:05.010 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}] 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 msgr2=0x7f206003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 0x7f206003b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f206c006fd0 tx=0x7f206c006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 msgr2=0x7f20781966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2068005850 tx=0x7f2068005030 comp rx=0 tx=0).stop 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 shutdown_connections 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2060038fc0 0x7f206003b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 --2- 172.21.15.17:0/4181085938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2078100e10 0x7f20781966f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 >> 172.21.15.17:0/4181085938 conn(0x7f20780fc6c0 msgr2=0x7f20781027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 shutdown_connections 2024-03-16T10:42:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:05.011+0000 7f207e38e700 1 -- 172.21.15.17:0/4181085938 wait complete. 2024-03-16T10:42:05.611 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-03-16T10:42:05.611 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:42:05.611 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-03-16T10:42:05.630 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:42:05.630 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:05.688 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-03-16T10:42:05.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch host add smithi174 2024-03-16T10:42:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:06.295 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:06 smithi017 ceph-mon[32078]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:42:06.295 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:07.172 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:07 smithi017 ceph-mon[32078]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 -- 172.21.15.17:0/2512902297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 msgr2=0x7f3c6c100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 --2- 172.21.15.17:0/2512902297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c100970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009910 tx=0x7f3c5c009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 -- 172.21.15.17:0/2512902297 shutdown_connections 2024-03-16T10:42:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 --2- 172.21.15.17:0/2512902297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c100970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 -- 172.21.15.17:0/2512902297 >> 172.21.15.17:0/2512902297 conn(0x7f3c6c0fbe20 msgr2=0x7f3c6c0fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 -- 172.21.15.17:0/2512902297 shutdown_connections 2024-03-16T10:42:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.382+0000 7f3c71d72700 1 -- 172.21.15.17:0/2512902297 wait complete. 2024-03-16T10:42:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c71d72700 1 Processor -- start 2024-03-16T10:42:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c71d72700 1 -- start start 2024-03-16T10:42:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c71d72700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c71d72700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10a960 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c6b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c6b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55736/0 (socket says 172.21.15.17:55736) 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c6b7fe700 1 -- 172.21.15.17:0/554294384 learned_addr learned my addr 172.21.15.17:0/554294384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c6b7fe700 1 -- 172.21.15.17:0/554294384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c19dac0 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.383+0000 7f3c6b7fe700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c005850 tx=0x7f3c5c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c026070 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c5c00bbd0 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c19ddb0 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c003970 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c197820 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.384+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f3c5c029070 con 0x7f3c6c100590 2024-03-16T10:42:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.385+0000 7f3c68ff9700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 0x7f3c5403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.385+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c5c01e070 con 0x7f3c6c100590 2024-03-16T10:42:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.385+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c101a70 con 0x7f3c6c100590 2024-03-16T10:42:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.385+0000 7f3c6affd700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 0x7f3c5403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.385+0000 7f3c6affd700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 0x7f3c5403b4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.391+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f3c5c030070 con 0x7f3c6c100590 2024-03-16T10:42:07.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:07.600+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}) -- 0x7f3c6c0008d0 con 0x7f3c54039020 2024-03-16T10:42:09.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:09.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:09.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: Updating smithi111:/etc/ceph/ceph.conf 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: Deploying cephadm binary to smithi174 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: Updating smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:09.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:09 smithi017 ceph-mon[32078]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:10 smithi017 ceph-mon[32078]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:11.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:11 smithi017 ceph-mon[32078]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:11.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.837+0000 7f3c68ff9700 1 -- 172.21.15.17:0/554294384 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3c6c0008d0 con 0x7f3c54039020 2024-03-16T10:42:11.838 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 msgr2=0x7f3c5403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 0x7f3c5403b4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 msgr2=0x7f3c6c19d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c005850 tx=0x7f3c5c005030 comp rx=0 tx=0).stop 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 shutdown_connections 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3c54039020 0x7f3c5403b4e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 --2- 172.21.15.17:0/554294384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c100590 0x7f3c6c19d580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 >> 172.21.15.17:0/554294384 conn(0x7f3c6c0fbe20 msgr2=0x7f3c6c108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 shutdown_connections 2024-03-16T10:42:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:11.840+0000 7f3c71d72700 1 -- 172.21.15.17:0/554294384 wait complete. 2024-03-16T10:42:12.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: Updating smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:12.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch host ls --format=json 2024-03-16T10:42:12.718 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:13.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:13 smithi017 ceph-mon[32078]: Added host smithi174 2024-03-16T10:42:13.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:13 smithi017 ceph-mon[32078]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:13.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.268+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/3068894816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 msgr2=0x7f0ae01022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.268+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/3068894816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae01022f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009910 tx=0x7f0adc009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/3068894816 shutdown_connections 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/3068894816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae01022f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/3068894816 >> 172.21.15.17:0/3068894816 conn(0x7f0ae00fd7e0 msgr2=0x7f0ae00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/3068894816 shutdown_connections 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/3068894816 wait complete. 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 Processor -- start 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- start start 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.269+0000 7f0ae7cf2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae010c2e0 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae5a8e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae5a8e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35106/0 (socket says 172.21.15.17:35106) 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae5a8e700 1 -- 172.21.15.17:0/1391296036 learned_addr learned my addr 172.21.15.17:0/1391296036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae5a8e700 1 -- 172.21.15.17:0/1391296036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae019db20 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae5a8e700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0adc005850 tx=0x7f0adc005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc026070 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0adc00bbd0 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc003970 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae019de10 con 0x7f0ae0101f10 2024-03-16T10:42:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.270+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae0197880 con 0x7f0ae0101f10 2024-03-16T10:42:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.271+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f0adc029070 con 0x7f0ae0101f10 2024-03-16T10:42:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.271+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae01033f0 con 0x7f0ae0101f10 2024-03-16T10:42:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.271+0000 7f0ad6ffd700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 0x7f0acc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.271+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0adc01e070 con 0x7f0ae0101f10 2024-03-16T10:42:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.271+0000 7f0ae528d700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 0x7f0acc03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.272+0000 7f0ae528d700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 0x7f0acc03b4e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006fd0 tx=0x7f0ad0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.276+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f0adc013070 con 0x7f0ae0101f10 2024-03-16T10:42:14.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.488+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ae0198be0 con 0x7f0acc039020 2024-03-16T10:42:14.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.489+0000 7f0ad6ffd700 1 -- 172.21.15.17:0/1391296036 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f0ae0198be0 con 0x7f0acc039020 2024-03-16T10:42:14.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:42:14.490 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-03-16T10:42:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 msgr2=0x7f0acc03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 0x7f0acc03b4e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006fd0 tx=0x7f0ad0006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 msgr2=0x7f0ae019d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0adc005850 tx=0x7f0adc005030 comp rx=0 tx=0).stop 2024-03-16T10:42:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 shutdown_connections 2024-03-16T10:42:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0acc039020 0x7f0acc03b4e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 --2- 172.21.15.17:0/1391296036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ae0101f10 0x7f0ae019d5e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 >> 172.21.15.17:0/1391296036 conn(0x7f0ae00fd7e0 msgr2=0x7f0ae0104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 shutdown_connections 2024-03-16T10:42:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:14.491+0000 7f0ae7cf2700 1 -- 172.21.15.17:0/1391296036 wait complete. 2024-03-16T10:42:15.135 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-16T10:42:15.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd crush tunables default 2024-03-16T10:42:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:15.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:15 smithi017 ceph-mon[32078]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:15.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:16.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:16 smithi017 ceph-mon[32078]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- 172.21.15.17:0/3928840518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 msgr2=0x7fa8901022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 --2- 172.21.15.17:0/3928840518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa8901022f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa880009910 tx=0x7fa880009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- 172.21.15.17:0/3928840518 shutdown_connections 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 --2- 172.21.15.17:0/3928840518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa8901022f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- 172.21.15.17:0/3928840518 >> 172.21.15.17:0/3928840518 conn(0x7fa8900fd7e0 msgr2=0x7fa8900ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- 172.21.15.17:0/3928840518 shutdown_connections 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- 172.21.15.17:0/3928840518 wait complete. 2024-03-16T10:42:16.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 Processor -- start 2024-03-16T10:42:16.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.796+0000 7fa8962d3700 1 -- start start 2024-03-16T10:42:16.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa8962d3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:16.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa8962d3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa89010c2e0 con 0x7fa890101f10 2024-03-16T10:42:16.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:16.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35130/0 (socket says 172.21.15.17:35130) 2024-03-16T10:42:16.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88ffff700 1 -- 172.21.15.17:0/262447006 learned_addr learned my addr 172.21.15.17:0/262447006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88ffff700 1 -- 172.21.15.17:0/262447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89019daf0 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88ffff700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa880005850 tx=0x7fa880005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa880026070 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88000bbd0 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89019dde0 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa880003970 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.797+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa890197850 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.798+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fa880029070 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.798+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8901033f0 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.798+0000 7fa88d7fa700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 0x7fa87803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.798+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa88001e070 con 0x7fa890101f10 2024-03-16T10:42:16.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.799+0000 7fa88f7fe700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 0x7fa87803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:16.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.799+0000 7fa88f7fe700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 0x7fa87803b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa884006fd0 tx=0x7fa884006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:16.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:16.803+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa880013070 con 0x7fa890101f10 2024-03-16T10:42:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.017+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa890198bb0 con 0x7fa890101f10 2024-03-16T10:42:17.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.407+0000 7fa88d7fa700 1 -- 172.21.15.17:0/262447006 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa880030090 con 0x7fa890101f10 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 msgr2=0x7fa87803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 0x7fa87803b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa884006fd0 tx=0x7fa884006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 msgr2=0x7fa89019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa880005850 tx=0x7fa880005030 comp rx=0 tx=0).stop 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 shutdown_connections 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa878039020 0x7fa87803b4e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 --2- 172.21.15.17:0/262447006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa890101f10 0x7fa89019d5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:17.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 >> 172.21.15.17:0/262447006 conn(0x7fa8900fd7e0 msgr2=0x7fa890104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 shutdown_connections 2024-03-16T10:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:17.409+0000 7fa8962d3700 1 -- 172.21.15.17:0/262447006 wait complete. 2024-03-16T10:42:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-03-16T10:42:17.695 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:17.695 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/262447006' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-16T10:42:17.695 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:17 smithi017 ceph-mon[32078]: Updating smithi174:/etc/ceph/ceph.conf 2024-03-16T10:42:17.990 INFO:tasks.cephadm:Adding mon.a on smithi017 2024-03-16T10:42:17.990 INFO:tasks.cephadm:Adding mon.b on smithi111 2024-03-16T10:42:17.990 INFO:tasks.cephadm:Adding mon.c on smithi174 2024-03-16T10:42:17.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi111:172.21.15.111=b;smithi174:172.21.15.174=c' 2024-03-16T10:42:18.226 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/262447006' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-16T10:42:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T10:42:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: Updating smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:18.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: Updating smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-16T10:42:18.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:18.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:18.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:18.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:18 smithi017 ceph-mon[32078]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:19.637 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 -- 172.21.15.174:0/4182886955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 msgr2=0x7fd5181011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:19.637 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 --2- 172.21.15.174:0/4182886955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd5181011f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd508009910 tx=0x7fd508009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:19.637 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 -- 172.21.15.174:0/4182886955 shutdown_connections 2024-03-16T10:42:19.637 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 --2- 172.21.15.174:0/4182886955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd5181011f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:19.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 -- 172.21.15.174:0/4182886955 >> 172.21.15.174:0/4182886955 conn(0x7fd5180fc6c0 msgr2=0x7fd5180feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:19.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 -- 172.21.15.174:0/4182886955 shutdown_connections 2024-03-16T10:42:19.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.636+0000 7fd51d86e700 1 -- 172.21.15.174:0/4182886955 wait complete. 2024-03-16T10:42:19.638 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd51d86e700 1 Processor -- start 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd51d86e700 1 -- start start 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd51d86e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd51d86e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd51810b1e0 con 0x7fd518100e10 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd516ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd516ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.174:58792/0 (socket says 172.21.15.174:58792) 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.637+0000 7fd516ffd700 1 -- 172.21.15.174:0/2300729128 learned_addr learned my addr 172.21.15.174:0/2300729128 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd516ffd700 1 -- 172.21.15.174:0/2300729128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51819d990 con 0x7fd518100e10 2024-03-16T10:42:19.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd516ffd700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd508005850 tx=0x7fd508005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:19.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508026070 con 0x7fd518100e10 2024-03-16T10:42:19.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51819dc80 con 0x7fd518100e10 2024-03-16T10:42:19.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd50800bbd0 con 0x7fd518100e10 2024-03-16T10:42:19.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508003970 con 0x7fd518100e10 2024-03-16T10:42:19.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.638+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd518197610 con 0x7fd518100e10 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.639+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5181022f0 con 0x7fd518100e10 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.639+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fd508029070 con 0x7fd518100e10 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.639+0000 7fd51c86c700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 0x7fd50003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.639+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd50801e070 con 0x7fd518100e10 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.640+0000 7fd5167fc700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 0x7fd50003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:19.641 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.640+0000 7fd5167fc700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 0x7fd50003b480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006fd0 tx=0x7fd50c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:19.645 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.645+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd508013070 con 0x7fd518100e10 2024-03-16T10:42:19.853 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.852+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi111:172.21.15.111=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}) -- 0x7fd518198b40 con 0x7fd500038fc0 2024-03-16T10:42:19.859 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.859+0000 7fd51c86c700 1 -- 172.21.15.174:0/2300729128 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd518198b40 con 0x7fd500038fc0 2024-03-16T10:42:19.859 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-03-16T10:42:19.861 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 msgr2=0x7fd50003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 0x7fd50003b480 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006fd0 tx=0x7fd50c006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 msgr2=0x7fd51819d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd508005850 tx=0x7fd508005030 comp rx=0 tx=0).stop 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 shutdown_connections 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd500038fc0 0x7fd50003b480 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 --2- 172.21.15.174:0/2300729128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd518100e10 0x7fd51819d450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 >> 172.21.15.174:0/2300729128 conn(0x7fd5180fc6c0 msgr2=0x7fd51806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 shutdown_connections 2024-03-16T10:42:19.862 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:19.861+0000 7fd51d86e700 1 -- 172.21.15.174:0/2300729128 wait complete. 2024-03-16T10:42:20.440 DEBUG:teuthology.orchestra.run.smithi111:mon.b> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.b.service 2024-03-16T10:42:20.443 DEBUG:teuthology.orchestra.run.smithi174:mon.c> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.c.service 2024-03-16T10:42:20.445 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T10:42:20.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T10:42:21.014 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:21.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi111:172.21.15.111=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi111:172.21.15.111=b;smithi174:172.21.15.174=c;count:3 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: Deploying daemon mon.c on smithi174 2024-03-16T10:42:21.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:20 smithi017 ceph-mon[32078]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:22 smithi017 ceph-mon[32078]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:23.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 -- 172.21.15.174:0/3747001648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 msgr2=0x7fab8c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:23.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 --2- 172.21.15.174:0/3747001648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1011e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009910 tx=0x7fab7c009c20 comp rx=0 tx=0).stop 2024-03-16T10:42:23.061 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 -- 172.21.15.174:0/3747001648 shutdown_connections 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 --2- 172.21.15.174:0/3747001648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1011e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 -- 172.21.15.174:0/3747001648 >> 172.21.15.174:0/3747001648 conn(0x7fab8c077810 msgr2=0x7fab8c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 -- 172.21.15.174:0/3747001648 shutdown_connections 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.058+0000 7fab90dde700 1 -- 172.21.15.174:0/3747001648 wait complete. 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.059+0000 7fab90dde700 1 Processor -- start 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.059+0000 7fab90dde700 1 -- start start 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.059+0000 7fab90dde700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab90dde700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c10a0c0 con 0x7fab8c100e00 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab8a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab8a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.174:58800/0 (socket says 172.21.15.174:58800) 2024-03-16T10:42:23.062 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab8a59c700 1 -- 172.21.15.174:0/361379943 learned_addr learned my addr 172.21.15.174:0/361379943 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab8a59c700 1 -- 172.21.15.174:0/361379943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c195b10 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab8a59c700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005850 tx=0x7fab7c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c026070 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c195e00 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c00bbd0 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c003970 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.060+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c199ea0 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.061+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c1022e0 con 0x7fab8c100e00 2024-03-16T10:42:23.064 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.061+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fab7c029070 con 0x7fab8c100e00 2024-03-16T10:42:23.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.062+0000 7fab7b7fe700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 0x7fab7403d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:23.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.062+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab7c01e070 con 0x7fab8c100e00 2024-03-16T10:42:23.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.062+0000 7fab89d9b700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 0x7fab7403d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:23.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.062+0000 7fab89d9b700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 0x7fab7403d6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:23.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.067+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fab7c013070 con 0x7fab8c100e00 2024-03-16T10:42:23.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.346+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fab8c196930 con 0x7fab8c100e00 2024-03-16T10:42:23.348 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.347+0000 7fab7b7fe700 1 -- 172.21.15.174:0/361379943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fab7c030090 con 0x7fab8c100e00 2024-03-16T10:42:23.348 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:42:23.349 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","modified":"2024-03-16T10:40:42.508418Z","created":"2024-03-16T10:40:42.508418Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 msgr2=0x7fab7403d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 0x7fab7403d6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab80006e40 comp rx=0 tx=0).stop 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 msgr2=0x7fab8c1955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab7c005850 tx=0x7fab7c005030 comp rx=0 tx=0).stop 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 shutdown_connections 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fab7403b220 0x7fab7403d6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 --2- 172.21.15.174:0/361379943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c100e00 0x7fab8c1955d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 >> 172.21.15.174:0/361379943 conn(0x7fab8c077810 msgr2=0x7fab8c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 shutdown_connections 2024-03-16T10:42:23.351 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:23.349+0000 7fab90dde700 1 -- 172.21.15.174:0/361379943 wait complete. 2024-03-16T10:42:23.352 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-03-16T10:42:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:23 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/361379943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:24 smithi017 ceph-mon[32078]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:25.488 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T10:42:25.488 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T10:42:25.720 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:42:30.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 -- 172.21.15.174:0/2232294575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d180035c0 msgr2=0x7f5d18005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 --2- 172.21.15.174:0/2232294575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d180035c0 0x7f5d18005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d30101cd0 tx=0x7f5d20014ec0 comp rx=0 tx=0).stop 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 -- 172.21.15.174:0/2232294575 shutdown_connections 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 --2- 172.21.15.174:0/2232294575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d180035c0 0x7f5d18005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 -- 172.21.15.174:0/2232294575 >> 172.21.15.174:0/2232294575 conn(0x7f5d300fd8d0 msgr2=0x7f5d300ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 -- 172.21.15.174:0/2232294575 shutdown_connections 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.826+0000 7f5d368b5700 1 -- 172.21.15.174:0/2232294575 wait complete. 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.827+0000 7f5d368b5700 1 Processor -- start 2024-03-16T10:42:30.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.827+0000 7f5d368b5700 1 -- start start 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d368b5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d368b5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 0x7f5d30197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d368b5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30109e30 con 0x7f5d3019dbb0 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d368b5700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30109cb0 con 0x7f5d180035c0 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44972/0 (socket says 172.21.15.174:44972) 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 -- 172.21.15.174:0/141495823 learned_addr learned my addr 172.21.15.174:0/141495823 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2f7fe700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 0x7f5d30197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:30.831 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 -- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 msgr2=0x7f5d3019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 -- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 msgr2=0x7f5d3019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.828+0000 7f5d2ffff700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2f7fe700 1 -- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 msgr2=0x7f5d3019d670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2f7fe700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2f7fe700 1 -- 172.21.15.174:0/141495823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3019e130 con 0x7f5d3019dbb0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2f7fe700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 0x7f5d30197740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400b4d0 tx=0x7f5d2400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5d24011630 con 0x7f5d3019dbb0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d24011cb0 con 0x7f5d3019dbb0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d30197ce0 con 0x7f5d3019dbb0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5d24010e60 con 0x7f5d3019dbb0 2024-03-16T10:42:30.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.829+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d30198270 con 0x7f5d3019dbb0 2024-03-16T10:42:30.833 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.830+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f5d24018020 con 0x7f5d3019dbb0 2024-03-16T10:42:30.833 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.830+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d301034e0 con 0x7f5d3019dbb0 2024-03-16T10:42:30.833 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.830+0000 7f5d2d7fa700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 0x7f5d1c03b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:30.833 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.831+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5d2404ba90 con 0x7f5d3019dbb0 2024-03-16T10:42:30.834 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.831+0000 7f5d2ffff700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 0x7f5d1c03b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:30.834 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.831+0000 7f5d2ffff700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 0x7f5d1c03b1d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000f470 tx=0x7f5d20021040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:30.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:30.836+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5d2401f020 con 0x7f5d3019dbb0 2024-03-16T10:42:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:42:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: mon.a calling monitor election 2024-03-16T10:42:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: mon.c calling monitor election 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: monmap epoch 2 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: last_changed 2024-03-16T10:42:25.421321+0000 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: created 2024-03-16T10:40:42.508418+0000 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: min_mon_release 19 (squid) 2024-03-16T10:42:30.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: election_strategy: 1 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: fsmap 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: mgrmap e13: x(active, since 50s) 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: overall HEALTH_OK 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:30.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:31.114 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.112+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5d30063900 con 0x7f5d3019dbb0 2024-03-16T10:42:31.114 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.113+0000 7f5d2d7fa700 1 -- 172.21.15.174:0/141495823 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5d24018310 con 0x7f5d3019dbb0 2024-03-16T10:42:31.115 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:42:31.115 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","modified":"2024-03-16T10:42:25.421321Z","created":"2024-03-16T10:40:42.508418Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 msgr2=0x7f5d1c03b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 0x7f5d1c03b1d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000f470 tx=0x7f5d20021040 comp rx=0 tx=0).stop 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 msgr2=0x7f5d30197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 0x7f5d30197740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400b4d0 tx=0x7f5d2400b890 comp rx=0 tx=0).stop 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 shutdown_connections 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d1c038d10 0x7f5d1c03b1d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d180035c0 0x7f5d3019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 --2- 172.21.15.174:0/141495823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3019dbb0 0x7f5d30197740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 >> 172.21.15.174:0/141495823 conn(0x7f5d300fd8d0 msgr2=0x7f5d300feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 shutdown_connections 2024-03-16T10:42:31.117 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:31.115+0000 7f5d368b5700 1 -- 172.21.15.174:0/141495823 wait complete. 2024-03-16T10:42:31.118 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-03-16T10:42:31.719 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:31 smithi174 ceph-mon[36202]: Deploying daemon mon.b on smithi111 2024-03-16T10:42:31.719 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:31 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/141495823' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:31.719 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:31.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:31 smithi017 ceph-mon[32078]: Deploying daemon mon.b on smithi111 2024-03-16T10:42:31.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:31 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/141495823' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:31.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:32.751 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-16T10:42:32.752 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-16T10:42:32.783 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:32 smithi174 ceph-mon[36202]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:32.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:32 smithi017 ceph-mon[32078]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:32.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:42:32 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:42:32.421+0000 7f00f60a7700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-16T10:42:32.994 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:42:39.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:42:39.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: mon.a calling monitor election 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: mon.c calling monitor election 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: mon.b calling monitor election 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: monmap epoch 3 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: last_changed 2024-03-16T10:42:34.225332+0000 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: created 2024-03-16T10:40:42.508418+0000 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: min_mon_release 19 (squid) 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: election_strategy: 1 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: 2: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.b 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: fsmap 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: mgrmap e13: x(active, since 58s) 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: overall HEALTH_OK 2024-03-16T10:42:39.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: mon.a calling monitor election 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: mon.c calling monitor election 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: mon.b calling monitor election 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-16T10:42:39.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: monmap epoch 3 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: last_changed 2024-03-16T10:42:34.225332+0000 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: created 2024-03-16T10:40:42.508418+0000 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: min_mon_release 19 (squid) 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: election_strategy: 1 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: 2: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.b 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: fsmap 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: osdmap e4: 0 total, 0 up, 0 in 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: mgrmap e13: x(active, since 58s) 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: overall HEALTH_OK 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:39.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:40.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 -- 172.21.15.174:0/622125895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2418006230 msgr2=0x7f24180086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:40.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 --2- 172.21.15.174:0/622125895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2418006230 0x7f24180086a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f243006a710 tx=0x7f242400fe90 comp rx=0 tx=0).stop 2024-03-16T10:42:40.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 -- 172.21.15.174:0/622125895 shutdown_connections 2024-03-16T10:42:40.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 --2- 172.21.15.174:0/622125895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2418006230 0x7f24180086a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 -- 172.21.15.174:0/622125895 >> 172.21.15.174:0/622125895 conn(0x7f24300fc7d0 msgr2=0x7f24300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 -- 172.21.15.174:0/622125895 shutdown_connections 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.459+0000 7f2435a8f700 1 -- 172.21.15.174:0/622125895 wait complete. 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 Processor -- start 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 -- start start 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2430101120 0x7f24301015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 0x7f24301a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2430109df0 con 0x7f24301a3d00 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2430109c70 con 0x7f2430101120 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.460+0000 7f2435a8f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2430109f70 con 0x7f2418006230 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:48440/0 (socket says 172.21.15.174:48440) 2024-03-16T10:42:40.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 -- 172.21.15.174:0/3348618082 learned_addr learned my addr 172.21.15.174:0/3348618082 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242ffff700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 0x7f24301a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242effd700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2430101120 0x7f24301015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 -- 172.21.15.174:0/3348618082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2430101120 msgr2=0x7f24301015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2430101120 0x7f24301015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 -- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 msgr2=0x7f24301a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 0x7f24301a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 -- 172.21.15.174:0/3348618082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24301a67c0 con 0x7f2418006230 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242ffff700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 0x7f24301a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242f7fe700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2424012c80 tx=0x7f2424012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424011d20 con 0x7f2418006230 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f242401d410 con 0x7f2418006230 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24301a6a50 con 0x7f2418006230 2024-03-16T10:42:40.466 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24240038e0 con 0x7f2418006230 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.461+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24301a6f30 con 0x7f2418006230 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.462+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f2424003b40 con 0x7f2418006230 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.462+0000 7f242cff9700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 0x7f241c03b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.462+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f242404f090 con 0x7f2418006230 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.462+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2430063900 con 0x7f2418006230 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.463+0000 7f242effd700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 0x7f241c03b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:40.467 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.463+0000 7f242effd700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 0x7f241c03b910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2420009ad0 tx=0x7f2420009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:40.470 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.469+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f2424024310 con 0x7f2418006230 2024-03-16T10:42:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:40.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:40.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:42:40.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.751+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f243002db70 con 0x7f2418006230 2024-03-16T10:42:40.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.752+0000 7f242cff9700 1 -- 172.21.15.174:0/3348618082 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f242401d630 con 0x7f2418006230 2024-03-16T10:42:40.753 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-03-16T10:42:40.753 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","modified":"2024-03-16T10:42:34.225332Z","created":"2024-03-16T10:40:42.508418Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 msgr2=0x7f241c03b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 0x7f241c03b910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2420009ad0 tx=0x7f2420009210 comp rx=0 tx=0).stop 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 msgr2=0x7f2430100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2424012c80 tx=0x7f2424012cb0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 shutdown_connections 2024-03-16T10:42:40.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f241c039450 0x7f241c03b910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24301a3d00 0x7f24301a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2418006230 0x7f2430100be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 --2- 172.21.15.174:0/3348618082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2430101120 0x7f24301015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 >> 172.21.15.174:0/3348618082 conn(0x7f24300fc7d0 msgr2=0x7f2430103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 shutdown_connections 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:40.754+0000 7f2435a8f700 1 -- 172.21.15.174:0/3348618082 wait complete. 2024-03-16T10:42:40.756 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 3 2024-03-16T10:42:41.451 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-16T10:42:41.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph config generate-minimal-conf 2024-03-16T10:42:41.696 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/3348618082' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:41.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:41.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:41.818 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/3348618082' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:41.820 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/3348618082' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:41.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:42.761 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi017:/etc/ceph/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi111:/etc/ceph/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi174:/etc/ceph/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Updating smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: Reconfiguring daemon mon.a on smithi017 2024-03-16T10:42:42.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:42 smithi017 ceph-mon[32078]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi017:/etc/ceph/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi111:/etc/ceph/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi174:/etc/ceph/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Updating smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: Reconfiguring daemon mon.a on smithi017 2024-03-16T10:42:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:42 smithi174 ceph-mon[36202]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:42.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi017:/etc/ceph/ceph.conf 2024-03-16T10:42:42.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi111:/etc/ceph/ceph.conf 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi174:/etc/ceph/ceph.conf 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Updating smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Reconfiguring mon.a (unknown last config time)... 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: Reconfiguring daemon mon.a on smithi017 2024-03-16T10:42:42.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:42 smithi111 ceph-mon[36315]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 -- 172.21.15.17:0/1990131905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c101b70 msgr2=0x7f8e5c10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 --2- 172.21.15.17:0/1990131905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c101b70 0x7f8e5c10e050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400b0a0 tx=0x7f8e5400b3b0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 -- 172.21.15.17:0/1990131905 shutdown_connections 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 --2- 172.21.15.17:0/1990131905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c101b70 0x7f8e5c10e050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 --2- 172.21.15.17:0/1990131905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 0x7f8e5c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 --2- 172.21.15.17:0/1990131905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 -- 172.21.15.17:0/1990131905 >> 172.21.15.17:0/1990131905 conn(0x7f8e5c078100 msgr2=0x7f8e5c078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 -- 172.21.15.17:0/1990131905 shutdown_connections 2024-03-16T10:42:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.217+0000 7f8e616cb700 1 -- 172.21.15.17:0/1990131905 wait complete. 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 Processor -- start 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 -- start start 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c101b70 0x7f8e5c199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 0x7f8e5c1a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c111460 con 0x7f8e5c1011d0 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c1112e0 con 0x7f8e5c101b70 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e616cb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c1115e0 con 0x7f8e5c107210 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46070/0 (socket says 172.21.15.17:46070) 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 -- 172.21.15.17:0/3767777943 learned_addr learned my addr 172.21.15.17:0/3767777943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5a7fc700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c101b70 0x7f8e5c199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5b7fe700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 0x7f8e5c1a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 -- 172.21.15.17:0/3767777943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 msgr2=0x7f8e5c1a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 0x7f8e5c1a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 -- 172.21.15.17:0/3767777943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c101b70 msgr2=0x7f8e5c199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c101b70 0x7f8e5c199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.218+0000 7f8e5affd700 1 -- 172.21.15.17:0/3767777943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1a4e00 con 0x7f8e5c1011d0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e5affd700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d980 tx=0x7f8e4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c016070 con 0x7f8e5c1011d0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e4c004d10 con 0x7f8e5c1011d0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c1a4fd0 con 0x7f8e5c1011d0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c005670 con 0x7f8e5c1011d0 2024-03-16T10:42:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.219+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c1a5530 con 0x7f8e5c1011d0 2024-03-16T10:42:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7f8e4c00f690 con 0x7f8e5c1011d0 2024-03-16T10:42:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c068f90 con 0x7f8e5c1011d0 2024-03-16T10:42:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e43fff700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 0x7f8e4403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8e4c04be10 con 0x7f8e5c1011d0 2024-03-16T10:42:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e5a7fc700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 0x7f8e4403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.220+0000 7f8e5a7fc700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 0x7f8e4403b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0786e0 tx=0x7f8e50009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.225+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8e4c01f020 con 0x7f8e5c1011d0 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.430+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f8e5c02db70 con 0x7f8e5c1011d0 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.431+0000 7f8e43fff700 1 -- 172.21.15.17:0/3767777943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f8e4c004ec0 con 0x7f8e5c1011d0 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:42:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 msgr2=0x7f8e4403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 0x7f8e4403b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0786e0 tx=0x7f8e50009260 comp rx=0 tx=0).stop 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 msgr2=0x7f8e5c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d980 tx=0x7f8e4c00dc90 comp rx=0 tx=0).stop 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 shutdown_connections 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8e44039200 0x7f8e4403b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e5c107210 0x7f8e5c1a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e5c1011d0 0x7f8e5c199840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 --2- 172.21.15.17:0/3767777943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e5c101b70 0x7f8e5c199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 >> 172.21.15.17:0/3767777943 conn(0x7f8e5c078100 msgr2=0x7f8e5c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 shutdown_connections 2024-03-16T10:42:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:44.434+0000 7f8e616cb700 1 -- 172.21.15.17:0/3767777943 wait complete. 2024-03-16T10:42:44.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: Reconfiguring mon.b (monmap changed)... 2024-03-16T10:42:44.443 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:44.443 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:44.443 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:44.443 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:44 smithi111 ceph-mon[36315]: Reconfiguring daemon mon.b on smithi111 2024-03-16T10:42:44.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: Reconfiguring mon.b (monmap changed)... 2024-03-16T10:42:44.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:44.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:44.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:44.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:44 smithi017 ceph-mon[32078]: Reconfiguring daemon mon.b on smithi111 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: Reconfiguring mon.b (monmap changed)... 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:44 smithi174 ceph-mon[36202]: Reconfiguring daemon mon.b on smithi111 2024-03-16T10:42:45.083 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-16T10:42:45.083 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:42:45.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T10:42:45.112 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:42:45.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:45.179 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:42:45.179 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T10:42:45.208 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:42:45.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:45.275 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:42:45.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-03-16T10:42:45.304 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:42:45.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-16T10:42:45.371 INFO:tasks.cephadm:Adding mgr.x on smithi017 2024-03-16T10:42:45.371 INFO:tasks.cephadm:Adding mgr.y on smithi111 2024-03-16T10:42:45.371 INFO:tasks.cephadm:Adding mgr.z on smithi174 2024-03-16T10:42:45.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch apply mgr '3;smithi017=x;smithi111=y;smithi174=z' 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3767777943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:45.480 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3767777943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3767777943' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-16T10:42:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:46.011 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:42:46.407 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:46 smithi174 ceph-mon[36202]: Reconfiguring mon.c (monmap changed)... 2024-03-16T10:42:46.407 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:46 smithi174 ceph-mon[36202]: Reconfiguring daemon mon.c on smithi174 2024-03-16T10:42:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:46 smithi111 ceph-mon[36315]: Reconfiguring mon.c (monmap changed)... 2024-03-16T10:42:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:46 smithi111 ceph-mon[36315]: Reconfiguring daemon mon.c on smithi174 2024-03-16T10:42:46.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:46 smithi017 ceph-mon[32078]: Reconfiguring mon.c (monmap changed)... 2024-03-16T10:42:46.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:46 smithi017 ceph-mon[32078]: Reconfiguring daemon mon.c on smithi174 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:47.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:47.700 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:47.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:47.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:47.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:47.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:47.894 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 -- 172.21.15.174:0/1430212105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102da0 msgr2=0x7fedcc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/1430212105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102da0 0x7fedcc109650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b0a0 tx=0x7fedc400b3b0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 -- 172.21.15.174:0/1430212105 shutdown_connections 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/1430212105 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/1430212105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102da0 0x7fedcc109650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/1430212105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102400 0x7fedcc102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 -- 172.21.15.174:0/1430212105 >> 172.21.15.174:0/1430212105 conn(0x7fedcc0fc7a0 msgr2=0x7fedcc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 -- 172.21.15.174:0/1430212105 shutdown_connections 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.891+0000 7fedd1dcf700 1 -- 172.21.15.174:0/1430212105 wait complete. 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 Processor -- start 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 -- start start 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:47.895 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102da0 0x7fedcc19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10ce70 con 0x7fedcc102da0 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10ccf0 con 0x7fedcc101200 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedd1dcf700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10cff0 con 0x7fedcc102400 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:48454/0 (socket says 172.21.15.174:48454) 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedc3fff700 1 -- 172.21.15.174:0/4068517406 learned_addr learned my addr 172.21.15.174:0/4068517406 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedcb7fe700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedc3fff700 1 -- 172.21.15.174:0/4068517406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 msgr2=0x7fedcc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedcbfff700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102da0 0x7fedcc19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.892+0000 7fedc3fff700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc3fff700 1 -- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102da0 msgr2=0x7fedcc19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:47.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc3fff700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102da0 0x7fedcc19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc3fff700 1 -- 172.21.15.174:0/4068517406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc1a0130 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedcb7fe700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc3fff700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c9b0 tx=0x7fedb400cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4007b00 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedb4007ca0 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc1a0420 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4018780 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.893+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc1a09e0 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.894+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fedb400f450 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.894+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc068f90 con 0x7fedcc102400 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.894+0000 7fedc97fa700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 0x7fedb803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:47.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.894+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fedb404c170 con 0x7fedcc102400 2024-03-16T10:42:47.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.894+0000 7fedcb7fe700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 0x7fedb803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:47.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.895+0000 7fedcb7fe700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 0x7fedb803b6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedbc006fd0 tx=0x7fedbc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:47.900 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:47.899+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fedb4014030 con 0x7fedcc102400 2024-03-16T10:42:48.104 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.103+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi111=y;smithi174=z", "target": ["mon-mgr", ""]}) -- 0x7fedcc0627a0 con 0x7fedb8039200 2024-03-16T10:42:48.110 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.109+0000 7fedc97fa700 1 -- 172.21.15.174:0/4068517406 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fedcc0627a0 con 0x7fedb8039200 2024-03-16T10:42:48.110 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mgr update... 2024-03-16T10:42:48.112 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.111+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 msgr2=0x7fedb803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.111+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 0x7fedb803b6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedbc006fd0 tx=0x7fedbc008040 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 msgr2=0x7fedcc19d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c9b0 tx=0x7fedb400cd70 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 shutdown_connections 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fedb8039200 0x7fedb803b6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedcc101200 0x7fedcc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102da0 0x7fedcc19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 --2- 172.21.15.174:0/4068517406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedcc102400 0x7fedcc19d1d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 >> 172.21.15.174:0/4068517406 conn(0x7fedcc0fc7a0 msgr2=0x7fedcc1056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 shutdown_connections 2024-03-16T10:42:48.113 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:42:48.112+0000 7fedd1dcf700 1 -- 172.21.15.174:0/4068517406 wait complete. 2024-03-16T10:42:48.672 DEBUG:teuthology.orchestra.run.smithi111:mgr.y> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.y.service 2024-03-16T10:42:48.675 DEBUG:teuthology.orchestra.run.smithi174:mgr.z> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.z.service 2024-03-16T10:42:48.677 INFO:tasks.cephadm:Deploying OSDs... 2024-03-16T10:42:48.677 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:42:48.677 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T10:42:48.695 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T10:42:48.695 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-16 10:41:52.651058663 +0000 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-16 10:37:05.021982766 +0000 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-16 10:37:05.021982766 +0000 2024-03-16T10:42:48.753 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-16 10:37:05.021982766 +0000 2024-03-16T10:42:48.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T10:42:48.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-16T10:42:48.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-16T10:42:48.823 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000122838 s, 4.2 MB/s 2024-03-16T10:42:48.824 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T10:42:48.883 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-16 10:41:52.686058334 +0000 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-16 10:37:05.361979575 +0000 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-16 10:37:05.361979575 +0000 2024-03-16T10:42:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-16 10:37:05.361979575 +0000 2024-03-16T10:42:48.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T10:42:49.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-16T10:42:49.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-16T10:42:49.006 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000115286 s, 4.4 MB/s 2024-03-16T10:42:49.007 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T10:42:49.064 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-16 10:41:52.720058015 +0000 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-16 10:37:05.689976495 +0000 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-16 10:37:05.689976495 +0000 2024-03-16T10:42:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-16 10:37:05.689976495 +0000 2024-03-16T10:42:49.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T10:42:49.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-16T10:42:49.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-16T10:42:49.188 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000112115 s, 4.6 MB/s 2024-03-16T10:42:49.189 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T10:42:49.246 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-03-16T10:42:49.300 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-16 10:41:52.753057705 +0000 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-16 10:37:06.025973340 +0000 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-16 10:37:06.025973340 +0000 2024-03-16T10:42:49.301 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-16 10:37:06.025973340 +0000 2024-03-16T10:42:49.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi111=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: Saving service mgr spec with placement smithi017=x;smithi111=y;smithi174=z;count:3 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:49.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: Deploying daemon mgr.z on smithi174 2024-03-16T10:42:49.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:49 smithi174 ceph-mon[36202]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:49.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi111=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:49.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: Saving service mgr spec with placement smithi017=x;smithi111=y;smithi174=z;count:3 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: Deploying daemon mgr.z on smithi174 2024-03-16T10:42:49.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:49 smithi017 ceph-mon[32078]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-16T10:42:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-16T10:42:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 8.5912e-05 s, 6.0 MB/s 2024-03-16T10:42:49.368 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi111=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: Saving service mgr spec with placement smithi017=x;smithi111=y;smithi174=z;count:3 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:49.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: Deploying daemon mgr.z on smithi174 2024-03-16T10:42:49.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:49 smithi111 ceph-mon[36315]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:49.423 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-16T10:42:49.424 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T10:42:49.442 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T10:42:49.442 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-03-16T10:42:49.499 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T10:42:49.499 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:49.499 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-16 10:42:33.692442667 +0000 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-16 10:37:16.884028560 +0000 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-16 10:37:16.884028560 +0000 2024-03-16T10:42:49.500 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-03-16 10:37:16.884028560 +0000 2024-03-16T10:42:49.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T10:42:49.568 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-16T10:42:49.568 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-16T10:42:49.568 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000290751 s, 1.8 MB/s 2024-03-16T10:42:49.570 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T10:42:49.627 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-03-16T10:42:49.682 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T10:42:49.682 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:49.682 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-16 10:42:33.692442667 +0000 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-16 10:37:17.221022924 +0000 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-16 10:37:17.221022924 +0000 2024-03-16T10:42:49.683 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-03-16 10:37:17.221022924 +0000 2024-03-16T10:42:49.683 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T10:42:49.749 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-16T10:42:49.749 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-16T10:42:49.750 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000190434 s, 2.7 MB/s 2024-03-16T10:42:49.752 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T10:42:49.809 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-03-16T10:42:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T10:42:49.864 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:49.864 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-03-16T10:42:49.864 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:49.865 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:49.865 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-16 10:42:33.693442651 +0000 2024-03-16T10:42:49.865 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-16 10:37:17.565017171 +0000 2024-03-16T10:42:49.865 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-16 10:37:17.565017171 +0000 2024-03-16T10:42:49.865 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-03-16 10:37:17.565017171 +0000 2024-03-16T10:42:49.865 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T10:42:49.930 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-16T10:42:49.930 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-16T10:42:49.931 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000183808 s, 2.8 MB/s 2024-03-16T10:42:49.932 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T10:42:49.987 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-03-16T10:42:50.042 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T10:42:50.042 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:50.042 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-16 10:42:33.693442651 +0000 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-16 10:37:17.909011419 +0000 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-16 10:37:17.909011419 +0000 2024-03-16T10:42:50.043 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-03-16 10:37:17.909011419 +0000 2024-03-16T10:42:50.043 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T10:42:50.108 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-16T10:42:50.108 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-16T10:42:50.109 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000173479 s, 3.0 MB/s 2024-03-16T10:42:50.110 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T10:42:50.165 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-03-16T10:42:50.165 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T10:42:50.181 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T10:42:50.182 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-03-16 10:42:49.984619201 +0000 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-03-16 10:37:16.831195840 +0000 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-03-16 10:37:16.831195840 +0000 2024-03-16T10:42:50.236 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-03-16 10:37:16.831195840 +0000 2024-03-16T10:42:50.237 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T10:42:50.257 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 systemd[1]: Starting Ceph mgr.z for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:42:50.283 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-03-16T10:42:50.284 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-03-16T10:42:50.284 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000309398 s, 1.7 MB/s 2024-03-16T10:42:50.285 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T10:42:50.341 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-03-16 10:42:49.985619187 +0000 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-03-16 10:37:17.182190766 +0000 2024-03-16T10:42:50.396 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-03-16 10:37:17.182190766 +0000 2024-03-16T10:42:50.397 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-03-16 10:37:17.182190766 +0000 2024-03-16T10:42:50.397 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T10:42:50.462 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-03-16T10:42:50.462 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-03-16T10:42:50.462 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000196011 s, 2.6 MB/s 2024-03-16T10:42:50.463 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:50 smithi174 ceph-mon[36202]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 podman[37841]: 2024-03-16 10:42:50.160312179 +0000 UTC m=+0.017519071 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 podman[37841]: 2024-03-16 10:42:50.303078089 +0000 UTC m=+0.160285014 container create c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 podman[37841]: 2024-03-16 10:42:50.490904491 +0000 UTC m=+0.348111397 container init c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 podman[37841]: 2024-03-16 10:42:50.493477401 +0000 UTC m=+0.350684274 container start c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0) 2024-03-16T10:42:50.518 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 ceph-mgr[37963]: -- 172.21.15.174:0/1444389119 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560240df25a0 con 0x560240dc6800 2024-03-16T10:42:50.519 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-03-16 10:42:49.985619187 +0000 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-03-16 10:37:17.536185648 +0000 2024-03-16T10:42:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-03-16 10:37:17.536185648 +0000 2024-03-16T10:42:50.575 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-03-16 10:37:17.536185648 +0000 2024-03-16T10:42:50.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T10:42:50.642 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-03-16T10:42:50.643 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-03-16T10:42:50.643 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000201606 s, 2.5 MB/s 2024-03-16T10:42:50.644 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T10:42:50.699 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-03-16T10:42:50.749 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:50 smithi111 ceph-mon[36315]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:50.754 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T10:42:50.754 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T10:42:50.754 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-03-16 10:42:49.985619187 +0000 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-03-16 10:37:17.875180747 +0000 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-03-16 10:37:17.875180747 +0000 2024-03-16T10:42:50.755 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-03-16 10:37:17.875180747 +0000 2024-03-16T10:42:50.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T10:42:50.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 bash[37841]: c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 2024-03-16T10:42:50.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:50 smithi174 systemd[1]: Started Ceph mgr.z for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:42:50.820 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-03-16T10:42:50.820 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-03-16T10:42:50.820 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00020762 s, 2.5 MB/s 2024-03-16T10:42:50.822 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T10:42:50.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:50 smithi017 ceph-mon[32078]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:50.878 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-03-16T10:42:50.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T10:42:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:51.153 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:51.057+0000 7f6e037c7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T10:42:51.153 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:51.149+0000 7f6e037c7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T10:42:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:51.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:51.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:51.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:51.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:51 smithi017 ceph-mon[32078]: Deploying daemon mgr.y on smithi111 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:51.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:51.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:51 smithi111 ceph-mon[36315]: Deploying daemon mgr.y on smithi111 2024-03-16T10:42:52.029 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-mon[36202]: Deploying daemon mgr.y on smithi111 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:51.786+0000 7f6e037c7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T10:42:52.030 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:51.880+0000 7f6e037c7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T10:42:52.031 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.028+0000 7f6e037c7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T10:42:52.312 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.127+0000 7f6e037c7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T10:42:52.312 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.214+0000 7f6e037c7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T10:42:52.563 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.492+0000 7f6e037c7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T10:42:52.889 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:52 smithi111 ceph-mon[36315]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:52.971 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-mon[36202]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:52.972 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.605+0000 7f6e037c7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T10:42:52.972 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.692+0000 7f6e037c7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T10:42:52.972 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.789+0000 7f6e037c7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T10:42:52.972 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:52.970+0000 7f6e037c7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T10:42:52.998 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:52 smithi017 ceph-mon[32078]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00824201 s, 1.3 GB/s 2024-03-16T10:42:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-03-16T10:42:53.141 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:53 smithi111 ceph-mgr[37747]: -- 172.21.15.111:0/517988396 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a6879e5a0 con 0x555a68772c00 2024-03-16T10:42:53.141 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:53 smithi111 bash[37728]: 9e1f123d317c65038359dd1b66d1740159018ad17bd01829ce4956c8960126a7 2024-03-16T10:42:53.411 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:53 smithi111 systemd[1]: Started Ceph mgr.y for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:42:53.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-03-16T10:42:53.872 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:42:53.912 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:53.620+0000 7febb9011200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T10:42:53.912 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:53.716+0000 7febb9011200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T10:42:54.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:54.313 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:53.996+0000 7f6e037c7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T10:42:54.314 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:54.131+0000 7f6e037c7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T10:42:54.491 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:54.396+0000 7febb9011200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T10:42:54.491 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:54.490+0000 7febb9011200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T10:42:54.492 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.492 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.492 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.492 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:54.492 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:54.778 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:54.478+0000 7f6e037c7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T10:42:54.778 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:54.568+0000 7f6e037c7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T10:42:54.778 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:54.777+0000 7f6e037c7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:42:54.823 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:54.630+0000 7febb9011200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T10:42:54.823 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:54.738+0000 7febb9011200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T10:42:54.823 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:54.822+0000 7febb9011200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T10:42:55.063 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:54.964+0000 7f6e037c7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T10:42:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- 172.21.15.17:0/2545203473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103540 msgr2=0x7fc1e41039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/2545203473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103540 0x7fc1e41039a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40099c0 tx=0x7fc1d4009cd0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- 172.21.15.17:0/2545203473 shutdown_connections 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/2545203473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4103ee0 0x7fc1e410a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/2545203473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4102340 0x7fc1e4102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/2545203473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103540 0x7fc1e41039a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- 172.21.15.17:0/2545203473 >> 172.21.15.17:0/2545203473 conn(0x7fc1e40fd920 msgr2=0x7fc1e40ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- 172.21.15.17:0/2545203473 shutdown_connections 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- 172.21.15.17:0/2545203473 wait complete. 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 Processor -- start 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.361+0000 7fc1eb65d700 1 -- start start 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4103540 0x7fc1e40746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103ee0 0x7fc1e4074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410df30 con 0x7fc1e4103ee0 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410ddb0 con 0x7fc1e4102340 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1eb65d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e410e0b0 con 0x7fc1e4103540 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38040/0 (socket says 172.21.15.17:38040) 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e9bfa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103ee0 0x7fc1e4074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 -- 172.21.15.17:0/1480922009 learned_addr learned my addr 172.21.15.17:0/1480922009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e8bf8700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4103540 0x7fc1e40746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 -- 172.21.15.17:0/1480922009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4103540 msgr2=0x7fc1e40746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4103540 0x7fc1e40746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 -- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103ee0 msgr2=0x7fc1e4074c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103ee0 0x7fc1e4074c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 -- 172.21.15.17:0/1480922009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e40754b0 con 0x7fc1e4102340 2024-03-16T10:42:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1e93f9700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e950 tx=0x7fc1e000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.362+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0004230 con 0x7fc1e4102340 2024-03-16T10:42:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.363+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e00043d0 con 0x7fc1e4102340 2024-03-16T10:42:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.363+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e41a26b0 con 0x7fc1e4102340 2024-03-16T10:42:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.363+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0003dd0 con 0x7fc1e4102340 2024-03-16T10:42:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.363+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41a2b70 con 0x7fc1e4102340 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.363+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 13) ==== 46162+0+0 (secure 0 0 0) 0x7fc1e0021440 con 0x7fc1e4102340 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.364+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4068f90 con 0x7fc1e4102340 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.364+0000 7fc1da7fc700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 0x7fc1d003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.364+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc1e004c4f0 con 0x7fc1e4102340 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.364+0000 7fc1e8bf8700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 0x7fc1d003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:42:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.364+0000 7fc1e8bf8700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 0x7fc1d003b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4000c00 tx=0x7fc1d4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:42:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.369+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fc1e001fe20 con 0x7fc1e4102340 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:55.371 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:55.372 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.372 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:55.083+0000 7febb9011200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T10:42:55.372 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:55.190+0000 7febb9011200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T10:42:55.372 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:55.277+0000 7febb9011200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T10:42:55.372 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:55.370+0000 7febb9011200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T10:42:55.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:55.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:55.502 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.517 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:55.247+0000 7f6e037c7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-16T10:42:55.518 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:55.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:55.600+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc1e4062710 con 0x7fc1d0039200 2024-03-16T10:42:55.661 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:55.544+0000 7febb9011200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T10:42:55.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:55.517+0000 7f6e037c7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T10:42:55.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:55.752+0000 7f6e037c7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T10:42:56.502 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T10:42:56.503 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: Reconfiguring daemon mgr.x on smithi017 2024-03-16T10:42:56.503 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:56.503 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:42:56.503 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:42:56.503 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:56.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T10:42:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: Reconfiguring daemon mgr.x on smithi017 2024-03-16T10:42:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:42:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:42:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: Reconfiguring mgr.x (unknown last config time)... 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: Reconfiguring daemon mgr.x on smithi017 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:42:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:56.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:56.556+0000 7f6e037c7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T10:42:56.911 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:56.501+0000 7febb9011200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T10:42:56.912 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:56.633+0000 7febb9011200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T10:42:57.217 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:56.961+0000 7febb9011200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T10:42:57.217 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:57.047+0000 7febb9011200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T10:42:57.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:57.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:57.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:57.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:57.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:57.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.443 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:57.129+0000 7f6e037c7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T10:42:57.443 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:57.227+0000 7f6e037c7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T10:42:57.443 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z[37925]: 2024-03-16T10:42:57.442+0000 7f6e037c7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:57.444 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.661 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:57.239+0000 7febb9011200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:57.417+0000 7febb9011200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:42:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:42:57.947 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:57.693+0000 7febb9011200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T10:42:57.947 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:57.946+0000 7febb9011200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T10:42:58.218 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:58.178+0000 7febb9011200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T10:42:58.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:42:58.225+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mgrmap(e 14) ==== 91698+0+0 (secure 0 0 0) 0x7fc1e00107b0 con 0x7fc1e4102340 2024-03-16T10:42:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:58 smithi174 ceph-mon[36202]: Standby manager daemon z started 2024-03-16T10:42:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:58 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T10:42:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:58 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:42:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:58 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T10:42:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:58 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:42:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:58 smithi017 ceph-mon[32078]: Standby manager daemon z started 2024-03-16T10:42:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:58 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T10:42:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:58 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:42:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:58 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T10:42:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:58 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:42:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-mon[36315]: Standby manager daemon z started 2024-03-16T10:42:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-16T10:42:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:42:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-16T10:42:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.174:0/2273155854' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:42:59.228 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:58.967+0000 7febb9011200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T10:42:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-16T10:42:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T10:42:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]: dispatch 2024-03-16T10:42:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]': finished 2024-03-16T10:42:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T10:42:59.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:42:59 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]: dispatch 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]': finished 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T10:42:59.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]: dispatch 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/710970623' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e80ee777-191c-4297-a64a-666a31e8fb28"}]': finished 2024-03-16T10:42:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: osdmap e5: 1 total, 0 up, 1 in 2024-03-16T10:42:59.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:42:59 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:42:59.833 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:59.526+0000 7febb9011200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T10:42:59.833 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:59.622+0000 7febb9011200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T10:42:59.833 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:42:59 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y[37743]: 2024-03-16T10:42:59.831+0000 7febb9011200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T10:43:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:00.238+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mon.2 v2:172.21.15.111:3300/0 8 ==== mgrmap(e 15) ==== 137234+0+0 (secure 0 0 0) 0x7fc1e0016370 con 0x7fc1e4102340 2024-03-16T10:43:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2538825291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: Standby manager daemon y started 2024-03-16T10:43:00.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T10:43:00.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:43:00.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T10:43:00.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:00 smithi174 ceph-mon[36202]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:43:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2538825291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: Standby manager daemon y started 2024-03-16T10:43:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T10:43:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:43:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T10:43:00.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:00 smithi017 ceph-mon[32078]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2538825291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: Standby manager daemon y started 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-16T10:43:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:00 smithi111 ceph-mon[36315]: from='mgr.? 172.21.15.111:0/3332631142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-16T10:43:01.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:01 smithi174 ceph-mon[36202]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-03-16T10:43:01.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T10:43:01.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:01 smithi174 ceph-mon[36202]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:01 smithi017 ceph-mon[32078]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-03-16T10:43:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T10:43:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:01 smithi017 ceph-mon[32078]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:01 smithi111 ceph-mon[36315]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-03-16T10:43:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-16T10:43:01.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:01 smithi111 ceph-mon[36315]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:02.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:02 smithi017 ceph-mon[32078]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:02.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:02 smithi174 ceph-mon[36202]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:02.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:02 smithi111 ceph-mon[36315]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:04.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:04 smithi017 ceph-mon[32078]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:04.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:04 smithi174 ceph-mon[36202]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:04.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:04 smithi111 ceph-mon[36315]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T10:43:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:06.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T10:43:06.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:06.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-16T10:43:06.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:06.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:06 smithi017 ceph-mon[32078]: Deploying daemon osd.0 on smithi017 2024-03-16T10:43:06.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:06 smithi017 ceph-mon[32078]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:06 smithi174 ceph-mon[36202]: Deploying daemon osd.0 on smithi017 2024-03-16T10:43:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:06 smithi174 ceph-mon[36202]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:07.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:06 smithi111 ceph-mon[36315]: Deploying daemon osd.0 on smithi017 2024-03-16T10:43:07.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:06 smithi111 ceph-mon[36315]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:08.555 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:08 smithi017 ceph-mon[32078]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:08.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:08 smithi174 ceph-mon[36202]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:08.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:08 smithi111 ceph-mon[36315]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:10.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:10 smithi174 ceph-mon[36202]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:10.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:10 smithi017 ceph-mon[32078]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:10.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:10 smithi111 ceph-mon[36315]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:11.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:11.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:11.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:12.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:12.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:12.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:13.044 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:12 smithi017 ceph-mon[32078]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:13.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:12 smithi174 ceph-mon[36202]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:13.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:12 smithi111 ceph-mon[36315]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.310+0000 7fc1da7fc700 1 -- 172.21.15.17:0/1480922009 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc1e4062710 con 0x7fc1d0039200 2024-03-16T10:43:14.311 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 msgr2=0x7fc1d003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 0x7fc1d003b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4000c00 tx=0x7fc1d4005fb0 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 msgr2=0x7fc1e4076070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e950 tx=0x7fc1e000ec60 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 shutdown_connections 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc1d0039200 0x7fc1d003b6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e4102340 0x7fc1e4076070 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1e4103ee0 0x7fc1e4074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 --2- 172.21.15.17:0/1480922009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e4103540 0x7fc1e40746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 >> 172.21.15.17:0/1480922009 conn(0x7fc1e40fd920 msgr2=0x7fc1e41067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 shutdown_connections 2024-03-16T10:43:14.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:43:14.314+0000 7fc1eb65d700 1 -- 172.21.15.17:0/1480922009 wait complete. 2024-03-16T10:43:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:14.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:14.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:15.047 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.0.service 2024-03-16T10:43:15.049 INFO:tasks.cephadm:Deploying osd.1 on smithi111 with /dev/vg_nvme/lv_4... 2024-03-16T10:43:15.049 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T10:43:15.290 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:43:15.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:15 smithi017 ceph-mon[32078]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:15.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:15 smithi017 ceph-mon[32078]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T10:43:15.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:15 smithi111 ceph-mon[36315]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:15.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:15 smithi111 ceph-mon[36315]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T10:43:15.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:15 smithi174 ceph-mon[36202]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:15.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:15 smithi174 ceph-mon[36202]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-16T10:43:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-mon[32078]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T10:43:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-mon[32078]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T10:43:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-mon[32078]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:43:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:16.619 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:16 smithi111 ceph-mon[36315]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T10:43:16.619 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:16 smithi111 ceph-mon[36315]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T10:43:16.619 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:16 smithi111 ceph-mon[36315]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:43:16.619 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:16 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:16.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:16 smithi174 ceph-mon[36202]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-16T10:43:16.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:16 smithi174 ceph-mon[36202]: osdmap e6: 1 total, 0 up, 1 in 2024-03-16T10:43:16.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:16 smithi174 ceph-mon[36202]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:43:16.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:16 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.091 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0[46836]: 2024-03-16T10:43:16.792+0000 7fb2708d7700 -1 osd.0 0 waiting for initial osdmap 2024-03-16T10:43:17.091 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:43:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0[46836]: 2024-03-16T10:43:16.795+0000 7fb267ec1700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:43:17.157 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T10:43:17.157 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T10:43:17.157 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-03-16T10:43:17.158 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-03-16T10:43:17.158 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127547 s, 822 MB/s 2024-03-16T10:43:17.158 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:17.448 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:17 smithi111 ceph-mon[36315]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' 2024-03-16T10:43:17.766 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:17 smithi174 ceph-mon[36202]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' 2024-03-16T10:43:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:43:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: osdmap e7: 1 total, 0 up, 1 in 2024-03-16T10:43:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-16T10:43:17.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:17 smithi017 ceph-mon[32078]: from='osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906]' entity='osd.0' 2024-03-16T10:43:18.005 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] boot 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.392 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:18.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:18.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:18.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:43:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:43:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] boot 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:43:18.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: osd.0 [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] boot 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: osdmap e8: 1 total, 1 up, 1 in 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:18.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:18.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:19.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:19 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi017 2024-03-16T10:43:19.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:19 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi017 to 17093M 2024-03-16T10:43:19.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:19 smithi111 ceph-mon[36315]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 -- 172.21.15.111:0/2456342159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 msgr2=0x7f61d410a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 --2- 172.21.15.111:0/2456342159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d410a460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00b0a0 tx=0x7f61cc00b3b0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 -- 172.21.15.111:0/2456342159 shutdown_connections 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 --2- 172.21.15.111:0/2456342159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d410a460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 --2- 172.21.15.111:0/2456342159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4102df0 0x7f61d41051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 --2- 172.21.15.111:0/2456342159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4105720 0x7f61d4107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.491+0000 7f61d886b700 1 -- 172.21.15.111:0/2456342159 >> 172.21.15.111:0/2456342159 conn(0x7f61d40fc7c0 msgr2=0x7f61d40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- 172.21.15.111:0/2456342159 shutdown_connections 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- 172.21.15.111:0/2456342159 wait complete. 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 Processor -- start 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- start start 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4102df0 0x7f61d4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4105720 0x7f61d4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410df10 con 0x7f61d4102df0 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410dd90 con 0x7f61d4108050 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.492+0000 7f61d886b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f61d410e090 con 0x7f61d4105720 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:19.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45008/0 (socket says 172.21.15.111:45008) 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 -- 172.21.15.111:0/3716718655 learned_addr learned my addr 172.21.15.111:0/3716718655 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d1d9b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4105720 0x7f61d4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d259c700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4102df0 0x7f61d4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 -- 172.21.15.111:0/3716718655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4105720 msgr2=0x7f61d4198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4105720 0x7f61d4198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 -- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4102df0 msgr2=0x7f61d4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4102df0 0x7f61d4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 -- 172.21.15.111:0/3716718655 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d41a0080 con 0x7f61d4108050 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d2d9d700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007f00 tx=0x7f61cc004e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc021070 con 0x7f61d4108050 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d41a0310 con 0x7f61d4108050 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61cc007cc0 con 0x7f61d4108050 2024-03-16T10:43:19.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc005500 con 0x7f61d4108050 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.493+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d41a07c0 con 0x7f61d4108050 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.494+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d4068f90 con 0x7f61d4108050 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.495+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 15) ==== 137234+0+0 (secure 0 0 0) 0x7f61cc024070 con 0x7f61d4108050 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.496+0000 7f61c37fe700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 0x7f61bc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.496+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f61cc0ce260 con 0x7f61d4108050 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.496+0000 7f61d259c700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 0x7f61bc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.496+0000 7f61d259c700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 0x7f61bc0a4cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61c4005950 tx=0x7f61c400a300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:43:19.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.499+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f61cc09ce00 con 0x7f61d4108050 2024-03-16T10:43:19.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:19.701+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f61d4062710 con 0x7f61bc0a2800 2024-03-16T10:43:19.713 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:19 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi017 2024-03-16T10:43:19.714 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:19 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi017 to 17093M 2024-03-16T10:43:19.714 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:19 smithi174 ceph-mon[36202]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:19 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi017 2024-03-16T10:43:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:19 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi017 to 17093M 2024-03-16T10:43:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:19 smithi017 ceph-mon[32078]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:20.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:20 smithi111 ceph-mon[36315]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T10:43:20.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:20 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:20.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:20 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:20.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:20 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:20.726 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:20 smithi174 ceph-mon[36202]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T10:43:20.727 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:20 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:20.727 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:20 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:20.727 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:20 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:20.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:20 smithi017 ceph-mon[32078]: osdmap e9: 1 total, 1 up, 1 in 2024-03-16T10:43:20.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:20.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:20.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:21.498 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:21 smithi111 ceph-mon[36315]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:21.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:21 smithi174 ceph-mon[36202]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:21 smithi017 ceph-mon[32078]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:22.627 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:22.627 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/1009481085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.627 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.627 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]': finished 2024-03-16T10:43:22.628 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T10:43:22.628 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/1009481085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]': finished 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T10:43:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/1009481085' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]: dispatch 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779bf596-8e58-42dc-bf10-e0ef94c86c9c"}]': finished 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: osdmap e10: 2 total, 1 up, 2 in 2024-03-16T10:43:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:23.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:23 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/3230922903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:23 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/3230922903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:23 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/3230922903' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:24 smithi111 ceph-mon[36315]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:24 smithi174 ceph-mon[36202]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:24 smithi017 ceph-mon[32078]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:26.480 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:26 smithi111 ceph-mon[36315]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:26 smithi174 ceph-mon[36202]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:26.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:26 smithi017 ceph-mon[32078]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:28.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:28 smithi111 ceph-mon[36315]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:28.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:28 smithi174 ceph-mon[36202]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:28.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:28 smithi017 ceph-mon[32078]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:29.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:29 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T10:43:29.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:29 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:29.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:29 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T10:43:29.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:29 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:29.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:29 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-16T10:43:29.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:29 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:30.574 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:30 smithi111 ceph-mon[36315]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:30.574 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:30 smithi111 ceph-mon[36315]: Deploying daemon osd.1 on smithi111 2024-03-16T10:43:30.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:30 smithi174 ceph-mon[36202]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:30.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:30 smithi174 ceph-mon[36202]: Deploying daemon osd.1 on smithi111 2024-03-16T10:43:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:30 smithi017 ceph-mon[32078]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:30 smithi017 ceph-mon[32078]: Deploying daemon osd.1 on smithi111 2024-03-16T10:43:32.586 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:32 smithi111 ceph-mon[36315]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:32.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:32 smithi174 ceph-mon[36202]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:32.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:32 smithi017 ceph-mon[32078]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:34.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:34 smithi111 ceph-mon[36315]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:34.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:34 smithi174 ceph-mon[36202]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:34.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:34 smithi017 ceph-mon[32078]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:36.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:35 smithi174 ceph-mon[36202]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:36.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:36.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:35 smithi017 ceph-mon[32078]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:36.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:36.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:35 smithi111 ceph-mon[36315]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:36.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:36.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:37.858 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:37 smithi111 ceph-mon[36315]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:37.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.915+0000 7f61c37fe700 1 -- 172.21.15.111:0/3716718655 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f61d4062710 con 0x7f61bc0a2800 2024-03-16T10:43:37.917 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 1 on host 'smithi111' 2024-03-16T10:43:37.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.918+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 msgr2=0x7f61bc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:37.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.918+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 0x7f61bc0a4cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61c4005950 tx=0x7f61c400a300 comp rx=0 tx=0).stop 2024-03-16T10:43:37.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.918+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 msgr2=0x7f61d419f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:37.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.918+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007f00 tx=0x7f61cc004e40 comp rx=0 tx=0).stop 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 shutdown_connections 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f61bc0a2800 0x7f61bc0a4cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d4108050 0x7f61d419f9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d4102df0 0x7f61d4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 --2- 172.21.15.111:0/3716718655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61d4105720 0x7f61d4198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 >> 172.21.15.111:0/3716718655 conn(0x7f61d40fc7c0 msgr2=0x7f61d4103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 shutdown_connections 2024-03-16T10:43:37.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:43:37.919+0000 7f61d886b700 1 -- 172.21.15.111:0/3716718655 wait complete. 2024-03-16T10:43:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:37 smithi174 ceph-mon[36202]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:38.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:37 smithi017 ceph-mon[32078]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:38.580 DEBUG:teuthology.orchestra.run.smithi111:osd.1> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.1.service 2024-03-16T10:43:38.582 INFO:tasks.cephadm:Deploying osd.2 on smithi174 with /dev/vg_nvme/lv_4... 2024-03-16T10:43:38.583 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-16T10:43:38.806 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:43:38.645+0000 7f7d14d6e7c0 -1 osd.1 0 log_to_monitors true 2024-03-16T10:43:38.829 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:39.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:38 smithi111 ceph-mon[36315]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:38 smithi174 ceph-mon[36202]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:39.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:39.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:39.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:38 smithi017 ceph-mon[32078]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:40.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-mon[36315]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T10:43:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T10:43:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:40.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:40 smithi174 ceph-mon[36202]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-16T10:43:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: osdmap e11: 2 total, 1 up, 2 in 2024-03-16T10:43:40.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: from='osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:40.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:40 smithi017 ceph-mon[32078]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:43:40.644 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-16T10:43:40.644 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-16T10:43:40.644 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-03-16T10:43:40.644 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-03-16T10:43:40.644 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113901 s, 921 MB/s 2024-03-16T10:43:40.645 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-03-16T10:43:40.912 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:43:40.635+0000 7f7d0a3d3700 -1 osd.1 0 waiting for initial osdmap 2024-03-16T10:43:40.912 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:43:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:43:40.638+0000 7f7d021be700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:43:41.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-03-16T10:43:41.235 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:41 smithi174 ceph-mon[36202]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:43:41.236 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:41 smithi174 ceph-mon[36202]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T10:43:41.236 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.236 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.236 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:41 smithi174 ceph-mon[36202]: from='osd.1 ' entity='osd.1' 2024-03-16T10:43:41.471 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:43:41.575 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:41 smithi111 ceph-mon[36315]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:43:41.576 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:41 smithi111 ceph-mon[36315]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T10:43:41.576 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.576 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.576 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:41 smithi111 ceph-mon[36315]: from='osd.1 ' entity='osd.1' 2024-03-16T10:43:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:41 smithi017 ceph-mon[32078]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:43:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:41 smithi017 ceph-mon[32078]: osdmap e12: 2 total, 1 up, 2 in 2024-03-16T10:43:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:41 smithi017 ceph-mon[32078]: from='osd.1 ' entity='osd.1' 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] boot 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] boot 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:43:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: osd.1 [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] boot 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: osdmap e13: 2 total, 2 up, 2 in 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:43:42.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:42.965 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.960+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4245706884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 msgr2=0x7f5cb810a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.960+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4245706884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb810a750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b0a0 tx=0x7f5cb000b3b0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.960+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4245706884 shutdown_connections 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4245706884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 0x7f5cb8102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4245706884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb810a750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4245706884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 0x7f5cb8103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4245706884 >> 172.21.15.174:0/4245706884 conn(0x7f5cb80fd8e0 msgr2=0x7f5cb80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4245706884 shutdown_connections 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4245706884 wait complete. 2024-03-16T10:43:42.966 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 Processor -- start 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.961+0000 7f5cbdd2b700 1 -- start start 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 0x7f5cb81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 0x7f5cb81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810dee0 con 0x7f5cb8103500 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810dd60 con 0x7f5cb8102300 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb810e060 con 0x7f5cb8103ea0 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:41790/0 (socket says 172.21.15.174:41790) 2024-03-16T10:43:42.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 -- 172.21.15.174:0/4215997230 learned_addr learned my addr 172.21.15.174:0/4215997230 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb6ffd700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 0x7f5cb81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb77fe700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 0x7f5cb81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 -- 172.21.15.174:0/4215997230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 msgr2=0x7f5cb81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 0x7f5cb81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 -- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 msgr2=0x7f5cb81989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 0x7f5cb81989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 -- 172.21.15.174:0/4215997230 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb81a0100 con 0x7f5cb8103ea0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb7fff700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009800 tx=0x7f5cb000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0021070 con 0x7f5cb8103ea0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cb0007cc0 con 0x7f5cb8103ea0 2024-03-16T10:43:42.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb001b7f0 con 0x7f5cb8103ea0 2024-03-16T10:43:42.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.962+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb81a0390 con 0x7f5cb8103ea0 2024-03-16T10:43:42.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.963+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb81a07e0 con 0x7f5cb8103ea0 2024-03-16T10:43:42.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.963+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb8068f90 con 0x7f5cb8103ea0 2024-03-16T10:43:42.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.965+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 15) ==== 137234+0+0 (secure 0 0 0) 0x7f5cb0024070 con 0x7f5cb8103ea0 2024-03-16T10:43:42.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.965+0000 7f5cb4ff9700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 0x7f5ca00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:43:42.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.965+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f5cb00cdf70 con 0x7f5cb8103ea0 2024-03-16T10:43:42.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.966+0000 7f5cb77fe700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 0x7f5ca00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:43:42.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.966+0000 7f5cb77fe700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 0x7f5ca00a4d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005950 tx=0x7f5ca800a300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:43:42.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:42.970+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5cb009c8f0 con 0x7f5cb8103ea0 2024-03-16T10:43:43.175 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:43:43.173+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5cb8062710 con 0x7f5ca00a2880 2024-03-16T10:43:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:43 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi111 2024-03-16T10:43:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:43 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi111 to 17080M 2024-03-16T10:43:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:43 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi111 2024-03-16T10:43:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:43 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi111 to 17080M 2024-03-16T10:43:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:43.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:43.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:43 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi111 2024-03-16T10:43:43.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:43 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi111 to 17080M 2024-03-16T10:43:43.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:43:43.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:43:43.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:44.431 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:44 smithi174 ceph-mon[36202]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:44.431 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:44 smithi174 ceph-mon[36202]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:44.432 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:44 smithi174 ceph-mon[36202]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T10:43:44.491 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:44 smithi017 ceph-mon[32078]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:44.492 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:44 smithi017 ceph-mon[32078]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:44.492 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:44 smithi017 ceph-mon[32078]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T10:43:44.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:44 smithi111 ceph-mon[36315]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:44.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:44 smithi111 ceph-mon[36315]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:43:44.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:44 smithi111 ceph-mon[36315]: osdmap e14: 2 total, 2 up, 2 in 2024-03-16T10:43:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/2916831542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]': finished 2024-03-16T10:43:46.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T10:43:46.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:43:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/2916831542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]': finished 2024-03-16T10:43:46.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T10:43:46.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/2916831542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]: dispatch 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5448fc77-cae4-481f-a7e0-fe2af1de6d52"}]': finished 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: osdmap e15: 3 total, 2 up, 3 in 2024-03-16T10:43:46.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:43:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:47 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/3477807485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:47 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/3477807485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:47.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:47 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/3477807485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:43:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:48 smithi174 ceph-mon[36202]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:48 smithi017 ceph-mon[32078]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:48 smithi111 ceph-mon[36315]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:50 smithi174 ceph-mon[36202]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:50 smithi017 ceph-mon[32078]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:50 smithi111 ceph-mon[36315]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:52 smithi174 ceph-mon[36202]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:52 smithi017 ceph-mon[32078]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:52 smithi111 ceph-mon[36315]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:53.532 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:53 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T10:43:53.533 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:53 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:53 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T10:43:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:53 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:53 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-16T10:43:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:53 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:43:54.364 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:54 smithi174 ceph-mon[36202]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:54.364 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:54 smithi174 ceph-mon[36202]: Deploying daemon osd.2 on smithi174 2024-03-16T10:43:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:54 smithi017 ceph-mon[32078]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:54 smithi017 ceph-mon[32078]: Deploying daemon osd.2 on smithi174 2024-03-16T10:43:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:54 smithi111 ceph-mon[36315]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:54 smithi111 ceph-mon[36315]: Deploying daemon osd.2 on smithi174 2024-03-16T10:43:56.557 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:56 smithi174 ceph-mon[36202]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:56 smithi017 ceph-mon[32078]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:56 smithi111 ceph-mon[36315]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:58 smithi174 ceph-mon[36202]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:58 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:58 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:43:58 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:58 smithi017 ceph-mon[32078]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:58 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:58 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:43:58 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:43:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:58 smithi111 ceph-mon[36315]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:43:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:58 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:58 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:43:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:43:58 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:00.435 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:00 smithi174 ceph-mon[36202]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:00 smithi017 ceph-mon[32078]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:00 smithi111 ceph-mon[36315]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:01.590 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.588+0000 7f5cb4ff9700 1 -- 172.21.15.174:0/4215997230 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5cb8062710 con 0x7f5ca00a2880 2024-03-16T10:44:01.590 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 2 on host 'smithi174' 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 msgr2=0x7f5ca00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 0x7f5ca00a4d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005950 tx=0x7f5ca800a300 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 msgr2=0x7f5cb819fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009800 tx=0x7f5cb000bd70 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 shutdown_connections 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ca00a2880 0x7f5ca00a4d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5cb8102300 0x7f5cb81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cb8103ea0 0x7f5cb819fa60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 --2- 172.21.15.174:0/4215997230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb8103500 0x7f5cb81989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 >> 172.21.15.174:0/4215997230 conn(0x7f5cb80fd8e0 msgr2=0x7f5cb81067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 shutdown_connections 2024-03-16T10:44:01.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:01.591+0000 7f5cbdd2b700 1 -- 172.21.15.174:0/4215997230 wait complete. 2024-03-16T10:44:02.201 DEBUG:teuthology.orchestra.run.smithi174:osd.2> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.2.service 2024-03-16T10:44:02.243 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2024-03-16T10:44:02.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:02.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:02 smithi174 ceph-mon[36202]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:02.494 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:02.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:02 smithi017 ceph-mon[32078]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:02 smithi111 ceph-mon[36315]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:03 smithi017 ceph-mon[32078]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T10:44:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T10:44:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:04.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:04.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:03 smithi174 ceph-mon[36202]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:04.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:04.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-16T10:44:04.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: osdmap e16: 3 total, 2 up, 3 in 2024-03-16T10:44:04.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:04.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: from='osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:04.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:03 smithi111 ceph-mon[36315]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:44:04.442 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2[41373]: 2024-03-16T10:44:04.126+0000 7f8cff625700 -1 osd.2 0 waiting for initial osdmap 2024-03-16T10:44:04.443 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2[41373]: 2024-03-16T10:44:04.129+0000 7f8cf7410700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0084007 s, 1.2 GB/s 2024-03-16T10:44:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-03-16T10:44:04.805 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:44:04.806 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T10:44:04.806 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:04.806 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:04.806 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: from='osd.2 ' entity='osd.2' 2024-03-16T10:44:04.806 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:04 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:44:05.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T10:44:05.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: from='osd.2 ' entity='osd.2' 2024-03-16T10:44:05.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-03-16T10:44:05.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:44:05.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: osdmap e17: 3 total, 2 up, 3 in 2024-03-16T10:44:05.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: from='osd.2 ' entity='osd.2' 2024-03-16T10:44:05.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:04 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.361 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] boot 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi174 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:05.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi174 to 17080M 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:05.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] boot 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T10:44:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi174 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi174 to 17080M 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:06.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: osd.2 [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] boot 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: osdmap e18: 3 total, 3 up, 3 in 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi174 2024-03-16T10:44:06.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi174 to 17080M 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:06.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.029+0000 7f9a09091700 1 -- 172.21.15.17:0/1528598294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 msgr2=0x7f9a0410a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.029+0000 7f9a09091700 1 --2- 172.21.15.17:0/1528598294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0410a750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00b0d0 tx=0x7f99fc00b3e0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 -- 172.21.15.17:0/1528598294 shutdown_connections 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 --2- 172.21.15.17:0/1528598294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0410a750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 --2- 172.21.15.17:0/1528598294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 0x7f9a04102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 --2- 172.21.15.17:0/1528598294 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 0x7f9a04103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 -- 172.21.15.17:0/1528598294 >> 172.21.15.17:0/1528598294 conn(0x7f9a040fd8e0 msgr2=0x7f9a040ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 -- 172.21.15.17:0/1528598294 shutdown_connections 2024-03-16T10:44:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 -- 172.21.15.17:0/1528598294 wait complete. 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.030+0000 7f9a09091700 1 Processor -- start 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 -- start start 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 0x7f9a041983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 0x7f9a04198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0410dec0 con 0x7f9a04103ea0 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0410dd40 con 0x7f9a04103500 2024-03-16T10:44:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a09091700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0410e040 con 0x7f9a04102300 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55656/0 (socket says 172.21.15.17:55656) 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 -- 172.21.15.17:0/86551354 learned_addr learned my addr 172.21.15.17:0/86551354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a02d9d700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 0x7f9a041983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0259c700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 0x7f9a04198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 -- 172.21.15.17:0/86551354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 msgr2=0x7f9a041983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 0x7f9a041983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 -- 172.21.15.17:0/86551354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 msgr2=0x7f9a04198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 0x7f9a04198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.031+0000 7f9a0359e700 1 -- 172.21.15.17:0/86551354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a041a0050 con 0x7f9a04103ea0 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f9a0359e700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99fc007d10 tx=0x7f99fc007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:07.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc021020 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a041a02e0 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99fc01d950 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0053b0 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.032+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a041a07d0 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.033+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a04068f90 con 0x7f9a04103ea0 2024-03-16T10:44:07.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.034+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 137234+0+0 (secure 0 0 0) 0x7f99fc024020 con 0x7f9a04103ea0 2024-03-16T10:44:07.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:07.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:06 smithi017 ceph-mon[32078]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T10:44:07.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.034+0000 7f99ebfff700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 0x7f99ec0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:07.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.035+0000 7f9a02d9d700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 0x7f99ec0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:07.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.035+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f99fc0cec60 con 0x7f9a04103ea0 2024-03-16T10:44:07.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.035+0000 7f9a02d9d700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 0x7f99ec0a4cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a04103360 tx=0x7f99f400a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:07.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.038+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f99fc02b020 con 0x7f9a04103ea0 2024-03-16T10:44:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:06 smithi174 ceph-mon[36202]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T10:44:07.065 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:07.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:06 smithi111 ceph-mon[36315]: osdmap e19: 3 total, 3 up, 3 in 2024-03-16T10:44:07.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:44:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:07.253+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9a04062710 con 0x7f99ec0a2800 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: pgmap v81: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:07 smithi174 ceph-mon[36202]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: pgmap v81: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:07 smithi017 ceph-mon[32078]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: pgmap v81: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:44:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:07 smithi111 ceph-mon[36315]: osdmap e20: 3 total, 3 up, 3 in 2024-03-16T10:44:08.365 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51213]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:08.365 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51213]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:08.365 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51213]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:08.365 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51213]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:08.774 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51229]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:08.775 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:08.775 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51229]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:08.775 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:44:08 smithi017 sudo[51229]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:08.889 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:08.890 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:08.890 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45086]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:08.890 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45086]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:09.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45089]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:09.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45089]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:09.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45089]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:09.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:44:08 smithi111 sudo[45089]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:09.412 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:09 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.412 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:09 smithi174 ceph-mon[36202]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T10:44:09.412 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:09 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.413 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45320]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:09.413 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:09.413 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45320]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:09.413 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45320]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:09.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:09 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:09 smithi111 ceph-mon[36315]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T10:44:09.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:09 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 ceph-mon[32078]: osdmap e21: 3 total, 3 up, 3 in 2024-03-16T10:44:09.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:09.813 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:09.813 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:09.813 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45323]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:09.813 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:44:09 smithi174 sudo[45323]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:09.957 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51289]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:09.957 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51289]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:09.958 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51289]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:09.958 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51289]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:09.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:09.974+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f99fc0991c0 con 0x7f9a04103ea0 2024-03-16T10:44:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51308]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51308]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:09 smithi017 sudo[51308]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45326]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45326]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45326]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45326]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45329]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:10.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 sudo[45329]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:10.944 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45092]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-16T10:44:10.944 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45092]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:10.944 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45092]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:10.944 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45092]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:10 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]: dispatch 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:10 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]: dispatch 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45095]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45095]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 sudo[45095]: pam_unix(sudo:session): session closed for user root 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:11.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:10 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:12.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]': finished 2024-03-16T10:44:12.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: osdmap e22: 4 total, 3 up, 4 in 2024-03-16T10:44:12.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:12.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:11 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/167270981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:12.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]': finished 2024-03-16T10:44:12.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: osdmap e22: 4 total, 3 up, 4 in 2024-03-16T10:44:12.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:12.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:11 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/167270981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1533511962' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b2b5e3b-24b9-4122-aa88-fbfad12dc540"}]': finished 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: osdmap e22: 4 total, 3 up, 4 in 2024-03-16T10:44:12.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:12.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-16T10:44:12.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:11 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/167270981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:13 smithi174 ceph-mon[36202]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:13 smithi017 ceph-mon[32078]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:14.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:13 smithi111 ceph-mon[36315]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:16.250 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:15 smithi017 ceph-mon[32078]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:15 smithi174 ceph-mon[36202]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:16.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:15 smithi111 ceph-mon[36315]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:18.282 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:17 smithi017 ceph-mon[32078]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:18.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T10:44:18.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:17 smithi174 ceph-mon[36202]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T10:44:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:18.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:17 smithi111 ceph-mon[36315]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-16T10:44:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:19.229 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:18 smithi174 ceph-mon[36202]: Deploying daemon osd.3 on smithi017 2024-03-16T10:44:19.253 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:18 smithi017 ceph-mon[32078]: Deploying daemon osd.3 on smithi017 2024-03-16T10:44:19.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:18 smithi111 ceph-mon[36315]: Deploying daemon osd.3 on smithi017 2024-03-16T10:44:20.313 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:19 smithi111 ceph-mon[36315]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:19 smithi174 ceph-mon[36202]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:20.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:19 smithi017 ceph-mon[32078]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:21 smithi174 ceph-mon[36202]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:22.318 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:21 smithi017 ceph-mon[32078]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:22.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:21 smithi111 ceph-mon[36315]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:24.545 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:24 smithi017 ceph-mon[32078]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:24.545 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.545 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.545 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:24 smithi174 ceph-mon[36202]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:24 smithi111 ceph-mon[36315]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:24.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:24.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:26 smithi174 ceph-mon[36202]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:26 smithi017 ceph-mon[32078]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:26 smithi111 ceph-mon[36315]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:27.010 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2024-03-16T10:44:27.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.008+0000 7f99ebfff700 1 -- 172.21.15.17:0/86551354 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a04062710 con 0x7f99ec0a2800 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 msgr2=0x7f99ec0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 0x7f99ec0a4cc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a04103360 tx=0x7f99f400a3b0 comp rx=0 tx=0).stop 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 msgr2=0x7f9a0419f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99fc007d10 tx=0x7f99fc007d40 comp rx=0 tx=0).stop 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 shutdown_connections 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99ec0a2800 0x7f99ec0a4cc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04103ea0 0x7f9a0419f9b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a04102300 0x7f9a041983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 --2- 172.21.15.17:0/86551354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a04103500 0x7f9a04198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 >> 172.21.15.17:0/86551354 conn(0x7f9a040fd8e0 msgr2=0x7f9a041067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 shutdown_connections 2024-03-16T10:44:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:44:27.011+0000 7f9a09091700 1 -- 172.21.15.17:0/86551354 wait complete. 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:27.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:27 smithi174 ceph-mon[36202]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:27.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:27 smithi017 ceph-mon[32078]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T10:44:27.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:27.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:27 smithi111 ceph-mon[36315]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-16T10:44:27.711 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.3.service 2024-03-16T10:44:27.714 INFO:tasks.cephadm:Deploying osd.4 on smithi111 with /dev/vg_nvme/lv_3... 2024-03-16T10:44:27.714 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T10:44:27.956 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:44:28.334 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:28 smithi111 ceph-mon[36315]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:28.334 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:28 smithi111 ceph-mon[36315]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T10:44:28.335 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:28 smithi111 ceph-mon[36315]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T10:44:28.335 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:28 smithi111 ceph-mon[36315]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:44:28.335 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:28.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:28 smithi174 ceph-mon[36202]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:28.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:28 smithi174 ceph-mon[36202]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T10:44:28.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:28 smithi174 ceph-mon[36202]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T10:44:28.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:28 smithi174 ceph-mon[36202]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:44:28.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:28 smithi017 ceph-mon[32078]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:28 smithi017 ceph-mon[32078]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-16T10:44:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:28 smithi017 ceph-mon[32078]: osdmap e23: 4 total, 3 up, 4 in 2024-03-16T10:44:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:28 smithi017 ceph-mon[32078]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:44:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:29.212 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:44:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:44:29.008+0000 7fa876390700 -1 osd.3 0 waiting for initial osdmap 2024-03-16T10:44:29.212 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:44:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:44:29.013+0000 7fa872183700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011205 s, 936 MB/s 2024-03-16T10:44:29.815 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-03-16T10:44:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:30 smithi174 ceph-mon[36202]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:30 smithi174 ceph-mon[36202]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:44:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:30 smithi174 ceph-mon[36202]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T10:44:30.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:30 smithi017 ceph-mon[32078]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:30.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:30 smithi017 ceph-mon[32078]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:44:30.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:30 smithi017 ceph-mon[32078]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T10:44:30.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:30 smithi111 ceph-mon[36315]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-03-16T10:44:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:30 smithi111 ceph-mon[36315]: from='osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:44:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:30 smithi111 ceph-mon[36315]: osdmap e24: 4 total, 3 up, 4 in 2024-03-16T10:44:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:30.453 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2024-03-16T10:44:30.688 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] boot 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: osdmap e25: 4 total, 4 up, 4 in 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.148 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:31.149 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:44:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:44:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] boot 2024-03-16T10:44:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: osdmap e25: 4 total, 4 up, 4 in 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:31.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:44:31.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:44:31.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: osd.3 [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] boot 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: osdmap e25: 4 total, 4 up, 4 in 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: osdmap e26: 4 total, 4 up, 4 in 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:31.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.264+0000 7f8d003ab700 1 -- 172.21.15.111:0/2282410758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8101270 msgr2=0x7f8cf8101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.264+0000 7f8d003ab700 1 --2- 172.21.15.111:0/2282410758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8101270 0x7f8cf8101690 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40099c0 tx=0x7f8cf4009cd0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- 172.21.15.111:0/2282410758 shutdown_connections 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- 172.21.15.111:0/2282410758 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8101270 0x7f8cf8101690 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- 172.21.15.111:0/2282410758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8102e10 0x7f8cf81096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- 172.21.15.111:0/2282410758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 0x7f8cf81028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- 172.21.15.111:0/2282410758 >> 172.21.15.111:0/2282410758 conn(0x7f8cf80fc830 msgr2=0x7f8cf80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- 172.21.15.111:0/2282410758 shutdown_connections 2024-03-16T10:44:32.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- 172.21.15.111:0/2282410758 wait complete. 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 Processor -- start 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- start start 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 0x7f8cf8197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 0x7f8cf8197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810cde0 con 0x7f8cf8102470 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810cc60 con 0x7f8cf8102e10 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8d003ab700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf810cf60 con 0x7f8cf8101270 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8cfe948700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8cfe948700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33700/0 (socket says 172.21.15.111:33700) 2024-03-16T10:44:32.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.265+0000 7f8cfe948700 1 -- 172.21.15.111:0/1864749107 learned_addr learned my addr 172.21.15.111:0/1864749107 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe147700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 0x7f8cf8197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfd946700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 0x7f8cf8197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 -- 172.21.15.111:0/1864749107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 msgr2=0x7f8cf8197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 0x7f8cf8197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 -- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 msgr2=0x7f8cf8197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 0x7f8cf8197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 -- 172.21.15.111:0/1864749107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf819f0b0 con 0x7f8cf8102e10 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe147700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 0x7f8cf8197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cfe948700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007ee0 tx=0x7f8cf000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0016030 con 0x7f8cf8102e10 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf000dbd0 con 0x7f8cf8102e10 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0012d40 con 0x7f8cf8102e10 2024-03-16T10:44:32.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf806aa30 con 0x7f8cf8102e10 2024-03-16T10:44:32.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.266+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf806af20 con 0x7f8cf8102e10 2024-03-16T10:44:32.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.267+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf8068f90 con 0x7f8cf8102e10 2024-03-16T10:44:32.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.269+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f8cf0012460 con 0x7f8cf8102e10 2024-03-16T10:44:32.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.269+0000 7f8cef7fe700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 0x7f8ce40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:32.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.269+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f8cf00cf860 con 0x7f8cf8102e10 2024-03-16T10:44:32.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.270+0000 7f8cfe147700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 0x7f8ce40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:32.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.270+0000 7f8cfe147700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 0x7f8ce40a4d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4003890 tx=0x7f8cf4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:32.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.273+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8cf009db20 con 0x7f8cf8102e10 2024-03-16T10:44:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:32 smithi111 ceph-mon[36315]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:32 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi017 2024-03-16T10:44:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:32 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi017 to 8546M 2024-03-16T10:44:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:32 smithi111 ceph-mon[36315]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T10:44:32.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:32.478+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8cf806b240 con 0x7f8ce40a2890 2024-03-16T10:44:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:32 smithi174 ceph-mon[36202]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:32 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi017 2024-03-16T10:44:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:32 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi017 to 8546M 2024-03-16T10:44:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:32 smithi174 ceph-mon[36202]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T10:44:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:32 smithi017 ceph-mon[32078]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:32 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi017 2024-03-16T10:44:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:32 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi017 to 8546M 2024-03-16T10:44:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:32 smithi017 ceph-mon[32078]: osdmap e27: 4 total, 4 up, 4 in 2024-03-16T10:44:33.332 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:33 smithi111 ceph-mon[36315]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T10:44:33.332 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:33.332 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:33.332 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:33.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:33 smithi174 ceph-mon[36202]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T10:44:33.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:33.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:33.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:33 smithi017 ceph-mon[32078]: osdmap e28: 4 total, 4 up, 4 in 2024-03-16T10:44:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:34.379 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:34 smithi111 ceph-mon[36315]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-03-16T10:44:34.379 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:34 smithi111 ceph-mon[36315]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:34.380 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:34 smithi111 ceph-mon[36315]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T10:44:34.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:34 smithi174 ceph-mon[36202]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-03-16T10:44:34.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:34 smithi174 ceph-mon[36202]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:34.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:34 smithi174 ceph-mon[36202]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T10:44:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:34 smithi017 ceph-mon[32078]: pgmap v104: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-03-16T10:44:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:34 smithi017 ceph-mon[32078]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:34 smithi017 ceph-mon[32078]: osdmap e29: 4 total, 4 up, 4 in 2024-03-16T10:44:36.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/2836145341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]': finished 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: osdmap e30: 5 total, 4 up, 5 in 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:36 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/1572516375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/2836145341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]': finished 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: osdmap e30: 5 total, 4 up, 5 in 2024-03-16T10:44:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:36 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/1572516375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:36.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/2836145341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]: dispatch 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "378c14d6-4057-4205-96df-afbe86d97234"}]': finished 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: osdmap e30: 5 total, 4 up, 5 in 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:36.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:36 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/1572516375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:44:38.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:38 smithi111 ceph-mon[36315]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:44:38.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:38 smithi174 ceph-mon[36202]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:44:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:38 smithi017 ceph-mon[32078]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:44:40.339 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:40 smithi111 ceph-mon[36315]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:44:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:40 smithi174 ceph-mon[36202]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:44:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:40 smithi017 ceph-mon[32078]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:44:42.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:42 smithi111 ceph-mon[36315]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:42 smithi174 ceph-mon[36202]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:42.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:42 smithi017 ceph-mon[32078]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:43.311 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T10:44:43.312 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:43.312 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:43 smithi111 ceph-mon[36315]: Deploying daemon osd.4 on smithi111 2024-03-16T10:44:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T10:44:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:43 smithi174 ceph-mon[36202]: Deploying daemon osd.4 on smithi111 2024-03-16T10:44:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-16T10:44:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:43 smithi017 ceph-mon[32078]: Deploying daemon osd.4 on smithi111 2024-03-16T10:44:44.317 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:44 smithi111 ceph-mon[36315]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:44.491 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:44 smithi017 ceph-mon[32078]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:44 smithi174 ceph-mon[36202]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:46.336 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:46 smithi111 ceph-mon[36315]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:46 smithi174 ceph-mon[36202]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:46 smithi017 ceph-mon[32078]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:48.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:48 smithi111 ceph-mon[36315]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:48.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:48 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:48 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:48 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:48 smithi174 ceph-mon[36202]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:48 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:48 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:48 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:48 smithi017 ceph-mon[32078]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:48 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:48 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:48 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:50.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:50 smithi111 ceph-mon[36315]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:50 smithi174 ceph-mon[36202]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:50 smithi017 ceph-mon[32078]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:51.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.896+0000 7f8cef7fe700 1 -- 172.21.15.111:0/1864749107 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8cf806b240 con 0x7f8ce40a2890 2024-03-16T10:44:51.897 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 4 on host 'smithi111' 2024-03-16T10:44:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 msgr2=0x7f8ce40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 0x7f8ce40a4d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4003890 tx=0x7f8cf4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 msgr2=0x7f8cf819ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007ee0 tx=0x7f8cf000d3b0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 shutdown_connections 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8ce40a2890 0x7f8ce40a4d50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cf8102e10 0x7f8cf819ea10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cf8101270 0x7f8cf8197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 --2- 172.21.15.111:0/1864749107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf8102470 0x7f8cf8197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.898+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 >> 172.21.15.111:0/1864749107 conn(0x7f8cf80fc830 msgr2=0x7f8cf8105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.899+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 shutdown_connections 2024-03-16T10:44:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:44:51.899+0000 7f8d003ab700 1 -- 172.21.15.111:0/1864749107 wait complete. 2024-03-16T10:44:52.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:51 smithi111 ceph-mon[36315]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:52.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:51 smithi174 ceph-mon[36202]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:52.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:52.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:51 smithi017 ceph-mon[32078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-16T10:44:52.572 DEBUG:teuthology.orchestra.run.smithi111:osd.4> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.4.service 2024-03-16T10:44:52.575 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_3... 2024-03-16T10:44:52.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-16T10:44:52.818 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:44:53.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:53.984 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T10:44:53.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T10:44:53.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:53.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:53.985 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:53 smithi174 ceph-mon[36202]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:54.143 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:54.143 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T10:44:54.143 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T10:44:54.144 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:54.144 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:54.144 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-mon[36315]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:54.144 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:44:53.863+0000 7f88bb23b700 -1 osd.4 0 waiting for initial osdmap 2024-03-16T10:44:54.144 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:44:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:44:53.871+0000 7f88b702e700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:44:54.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:54.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-16T10:44:54.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: osdmap e31: 5 total, 4 up, 5 in 2024-03-16T10:44:54.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: from='osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:54.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:54.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:53 smithi017 ceph-mon[32078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:44:54.844 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-16T10:44:54.845 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-16T10:44:54.845 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-03-16T10:44:54.845 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-03-16T10:44:54.845 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111592 s, 940 MB/s 2024-03-16T10:44:54.845 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-03-16T10:44:55.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:54 smithi111 ceph-mon[36315]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:44:55.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:54 smithi111 ceph-mon[36315]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T10:44:55.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.191 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:54 smithi174 ceph-mon[36202]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:44:55.191 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:54 smithi174 ceph-mon[36202]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T10:44:55.191 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.191 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:54 smithi017 ceph-mon[32078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:44:55.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:54 smithi017 ceph-mon[32078]: osdmap e32: 5 total, 4 up, 5 in 2024-03-16T10:44:55.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:55.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-03-16T10:44:55.764 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:44:56.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:44:56.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:44:56.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:56.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] boot 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: osdmap e33: 5 total, 5 up, 5 in 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:56.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:55 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] boot 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: osdmap e33: 5 total, 5 up, 5 in 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:56.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:56.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:55 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: osd.4 [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] boot 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: osdmap e33: 5 total, 5 up, 5 in 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-16T10:44:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:44:56.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:55 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:44:56.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:56 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi111 2024-03-16T10:44:56.972 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:56 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi111 to 8540M 2024-03-16T10:44:56.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:56 smithi174 ceph-mon[36202]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T10:44:57.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:56 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi111 2024-03-16T10:44:57.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:56 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi111 to 8540M 2024-03-16T10:44:57.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:56 smithi111 ceph-mon[36315]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T10:44:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:56 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi111 2024-03-16T10:44:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:56 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi111 to 8540M 2024-03-16T10:44:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:56 smithi017 ceph-mon[32078]: osdmap e34: 5 total, 5 up, 5 in 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 -- 172.21.15.174:0/3399243063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 msgr2=0x7f8048103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 --2- 172.21.15.174:0/3399243063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f8048103d40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f803c009990 tx=0x7f803c009ca0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 -- 172.21.15.174:0/3399243063 shutdown_connections 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 --2- 172.21.15.174:0/3399243063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8048100d60 0x7f804810a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 --2- 172.21.15.174:0/3399243063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f8048103d40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 --2- 172.21.15.174:0/3399243063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80481003a0 0x7f8048100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 -- 172.21.15.174:0/3399243063 >> 172.21.15.174:0/3399243063 conn(0x7f80480fbf20 msgr2=0x7f80480fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:44:57.506 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 -- 172.21.15.174:0/3399243063 shutdown_connections 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.501+0000 7f804f11c700 1 -- 172.21.15.174:0/3399243063 wait complete. 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 Processor -- start 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 -- start start 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 0x7f80481985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 0x7f8048198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f804810dfa0 con 0x7f80481003a0 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f804810de20 con 0x7f8048100d60 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804f11c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f804810e120 con 0x7f8048103920 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804d6b9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804d6b9700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46034/0 (socket says 172.21.15.174:46034) 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.502+0000 7f804d6b9700 1 -- 172.21.15.174:0/1128906578 learned_addr learned my addr 172.21.15.174:0/1128906578 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:44:57.507 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804ceb8700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 0x7f80481985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f8047fff700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 0x7f8048198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 -- 172.21.15.174:0/1128906578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 msgr2=0x7f8048198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 0x7f8048198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 -- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 msgr2=0x7f80481985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 0x7f80481985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 -- 172.21.15.174:0/1128906578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80481a0240 con 0x7f8048103920 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f8047fff700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 0x7f8048198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804ceb8700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 0x7f80481985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804d6b9700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f804000add0 tx=0x7f804000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040017020 con 0x7f8048103920 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f804000ce20 con 0x7f8048103920 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80481a0530 con 0x7f8048103920 2024-03-16T10:44:57.508 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040005520 con 0x7f8048103920 2024-03-16T10:44:57.509 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.503+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80481a0aa0 con 0x7f8048103920 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.504+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8048068f90 con 0x7f8048103920 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.505+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f8040004ad0 con 0x7f8048103920 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.506+0000 7f8045ffb700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 0x7f80380a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.506+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f80400cd1f0 con 0x7f8048103920 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.506+0000 7f804ceb8700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 0x7f80380a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:44:57.510 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.507+0000 7f804ceb8700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 0x7f80380a4d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f803c0039c0 tx=0x7f803c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:44:57.512 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.511+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8040021020 con 0x7f8048103920 2024-03-16T10:44:57.713 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:44:57.711+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8048062710 con 0x7f80380a2890 2024-03-16T10:44:58.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:57 smithi174 ceph-mon[36202]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:44:58.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:58.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:58.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:58.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:57 smithi111 ceph-mon[36315]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:44:58.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:58.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:58.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:58.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:57 smithi017 ceph-mon[32078]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:44:58.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:44:58.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:44:58.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:44:59.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:58 smithi111 ceph-mon[36315]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:59.249 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:58 smithi174 ceph-mon[36202]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:44:59.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:58 smithi017 ceph-mon[32078]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:00.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:44:59 smithi111 ceph-mon[36315]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:00.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:44:59 smithi174 ceph-mon[36202]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:00.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:44:59 smithi017 ceph-mon[32078]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:01.066 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:00 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/2903981823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.067 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:00 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.067 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:00 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]': finished 2024-03-16T10:45:01.067 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:00 smithi174 ceph-mon[36202]: osdmap e35: 6 total, 5 up, 6 in 2024-03-16T10:45:01.067 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:01.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:00 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/2903981823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:00 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:00 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]': finished 2024-03-16T10:45:01.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:00 smithi111 ceph-mon[36315]: osdmap e35: 6 total, 5 up, 6 in 2024-03-16T10:45:01.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:01.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:00 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/2903981823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:00 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]: dispatch 2024-03-16T10:45:01.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:00 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "250babd9-c57e-4a5a-b6e8-61da501066a8"}]': finished 2024-03-16T10:45:01.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:00 smithi017 ceph-mon[32078]: osdmap e35: 6 total, 5 up, 6 in 2024-03-16T10:45:01.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:01 smithi111 ceph-mon[36315]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:01 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/2334210988' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:02.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:01 smithi174 ceph-mon[36202]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:02.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:01 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/2334210988' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:02.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:01 smithi017 ceph-mon[32078]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:02.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:01 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/2334210988' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:04.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:03 smithi111 ceph-mon[36315]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:04.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:03 smithi174 ceph-mon[36202]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:04.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:03 smithi017 ceph-mon[32078]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:06.029 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:05 smithi174 ceph-mon[36202]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:06.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:05 smithi111 ceph-mon[36315]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:06.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:05 smithi017 ceph-mon[32078]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:08.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:07 smithi111 ceph-mon[36315]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T10:45:08.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:08.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:07 smithi174 ceph-mon[36202]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:08.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T10:45:08.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:08.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:07 smithi017 ceph-mon[32078]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:08.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-16T10:45:08.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:09.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:08 smithi111 ceph-mon[36315]: Deploying daemon osd.5 on smithi174 2024-03-16T10:45:09.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:08 smithi174 ceph-mon[36202]: Deploying daemon osd.5 on smithi174 2024-03-16T10:45:09.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:08 smithi017 ceph-mon[32078]: Deploying daemon osd.5 on smithi174 2024-03-16T10:45:10.013 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:09 smithi174 ceph-mon[36202]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:10.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:09 smithi111 ceph-mon[36315]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:10.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:09 smithi017 ceph-mon[32078]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:11 smithi174 ceph-mon[36202]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:12.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:11 smithi017 ceph-mon[32078]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:12.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:11 smithi111 ceph-mon[36315]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:14.106 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:13 smithi174 ceph-mon[36202]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:14.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:14.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:14.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:13 smithi017 ceph-mon[32078]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:14.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:13 smithi111 ceph-mon[36315]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:16.300 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:15 smithi174 ceph-mon[36202]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:16.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:15 smithi017 ceph-mon[32078]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:16.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:15 smithi111 ceph-mon[36315]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:16.682 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.681+0000 7f8045ffb700 1 -- 172.21.15.174:0/1128906578 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8048062710 con 0x7f80380a2890 2024-03-16T10:45:16.683 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 msgr2=0x7f80380a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 0x7f80380a4d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f803c0039c0 tx=0x7f803c005fb0 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 msgr2=0x7f804819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f804000add0 tx=0x7f804000c330 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 shutdown_connections 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80380a2890 0x7f80380a4d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8048103920 0x7f804819fba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80481003a0 0x7f80481985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 --2- 172.21.15.174:0/1128906578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8048100d60 0x7f8048198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 >> 172.21.15.174:0/1128906578 conn(0x7f80480fbf20 msgr2=0x7f80481069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 shutdown_connections 2024-03-16T10:45:16.685 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:45:16.684+0000 7f804f11c700 1 -- 172.21.15.174:0/1128906578 wait complete. 2024-03-16T10:45:17.723 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.5.service 2024-03-16T10:45:17.725 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2024-03-16T10:45:17.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T10:45:17.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:17 smithi111 ceph-mon[36315]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:17.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:17.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:17.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:17 smithi111 ceph-mon[36315]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:17.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:17 smithi111 ceph-mon[36315]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:17.979 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:45:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:17 smithi174 ceph-mon[36202]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:17 smithi174 ceph-mon[36202]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:17 smithi174 ceph-mon[36202]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:17 smithi017 ceph-mon[32078]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:17 smithi017 ceph-mon[32078]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:17 smithi017 ceph-mon[32078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:18 smithi174 ceph-mon[36202]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T10:45:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T10:45:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:19.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:18 smithi017 ceph-mon[32078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: osdmap e36: 6 total, 5 up, 6 in 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:18 smithi111 ceph-mon[36315]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:45:19.590 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:45:19.334+0000 7f9c562b0700 -1 osd.5 0 waiting for initial osdmap 2024-03-16T10:45:19.590 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:45:19.341+0000 7f9c4e09b700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:45:20.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:20.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:45:20.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T10:45:20.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:19 smithi017 ceph-mon[32078]: from='osd.5 ' entity='osd.5' 2024-03-16T10:45:20.074 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T10:45:20.074 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T10:45:20.074 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-03-16T10:45:20.074 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-03-16T10:45:20.074 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00837473 s, 1.3 GB/s 2024-03-16T10:45:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:19 smithi174 ceph-mon[36202]: from='osd.5 ' entity='osd.5' 2024-03-16T10:45:20.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-03-16T10:45:20.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:45:20.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: osdmap e37: 6 total, 5 up, 6 in 2024-03-16T10:45:20.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:20.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:19 smithi111 ceph-mon[36315]: from='osd.5 ' entity='osd.5' 2024-03-16T10:45:20.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-03-16T10:45:21.036 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] boot 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: osdmap e38: 6 total, 6 up, 6 in 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:21.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:20 smithi017 ceph-mon[32078]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] boot 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: osdmap e38: 6 total, 6 up, 6 in 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:21.271 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:20 smithi174 ceph-mon[36202]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T10:45:21.336 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:45:21.336 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:45:21.337 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: osd.5 [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] boot 2024-03-16T10:45:21.337 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: osdmap e38: 6 total, 6 up, 6 in 2024-03-16T10:45:21.337 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-16T10:45:21.337 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:20 smithi111 ceph-mon[36315]: osdmap e39: 6 total, 6 up, 6 in 2024-03-16T10:45:22.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi174 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi174 to 8540M 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi174 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.472 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi174 to 8540M 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.473 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.474 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: osdmap e40: 6 total, 6 up, 6 in 2024-03-16T10:45:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi174 2024-03-16T10:45:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi174 to 8540M 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:22.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 -- 172.21.15.17:0/538264820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 msgr2=0x7fbdf8107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 --2- 172.21.15.17:0/538264820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8107b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009990 tx=0x7fbde8009ca0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 -- 172.21.15.17:0/538264820 shutdown_connections 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 --2- 172.21.15.17:0/538264820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8108050 0x7fbdf810a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 --2- 172.21.15.17:0/538264820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8102df0 0x7fbdf81051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 --2- 172.21.15.17:0/538264820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8107b10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.805+0000 7fbdffa85700 1 -- 172.21.15.17:0/538264820 >> 172.21.15.17:0/538264820 conn(0x7fbdf80fc7c0 msgr2=0x7fbdf80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- 172.21.15.17:0/538264820 shutdown_connections 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- 172.21.15.17:0/538264820 wait complete. 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 Processor -- start 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- start start 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8102df0 0x7fbdf81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 0x7fbdf819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf810ded0 con 0x7fbdf8105720 2024-03-16T10:45:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf810dd50 con 0x7fbdf8102df0 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdffa85700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf810e050 con 0x7fbdf8108050 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdfd020700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdfd020700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51018/0 (socket says 172.21.15.17:51018) 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.806+0000 7fbdfd020700 1 -- 172.21.15.17:0/3045535274 learned_addr learned my addr 172.21.15.17:0/3045535274 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd821700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8102df0 0x7fbdf81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfe022700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 0x7fbdf819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 -- 172.21.15.17:0/3045535274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 msgr2=0x7fbdf819f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 0x7fbdf819f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 -- 172.21.15.17:0/3045535274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8102df0 msgr2=0x7fbdf81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8102df0 0x7fbdf81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 -- 172.21.15.17:0/3045535274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf81a0050 con 0x7fbdf8105720 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfe022700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 0x7fbdf819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:45:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdfd020700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbde80047b0 tx=0x7fbde8009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:45:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8027070 con 0x7fbdf8105720 2024-03-16T10:45:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf81a02e0 con 0x7fbdf8105720 2024-03-16T10:45:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde8022470 con 0x7fbdf8105720 2024-03-16T10:45:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800f6c0 con 0x7fbdf8105720 2024-03-16T10:45:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.807+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf81a0790 con 0x7fbdf8105720 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.808+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf8068f90 con 0x7fbdf8105720 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.809+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fbde802a070 con 0x7fbdf8105720 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.810+0000 7fbdeeffd700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 0x7fbde40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.810+0000 7fbdfd821700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 0x7fbde40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.810+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4533+0+0 (secure 0 0 0) 0x7fbde80cec60 con 0x7fbdf8105720 2024-03-16T10:45:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.810+0000 7fbdfd821700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 0x7fbde40a4d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400ac50 tx=0x7fbdf400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:45:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:22.815+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbde805e740 con 0x7fbdf8105720 2024-03-16T10:45:23.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:23.029+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbdf8062710 con 0x7fbde40a2890 2024-03-16T10:45:23.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:23 smithi017 ceph-mon[32078]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T10:45:23.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:23.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:23.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:23.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:23 smithi111 ceph-mon[36315]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T10:45:23.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:23.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:23.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:23 smithi174 ceph-mon[36202]: osdmap e41: 6 total, 6 up, 6 in 2024-03-16T10:45:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:24.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:24 smithi017 ceph-mon[32078]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-03-16T10:45:24.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:24 smithi017 ceph-mon[32078]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:24.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:24 smithi017 ceph-mon[32078]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T10:45:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:24 smithi111 ceph-mon[36315]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-03-16T10:45:24.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:24 smithi111 ceph-mon[36315]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:24.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:24 smithi111 ceph-mon[36315]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T10:45:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:24 smithi174 ceph-mon[36202]: pgmap v142: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 164 KiB/s, 0 objects/s recovering 2024-03-16T10:45:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:24 smithi174 ceph-mon[36202]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:24 smithi174 ceph-mon[36202]: osdmap e42: 6 total, 6 up, 6 in 2024-03-16T10:45:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:26 smithi017 ceph-mon[32078]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:45:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:26 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]: dispatch 2024-03-16T10:45:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:26 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]': finished 2024-03-16T10:45:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:26 smithi017 ceph-mon[32078]: osdmap e43: 7 total, 6 up, 7 in 2024-03-16T10:45:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:26 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:26 smithi111 ceph-mon[36315]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:45:26.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:26 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]: dispatch 2024-03-16T10:45:26.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:26 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]': finished 2024-03-16T10:45:26.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:26 smithi111 ceph-mon[36315]: osdmap e43: 7 total, 6 up, 7 in 2024-03-16T10:45:26.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:26 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:26 smithi174 ceph-mon[36202]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-16T10:45:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:26 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]: dispatch 2024-03-16T10:45:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:26 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1492909081' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbed0a5f-2a68-41e2-a105-431f47433d7b"}]': finished 2024-03-16T10:45:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:26 smithi174 ceph-mon[36202]: osdmap e43: 7 total, 6 up, 7 in 2024-03-16T10:45:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:26 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:27.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:27 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1491550980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:27.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:27 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1491550980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:27.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:27 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1491550980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:28 smithi111 ceph-mon[36315]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:45:28.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:28 smithi174 ceph-mon[36202]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:45:28.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:28 smithi017 ceph-mon[32078]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-03-16T10:45:30.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:30 smithi111 ceph-mon[36315]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:30.713 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:30 smithi017 ceph-mon[32078]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:30.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:30 smithi174 ceph-mon[36202]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:32 smithi111 ceph-mon[36315]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:32.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:32 smithi017 ceph-mon[32078]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:32.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:32 smithi174 ceph-mon[36202]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:33.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T10:45:33.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:33.674 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T10:45:33.674 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:33.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-16T10:45:33.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:34.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:34 smithi017 ceph-mon[32078]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:34.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:34 smithi017 ceph-mon[32078]: Deploying daemon osd.6 on smithi017 2024-03-16T10:45:34.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:34 smithi111 ceph-mon[36315]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:34.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:34 smithi111 ceph-mon[36315]: Deploying daemon osd.6 on smithi017 2024-03-16T10:45:34.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:34 smithi174 ceph-mon[36202]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:34.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:34 smithi174 ceph-mon[36202]: Deploying daemon osd.6 on smithi017 2024-03-16T10:45:36.535 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:36 smithi017 ceph-mon[32078]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:36 smithi111 ceph-mon[36315]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:36.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:36 smithi174 ceph-mon[36202]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:38.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:38 smithi017 ceph-mon[32078]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:38 smithi111 ceph-mon[36315]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:38 smithi174 ceph-mon[36202]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:39 smithi174 ceph-mon[36202]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:40.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:39 smithi017 ceph-mon[32078]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:40.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:40.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:39 smithi111 ceph-mon[36315]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:40.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:40.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:41.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:41.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:41.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:41.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:41.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:41.993 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:42.838 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2024-03-16T10:45:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.836+0000 7fbdeeffd700 1 -- 172.21.15.17:0/3045535274 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbdf8062710 con 0x7fbde40a2890 2024-03-16T10:45:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.837+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 msgr2=0x7fbde40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 0x7fbde40a4d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400ac50 tx=0x7fbdf400a380 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 msgr2=0x7fbdf8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbde80047b0 tx=0x7fbde8009f50 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 shutdown_connections 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbde40a2890 0x7fbde40a4d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdf8102df0 0x7fbdf81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdf8108050 0x7fbdf819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 --2- 172.21.15.17:0/3045535274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdf8105720 0x7fbdf8198930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 >> 172.21.15.17:0/3045535274 conn(0x7fbdf80fc7c0 msgr2=0x7fbdf8103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 shutdown_connections 2024-03-16T10:45:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:45:42.838+0000 7fbdffa85700 1 -- 172.21.15.17:0/3045535274 wait complete. 2024-03-16T10:45:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:42 smithi174 ceph-mon[36202]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T10:45:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:42 smithi017 ceph-mon[32078]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T10:45:43.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:42 smithi111 ceph-mon[36315]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-16T10:45:43.637 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.6.service 2024-03-16T10:45:43.639 INFO:tasks.cephadm:Deploying osd.7 on smithi111 with /dev/vg_nvme/lv_2... 2024-03-16T10:45:43.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T10:45:43.888 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:43.943 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:43 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:44.010 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:43 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: osdmap e44: 7 total, 6 up, 7 in 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:43 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:45:44.524 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:45:44.242+0000 7f8975cc3700 -1 osd.6 0 waiting for initial osdmap 2024-03-16T10:45:44.524 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:45:44.251+0000 7f896daae700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:45:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:44 smithi174 ceph-mon[36202]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:45:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:44 smithi174 ceph-mon[36202]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T10:45:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:44 smithi174 ceph-mon[36202]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' 2024-03-16T10:45:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-mon[32078]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:45:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-mon[32078]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T10:45:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:44 smithi017 ceph-mon[32078]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' 2024-03-16T10:45:45.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:44 smithi111 ceph-mon[36315]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:45:45.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:44 smithi111 ceph-mon[36315]: osdmap e45: 7 total, 6 up, 7 in 2024-03-16T10:45:45.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:45.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:44 smithi111 ceph-mon[36315]: from='osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791]' entity='osd.6' 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] boot 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: osdmap e46: 7 total, 7 up, 7 in 2024-03-16T10:45:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T10:45:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T10:45:46.087 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-03-16T10:45:46.087 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-03-16T10:45:46.087 INFO:teuthology.orchestra.run.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112832 s, 929 MB/s 2024-03-16T10:45:46.087 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] boot 2024-03-16T10:45:46.087 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: osdmap e46: 7 total, 7 up, 7 in 2024-03-16T10:45:46.088 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: osd.6 [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] boot 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: osdmap e46: 7 total, 7 up, 7 in 2024-03-16T10:45:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-16T10:45:46.828 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2024-03-16T10:45:47.070 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:45:47.438 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:47.439 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:47.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:47.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: osdmap e47: 7 total, 7 up, 7 in 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:45:47.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:47.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:47.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:45:47.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:45:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:48 smithi174 ceph-mon[36202]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:48 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi017 2024-03-16T10:45:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:48 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi017 to 5697M 2024-03-16T10:45:48.572 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:48 smithi111 ceph-mon[36315]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:48.572 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:48 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi017 2024-03-16T10:45:48.572 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:48 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi017 to 5697M 2024-03-16T10:45:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:48 smithi017 ceph-mon[32078]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:48 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi017 2024-03-16T10:45:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:48 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi017 to 5697M 2024-03-16T10:45:48.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 -- 172.21.15.111:0/3852621156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20108060 msgr2=0x7f5b2010a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:48.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 --2- 172.21.15.111:0/3852621156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20108060 0x7f5b2010a4d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800b0a0 tx=0x7f5b1800b3b0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 -- 172.21.15.111:0/3852621156 shutdown_connections 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 --2- 172.21.15.111:0/3852621156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20108060 0x7f5b2010a4d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 --2- 172.21.15.111:0/3852621156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 0x7f5b201051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 --2- 172.21.15.111:0/3852621156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20105730 0x7f5b20107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 -- 172.21.15.111:0/3852621156 >> 172.21.15.111:0/3852621156 conn(0x7f5b200fc830 msgr2=0x7f5b200fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.834+0000 7f5b28649700 1 -- 172.21.15.111:0/3852621156 shutdown_connections 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 -- 172.21.15.111:0/3852621156 wait complete. 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 Processor -- start 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 -- start start 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 0x7f5b20198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:48.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20108060 0x7f5b2019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010df80 con 0x7f5b20108060 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010de00 con 0x7f5b20105730 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.835+0000 7f5b28649700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2010e100 con 0x7f5b20102e00 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33622/0 (socket says 172.21.15.111:33622) 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 -- 172.21.15.111:0/3617631594 learned_addr learned my addr 172.21.15.111:0/3617631594 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b263e5700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 0x7f5b20198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b26be6700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20108060 0x7f5b2019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 -- 172.21.15.111:0/3617631594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 msgr2=0x7f5b20198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 0x7f5b20198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 -- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20108060 msgr2=0x7f5b2019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20108060 0x7f5b2019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:45:48.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 -- 172.21.15.111:0/3617631594 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b201a01c0 con 0x7f5b20105730 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b25be4700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d950 tx=0x7f5b1000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10016070 con 0x7f5b20105730 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b1000fd70 con 0x7f5b20105730 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000e610 con 0x7f5b20105730 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b201a04b0 con 0x7f5b20105730 2024-03-16T10:45:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.836+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201a0a40 con 0x7f5b20105730 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.837+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b20068f90 con 0x7f5b20105730 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.839+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f5b10019070 con 0x7f5b20105730 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.839+0000 7f5b177fe700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 0x7f5b0c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.839+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f5b100cd750 con 0x7f5b20105730 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.839+0000 7f5b263e5700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 0x7f5b0c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:45:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.840+0000 7f5b263e5700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 0x7f5b0c0a4dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009a10 tx=0x7f5b1c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:45:48.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:48.843+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5b1009b500 con 0x7f5b20105730 2024-03-16T10:45:49.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:45:49.043+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5b200627d0 con 0x7f5b0c0a2910 2024-03-16T10:45:49.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:49.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:49.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:49.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:49.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:49.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:49.629 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:45:49.630 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:45:49.630 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:50 smithi174 ceph-mon[36202]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:50 smithi174 ceph-mon[36202]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:50 smithi017 ceph-mon[32078]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:50 smithi017 ceph-mon[32078]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:50.633 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:50 smithi111 ceph-mon[36315]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:50.633 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:50 smithi111 ceph-mon[36315]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:45:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/2179860834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]': finished 2024-03-16T10:45:52.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: osdmap e48: 8 total, 7 up, 8 in 2024-03-16T10:45:52.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:52 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/2179860834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]': finished 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: osdmap e48: 8 total, 7 up, 8 in 2024-03-16T10:45:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:52 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:45:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:52.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/2179860834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]: dispatch 2024-03-16T10:45:52.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9926c51c-4954-470c-a6d2-cd4ec79d50bb"}]': finished 2024-03-16T10:45:52.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: osdmap e48: 8 total, 7 up, 8 in 2024-03-16T10:45:52.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:52 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:45:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:53 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/384198214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:53 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/384198214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:53 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/384198214' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:45:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:54 smithi174 ceph-mon[36202]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:54 smithi017 ceph-mon[32078]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:54 smithi111 ceph-mon[36315]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:56.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:56 smithi111 ceph-mon[36315]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:56 smithi174 ceph-mon[36202]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:56 smithi017 ceph-mon[32078]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:58.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:58 smithi111 ceph-mon[36315]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:58 smithi174 ceph-mon[36202]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:58 smithi017 ceph-mon[32078]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:45:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:59 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T10:45:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:45:59 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:59 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T10:45:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:45:59 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:45:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:59 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-16T10:45:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:45:59 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:00 smithi174 ceph-mon[36202]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:00 smithi174 ceph-mon[36202]: Deploying daemon osd.7 on smithi111 2024-03-16T10:46:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:00 smithi017 ceph-mon[32078]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:00 smithi017 ceph-mon[32078]: Deploying daemon osd.7 on smithi111 2024-03-16T10:46:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:00 smithi111 ceph-mon[36315]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:00 smithi111 ceph-mon[36315]: Deploying daemon osd.7 on smithi111 2024-03-16T10:46:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:02 smithi174 ceph-mon[36202]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:02 smithi017 ceph-mon[32078]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:02.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:02 smithi111 ceph-mon[36315]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:04.414 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:04 smithi111 ceph-mon[36315]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:04 smithi174 ceph-mon[36202]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:04.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:04 smithi017 ceph-mon[32078]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:06.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:06 smithi017 ceph-mon[32078]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:06.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:06.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:06 smithi111 ceph-mon[36315]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:06.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:06 smithi174 ceph-mon[36202]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:08.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:08.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:08.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:08.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:08.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:08.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:08.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:08.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.810+0000 7f5b177fe700 1 -- 172.21.15.111:0/3617631594 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5b200627d0 con 0x7f5b0c0a2910 2024-03-16T10:46:08.812 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 7 on host 'smithi111' 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 msgr2=0x7f5b0c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 0x7f5b0c0a4dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009a10 tx=0x7f5b1c009190 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 msgr2=0x7f5b20198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d950 tx=0x7f5b1000dc60 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 shutdown_connections 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b0c0a2910 0x7f5b0c0a4dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b20108060 0x7f5b2019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b20102e00 0x7f5b20198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 --2- 172.21.15.111:0/3617631594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b20105730 0x7f5b20198aa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:08.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 >> 172.21.15.111:0/3617631594 conn(0x7f5b200fc830 msgr2=0x7f5b201036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:46:08.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 shutdown_connections 2024-03-16T10:46:08.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:46:08.813+0000 7f5b28649700 1 -- 172.21.15.111:0/3617631594 wait complete. 2024-03-16T10:46:09.496 DEBUG:teuthology.orchestra.run.smithi111:osd.7> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.7.service 2024-03-16T10:46:09.498 INFO:tasks.cephadm:Deploying osd.8 on smithi174 with /dev/vg_nvme/lv_2... 2024-03-16T10:46:09.498 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-16T10:46:09.742 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:09 smithi174 ceph-mon[36202]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:09 smithi017 ceph-mon[32078]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:09 smithi111 ceph-mon[36315]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-16T10:46:10.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:10 smithi111 ceph-mon[36315]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T10:46:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:10 smithi111 ceph-mon[36315]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T10:46:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:10 smithi111 ceph-mon[36315]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:10 smithi111 ceph-mon[36315]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:10.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:10 smithi174 ceph-mon[36202]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T10:46:10.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:10 smithi174 ceph-mon[36202]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T10:46:10.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:10.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:10 smithi174 ceph-mon[36202]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:10.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:10 smithi174 ceph-mon[36202]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:10 smithi017 ceph-mon[32078]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-16T10:46:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:10 smithi017 ceph-mon[32078]: osdmap e49: 8 total, 7 up, 8 in 2024-03-16T10:46:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:10 smithi017 ceph-mon[32078]: from='osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:11.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:10 smithi017 ceph-mon[32078]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:46:11.663 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:46:11.231+0000 7f1ebbb4b700 -1 osd.7 0 waiting for initial osdmap 2024-03-16T10:46:11.663 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:46:11.242+0000 7f1eb3936700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:46:11.744 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-16T10:46:11.745 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-16T10:46:11.745 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-03-16T10:46:11.745 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-03-16T10:46:11.745 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115858 s, 905 MB/s 2024-03-16T10:46:11.745 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-03-16T10:46:12.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:12.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:46:12.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T10:46:12.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:11 smithi017 ceph-mon[32078]: from='osd.7 ' entity='osd.7' 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.108 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:11 smithi111 ceph-mon[36315]: from='osd.7 ' entity='osd.7' 2024-03-16T10:46:12.224 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-03-16T10:46:12.224 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:46:12.225 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: osdmap e50: 8 total, 7 up, 8 in 2024-03-16T10:46:12.225 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.225 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.225 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:11 smithi174 ceph-mon[36202]: from='osd.7 ' entity='osd.7' 2024-03-16T10:46:12.611 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-03-16T10:46:12.861 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:46:12.885 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:46:12.885 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:46:12.885 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] boot 2024-03-16T10:46:12.885 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: osdmap e51: 8 total, 8 up, 8 in 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:12.886 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:46:13.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:46:13.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] boot 2024-03-16T10:46:13.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: osdmap e51: 8 total, 8 up, 8 in 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:13.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: osd.7 [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] boot 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: osdmap e51: 8 total, 8 up, 8 in 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:13.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:13.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:13 smithi174 ceph-mon[36202]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:13.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:13 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi111 2024-03-16T10:46:13.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:13 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi111 to 5693M 2024-03-16T10:46:13.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:13 smithi174 ceph-mon[36202]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T10:46:14.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:13 smithi017 ceph-mon[32078]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:14.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:13 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi111 2024-03-16T10:46:14.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:13 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi111 to 5693M 2024-03-16T10:46:14.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:13 smithi017 ceph-mon[32078]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T10:46:14.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:13 smithi111 ceph-mon[36315]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:14.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:13 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi111 2024-03-16T10:46:14.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:13 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi111 to 5693M 2024-03-16T10:46:14.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:13 smithi111 ceph-mon[36315]: osdmap e52: 8 total, 8 up, 8 in 2024-03-16T10:46:14.530 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- 172.21.15.174:0/3224839806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 msgr2=0x7f430010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:14.530 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 --2- 172.21.15.174:0/3224839806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430010a750 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f42f800b0a0 tx=0x7f42f800b3b0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.530 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- 172.21.15.174:0/3224839806 shutdown_connections 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 --2- 172.21.15.174:0/3224839806 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430010a750 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 --2- 172.21.15.174:0/3224839806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300102300 0x7f4300102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 --2- 172.21.15.174:0/3224839806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300103500 0x7f4300103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- 172.21.15.174:0/3224839806 >> 172.21.15.174:0/3224839806 conn(0x7f43000fd8e0 msgr2=0x7f43000ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- 172.21.15.174:0/3224839806 shutdown_connections 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- 172.21.15.174:0/3224839806 wait complete. 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 Processor -- start 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.527+0000 7f4307f58700 1 -- start start 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300102300 0x7f43001983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300103500 0x7f4300198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f430010dee0 con 0x7f4300103500 2024-03-16T10:46:14.531 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f430010dd60 con 0x7f4300102300 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f430010e060 con 0x7f4300103ea0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:59660/0 (socket says 172.21.15.174:59660) 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 -- 172.21.15.174:0/1326236848 learned_addr learned my addr 172.21.15.174:0/1326236848 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43054f3700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300103500 0x7f4300198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4305cf4700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300102300 0x7f43001983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 -- 172.21.15.174:0/1326236848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300102300 msgr2=0x7f43001983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300102300 0x7f43001983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 -- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300103500 msgr2=0x7f4300198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300103500 0x7f4300198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 -- 172.21.15.174:0/1326236848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001a0030 con 0x7f4300103ea0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f43064f5700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f42f800be60 tx=0x7f42f800be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8021020 con 0x7f4300103ea0 2024-03-16T10:46:14.532 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43001a02c0 con 0x7f4300103ea0 2024-03-16T10:46:14.533 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f8005520 con 0x7f4300103ea0 2024-03-16T10:46:14.533 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f801b900 con 0x7f4300103ea0 2024-03-16T10:46:14.533 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.528+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001a0770 con 0x7f4300103ea0 2024-03-16T10:46:14.533 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.529+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4300068f90 con 0x7f4300103ea0 2024-03-16T10:46:14.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.531+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f42f8024020 con 0x7f4300103ea0 2024-03-16T10:46:14.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.532+0000 7f42f6ffd700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 0x7f42ec0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:14.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.532+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f42f800f020 con 0x7f4300103ea0 2024-03-16T10:46:14.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.532+0000 7f4305cf4700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 0x7f42ec0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:14.534 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.532+0000 7f4305cf4700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 0x7f42ec0a4d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4300103360 tx=0x7f42fc00a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:46:14.538 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.536+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f42f809d180 con 0x7f4300103ea0 2024-03-16T10:46:14.739 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:14.737+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4300062710 con 0x7f42ec0a2890 2024-03-16T10:46:15.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:14 smithi017 ceph-mon[32078]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T10:46:15.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:15.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:15.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:15.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:14 smithi111 ceph-mon[36315]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T10:46:15.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:15.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:15.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:14 smithi174 ceph-mon[36202]: osdmap e53: 8 total, 8 up, 8 in 2024-03-16T10:46:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:16.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:15 smithi174 ceph-mon[36202]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:16.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:15 smithi174 ceph-mon[36202]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:16.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:15 smithi174 ceph-mon[36202]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T10:46:16.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:15 smithi111 ceph-mon[36315]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:15 smithi111 ceph-mon[36315]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:15 smithi111 ceph-mon[36315]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T10:46:16.234 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:15 smithi017 ceph-mon[32078]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:16.234 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:15 smithi017 ceph-mon[32078]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:16.234 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:15 smithi017 ceph-mon[32078]: osdmap e54: 8 total, 8 up, 8 in 2024-03-16T10:46:17.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:16 smithi174 ceph-mon[36202]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T10:46:17.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:16 smithi111 ceph-mon[36315]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T10:46:17.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:16 smithi017 ceph-mon[32078]: osdmap e55: 8 total, 8 up, 8 in 2024-03-16T10:46:18.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:18.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/980182259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]': finished 2024-03-16T10:46:18.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: osdmap e56: 9 total, 8 up, 9 in 2024-03-16T10:46:18.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:17 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/980182259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]': finished 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: osdmap e56: 9 total, 8 up, 9 in 2024-03-16T10:46:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:17 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/980182259' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]: dispatch 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c482b95a-bcfd-4b86-806e-e5e11694b585"}]': finished 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: osdmap e56: 9 total, 8 up, 9 in 2024-03-16T10:46:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:17 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:19.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/1675599175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:19.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/1675599175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:19.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/1675599175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:20.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:19 smithi111 ceph-mon[36315]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:20.214 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:19 smithi174 ceph-mon[36202]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:20.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:19 smithi017 ceph-mon[32078]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:22.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:21 smithi111 ceph-mon[36315]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:21 smithi174 ceph-mon[36202]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:22.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:21 smithi017 ceph-mon[32078]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:24.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:23 smithi174 ceph-mon[36202]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:24.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:23 smithi111 ceph-mon[36315]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:24.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:23 smithi017 ceph-mon[32078]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:26.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:25 smithi017 ceph-mon[32078]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:26.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T10:46:26.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:26.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:25 smithi017 ceph-mon[32078]: Deploying daemon osd.8 on smithi174 2024-03-16T10:46:26.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:25 smithi111 ceph-mon[36315]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:26.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T10:46:26.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:26.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:25 smithi111 ceph-mon[36315]: Deploying daemon osd.8 on smithi174 2024-03-16T10:46:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:25 smithi174 ceph-mon[36202]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-16T10:46:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:25 smithi174 ceph-mon[36202]: Deploying daemon osd.8 on smithi174 2024-03-16T10:46:28.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:27 smithi174 ceph-mon[36202]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:28.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:27 smithi111 ceph-mon[36315]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:28.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:27 smithi017 ceph-mon[32078]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:30.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:29 smithi174 ceph-mon[36202]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:30.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:29 smithi111 ceph-mon[36315]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:30.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:29 smithi017 ceph-mon[32078]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:32.055 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:32 smithi174 ceph-mon[36202]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:32.056 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.056 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.056 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:32 smithi017 ceph-mon[32078]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:32.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:32 smithi111 ceph-mon[36315]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:34 smithi174 ceph-mon[36202]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:34 smithi017 ceph-mon[32078]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:34.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:34 smithi111 ceph-mon[36315]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:34.556 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 8 on host 'smithi174' 2024-03-16T10:46:34.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.555+0000 7f42f6ffd700 1 -- 172.21.15.174:0/1326236848 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4300062710 con 0x7f42ec0a2890 2024-03-16T10:46:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 msgr2=0x7f42ec0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 0x7f42ec0a4d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4300103360 tx=0x7f42fc00a3b0 comp rx=0 tx=0).stop 2024-03-16T10:46:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 msgr2=0x7f430019f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f42f800be60 tx=0x7f42f800be90 comp rx=0 tx=0).stop 2024-03-16T10:46:34.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 shutdown_connections 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f42ec0a2890 0x7f42ec0a4d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300102300 0x7f43001983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4300103ea0 0x7f430019f990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 --2- 172.21.15.174:0/1326236848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300103500 0x7f4300198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.557+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 >> 172.21.15.174:0/1326236848 conn(0x7f43000fd8e0 msgr2=0x7f43001067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.558+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 shutdown_connections 2024-03-16T10:46:34.559 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:46:34.558+0000 7f4307f58700 1 -- 172.21.15.174:0/1326236848 wait complete. 2024-03-16T10:46:35.592 DEBUG:teuthology.orchestra.run.smithi174:osd.8> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.8.service 2024-03-16T10:46:35.594 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2024-03-16T10:46:35.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:35 smithi174 ceph-mon[36202]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:35 smithi174 ceph-mon[36202]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:35 smithi174 ceph-mon[36202]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:35 smithi017 ceph-mon[32078]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:35 smithi017 ceph-mon[32078]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:35 smithi017 ceph-mon[32078]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:35.851 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:46:35.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:35 smithi111 ceph-mon[36315]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:35.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:35.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:35 smithi111 ceph-mon[36315]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:35.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:35 smithi111 ceph-mon[36315]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-16T10:46:36.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:46:36.525+0000 7feb1fc45700 -1 osd.8 0 waiting for initial osdmap 2024-03-16T10:46:36.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:46:36.534+0000 7feb1ba38700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:46:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:36.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:36 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:36.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:36 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:36.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-16T10:46:36.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: osdmap e57: 9 total, 8 up, 9 in 2024-03-16T10:46:36.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:36.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:46:36.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:36.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:36 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:37.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:37 smithi174 ceph-mon[36202]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:37.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:37 smithi174 ceph-mon[36202]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:46:37.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:37 smithi174 ceph-mon[36202]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T10:46:37.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:37 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:37.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:37 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:37.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:37 smithi017 ceph-mon[32078]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:37.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:37 smithi017 ceph-mon[32078]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:46:37.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:37 smithi017 ceph-mon[32078]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T10:46:37.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:37 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:37.779 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:37 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:37 smithi111 ceph-mon[36315]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:37 smithi111 ceph-mon[36315]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:46:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:37 smithi111 ceph-mon[36315]: osdmap e58: 9 total, 8 up, 9 in 2024-03-16T10:46:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:37 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:37 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T10:46:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T10:46:38.111 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2024-03-16T10:46:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2024-03-16T10:46:38.112 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00880813 s, 1.2 GB/s 2024-03-16T10:46:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] boot 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: osdmap e59: 9 total, 9 up, 9 in 2024-03-16T10:46:38.758 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:38 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] boot 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: osdmap e59: 9 total, 9 up, 9 in 2024-03-16T10:46:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:38 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: osd.8 [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] boot 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: osdmap e59: 9 total, 9 up, 9 in 2024-03-16T10:46:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:38 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-16T10:46:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi174 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi174 to 5693M 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:39.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:39.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T10:46:39.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi174 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi174 to 5693M 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:39.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:39.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: pgmap v198: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: osdmap e60: 9 total, 9 up, 9 in 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi174 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:46:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi174 to 5693M 2024-03-16T10:46:39.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:39.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:39.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:39.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 -- 172.21.15.17:0/721296580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30101200 msgr2=0x7fca30101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 --2- 172.21.15.17:0/721296580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30101200 0x7fca30101620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fca200099c0 tx=0x7fca20009cd0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 -- 172.21.15.17:0/721296580 shutdown_connections 2024-03-16T10:46:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 --2- 172.21.15.17:0/721296580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102da0 0x7fca30109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 --2- 172.21.15.17:0/721296580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30101200 0x7fca30101620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 --2- 172.21.15.17:0/721296580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30102400 0x7fca30102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 -- 172.21.15.17:0/721296580 >> 172.21.15.17:0/721296580 conn(0x7fca300fc7a0 msgr2=0x7fca300febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 -- 172.21.15.17:0/721296580 shutdown_connections 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.740+0000 7fca35427700 1 -- 172.21.15.17:0/721296580 wait complete. 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 Processor -- start 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 -- start start 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 0x7fca30105190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102400 0x7fca301037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca3010ce50 con 0x7fca30102da0 2024-03-16T10:46:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fca3010ccd0 con 0x7fca30101200 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca35427700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca3010cfd0 con 0x7fca30102400 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.741+0000 7fca2f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43880/0 (socket says 172.21.15.17:43880) 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2f7fe700 1 -- 172.21.15.17:0/2615345005 learned_addr learned my addr 172.21.15.17:0/2615345005 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 0x7fca30105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2e7fc700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102400 0x7fca301037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 -- 172.21.15.17:0/2615345005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102400 msgr2=0x7fca301037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102400 0x7fca301037e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 -- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 msgr2=0x7fca30103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 -- 172.21.15.17:0/2615345005 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca301045d0 con 0x7fca30101200 2024-03-16T10:46:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2f7fe700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca2effd700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 0x7fca30105190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca200098e0 tx=0x7fca20009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20027070 con 0x7fca30101200 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20003f40 con 0x7fca30101200 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301a26f0 con 0x7fca30101200 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20022ba0 con 0x7fca30101200 2024-03-16T10:46:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.742+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301a2bd0 con 0x7fca30101200 2024-03-16T10:46:40.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.743+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca30068f90 con 0x7fca30101200 2024-03-16T10:46:40.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.744+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fca2002a070 con 0x7fca30101200 2024-03-16T10:46:40.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.745+0000 7fca17fff700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 0x7fca180a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:46:40.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.745+0000 7fca2e7fc700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 0x7fca180a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:46:40.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.745+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5829+0+0 (secure 0 0 0) 0x7fca200cf070 con 0x7fca30101200 2024-03-16T10:46:40.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.745+0000 7fca2e7fc700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 0x7fca180a4dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca24007c60 tx=0x7fca240073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:46:40.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.749+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fca20013070 con 0x7fca30101200 2024-03-16T10:46:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:40 smithi174 ceph-mon[36202]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T10:46:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:40 smithi174 ceph-mon[36202]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T10:46:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:40 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:40 smithi017 ceph-mon[32078]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T10:46:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:40 smithi017 ceph-mon[32078]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T10:46:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:40.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:40 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:40.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:40 smithi111 ceph-mon[36315]: osdmap e61: 9 total, 9 up, 9 in 2024-03-16T10:46:40.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:40 smithi111 ceph-mon[36315]: osdmap e62: 9 total, 9 up, 9 in 2024-03-16T10:46:40.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:40.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:46:40.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:40 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:40.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:46:40.964+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fca301a2ef0 con 0x7fca180a2910 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:41.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:41 smithi174 ceph-mon[36202]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:41.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:41 smithi017 ceph-mon[32078]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T10:46:41.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:46:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:46:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:46:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:41.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:41 smithi111 ceph-mon[36315]: osdmap e63: 9 total, 9 up, 9 in 2024-03-16T10:46:43.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:43 smithi174 ceph-mon[36202]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T10:46:43.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:43 smithi017 ceph-mon[32078]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T10:46:43.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:43 smithi111 ceph-mon[36315]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-16T10:46:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]: dispatch 2024-03-16T10:46:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]': finished 2024-03-16T10:46:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:44 smithi174 ceph-mon[36202]: osdmap e64: 10 total, 9 up, 10 in 2024-03-16T10:46:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:46:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/51082369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:44.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]: dispatch 2024-03-16T10:46:44.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]': finished 2024-03-16T10:46:44.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:44 smithi017 ceph-mon[32078]: osdmap e64: 10 total, 9 up, 10 in 2024-03-16T10:46:44.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:46:44.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/51082369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:44.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]: dispatch 2024-03-16T10:46:44.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1072351768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "126cff44-91f0-49a3-8ff3-762baa059349"}]': finished 2024-03-16T10:46:44.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:44 smithi111 ceph-mon[36315]: osdmap e64: 10 total, 9 up, 10 in 2024-03-16T10:46:44.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:46:44.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/51082369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:46:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:45 smithi017 ceph-mon[32078]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-03-16T10:46:46.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:45 smithi111 ceph-mon[36315]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-03-16T10:46:46.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:45 smithi174 ceph-mon[36202]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-03-16T10:46:48.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:47 smithi111 ceph-mon[36315]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:46:48.288 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:47 smithi017 ceph-mon[32078]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:46:48.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:47 smithi174 ceph-mon[36202]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-03-16T10:46:50.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:49 smithi017 ceph-mon[32078]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-16T10:46:50.115 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:49 smithi174 ceph-mon[36202]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-16T10:46:50.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:49 smithi111 ceph-mon[36315]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-16T10:46:52.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:51 smithi017 ceph-mon[32078]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-16T10:46:52.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T10:46:52.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:52.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:51 smithi111 ceph-mon[36315]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-16T10:46:52.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T10:46:52.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:51 smithi174 ceph-mon[36202]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-16T10:46:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-16T10:46:52.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:46:53.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:52 smithi111 ceph-mon[36315]: Deploying daemon osd.9 on smithi017 2024-03-16T10:46:53.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:52 smithi017 ceph-mon[32078]: Deploying daemon osd.9 on smithi017 2024-03-16T10:46:53.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:52 smithi174 ceph-mon[36202]: Deploying daemon osd.9 on smithi017 2024-03-16T10:46:53.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:53 smithi017 ceph-mon[32078]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:54.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:53 smithi111 ceph-mon[36315]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:54.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:53 smithi174 ceph-mon[36202]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:56.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:55 smithi111 ceph-mon[36315]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:56.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:55 smithi174 ceph-mon[36202]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:56.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:55 smithi017 ceph-mon[32078]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:58.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:57 smithi017 ceph-mon[32078]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:58.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:58.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:57 smithi111 ceph-mon[36315]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:58.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:46:58.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:57 smithi174 ceph-mon[36202]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:46:58.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:46:58.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:00.009 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:46:59 smithi017 ceph-mon[32078]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:00.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:46:59 smithi111 ceph-mon[36315]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:00.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:46:59 smithi174 ceph-mon[36202]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:01.622 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2024-03-16T10:47:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.621+0000 7fca17fff700 1 -- 172.21.15.17:0/2615345005 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fca301a2ef0 con 0x7fca180a2910 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 msgr2=0x7fca180a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 0x7fca180a4dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca24007c60 tx=0x7fca240073d0 comp rx=0 tx=0).stop 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 msgr2=0x7fca30105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 0x7fca30105190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca200098e0 tx=0x7fca20009580 comp rx=0 tx=0).stop 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 shutdown_connections 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fca180a2910 0x7fca180a4dd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca30101200 0x7fca30105190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca30102da0 0x7fca30103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 --2- 172.21.15.17:0/2615345005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca30102400 0x7fca301037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.623+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 >> 172.21.15.17:0/2615345005 conn(0x7fca300fc7a0 msgr2=0x7fca300fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.624+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 shutdown_connections 2024-03-16T10:47:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:01.624+0000 7fca35427700 1 -- 172.21.15.17:0/2615345005 wait complete. 2024-03-16T10:47:01.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:01.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:01.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:01.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:01.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:01 smithi017 ceph-mon[32078]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:02.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:01 smithi174 ceph-mon[36202]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:02.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:01 smithi111 ceph-mon[36315]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-16T10:47:02.356 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.9.service 2024-03-16T10:47:02.359 INFO:tasks.cephadm:Deploying osd.10 on smithi111 with /dev/vg_nvme/lv_1... 2024-03-16T10:47:02.359 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T10:47:02.605 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:47:03.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-mon[32078]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-mon[32078]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T10:47:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-mon[32078]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T10:47:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-mon[32078]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:47:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:03.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:47:03.587+0000 7f6da5ef9700 -1 osd.9 0 waiting for initial osdmap 2024-03-16T10:47:03.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:47:03 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:47:03.600+0000 7f6da1cec700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:47:03.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:03 smithi111 ceph-mon[36315]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:03.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:03 smithi111 ceph-mon[36315]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T10:47:03.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:03 smithi111 ceph-mon[36315]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T10:47:03.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:03 smithi111 ceph-mon[36315]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:47:03.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:03 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:03 smithi174 ceph-mon[36202]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:03 smithi174 ceph-mon[36202]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-16T10:47:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:03 smithi174 ceph-mon[36202]: osdmap e65: 10 total, 9 up, 10 in 2024-03-16T10:47:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:03 smithi174 ceph-mon[36202]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-03-16T10:47:04.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:03 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:04.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:04 smithi017 ceph-mon[32078]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:47:04.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:04 smithi017 ceph-mon[32078]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T10:47:04.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110549 s, 949 MB/s 2024-03-16T10:47:04.697 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-03-16T10:47:04.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:04 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:04.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:04 smithi111 ceph-mon[36315]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:47:04.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:04 smithi111 ceph-mon[36315]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T10:47:04.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:04 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:04.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:04 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:04 smithi174 ceph-mon[36202]: from='osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-03-16T10:47:05.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:04 smithi174 ceph-mon[36202]: osdmap e66: 10 total, 9 up, 10 in 2024-03-16T10:47:05.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:04 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:04 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.445 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_1 2024-03-16T10:47:05.690 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:47:05.722 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] boot 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: osdmap e67: 10 total, 10 up, 10 in 2024-03-16T10:47:05.723 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:05 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] boot 2024-03-16T10:47:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: osdmap e67: 10 total, 10 up, 10 in 2024-03-16T10:47:05.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:05 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: osd.9 [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] boot 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: osdmap e67: 10 total, 10 up, 10 in 2024-03-16T10:47:06.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:05 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-16T10:47:06.855 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi017 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi017 to 4273M 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:06.856 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:06 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi017 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi017 to 4273M 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:07.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:06 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: osdmap e68: 10 total, 10 up, 10 in 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi017 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:07.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi017 to 4273M 2024-03-16T10:47:07.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:07.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:07.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:06 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 -- 172.21.15.111:0/486296847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 msgr2=0x7f78e0102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/486296847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e0102860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78d00099c0 tx=0x7f78d0009cd0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 -- 172.21.15.111:0/486296847 shutdown_connections 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/486296847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0102da0 0x7f78e0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/486296847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0101200 0x7f78e0101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/486296847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e0102860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 -- 172.21.15.111:0/486296847 >> 172.21.15.111:0/486296847 conn(0x7f78e00fc7a0 msgr2=0x7f78e00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:07.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 -- 172.21.15.111:0/486296847 shutdown_connections 2024-03-16T10:47:07.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.369+0000 7f78e7b1c700 1 -- 172.21.15.111:0/486296847 wait complete. 2024-03-16T10:47:07.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 Processor -- start 2024-03-16T10:47:07.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 -- start start 2024-03-16T10:47:07.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0101200 0x7f78e0105190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:07.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:07.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102da0 0x7f78e0103d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:07.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010cdd0 con 0x7f78e0101200 2024-03-16T10:47:07.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010cc50 con 0x7f78e0102400 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e7b1c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78e010cf50 con 0x7f78e0102da0 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52272/0 (socket says 172.21.15.111:52272) 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 -- 172.21.15.111:0/2633312845 learned_addr learned my addr 172.21.15.111:0/2633312845 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e58b8700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0101200 0x7f78e0105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e60b9700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102da0 0x7f78e0103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 -- 172.21.15.111:0/2633312845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102da0 msgr2=0x7f78e0103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102da0 0x7f78e0103d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 -- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0101200 msgr2=0x7f78e0105190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0101200 0x7f78e0105190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 -- 172.21.15.111:0/2633312845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e01045d0 con 0x7f78e0102400 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.370+0000 7f78e50b7700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78d0006010 tx=0x7f78d0009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.371+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0004810 con 0x7f78e0102400 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.371+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78d0005020 con 0x7f78e0102400 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.371+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e01a2630 con 0x7f78e0102400 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.371+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0003f20 con 0x7f78e0102400 2024-03-16T10:47:07.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.371+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e01a2a20 con 0x7f78e0102400 2024-03-16T10:47:07.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.372+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e0068f90 con 0x7f78e0102400 2024-03-16T10:47:07.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.373+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f78d0029060 con 0x7f78e0102400 2024-03-16T10:47:07.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.374+0000 7f78d6ffd700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 0x7f78cc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:07.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.374+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f78d00cef80 con 0x7f78e0102400 2024-03-16T10:47:07.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.374+0000 7f78e58b8700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 0x7f78cc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:07.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.375+0000 7f78e58b8700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 0x7f78cc0a4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009550 tx=0x7f78d80091b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:07.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.378+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f78d005d740 con 0x7f78e0102400 2024-03-16T10:47:07.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:07.580+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f78e00fe910 con 0x7f78cc0a2890 2024-03-16T10:47:07.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:07 smithi111 ceph-mon[36315]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:07.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:07.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:07.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:07 smithi174 ceph-mon[36202]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:07 smithi017 ceph-mon[32078]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:08.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:08.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:08 smithi111 ceph-mon[36315]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:09.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:08 smithi174 ceph-mon[36202]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:09.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:08 smithi017 ceph-mon[32078]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:09.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:09 smithi111 ceph-mon[36315]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:10.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:09 smithi174 ceph-mon[36202]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:10.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:09 smithi017 ceph-mon[32078]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:10 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/1296698603' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:10 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:10 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]': finished 2024-03-16T10:47:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:10 smithi111 ceph-mon[36315]: osdmap e69: 11 total, 10 up, 11 in 2024-03-16T10:47:10.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:11.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:10 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/1296698603' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:11.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:10 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:11.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:10 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]': finished 2024-03-16T10:47:11.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:10 smithi174 ceph-mon[36202]: osdmap e69: 11 total, 10 up, 11 in 2024-03-16T10:47:11.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:10 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/1296698603' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:10 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]: dispatch 2024-03-16T10:47:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:10 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1209c41f-8100-49bf-9d4b-f422fd725d71"}]': finished 2024-03-16T10:47:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:10 smithi017 ceph-mon[32078]: osdmap e69: 11 total, 10 up, 11 in 2024-03-16T10:47:11.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:11.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:11 smithi111 ceph-mon[36315]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:11.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:11 smithi111 ceph-mon[36315]: from='client.? 172.21.15.111:0/1639417833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:11 smithi174 ceph-mon[36202]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:12.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:11 smithi174 ceph-mon[36202]: from='client.? 172.21.15.111:0/1639417833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:12.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:11 smithi017 ceph-mon[32078]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:12.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:11 smithi017 ceph-mon[32078]: from='client.? 172.21.15.111:0/1639417833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:13.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:13 smithi111 ceph-mon[36315]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:14.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:13 smithi174 ceph-mon[36202]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:14.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:13 smithi017 ceph-mon[32078]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:15.718 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:15 smithi111 ceph-mon[36315]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:15.907 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:15 smithi017 ceph-mon[32078]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:16.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:15 smithi174 ceph-mon[36202]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:17.876 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:17 smithi111 ceph-mon[36315]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:18.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:17 smithi174 ceph-mon[36202]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:17 smithi017 ceph-mon[32078]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:18.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T10:47:18.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:18 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:18.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:18 smithi111 ceph-mon[36315]: Deploying daemon osd.10 on smithi111 2024-03-16T10:47:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T10:47:19.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:18 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:19.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:18 smithi174 ceph-mon[36202]: Deploying daemon osd.10 on smithi111 2024-03-16T10:47:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-16T10:47:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:18 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:19.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:18 smithi017 ceph-mon[32078]: Deploying daemon osd.10 on smithi111 2024-03-16T10:47:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:19 smithi111 ceph-mon[36315]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:20.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:19 smithi174 ceph-mon[36202]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:19 smithi017 ceph-mon[32078]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:21.828 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:21 smithi111 ceph-mon[36315]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:22.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:21 smithi174 ceph-mon[36202]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:21 smithi017 ceph-mon[32078]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:23.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:23 smithi111 ceph-mon[36315]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:24.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:23 smithi174 ceph-mon[36202]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:24.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:23 smithi017 ceph-mon[32078]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:24.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:24.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:24.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:24 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:25.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:25.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:25.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:24 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:25.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:25.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:25.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:24 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:25.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:25 smithi017 ceph-mon[32078]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:25.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:25 smithi111 ceph-mon[36315]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:26.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:25 smithi174 ceph-mon[36202]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:27.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.240+0000 7f78d6ffd700 1 -- 172.21.15.111:0/2633312845 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f78e00fe910 con 0x7f78cc0a2890 2024-03-16T10:47:27.242 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 10 on host 'smithi111' 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 msgr2=0x7f78cc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 0x7f78cc0a4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009550 tx=0x7f78d80091b0 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 msgr2=0x7f78e01037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78d0006010 tx=0x7f78d0009f10 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 shutdown_connections 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f78cc0a2890 0x7f78cc0a4d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102da0 0x7f78e0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78e0101200 0x7f78e0105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 --2- 172.21.15.111:0/2633312845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78e0102400 0x7f78e01037e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:27.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 >> 172.21.15.111:0/2633312845 conn(0x7f78e00fc7a0 msgr2=0x7f78e00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:27.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 shutdown_connections 2024-03-16T10:47:27.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-16T10:47:27.243+0000 7f78e7b1c700 1 -- 172.21.15.111:0/2633312845 wait complete. 2024-03-16T10:47:27.909 DEBUG:teuthology.orchestra.run.smithi111:osd.10> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.10.service 2024-03-16T10:47:27.911 INFO:tasks.cephadm:Deploying osd.11 on smithi174 with /dev/vg_nvme/lv_1... 2024-03-16T10:47:27.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-16T10:47:28.159 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.450 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:29.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:29 smithi174 ceph-mon[36202]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T10:47:29.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:29 smithi174 ceph-mon[36202]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T10:47:29.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:29 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:29.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:29 smithi174 ceph-mon[36202]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:29 smithi174 ceph-mon[36202]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:29 smithi017 ceph-mon[32078]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T10:47:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:29 smithi017 ceph-mon[32078]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T10:47:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:29 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:29 smithi017 ceph-mon[32078]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:29 smithi017 ceph-mon[32078]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.634 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-mon[36315]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-16T10:47:29.634 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-mon[36315]: osdmap e70: 11 total, 10 up, 11 in 2024-03-16T10:47:29.634 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:29.634 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-mon[36315]: from='osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.634 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-mon[36315]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-03-16T10:47:29.911 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:47:29.633+0000 7f32f5210700 -1 osd.10 0 waiting for initial osdmap 2024-03-16T10:47:29.912 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:47:29 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:47:29.644+0000 7f32ecffb700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114541 s, 915 MB/s 2024-03-16T10:47:30.345 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: from='osd.10 ' entity='osd.10' 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] boot 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: osdmap e72: 11 total, 11 up, 11 in 2024-03-16T10:47:30.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: from='osd.10 ' entity='osd.10' 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] boot 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: osdmap e72: 11 total, 11 up, 11 in 2024-03-16T10:47:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: osdmap e71: 11 total, 10 up, 11 in 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: from='osd.10 ' entity='osd.10' 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: osd.10 [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] boot 2024-03-16T10:47:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: osdmap e72: 11 total, 11 up, 11 in 2024-03-16T10:47:30.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-16T10:47:31.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi174:vg_nvme/lv_1 2024-03-16T10:47:31.289 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:47:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:31 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:47:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:31 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:47:31.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:31 smithi174 ceph-mon[36202]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T10:47:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:31 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:47:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:31 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:47:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:31 smithi017 ceph-mon[32078]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T10:47:31.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:31 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:47:31.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:31 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:47:31.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:31 smithi111 ceph-mon[36315]: osdmap e73: 11 total, 11 up, 11 in 2024-03-16T10:47:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:32.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:32 smithi174 ceph-mon[36202]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:32 smithi017 ceph-mon[32078]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T10:47:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:32 smithi111 ceph-mon[36315]: osdmap e74: 11 total, 11 up, 11 in 2024-03-16T10:47:33.311 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 -- 172.21.15.174:0/514284562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 msgr2=0x7fbc1c101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:33.311 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 --2- 172.21.15.174:0/514284562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c101620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009990 tx=0x7fbc0c009ca0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.311 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 -- 172.21.15.174:0/514284562 shutdown_connections 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 --2- 172.21.15.174:0/514284562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102da0 0x7fbc1c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 --2- 172.21.15.174:0/514284562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c101620 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 --2- 172.21.15.174:0/514284562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102400 0x7fbc1c102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 -- 172.21.15.174:0/514284562 >> 172.21.15.174:0/514284562 conn(0x7fbc1c0fc7a0 msgr2=0x7fbc1c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 -- 172.21.15.174:0/514284562 shutdown_connections 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.309+0000 7fbc212e3700 1 -- 172.21.15.174:0/514284562 wait complete. 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 Processor -- start 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 -- start start 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102400 0x7fbc1c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102da0 0x7fbc1c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10cdf0 con 0x7fbc1c102da0 2024-03-16T10:47:33.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10cc70 con 0x7fbc1c102400 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc212e3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c10cf70 con 0x7fbc1c101200 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:33076/0 (socket says 172.21.15.174:33076) 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 -- 172.21.15.174:0/3319069825 learned_addr learned my addr 172.21.15.174:0/3319069825 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc13fff700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102400 0x7fbc1c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1b7fe700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102da0 0x7fbc1c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 -- 172.21.15.174:0/3319069825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102400 msgr2=0x7fbc1c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102400 0x7fbc1c197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 -- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102da0 msgr2=0x7fbc1c19ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102da0 0x7fbc1c19ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 -- 172.21.15.174:0/3319069825 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c19f0a0 con 0x7fbc1c101200 2024-03-16T10:47:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.310+0000 7fbc1affd700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000c00 tx=0x7fbc0c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:33.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c029070 con 0x7fbc1c101200 2024-03-16T10:47:33.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0c004150 con 0x7fbc1c101200 2024-03-16T10:47:33.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c06a970 con 0x7fbc1c101200 2024-03-16T10:47:33.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c024470 con 0x7fbc1c101200 2024-03-16T10:47:33.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c06ae50 con 0x7fbc1c101200 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.311+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1c068f90 con 0x7fbc1c101200 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.313+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fbc0c02c070 con 0x7fbc1c101200 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.313+0000 7fbc18ff9700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 0x7fbc080a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.313+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7fbc0c0d19c0 con 0x7fbc1c101200 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.314+0000 7fbc13fff700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 0x7fbc080a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.314+0000 7fbc13fff700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 0x7fbc080a4d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc04005950 tx=0x7fbc0400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:33.318 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.317+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbc0c033080 con 0x7fbc1c101200 2024-03-16T10:47:33.318 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:33 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi111 2024-03-16T10:47:33.318 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:33 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi111 to 4270M 2024-03-16T10:47:33.318 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:33.318 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:33.318 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:33.526 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:33.525+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbc1c06b110 con 0x7fbc080a2890 2024-03-16T10:47:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:33 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi111 2024-03-16T10:47:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:33 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi111 to 4270M 2024-03-16T10:47:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:33.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:33 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi111 2024-03-16T10:47:33.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:33 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi111 to 4270M 2024-03-16T10:47:33.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:33.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:47:33.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:34.389 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:34 smithi174 ceph-mon[36202]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:34.389 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:34 smithi174 ceph-mon[36202]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T10:47:34.389 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:34 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:34.389 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:34 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:34.390 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:34 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:34 smithi017 ceph-mon[32078]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:34 smithi017 ceph-mon[32078]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:34 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:34 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:34 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:34.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:34 smithi111 ceph-mon[36315]: pgmap v240: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:34.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:34 smithi111 ceph-mon[36315]: osdmap e75: 11 total, 11 up, 11 in 2024-03-16T10:47:34.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:34 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-16T10:47:34.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:34 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-16T10:47:34.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:34 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:35.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:35 smithi174 ceph-mon[36202]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:35.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:35 smithi174 ceph-mon[36202]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T10:47:35.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:35 smithi017 ceph-mon[32078]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:35.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:35 smithi017 ceph-mon[32078]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T10:47:35.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:35 smithi111 ceph-mon[36315]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:47:35.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:35 smithi111 ceph-mon[36315]: osdmap e76: 11 total, 11 up, 11 in 2024-03-16T10:47:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:36 smithi174 ceph-mon[36202]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:36.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:36 smithi017 ceph-mon[32078]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:36 smithi111 ceph-mon[36315]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 363 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/221659705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]': finished 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: osdmap e77: 12 total, 11 up, 12 in 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:37 smithi174 ceph-mon[36202]: from='client.? 172.21.15.174:0/859680595' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/221659705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]': finished 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: osdmap e77: 12 total, 11 up, 12 in 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:37.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:37 smithi017 ceph-mon[32078]: from='client.? 172.21.15.174:0/859680595' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:37.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/221659705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]: dispatch 2024-03-16T10:47:37.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb52cfa5-7b9d-4008-bbff-17225492bb2a"}]': finished 2024-03-16T10:47:37.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: osdmap e77: 12 total, 11 up, 12 in 2024-03-16T10:47:37.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:37.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:37 smithi111 ceph-mon[36315]: from='client.? 172.21.15.174:0/859680595' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-16T10:47:38.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:38 smithi174 ceph-mon[36202]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:38 smithi017 ceph-mon[32078]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:38 smithi111 ceph-mon[36315]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:40.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:40 smithi174 ceph-mon[36202]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T10:47:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:40 smithi017 ceph-mon[32078]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T10:47:40.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:40 smithi111 ceph-mon[36315]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-16T10:47:42.559 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:42 smithi174 ceph-mon[36202]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-03-16T10:47:42.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:42 smithi017 ceph-mon[32078]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-03-16T10:47:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:42 smithi111 ceph-mon[36315]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-03-16T10:47:44.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:44 smithi174 ceph-mon[36202]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-16T10:47:44.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T10:47:44.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:44 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:44 smithi017 ceph-mon[32078]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-16T10:47:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T10:47:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:44 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:44 smithi111 ceph-mon[36315]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-03-16T10:47:44.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-16T10:47:44.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:44 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:47:45.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:45 smithi174 ceph-mon[36202]: Deploying daemon osd.11 on smithi174 2024-03-16T10:47:45.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:45 smithi017 ceph-mon[32078]: Deploying daemon osd.11 on smithi174 2024-03-16T10:47:45.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:45 smithi111 ceph-mon[36315]: Deploying daemon osd.11 on smithi174 2024-03-16T10:47:46.539 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:46 smithi174 ceph-mon[36202]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:46 smithi017 ceph-mon[32078]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:46 smithi111 ceph-mon[36315]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:48.548 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:48 smithi174 ceph-mon[36202]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:48 smithi017 ceph-mon[32078]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:48 smithi111 ceph-mon[36315]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-16T10:47:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:50 smithi174 ceph-mon[36202]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-16T10:47:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:50 smithi017 ceph-mon[32078]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-16T10:47:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:50 smithi111 ceph-mon[36315]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-16T10:47:51.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:51.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:51.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:51.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:51.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:51.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:47:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:52.404 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:52 smithi174 ceph-mon[36202]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:52 smithi111 ceph-mon[36315]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:52.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:52 smithi017 ceph-mon[32078]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:54.195 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.194+0000 7fbc18ff9700 1 -- 172.21.15.174:0/3319069825 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbc1c06b110 con 0x7fbc080a2890 2024-03-16T10:47:54.195 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 11 on host 'smithi174' 2024-03-16T10:47:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 msgr2=0x7fbc080a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 0x7fbc080a4d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc04005950 tx=0x7fbc0400b410 comp rx=0 tx=0).stop 2024-03-16T10:47:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 msgr2=0x7fbc1c197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000c00 tx=0x7fbc0c0057c0 comp rx=0 tx=0).stop 2024-03-16T10:47:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 shutdown_connections 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc080a2890 0x7fbc080a4d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc1c102da0 0x7fbc1c19ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc1c101200 0x7fbc1c197440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 --2- 172.21.15.174:0/3319069825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc1c102400 0x7fbc1c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 >> 172.21.15.174:0/3319069825 conn(0x7fbc1c0fc7a0 msgr2=0x7fbc1c105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 shutdown_connections 2024-03-16T10:47:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:47:54.196+0000 7fbc212e3700 1 -- 172.21.15.174:0/3319069825 wait complete. 2024-03-16T10:47:54.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:54 smithi174 ceph-mon[36202]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:54.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:54 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:54 smithi174 ceph-mon[36202]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T10:47:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:54 smithi111 ceph-mon[36315]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:54 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:54 smithi111 ceph-mon[36315]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T10:47:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:54 smithi017 ceph-mon[32078]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:54 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:54 smithi017 ceph-mon[32078]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-16T10:47:54.865 DEBUG:teuthology.orchestra.run.smithi174:osd.11> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.11.service 2024-03-16T10:47:54.868 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-16T10:47:54.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd stat -f json 2024-03-16T10:47:55.125 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:47:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:56 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:47:56.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:56 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: osdmap e78: 12 total, 11 up, 12 in 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-03-16T10:47:56.449 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:56.449 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:47:56.188+0000 7f6c54f04700 -1 osd.11 0 waiting for initial osdmap 2024-03-16T10:47:56.449 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:47:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:47:56.205+0000 7f6c50cf7700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T10:47:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 -- 172.21.15.17:0/3898458554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103ec0 msgr2=0x7fe00010a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 --2- 172.21.15.17:0/3898458554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103ec0 0x7fe00010a770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b0d0 tx=0x7fdff800b3e0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 -- 172.21.15.17:0/3898458554 shutdown_connections 2024-03-16T10:47:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 --2- 172.21.15.17:0/3898458554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 0x7fe000102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 --2- 172.21.15.17:0/3898458554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103ec0 0x7fe00010a770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 --2- 172.21.15.17:0/3898458554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103520 0x7fe000103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 -- 172.21.15.17:0/3898458554 >> 172.21.15.17:0/3898458554 conn(0x7fe0000fd8e0 msgr2=0x7fe0000ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 -- 172.21.15.17:0/3898458554 shutdown_connections 2024-03-16T10:47:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.922+0000 7fe0060c4700 1 -- 172.21.15.17:0/3898458554 wait complete. 2024-03-16T10:47:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 Processor -- start 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 -- start start 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 0x7fe000198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103ec0 0x7fe00019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe00010df60 con 0x7fe000103520 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe00010dde0 con 0x7fe000102320 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fe0060c4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe00010e0e0 con 0x7fe000103ec0 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fdffeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fdffeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49424/0 (socket says 172.21.15.17:49424) 2024-03-16T10:47:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fdffeffd700 1 -- 172.21.15.17:0/912838412 learned_addr learned my addr 172.21.15.17:0/912838412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.923+0000 7fdfff7fe700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 0x7fe000198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffffff700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103ec0 0x7fe00019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 -- 172.21.15.17:0/912838412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103ec0 msgr2=0x7fe00019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103ec0 0x7fe00019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 -- 172.21.15.17:0/912838412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 msgr2=0x7fe000198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 0x7fe000198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 -- 172.21.15.17:0/912838412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0001a00e0 con 0x7fe000103520 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffeffd700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b560 tx=0x7fdff400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4015020 con 0x7fe000103520 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff4011d10 con 0x7fe000103520 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0001a03d0 con 0x7fe000103520 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff400f2e0 con 0x7fe000103520 2024-03-16T10:47:56.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.924+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001a0940 con 0x7fe000103520 2024-03-16T10:47:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.925+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe000068f90 con 0x7fe000103520 2024-03-16T10:47:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.926+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fdff4018020 con 0x7fe000103520 2024-03-16T10:47:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.927+0000 7fdffcff9700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 0x7fdfe80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:47:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.927+0000 7fdfff7fe700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 0x7fdfe80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:47:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.927+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7fdff40cddc0 con 0x7fe000103520 2024-03-16T10:47:56.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.927+0000 7fdfff7fe700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 0x7fdfe80a4d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdff0005fd0 tx=0x7fdff0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:47:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:56.931+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fdff401f020 con 0x7fe000103520 2024-03-16T10:47:57.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.138+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe000062ee0 con 0x7fe000103520 2024-03-16T10:47:57.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.139+0000 7fdffcff9700 1 -- 172.21.15.17:0/912838412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7fdff409b380 con 0x7fe000103520 2024-03-16T10:47:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 msgr2=0x7fdfe80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 0x7fdfe80a4d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdff0005fd0 tx=0x7fdff0005e50 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 msgr2=0x7fe0001989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b560 tx=0x7fdff400b920 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 shutdown_connections 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdfe80a2890 0x7fdfe80a4d50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe000102320 0x7fe000198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe000103ec0 0x7fe00019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 --2- 172.21.15.17:0/912838412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe000103520 0x7fe0001989c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:47:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 >> 172.21.15.17:0/912838412 conn(0x7fe0000fd8e0 msgr2=0x7fe000106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:47:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 shutdown_connections 2024-03-16T10:47:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:47:57.141+0000 7fe0060c4700 1 -- 172.21.15.17:0/912838412 wait complete. 2024-03-16T10:47:57.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:57 smithi017 ceph-mon[32078]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:47:57.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:57 smithi017 ceph-mon[32078]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T10:47:57.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:57 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.508 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/912838412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:47:57.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:57 smithi174 ceph-mon[36202]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:47:57.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:57 smithi174 ceph-mon[36202]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T10:47:57.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:57 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/912838412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:47:57.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:57 smithi111 ceph-mon[36315]: from='osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-03-16T10:47:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:57 smithi111 ceph-mon[36315]: osdmap e79: 12 total, 11 up, 12 in 2024-03-16T10:47:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:57 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/912838412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:47:57.846 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1710586050,"num_in_osds":12,"osd_in_since":1710586056,"num_remapped_pgs":0} 2024-03-16T10:47:58.491 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: purged_snaps scrub starts 2024-03-16T10:47:58.491 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: purged_snaps scrub ok 2024-03-16T10:47:58.491 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:58.491 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] boot 2024-03-16T10:47:58.491 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: osdmap e80: 12 total, 12 up, 12 in 2024-03-16T10:47:58.492 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:58 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: purged_snaps scrub starts 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: purged_snaps scrub ok 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] boot 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: osdmap e80: 12 total, 12 up, 12 in 2024-03-16T10:47:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:58 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: purged_snaps scrub starts 2024-03-16T10:47:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: purged_snaps scrub ok 2024-03-16T10:47:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-03-16T10:47:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: osd.11 [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] boot 2024-03-16T10:47:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: osdmap e80: 12 total, 12 up, 12 in 2024-03-16T10:47:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:58 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-16T10:47:58.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd stat -f json 2024-03-16T10:47:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:47:59.530 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:47:59 smithi017 ceph-mon[32078]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T10:47:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:47:59 smithi174 ceph-mon[36202]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T10:47:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:47:59 smithi111 ceph-mon[36315]: osdmap e81: 12 total, 12 up, 12 in 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: Detected new or changed devices on smithi174 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.513 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: Adjusting osd_memory_target on smithi174 to 4270M 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.514 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:00 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: Detected new or changed devices on smithi174 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: Adjusting osd_memory_target on smithi174 to 4270M 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:00 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: Detected new or changed devices on smithi174 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: Adjusting osd_memory_target on smithi174 to 4270M 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:00.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:00 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 -- 172.21.15.17:0/651983807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141028d0 msgr2=0x7ff414102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 --2- 172.21.15.17:0/651983807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141028d0 0x7ff414102cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff408009990 tx=0x7ff408009ca0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 -- 172.21.15.17:0/651983807 shutdown_connections 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 --2- 172.21.15.17:0/651983807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 0x7ff414109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 --2- 172.21.15.17:0/651983807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141028d0 0x7ff414102cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 --2- 172.21.15.17:0/651983807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141014a0 0x7ff414101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 -- 172.21.15.17:0/651983807 >> 172.21.15.17:0/651983807 conn(0x7ff4140fbf70 msgr2=0x7ff4140fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 -- 172.21.15.17:0/651983807 shutdown_connections 2024-03-16T10:48:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 -- 172.21.15.17:0/651983807 wait complete. 2024-03-16T10:48:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.760+0000 7ff41ae50700 1 Processor -- start 2024-03-16T10:48:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 -- start start 2024-03-16T10:48:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 0x7ff414198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 0x7ff41419faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff41410ce90 con 0x7ff4141014a0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff41410cd10 con 0x7ff4141028d0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff41ae50700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff41410d010 con 0x7ff414101e60 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39416/0 (socket says 172.21.15.17:39416) 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 -- 172.21.15.17:0/859377031 learned_addr learned my addr 172.21.15.17:0/859377031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff413fff700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 0x7ff414198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff4193ed700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 0x7ff41419faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 -- 172.21.15.17:0/859377031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 msgr2=0x7ff414198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 0x7ff414198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 -- 172.21.15.17:0/859377031 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 msgr2=0x7ff41419faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 0x7ff41419faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 -- 172.21.15.17:0/859377031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4141a0190 con 0x7ff4141014a0 2024-03-16T10:48:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff4193ed700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 0x7ff41419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff418bec700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff4080057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.761+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408027070 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.762+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff408004150 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.762+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4141a0420 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.762+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40800f6c0 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.762+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4141a08f0 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.763+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff414068f90 con 0x7ff4141014a0 2024-03-16T10:48:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.765+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7ff40802a070 con 0x7ff4141014a0 2024-03-16T10:48:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.765+0000 7ff411ffb700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 0x7ff4040a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.766+0000 7ff413fff700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 0x7ff4040a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.766+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff4080cff30 con 0x7ff4141014a0 2024-03-16T10:48:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.766+0000 7ff413fff700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 0x7ff4040a4d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff400009a10 tx=0x7ff400009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.768+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff408013070 con 0x7ff4141014a0 2024-03-16T10:48:00.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.975+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff4141a0d80 con 0x7ff4141014a0 2024-03-16T10:48:00.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.975+0000 7ff411ffb700 1 -- 172.21.15.17:0/859377031 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7ff40809d500 con 0x7ff4141014a0 2024-03-16T10:48:00.976 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:00.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 msgr2=0x7ff4040a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:00.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 0x7ff4040a4d50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff400009a10 tx=0x7ff400009190 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 msgr2=0x7ff414198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff4080057c0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 shutdown_connections 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4040a2890 0x7ff4040a4d50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4141028d0 0x7ff41419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4141014a0 0x7ff414198530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 --2- 172.21.15.17:0/859377031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff414101e60 0x7ff414198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 >> 172.21.15.17:0/859377031 conn(0x7ff4140fbf70 msgr2=0x7ff4140fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 shutdown_connections 2024-03-16T10:48:00.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:00.977+0000 7ff41ae50700 1 -- 172.21.15.17:0/859377031 wait complete. 2024-03-16T10:48:01.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:01 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/859377031' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:48:01.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:01 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/859377031' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:48:01.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:01 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/859377031' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-16T10:48:01.678 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1710586077,"num_in_osds":12,"osd_in_since":1710586056,"num_remapped_pgs":0} 2024-03-16T10:48:01.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T10:48:01.921 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:48:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:02 smithi174 ceph-mon[36202]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:02 smithi017 ceph-mon[32078]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:02 smithi111 ceph-mon[36315]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:03.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 -- 172.21.15.17:0/1491641677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648069f80 msgr2=0x7f464806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 --2- 172.21.15.17:0/1491641677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648069f80 0x7f464806a3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f463c0099c0 tx=0x7f463c009cd0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 -- 172.21.15.17:0/1491641677 shutdown_connections 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 --2- 172.21.15.17:0/1491641677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f464806a920 0x7f464810f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 --2- 172.21.15.17:0/1491641677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648108320 0x7f4648108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 --2- 172.21.15.17:0/1491641677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648069f80 0x7f464806a3e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 -- 172.21.15.17:0/1491641677 >> 172.21.15.17:0/1491641677 conn(0x7f4648078100 msgr2=0x7f4648078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 -- 172.21.15.17:0/1491641677 shutdown_connections 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.649+0000 7f464ec2e700 1 -- 172.21.15.17:0/1491641677 wait complete. 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 Processor -- start 2024-03-16T10:48:03.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 -- start start 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4648069f80 0x7f46481012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f464806a920 0x7f46481017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4648112580 con 0x7f4648108320 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4648112400 con 0x7f4648069f80 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464ec2e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4648112700 con 0x7f464806a920 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39442/0 (socket says 172.21.15.17:39442) 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 -- 172.21.15.17:0/3564581121 learned_addr learned my addr 172.21.15.17:0/3564581121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464c9ca700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4648069f80 0x7f46481012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f4647fff700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f464806a920 0x7f46481017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 -- 172.21.15.17:0/3564581121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f464806a920 msgr2=0x7f46481017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f464806a920 0x7f46481017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 -- 172.21.15.17:0/3564581121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4648069f80 msgr2=0x7f46481012a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4648069f80 0x7f46481012a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 -- 172.21.15.17:0/3564581121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46481a6f80 con 0x7f4648108320 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.650+0000 7f464d1cb700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4640007ee0 tx=0x7f464000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.651+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640004bb0 con 0x7f4648108320 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.651+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481a7270 con 0x7f4648108320 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.651+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4640004d50 con 0x7f4648108320 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.651+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640005960 con 0x7f4648108320 2024-03-16T10:48:03.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.651+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481a7780 con 0x7f4648108320 2024-03-16T10:48:03.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.652+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4648068f90 con 0x7f4648108320 2024-03-16T10:48:03.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.653+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f464001a020 con 0x7f4648108320 2024-03-16T10:48:03.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.654+0000 7f4645ffb700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 0x7f46300a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:03.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.654+0000 7f464c9ca700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 0x7f46300a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:03.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.654+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f46400ce430 con 0x7f4648108320 2024-03-16T10:48:03.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.654+0000 7f464c9ca700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 0x7f46300a4d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4638007b60 tx=0x7f46380073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:03.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.657+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4640010070 con 0x7f4648108320 2024-03-16T10:48:03.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.863+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f464802db70 con 0x7f4648108320 2024-03-16T10:48:03.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.864+0000 7f4645ffb700 1 -- 172.21.15.17:0/3564581121 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18468 (secure 0 0 0) 0x7f464009b8d0 con 0x7f4648108320 2024-03-16T10:48:03.865 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:03.866 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":81,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:47:58.188556+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 msgr2=0x7f46300a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 0x7f46300a4d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4638007b60 tx=0x7f46380073d0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 msgr2=0x7f4648101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4640007ee0 tx=0x7f464000d3b0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 shutdown_connections 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46300a2890 0x7f46300a4d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4648069f80 0x7f46481012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4648108320 0x7f4648101d20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 --2- 172.21.15.17:0/3564581121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f464806a920 0x7f46481017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 >> 172.21.15.17:0/3564581121 conn(0x7f4648078100 msgr2=0x7f46480ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:03.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 shutdown_connections 2024-03-16T10:48:03.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:03.867+0000 7f464ec2e700 1 -- 172.21.15.17:0/3564581121 wait complete. 2024-03-16T10:48:04.547 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:04 smithi017 ceph-mon[32078]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:04.547 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:04 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3564581121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:04 smithi174 ceph-mon[36202]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:04 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3564581121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:04.575 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:48:04.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-16T10:48:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:04 smithi111 ceph-mon[36315]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:04.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:04 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3564581121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:48:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 -- 172.21.15.17:0/3149296178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 msgr2=0x7f5ec0101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 --2- 172.21.15.17:0/3149296178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0101930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009990 tx=0x7f5eac009ca0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:06 smithi017 ceph-mon[32078]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 -- 172.21.15.17:0/3149296178 shutdown_connections 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 --2- 172.21.15.17:0/3149296178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 0x7f5ec010e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 --2- 172.21.15.17:0/3149296178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ec01073c0 0x7f5ec01077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 --2- 172.21.15.17:0/3149296178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0101930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 -- 172.21.15.17:0/3149296178 >> 172.21.15.17:0/3149296178 conn(0x7f5ec0078030 msgr2=0x7f5ec0078440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 -- 172.21.15.17:0/3149296178 shutdown_connections 2024-03-16T10:48:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.549+0000 7f5ec702f700 1 -- 172.21.15.17:0/3149296178 wait complete. 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 Processor -- start 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 -- start start 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 0x7f5ec0103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ec01073c0 0x7f5ec0103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0111540 con 0x7f5ec01014b0 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01113c0 con 0x7f5ec0101e70 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec702f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01116c0 con 0x7f5ec01073c0 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39470/0 (socket says 172.21.15.17:39470) 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 -- 172.21.15.17:0/2047879433 learned_addr learned my addr 172.21.15.17:0/2047879433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ebffff700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 0x7f5ec0103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 -- 172.21.15.17:0/2047879433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ec01073c0 msgr2=0x7f5ec0103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ec01073c0 0x7f5ec0103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 -- 172.21.15.17:0/2047879433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 msgr2=0x7f5ec0103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 0x7f5ec0103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.550+0000 7f5ec4dcb700 1 -- 172.21.15.17:0/2047879433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec01a7020 con 0x7f5ec01014b0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ec4dcb700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400d980 tx=0x7f5eb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4017070 con 0x7f5ec01014b0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec01a7310 con 0x7f5ec01014b0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb4005020 con 0x7f5ec01014b0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4009bc0 con 0x7f5ec01014b0 2024-03-16T10:48:06.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.551+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a7820 con 0x7f5ec01014b0 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.552+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec0102950 con 0x7f5ec01014b0 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.553+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f5eb40051d0 con 0x7f5ec01014b0 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.554+0000 7f5ebdffb700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 0x7f5eb00a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.554+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5eb40ce4c0 con 0x7f5ec01014b0 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.554+0000 7f5ebffff700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 0x7f5eb00a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:06.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.555+0000 7f5ebffff700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 0x7f5eb00a4dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00b5c0 tx=0x7f5eac005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:06.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.559+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5eb4020020 con 0x7f5ec01014b0 2024-03-16T10:48:06.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:06 smithi174 ceph-mon[36202]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:06 smithi111 ceph-mon[36315]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.763+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5ec01a7a50 con 0x7f5ec01014b0 2024-03-16T10:48:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.764+0000 7f5ebdffb700 1 -- 172.21.15.17:0/2047879433 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f5eb409b960 con 0x7f5ec01014b0 2024-03-16T10:48:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 msgr2=0x7f5eb00a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 0x7f5eb00a4dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00b5c0 tx=0x7f5eac005960 comp rx=0 tx=0).stop 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 msgr2=0x7f5ec0102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400d980 tx=0x7f5eb400dc90 comp rx=0 tx=0).stop 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 shutdown_connections 2024-03-16T10:48:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5eb00a2910 0x7f5eb00a4dd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ec01073c0 0x7f5ec0103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec01014b0 0x7f5ec0102f10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 --2- 172.21.15.17:0/2047879433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec0101e70 0x7f5ec0103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 >> 172.21.15.17:0/2047879433 conn(0x7f5ec0078030 msgr2=0x7f5ec0100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 shutdown_connections 2024-03-16T10:48:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:06.766+0000 7f5ec702f700 1 -- 172.21.15.17:0/2047879433 wait complete. 2024-03-16T10:48:07.504 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:07 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2047879433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.a on smithi017 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.d on smithi017 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.g on smithi017 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.j on smithi017 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.b on smithi111 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.e on smithi111 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.h on smithi111 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.k on smithi111 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.c on smithi174 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.f on smithi174 2024-03-16T10:48:07.531 INFO:tasks.cephadm:Adding mds.i on smithi174 2024-03-16T10:48:07.532 INFO:tasks.cephadm:Adding mds.l on smithi174 2024-03-16T10:48:07.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l' 2024-03-16T10:48:07.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:07 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2047879433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:07.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:07 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2047879433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:07.780 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:48:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:08 smithi174 ceph-mon[36202]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:08.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:08 smithi017 ceph-mon[32078]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:08.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:08 smithi111 ceph-mon[36315]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.480+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/277383134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4102df0 msgr2=0x7f6ab41051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.480+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/277383134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4102df0 0x7f6ab41051e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009990 tx=0x7f6aa4009ca0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/277383134 shutdown_connections 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/277383134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4108050 0x7f6ab410a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/277383134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4102df0 0x7f6ab41051e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/277383134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4105720 0x7f6ab4107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/277383134 >> 172.21.15.174:0/277383134 conn(0x7f6ab40fc7c0 msgr2=0x7f6ab40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/277383134 shutdown_connections 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/277383134 wait complete. 2024-03-16T10:48:09.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 Processor -- start 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 -- start start 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4102df0 0x7f6ab4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.481+0000 7f6ab8c3f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 0x7f6ab4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab410ded0 con 0x7f6ab4105720 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab410dd50 con 0x7f6ab4102df0 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab410e050 con 0x7f6ab4108050 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:46498/0 (socket says 172.21.15.174:46498) 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 -- 172.21.15.174:0/3885455328 learned_addr learned my addr 172.21.15.174:0/3885455328 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab1d9b700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 0x7f6ab4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab259c700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4102df0 0x7f6ab4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 -- 172.21.15.174:0/3885455328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4102df0 msgr2=0x7f6ab4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:09.485 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4102df0 0x7f6ab4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 -- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 msgr2=0x7f6ab4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 0x7f6ab4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 -- 172.21.15.174:0/3885455328 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41a00b0 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab1d9b700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 0x7f6ab4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab2d9d700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007ee0 tx=0x7f6aac00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac004db0 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab41a03a0 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aac005020 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac015660 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.482+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab41a0890 con 0x7f6ab4108050 2024-03-16T10:48:09.486 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.483+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab4068f90 con 0x7f6ab4108050 2024-03-16T10:48:09.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.484+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f6aac005560 con 0x7f6ab4108050 2024-03-16T10:48:09.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.485+0000 7f6aa37fe700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 0x7f6a9c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:09.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.485+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6aac0ce7f0 con 0x7f6ab4108050 2024-03-16T10:48:09.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.485+0000 7f6ab259c700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 0x7f6a9c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:09.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.486+0000 7f6ab259c700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 0x7f6a9c0a4d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400b5c0 tx=0x7f6aa4003960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:09.489 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.489+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f6aac010070 con 0x7f6ab4108050 2024-03-16T10:48:09.695 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.694+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}) -- 0x7f6ab40629d0 con 0x7f6a9c0a2890 2024-03-16T10:48:09.702 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.702+0000 7f6aa37fe700 1 -- 172.21.15.174:0/3885455328 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6ab40629d0 con 0x7f6a9c0a2890 2024-03-16T10:48:09.702 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mds.all update... 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 msgr2=0x7f6a9c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 0x7f6a9c0a4d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400b5c0 tx=0x7f6aa4003960 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 msgr2=0x7f6ab419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007ee0 tx=0x7f6aac00d3b0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 shutdown_connections 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6a9c0a2890 0x7f6a9c0a4d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ab4102df0 0x7f6ab4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ab4108050 0x7f6ab419fa10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 --2- 172.21.15.174:0/3885455328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab4105720 0x7f6ab4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 >> 172.21.15.174:0/3885455328 conn(0x7f6ab40fc7c0 msgr2=0x7f6ab4103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 shutdown_connections 2024-03-16T10:48:09.705 INFO:teuthology.orchestra.run.smithi174.stderr:2024-03-16T10:48:09.704+0000 7f6ab8c3f700 1 -- 172.21.15.174:0/3885455328 wait complete. 2024-03-16T10:48:10.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:10.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:10.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:10.506 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.506 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:10.506 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:10.506 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.532 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.a.service 2024-03-16T10:48:10.536 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.d.service 2024-03-16T10:48:10.562 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:10.562 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:10.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.565 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.g.service 2024-03-16T10:48:10.609 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.j.service 2024-03-16T10:48:10.652 DEBUG:teuthology.orchestra.run.smithi111:mds.b> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.b.service 2024-03-16T10:48:10.655 DEBUG:teuthology.orchestra.run.smithi111:mds.e> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.e.service 2024-03-16T10:48:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:10.662 DEBUG:teuthology.orchestra.run.smithi111:mds.h> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.h.service 2024-03-16T10:48:10.705 DEBUG:teuthology.orchestra.run.smithi111:mds.k> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.k.service 2024-03-16T10:48:10.748 DEBUG:teuthology.orchestra.run.smithi174:mds.c> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.c.service 2024-03-16T10:48:10.751 DEBUG:teuthology.orchestra.run.smithi174:mds.f> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.f.service 2024-03-16T10:48:10.793 DEBUG:teuthology.orchestra.run.smithi174:mds.i> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.i.service 2024-03-16T10:48:10.836 DEBUG:teuthology.orchestra.run.smithi174:mds.l> sudo journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.l.service 2024-03-16T10:48:10.879 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-16T10:48:10.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:48:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 -- 172.21.15.17:0/3991153917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 msgr2=0x7f880c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 --2- 172.21.15.17:0/3991153917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c101d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009900 tx=0x7f87f402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 -- 172.21.15.17:0/3991153917 shutdown_connections 2024-03-16T10:48:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 --2- 172.21.15.17:0/3991153917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 --2- 172.21.15.17:0/3991153917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c101d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 --2- 172.21.15.17:0/3991153917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 -- 172.21.15.17:0/3991153917 >> 172.21.15.17:0/3991153917 conn(0x7f880c0fbc70 msgr2=0x7f880c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 -- 172.21.15.17:0/3991153917 shutdown_connections 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 -- 172.21.15.17:0/3991153917 wait complete. 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:10.999+0000 7f8811263640 1 Processor -- start 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 -- start start 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f880c10c380 con 0x7f880c1018f0 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f880c10c200 con 0x7f880c1022b0 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f8811263640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f880c10c500 con 0x7f880c100700 2024-03-16T10:48:11.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46618/0 (socket says 172.21.15.17:46618) 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 -- 172.21.15.17:0/2877437670 learned_addr learned my addr 172.21.15.17:0/2877437670 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880affd640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880b7fe640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 -- 172.21.15.17:0/2877437670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 msgr2=0x7f880c196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 -- 172.21.15.17:0/2877437670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 msgr2=0x7f880c19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 -- 172.21.15.17:0/2877437670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c19e660 con 0x7f880c1018f0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880b7fe640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880affd640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.000+0000 7f880a7fc640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009230 tx=0x7f87f4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.001+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4041070 con 0x7f880c1018f0 2024-03-16T10:48:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.001+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f40044d0 con 0x7f880c1018f0 2024-03-16T10:48:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.001+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c19e8f0 con 0x7f880c1018f0 2024-03-16T10:48:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.001+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4034440 con 0x7f880c1018f0 2024-03-16T10:48:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.001+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c19ede0 con 0x7f880c1018f0 2024-03-16T10:48:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.002+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880c107a20 con 0x7f880c1018f0 2024-03-16T10:48:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.003+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f87f4044070 con 0x7f880c1018f0 2024-03-16T10:48:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.003+0000 7f8803fff640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 0x7f87f80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.004+0000 7f880affd640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 0x7f87f80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.004+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f87f40f05a0 con 0x7f880c1018f0 2024-03-16T10:48:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.004+0000 7f880affd640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 0x7f87f80a4cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f880c101750 tx=0x7f8804005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.007+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f87f40bdae0 con 0x7f880c1018f0 2024-03-16T10:48:11.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.192+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f880c02d3c0 con 0x7f880c1018f0 2024-03-16T10:48:11.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.193+0000 7f8803fff640 1 -- 172.21.15.17:0/2877437670 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18468 (secure 0 0 0) 0x7f87f40bd3e0 con 0x7f880c1018f0 2024-03-16T10:48:11.194 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:11.194 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":81,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:47:58.188556+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 msgr2=0x7f87f80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 0x7f87f80a4cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f880c101750 tx=0x7f8804005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 msgr2=0x7f880c196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009230 tx=0x7f87f4005d50 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 shutdown_connections 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87f80a2800 0x7f87f80a4cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f880c1022b0 0x7f880c19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f880c1018f0 0x7f880c196f80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 --2- 172.21.15.17:0/2877437670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f880c100700 0x7f880c196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 >> 172.21.15.17:0/2877437670 conn(0x7f880c0fbc70 msgr2=0x7f880c104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 shutdown_connections 2024-03-16T10:48:11.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.195+0000 7f8811263640 1 -- 172.21.15.17:0/2877437670 wait complete. 2024-03-16T10:48:11.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:48:11.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 -- 172.21.15.17:0/2224462504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041006e0 msgr2=0x7f9904100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 --2- 172.21.15.17:0/2224462504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041006e0 0x7f9904100b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009900 tx=0x7f98f402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 -- 172.21.15.17:0/2224462504 shutdown_connections 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 --2- 172.21.15.17:0/2224462504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 0x7f9904108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 --2- 172.21.15.17:0/2224462504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041018d0 0x7f9904101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 --2- 172.21.15.17:0/2224462504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041006e0 0x7f9904100b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 -- 172.21.15.17:0/2224462504 >> 172.21.15.17:0/2224462504 conn(0x7f99040fbc70 msgr2=0x7f99040fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 -- 172.21.15.17:0/2224462504 shutdown_connections 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.313+0000 7f990a5c4640 1 -- 172.21.15.17:0/2224462504 wait complete. 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 Processor -- start 2024-03-16T10:48:11.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 -- start start 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041006e0 0x7f9904197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 0x7f990419f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f990410c350 con 0x7f99041018d0 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f990410c1d0 con 0x7f9904102290 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f990a5c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f990410c4d0 con 0x7f99041006e0 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f99037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f99037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46630/0 (socket says 172.21.15.17:46630) 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f9903fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041006e0 0x7f9904197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f99037fe640 1 -- 172.21.15.17:0/3820103743 learned_addr learned my addr 172.21.15.17:0/3820103743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.314+0000 7f9908b61640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 0x7f990419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 -- 172.21.15.17:0/3820103743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041006e0 msgr2=0x7f9904197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041006e0 0x7f9904197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 -- 172.21.15.17:0/3820103743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 msgr2=0x7f990419f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 0x7f990419f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 -- 172.21.15.17:0/3820103743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990419f7f0 con 0x7f99041018d0 2024-03-16T10:48:11.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.315+0000 7f99037fe640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e9f0 tx=0x7f98f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.316+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f800cd80 con 0x7f99041018d0 2024-03-16T10:48:11.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.316+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8005500 con 0x7f99041018d0 2024-03-16T10:48:11.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.316+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990419fae0 con 0x7f99041018d0 2024-03-16T10:48:11.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.316+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8010690 con 0x7f99041018d0 2024-03-16T10:48:11.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.317+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990419ffe0 con 0x7f99041018d0 2024-03-16T10:48:11.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.318+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99041a0270 con 0x7f99041018d0 2024-03-16T10:48:11.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.319+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f98f80046c0 con 0x7f99041018d0 2024-03-16T10:48:11.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.319+0000 7f99017fa640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 0x7f98ec0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.319+0000 7f9903fff640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 0x7f98ec0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.319+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f98f80ce9a0 con 0x7f99041018d0 2024-03-16T10:48:11.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.320+0000 7f9903fff640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 0x7f98ec0a4cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000c00 tx=0x7f98f4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.324+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f98f809bee0 con 0x7f99041018d0 2024-03-16T10:48:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.508+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f99041a0440 con 0x7f99041018d0 2024-03-16T10:48:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.508+0000 7f99017fa640 1 -- 172.21.15.17:0/3820103743 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f98f809b7e0 con 0x7f99041018d0 2024-03-16T10:48:11.509 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 msgr2=0x7f98ec0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 0x7f98ec0a4cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000c00 tx=0x7f98f4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 msgr2=0x7f9904198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e9f0 tx=0x7f98f800edf0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 shutdown_connections 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f98ec0a2800 0x7f98ec0a4cc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9904102290 0x7f990419f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99041018d0 0x7f9904198110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 --2- 172.21.15.17:0/3820103743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99041006e0 0x7f9904197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 >> 172.21.15.17:0/3820103743 conn(0x7f99040fbc70 msgr2=0x7f99040689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 shutdown_connections 2024-03-16T10:48:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.510+0000 7f990a5c4640 1 -- 172.21.15.17:0/3820103743 wait complete. 2024-03-16T10:48:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:11 smithi017 ceph-mon[32078]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:11 smithi017 ceph-mon[32078]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-03-16T10:48:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:11 smithi017 ceph-mon[32078]: Deploying daemon mds.l on smithi174 2024-03-16T10:48:11.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:11 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2877437670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:11.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:11.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:11 smithi174 ceph-mon[36202]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:11.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:11 smithi174 ceph-mon[36202]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-03-16T10:48:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:11 smithi174 ceph-mon[36202]: Deploying daemon mds.l on smithi174 2024-03-16T10:48:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:11 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2877437670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 -- 172.21.15.17:0/2068290600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901006f0 msgr2=0x7f5490100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 --2- 172.21.15.17:0/2068290600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901006f0 0x7f5490100b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 -- 172.21.15.17:0/2068290600 shutdown_connections 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 --2- 172.21.15.17:0/2068290600 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f5490108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 --2- 172.21.15.17:0/2068290600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901018e0 0x7f5490101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 --2- 172.21.15.17:0/2068290600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901006f0 0x7f5490100b10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 -- 172.21.15.17:0/2068290600 >> 172.21.15.17:0/2068290600 conn(0x7f54900fbc80 msgr2=0x7f54900fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 -- 172.21.15.17:0/2068290600 shutdown_connections 2024-03-16T10:48:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.624+0000 7f5497427640 1 -- 172.21.15.17:0/2068290600 wait complete. 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 Processor -- start 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 -- start start 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901006f0 0x7f5490196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f549019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f549010c360 con 0x7f54901018e0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f549010c1e0 con 0x7f54901022a0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f5497427640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f549010c4e0 con 0x7f54901006f0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46640/0 (socket says 172.21.15.17:46640) 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 -- 172.21.15.17:0/3591294157 learned_addr learned my addr 172.21.15.17:0/3591294157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54951c3640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901006f0 0x7f5490196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 -- 172.21.15.17:0/3591294157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901006f0 msgr2=0x7f5490196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54959c4640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f549019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901006f0 0x7f5490196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 -- 172.21.15.17:0/3591294157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 msgr2=0x7f549019e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f549019e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 -- 172.21.15.17:0/3591294157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549019e6b0 con 0x7f54901018e0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54959c4640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f549019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.625+0000 7f54949c2640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f548000e9f0 tx=0x7f548000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.626+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548000cd80 con 0x7f54901018e0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.626+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5480005500 con 0x7f54901018e0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.626+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549019e9a0 con 0x7f54901018e0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.626+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480010690 con 0x7f54901018e0 2024-03-16T10:48:11.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.626+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549019eef0 con 0x7f54901018e0 2024-03-16T10:48:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.627+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5490107a80 con 0x7f54901018e0 2024-03-16T10:48:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.628+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f54800046c0 con 0x7f54901018e0 2024-03-16T10:48:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.629+0000 7f54867fc640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 0x7f547c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.629+0000 7f54951c3640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 0x7f547c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:11.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.629+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f54800cebe0 con 0x7f54901018e0 2024-03-16T10:48:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.629+0000 7f54951c3640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 0x7f547c0a4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:11.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.633+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5480053740 con 0x7f54901018e0 2024-03-16T10:48:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:11 smithi111 ceph-mon[36315]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:11 smithi111 ceph-mon[36315]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-03-16T10:48:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:11 smithi111 ceph-mon[36315]: Deploying daemon mds.l on smithi174 2024-03-16T10:48:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:11 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2877437670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:11.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.856+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f549002d400 con 0x7f54901018e0 2024-03-16T10:48:11.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.857+0000 7f54867fc640 1 -- 172.21.15.17:0/3591294157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f548009c120 con 0x7f54901018e0 2024-03-16T10:48:11.858 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:11.858 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-16T10:48:11.858 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-03-16T10:48:11.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.858+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 msgr2=0x7f547c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.858+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 0x7f547c0a4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f548c000c00 tx=0x7f548c005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.858+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 msgr2=0x7f5490196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.858+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f548000e9f0 tx=0x7f548000edf0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 shutdown_connections 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f547c0a2880 0x7f547c0a4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54901022a0 0x7f549019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54901018e0 0x7f5490196fd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 --2- 172.21.15.17:0/3591294157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54901006f0 0x7f5490196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 >> 172.21.15.17:0/3591294157 conn(0x7f54900fbc80 msgr2=0x7f5490104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 shutdown_connections 2024-03-16T10:48:11.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:11.859+0000 7f5497427640 1 -- 172.21.15.17:0/3591294157 wait complete. 2024-03-16T10:48:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:12 smithi174 ceph-mon[36202]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:12 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3820103743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:12 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3591294157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:12.564 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 systemd[1]: Starting Ceph mds.l for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:12 smithi017 ceph-mon[32078]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:12 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3820103743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:12 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3591294157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:12.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:12 smithi111 ceph-mon[36315]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:12.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:12 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3820103743' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:12 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3591294157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:12.894 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 podman[66223]: 2024-03-16 10:48:12.494598199 +0000 UTC m=+0.018216592 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:12.894 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 podman[66223]: 2024-03-16 10:48:12.616227537 +0000 UTC m=+0.139845914 container create 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-16T10:48:12.894 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 podman[66223]: 2024-03-16 10:48:12.893838749 +0000 UTC m=+0.417457133 container init 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-16T10:48:13.313 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 podman[66223]: 2024-03-16 10:48:12.896468268 +0000 UTC m=+0.420086661 container start 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:13.313 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 ceph-mds[66243]: -- 172.21.15.174:0/625661431 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610f8575a40 con 0x5610f8548c00 2024-03-16T10:48:13.313 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: starting mds.l at 2024-03-16T10:48:13.313 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 bash[66223]: 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 2024-03-16T10:48:13.313 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:48:12 smithi174 systemd[1]: Started Ceph mds.l for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:13.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:13.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 -- 172.21.15.17:0/3549326937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 msgr2=0x7f5c2c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 --2- 172.21.15.17:0/3549326937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c102e70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009900 tx=0x7f5c2002bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 -- 172.21.15.17:0/3549326937 shutdown_connections 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 --2- 172.21.15.17:0/3549326937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c1033b0 0x7f5c2c109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 --2- 172.21.15.17:0/3549326937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c102e70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 --2- 172.21.15.17:0/3549326937 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c101800 0x7f5c2c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 -- 172.21.15.17:0/3549326937 >> 172.21.15.17:0/3549326937 conn(0x7f5c2c0fcd90 msgr2=0x7f5c2c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 -- 172.21.15.17:0/3549326937 shutdown_connections 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.986+0000 7f5c32de6640 1 -- 172.21.15.17:0/3549326937 wait complete. 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 Processor -- start 2024-03-16T10:48:13.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 -- start start 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c101800 0x7f5c2c197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c1033b0 0x7f5c2c19f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c10d460 con 0x7f5c2c1029f0 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c10d2e0 con 0x7f5c2c1033b0 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c32de6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c10d5e0 con 0x7f5c2c101800 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46648/0 (socket says 172.21.15.17:46648) 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1064586807 learned_addr learned my addr 172.21.15.17:0/1064586807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c30b82640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c101800 0x7f5c2c197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1064586807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c101800 msgr2=0x7f5c2c197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:13.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c101800 0x7f5c2c197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c31383640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c1033b0 0x7f5c2c19f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1064586807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c1033b0 msgr2=0x7f5c2c19f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c1033b0 0x7f5c2c19f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1064586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c19f730 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.987+0000 7f5c2bfff640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c20006010 tx=0x7f5c20005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.988+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20041070 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.988+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c200054e0 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.988+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c19f9c0 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.988+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20034440 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.988+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c19ff00 con 0x7f5c2c1029f0 2024-03-16T10:48:13.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.989+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c108ac0 con 0x7f5c2c1029f0 2024-03-16T10:48:13.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.990+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f5c20044070 con 0x7f5c2c1029f0 2024-03-16T10:48:13.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.991+0000 7f5c29ffb640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 0x7f5c140a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:13.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.991+0000 7f5c30b82640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 0x7f5c140a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:13.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.991+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5c200f0490 con 0x7f5c2c1029f0 2024-03-16T10:48:13.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.991+0000 7f5c30b82640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 0x7f5c140a4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c102850 tx=0x7f5c24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:13.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:13.994+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5c200bd930 con 0x7f5c2c1029f0 2024-03-16T10:48:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.214+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c2c02d1b0 con 0x7f5c2c1029f0 2024-03-16T10:48:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.215+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1064586807 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f5c200bd230 con 0x7f5c2c1029f0 2024-03-16T10:48:14.216 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:14.216 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-16T10:48:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 msgr2=0x7f5c140a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 0x7f5c140a4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c102850 tx=0x7f5c24009500 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 msgr2=0x7f5c2c198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c20006010 tx=0x7f5c20005dd0 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 shutdown_connections 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c140a2880 0x7f5c140a4d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c2c1033b0 0x7f5c2c19f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c1029f0 0x7f5c2c198050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 --2- 172.21.15.17:0/1064586807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c2c101800 0x7f5c2c197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 >> 172.21.15.17:0/1064586807 conn(0x7f5c2c0fcd90 msgr2=0x7f5c2c105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:14.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 shutdown_connections 2024-03-16T10:48:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:14.217+0000 7f5c32de6640 1 -- 172.21.15.17:0/1064586807 wait complete. 2024-03-16T10:48:14.227 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6832/760873641,v1:172.21.15.174:6833/760873641] up:boot 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: fsmap 1 up:standby 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:14.228 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:13 smithi017 ceph-mon[32078]: Deploying daemon mds.k on smithi111 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6832/760873641,v1:172.21.15.174:6833/760873641] up:boot 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: fsmap 1 up:standby 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:14.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:14.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:14.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:13 smithi174 ceph-mon[36202]: Deploying daemon mds.k on smithi111 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6832/760873641,v1:172.21.15.174:6833/760873641] up:boot 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: fsmap 1 up:standby 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:14.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:14.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:13 smithi111 ceph-mon[36315]: Deploying daemon mds.k on smithi111 2024-03-16T10:48:15.074 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:14 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1064586807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:14 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1064586807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:15.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:14 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1064586807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:15.412 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 systemd[1]: Starting Ceph mds.k for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:15.720 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 podman[65887]: 2024-03-16 10:48:15.364707262 +0000 UTC m=+0.018040344 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:15.720 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 podman[65887]: 2024-03-16 10:48:15.484192298 +0000 UTC m=+0.137525373 container create 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-16T10:48:16.161 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 podman[65887]: 2024-03-16 10:48:15.720267088 +0000 UTC m=+0.373600175 container init 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, ceph=True, io.buildah.version=1.33.5) 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 podman[65887]: 2024-03-16 10:48:15.72304084 +0000 UTC m=+0.376373924 container start 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD) 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mds[65906]: -- 172.21.15.111:0/1247261670 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55595775fa40 con 0x555957732c00 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: starting mds.k at 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 bash[65887]: 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:48:15 smithi111 systemd[1]: Started Ceph mds.k for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:16.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:16.163 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:16.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:16.254 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:16.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 -- 172.21.15.17:0/325917707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b14102a00 msgr2=0x7f4b14102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 --2- 172.21.15.17:0/325917707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b14102a00 0x7f4b14102e80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009900 tx=0x7f4afc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 -- 172.21.15.17:0/325917707 shutdown_connections 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 --2- 172.21.15.17:0/325917707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b141033c0 0x7f4b14109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 --2- 172.21.15.17:0/325917707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b14102a00 0x7f4b14102e80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 --2- 172.21.15.17:0/325917707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 -- 172.21.15.17:0/325917707 >> 172.21.15.17:0/325917707 conn(0x7f4b140fcd80 msgr2=0x7f4b140ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 -- 172.21.15.17:0/325917707 shutdown_connections 2024-03-16T10:48:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 -- 172.21.15.17:0/325917707 wait complete. 2024-03-16T10:48:16.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.335+0000 7f4b1955b640 1 Processor -- start 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 -- start start 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 0x7f4b141980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410d500 con 0x7f4b141033c0 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410d380 con 0x7f4b14102a00 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b1955b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1410d680 con 0x7f4b14101810 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46660/0 (socket says 172.21.15.17:46660) 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 -- 172.21.15.17:0/2638773859 learned_addr learned my addr 172.21.15.17:0/2638773859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b12ffd640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b0a7fc640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 0x7f4b141980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 -- 172.21.15.17:0/2638773859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 msgr2=0x7f4b14197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:16.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 -- 172.21.15.17:0/2638773859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 msgr2=0x7f4b141980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.336+0000 7f4b137fe640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 0x7f4b141980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b137fe640 1 -- 172.21.15.17:0/2638773859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1419f7c0 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b12ffd640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b0a7fc640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 0x7f4b141980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b137fe640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00eaa0 tx=0x7f4b0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00cdb0 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1419fab0 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c005020 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0116b0 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.337+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1419ff80 con 0x7f4b141033c0 2024-03-16T10:48:16.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.338+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b14108b30 con 0x7f4b141033c0 2024-03-16T10:48:16.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.340+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f4b0c005560 con 0x7f4b141033c0 2024-03-16T10:48:16.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.341+0000 7f4b10ff9640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 0x7f4b000a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:16.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.341+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f4b0c0cec90 con 0x7f4b141033c0 2024-03-16T10:48:16.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.341+0000 7f4b12ffd640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 0x7f4b000a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:16.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.342+0000 7f4b12ffd640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 0x7f4b000a4cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b14102860 tx=0x7f4b04008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:16.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.344+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4b0c016030 con 0x7f4b141033c0 2024-03-16T10:48:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.588+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b1402d1b0 con 0x7f4b141033c0 2024-03-16T10:48:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.588+0000 7f4b10ff9640 1 -- 172.21.15.17:0/2638773859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f4b0c09c1d0 con 0x7f4b141033c0 2024-03-16T10:48:16.589 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:16.589 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-16T10:48:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-03-16T10:48:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 msgr2=0x7f4b000a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 0x7f4b000a4cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b14102860 tx=0x7f4b04008040 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 msgr2=0x7f4b1419f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00eaa0 tx=0x7f4b0c00ef60 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 shutdown_connections 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b000a2800 0x7f4b000a4cc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b141033c0 0x7f4b1419f150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b14102a00 0x7f4b141980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 --2- 172.21.15.17:0/2638773859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b14101810 0x7f4b14197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 >> 172.21.15.17:0/2638773859 conn(0x7f4b140fcd80 msgr2=0x7f4b14105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 shutdown_connections 2024-03-16T10:48:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:16.591+0000 7f4b1955b640 1 -- 172.21.15.17:0/2638773859 wait complete. 2024-03-16T10:48:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:16 smithi017 ceph-mon[32078]: Deploying daemon mds.j on smithi017 2024-03-16T10:48:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:16 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6832/1048472977,v1:172.21.15.111:6833/1048472977] up:boot 2024-03-16T10:48:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:16 smithi017 ceph-mon[32078]: fsmap 2 up:standby 2024-03-16T10:48:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:16 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:48:17.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:16 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2638773859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:16 smithi174 ceph-mon[36202]: Deploying daemon mds.j on smithi017 2024-03-16T10:48:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:16 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6832/1048472977,v1:172.21.15.111:6833/1048472977] up:boot 2024-03-16T10:48:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:16 smithi174 ceph-mon[36202]: fsmap 2 up:standby 2024-03-16T10:48:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:16 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:48:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:16 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2638773859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:17.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:16 smithi111 ceph-mon[36315]: Deploying daemon mds.j on smithi017 2024-03-16T10:48:17.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:16 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6832/1048472977,v1:172.21.15.111:6833/1048472977] up:boot 2024-03-16T10:48:17.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:16 smithi111 ceph-mon[36315]: fsmap 2 up:standby 2024-03-16T10:48:17.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:16 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:48:17.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:16 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2638773859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:18.123 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:17 smithi111 ceph-mon[36315]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:17 smithi174 ceph-mon[36202]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:17 smithi017 ceph-mon[32078]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:18.340 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 systemd[1]: Starting Ceph mds.j for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:18.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:18.656 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 podman[72158]: 2024-03-16 10:48:18.293299809 +0000 UTC m=+0.018151501 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:18.656 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 podman[72158]: 2024-03-16 10:48:18.411006723 +0000 UTC m=+0.135858402 container create db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:18.656 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 podman[72158]: 2024-03-16 10:48:18.656328021 +0000 UTC m=+0.381179700 container init db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T10:48:18.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1488744896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f01019a0 msgr2=0x7fa4f01082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1488744896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f01019a0 0x7fa4f01082c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009ca0 tx=0x7fa4e802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1488744896 shutdown_connections 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1488744896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f01019a0 0x7fa4f01082c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1488744896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0100fe0 0x7fa4f0101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1488744896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f00ffe90 0x7fa4f01002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1488744896 >> 172.21.15.17:0/1488744896 conn(0x7fa4f00fb400 msgr2=0x7fa4f00fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1488744896 shutdown_connections 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1488744896 wait complete. 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 Processor -- start 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.712+0000 7fa4f6c6c640 1 -- start start 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00ffe90 0x7fa4f0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:18.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 0x7fa4f01a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f010c3a0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f010c220 con 0x7fa4f01019a0 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f010c520 con 0x7fa4f00ffe90 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46684/0 (socket says 172.21.15.17:46684) 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 -- 172.21.15.17:0/1825776681 learned_addr learned my addr 172.21.15.17:0/1825776681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f5209640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 0x7fa4f01a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f4a08640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00ffe90 0x7fa4f0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 -- 172.21.15.17:0/1825776681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00ffe90 msgr2=0x7fa4f0199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00ffe90 0x7fa4f0199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 -- 172.21.15.17:0/1825776681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 msgr2=0x7fa4f01a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 0x7fa4f01a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 -- 172.21.15.17:0/1825776681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f01a18c0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f5209640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 0x7fa4f01a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4effff640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800c970 tx=0x7fa4d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8007c10 con 0x7fa4f0100fe0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4d8007db0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f01a1bb0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.713+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800f940 con 0x7fa4f0100fe0 2024-03-16T10:48:18.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.714+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f01a2100 con 0x7fa4f0100fe0 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.714+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f01a2330 con 0x7fa4f0100fe0 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.715+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fa4d800fae0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.716+0000 7fa4edffb640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 0x7fa4dc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.716+0000 7fa4f4a08640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 0x7fa4dc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.716+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa4d80ce8b0 con 0x7fa4f0100fe0 2024-03-16T10:48:18.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.716+0000 7fa4f4a08640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 0x7fa4dc0a4cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4f019ab50 tx=0x7fa4e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.720+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa4d809be80 con 0x7fa4f0100fe0 2024-03-16T10:48:18.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.964+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4f01a2500 con 0x7fa4f0100fe0 2024-03-16T10:48:18.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.964+0000 7fa4edffb640 1 -- 172.21.15.17:0/1825776681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7fa4d809b780 con 0x7fa4f0100fe0 2024-03-16T10:48:18.965 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:18.965 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-16T10:48:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 msgr2=0x7fa4dc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 0x7fa4dc0a4cc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4f019ab50 tx=0x7fa4e0005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 msgr2=0x7fa4f019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800c970 tx=0x7fa4d800ce30 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 shutdown_connections 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa4dc0a2800 0x7fa4dc0a4cc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f01019a0 0x7fa4f01a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f0100fe0 0x7fa4f019a1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 --2- 172.21.15.17:0/1825776681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00ffe90 0x7fa4f0199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 >> 172.21.15.17:0/1825776681 conn(0x7fa4f00fb400 msgr2=0x7fa4f00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 shutdown_connections 2024-03-16T10:48:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:18.967+0000 7fa4f6c6c640 1 -- 172.21.15.17:0/1825776681 wait complete. 2024-03-16T10:48:18.978 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 podman[72158]: 2024-03-16 10:48:18.659961707 +0000 UTC m=+0.384813383 container start db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-16T10:48:18.978 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 ceph-mds[72198]: -- 172.21.15.17:0/2867466599 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c4b6e23a40 con 0x55c4b6df7000 2024-03-16T10:48:18.978 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j[72174]: starting mds.j at 2024-03-16T10:48:18.978 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 bash[72158]: db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da 2024-03-16T10:48:18.978 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:48:18 smithi017 systemd[1]: Started Ceph mds.j for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: Deploying daemon mds.d on smithi017 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6834/234575221,v1:172.21.15.17:6835/234575221] up:boot 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: fsmap 3 up:standby 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T10:48:20.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1825776681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: Deploying daemon mds.d on smithi017 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6834/234575221,v1:172.21.15.17:6835/234575221] up:boot 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: fsmap 3 up:standby 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T10:48:20.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1825776681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: Deploying daemon mds.d on smithi017 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6834/234575221,v1:172.21.15.17:6835/234575221] up:boot 2024-03-16T10:48:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: fsmap 3 up:standby 2024-03-16T10:48:20.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-16T10:48:20.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1825776681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:20.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:21.010 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:20 smithi017 systemd[1]: Starting Ceph mds.d for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 -- 172.21.15.17:0/2101015211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b4102b60 msgr2=0x7f31b4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 --2- 172.21.15.17:0/2101015211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b4102b60 0x7f31b4102fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009930 tx=0x7f31a402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 -- 172.21.15.17:0/2101015211 shutdown_connections 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 --2- 172.21.15.17:0/2101015211 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b4109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 --2- 172.21.15.17:0/2101015211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b4102b60 0x7f31b4102fe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 --2- 172.21.15.17:0/2101015211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b40ffaf0 0x7f31b40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 -- 172.21.15.17:0/2101015211 >> 172.21.15.17:0/2101015211 conn(0x7f31b40fb400 msgr2=0x7f31b40fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 -- 172.21.15.17:0/2101015211 shutdown_connections 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.092+0000 7f31bc436640 1 -- 172.21.15.17:0/2101015211 wait complete. 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 Processor -- start 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 -- start start 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b4102b60 0x7f31b4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31b410d4a0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f31b410d320 con 0x7f31b4103520 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31bc436640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31b410d620 con 0x7f31b4102b60 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45304/0 (socket says 172.21.15.17:45304) 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 -- 172.21.15.17:0/4006874223 learned_addr learned my addr 172.21.15.17:0/4006874223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba9d3640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31b99d1640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b4102b60 0x7f31b4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 -- 172.21.15.17:0/4006874223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b4102b60 msgr2=0x7f31b4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b4102b60 0x7f31b4198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 -- 172.21.15.17:0/4006874223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 msgr2=0x7f31b419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 -- 172.21.15.17:0/4006874223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b419f760 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba9d3640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ba1d2640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f31b000e9c0 tx=0x7f31b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.093+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000cd80 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.094+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b00035f0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.094+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b419fa50 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.094+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0010690 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.094+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b419ff50 con 0x7f31b40ffaf0 2024-03-16T10:48:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.094+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b4108c90 con 0x7f31b40ffaf0 2024-03-16T10:48:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.095+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f31b00037a0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.096+0000 7f31ab7fe640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 0x7f31a00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.096+0000 7f31b99d1640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 0x7f31a00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.096+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f31b00ceab0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.097+0000 7f31b99d1640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 0x7f31a00a4cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f31a402c170 tx=0x7f31a4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.101+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f31b009bff0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.324+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b402d460 con 0x7f31b40ffaf0 2024-03-16T10:48:21.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.325+0000 7f31ab7fe640 1 -- 172.21.15.17:0/4006874223 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f31b009b8f0 con 0x7f31b40ffaf0 2024-03-16T10:48:21.326 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:21.326 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-16T10:48:21.326 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 msgr2=0x7f31a00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 0x7f31a00a4cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f31a402c170 tx=0x7f31a4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 msgr2=0x7f31b4197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f31b000e9c0 tx=0x7f31b000ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 shutdown_connections 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31a00a2800 0x7f31a00a4cc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31b4103520 0x7f31b419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31b4102b60 0x7f31b4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 --2- 172.21.15.17:0/4006874223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b40ffaf0 0x7f31b4197b40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 >> 172.21.15.17:0/4006874223 conn(0x7f31b40fb400 msgr2=0x7f31b4105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 shutdown_connections 2024-03-16T10:48:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:21.327+0000 7f31bc436640 1 -- 172.21.15.17:0/4006874223 wait complete. 2024-03-16T10:48:21.337 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 podman[72511]: 2024-03-16 10:48:21.009233598 +0000 UTC m=+0.019086642 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:21.337 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 podman[72511]: 2024-03-16 10:48:21.117344451 +0000 UTC m=+0.127197491 container create 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 podman[72511]: 2024-03-16 10:48:21.353892127 +0000 UTC m=+0.363745178 container init 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 podman[72511]: 2024-03-16 10:48:21.357503378 +0000 UTC m=+0.367356426 container start 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mds[72570]: -- 172.21.15.17:0/3899760993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55980b63fa40 con 0x55980b613000 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d[72564]: starting mds.d at 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 bash[72511]: 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 2024-03-16T10:48:21.590 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:48:21 smithi017 systemd[1]: Started Ceph mds.d for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4006874223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:22.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:22.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:21 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:22.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:22.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4006874223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:22.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:21 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4006874223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:22.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:21 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:23.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:22 smithi017 ceph-mon[32078]: Deploying daemon mds.e on smithi111 2024-03-16T10:48:23.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:22 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6836/3386509633,v1:172.21.15.17:6837/3386509633] up:boot 2024-03-16T10:48:23.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:22 smithi017 ceph-mon[32078]: fsmap 4 up:standby 2024-03-16T10:48:23.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:22 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T10:48:23.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:22 smithi111 ceph-mon[36315]: Deploying daemon mds.e on smithi111 2024-03-16T10:48:23.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:22 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6836/3386509633,v1:172.21.15.17:6837/3386509633] up:boot 2024-03-16T10:48:23.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:22 smithi111 ceph-mon[36315]: fsmap 4 up:standby 2024-03-16T10:48:23.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:22 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T10:48:23.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:22 smithi174 ceph-mon[36202]: Deploying daemon mds.e on smithi111 2024-03-16T10:48:23.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:22 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6836/3386509633,v1:172.21.15.17:6837/3386509633] up:boot 2024-03-16T10:48:23.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:22 smithi174 ceph-mon[36202]: fsmap 4 up:standby 2024-03-16T10:48:23.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:22 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-16T10:48:23.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 -- 172.21.15.17:0/3783652626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a81033b0 msgr2=0x7f31a8109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 --2- 172.21.15.17:0/3783652626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a81033b0 0x7f31a8109c40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009ca0 tx=0x7f31a002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 -- 172.21.15.17:0/3783652626 shutdown_connections 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 --2- 172.21.15.17:0/3783652626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a81033b0 0x7f31a8109c40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 --2- 172.21.15.17:0/3783652626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 0x7f31a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 --2- 172.21.15.17:0/3783652626 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a8101800 0x7f31a8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 -- 172.21.15.17:0/3783652626 >> 172.21.15.17:0/3783652626 conn(0x7f31a80fcd90 msgr2=0x7f31a80ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:23.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 -- 172.21.15.17:0/3783652626 shutdown_connections 2024-03-16T10:48:23.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.454+0000 7f31afda9640 1 -- 172.21.15.17:0/3783652626 wait complete. 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 Processor -- start 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 -- start start 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 0x7f31a8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 0x7f31a819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31a810d460 con 0x7f31a8101800 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f31a810d2e0 con 0x7f31a81033b0 2024-03-16T10:48:23.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31afda9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31a810d5e0 con 0x7f31a81029f0 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31adb45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31adb45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45350/0 (socket says 172.21.15.17:45350) 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31adb45640 1 -- 172.21.15.17:0/3216868187 learned_addr learned my addr 172.21.15.17:0/3216868187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31ad344640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 0x7f31a8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.455+0000 7f31ae346640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 0x7f31a819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 -- 172.21.15.17:0/3216868187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 msgr2=0x7f31a8198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 0x7f31a8198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 -- 172.21.15.17:0/3216868187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 msgr2=0x7f31a819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 0x7f31a819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 -- 172.21.15.17:0/3216868187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a819f6f0 con 0x7f31a8101800 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31ae346640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 0x7f31a819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31adb45640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c970 tx=0x7f31a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:23.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4004220 con 0x7f31a8101800 2024-03-16T10:48:23.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a819f9e0 con 0x7f31a8101800 2024-03-16T10:48:23.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31a40043c0 con 0x7f31a8101800 2024-03-16T10:48:23.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a400f450 con 0x7f31a8101800 2024-03-16T10:48:23.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.456+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a819ff30 con 0x7f31a8101800 2024-03-16T10:48:23.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.457+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a8068a20 con 0x7f31a8101800 2024-03-16T10:48:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.458+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f31a40079b0 con 0x7f31a8101800 2024-03-16T10:48:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.459+0000 7f319effd640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 0x7f31940a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.459+0000 7f31ad344640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 0x7f31940a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.459+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f31a40ce340 con 0x7f31a8101800 2024-03-16T10:48:23.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.459+0000 7f31ad344640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 0x7f31940a4cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f31a8198fe0 tx=0x7f319800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.463+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f31a4014030 con 0x7f31a8101800 2024-03-16T10:48:23.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.685+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31a8108b20 con 0x7f31a8101800 2024-03-16T10:48:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.686+0000 7f319effd640 1 -- 172.21.15.17:0/3216868187 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3868 (secure 0 0 0) 0x7f31a409b880 con 0x7f31a8101800 2024-03-16T10:48:23.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:23.687 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-16T10:48:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 msgr2=0x7f31940a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 0x7f31940a4cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f31a8198fe0 tx=0x7f319800b390 comp rx=0 tx=0).stop 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 msgr2=0x7f31a8197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c970 tx=0x7f31a400ce30 comp rx=0 tx=0).stop 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 shutdown_connections 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f31940a2800 0x7f31940a4cc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31a81033b0 0x7f31a819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31a81029f0 0x7f31a8198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 --2- 172.21.15.17:0/3216868187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31a8101800 0x7f31a8197ad0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:23.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 >> 172.21.15.17:0/3216868187 conn(0x7f31a80fcd90 msgr2=0x7f31a8105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:23.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 shutdown_connections 2024-03-16T10:48:23.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:23.688+0000 7f31afda9640 1 -- 172.21.15.17:0/3216868187 wait complete. 2024-03-16T10:48:23.834 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:23 smithi111 systemd[1]: Starting Ceph mds.e for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:24.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:23 smithi017 ceph-mon[32078]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:24.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:23 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3216868187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:24.150 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:23 smithi111 ceph-mon[36315]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:24.150 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:23 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3216868187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:24.150 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:23 smithi111 podman[66209]: 2024-03-16 10:48:23.800899024 +0000 UTC m=+0.018029766 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:24.150 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:23 smithi111 podman[66209]: 2024-03-16 10:48:23.914661702 +0000 UTC m=+0.131792444 container create 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-03-16T10:48:24.151 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 podman[66209]: 2024-03-16 10:48:24.150536582 +0000 UTC m=+0.367667324 container init 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-16T10:48:24.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:23 smithi174 ceph-mon[36202]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:24.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:23 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3216868187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:24.411 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 podman[66209]: 2024-03-16 10:48:24.153220191 +0000 UTC m=+0.370350937 container start 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-16T10:48:24.412 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 ceph-mds[66228]: -- 172.21.15.111:0/4014105277 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ab89ba3a40 con 0x55ab89b76800 2024-03-16T10:48:24.412 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: starting mds.e at 2024-03-16T10:48:24.412 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 bash[66209]: 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 2024-03-16T10:48:24.412 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:48:24 smithi111 systemd[1]: Started Ceph mds.e for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:25.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:25.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: Deploying daemon mds.f on smithi174 2024-03-16T10:48:25.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:boot 2024-03-16T10:48:25.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: fsmap 5 up:standby 2024-03-16T10:48:25.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:25 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: Deploying daemon mds.f on smithi174 2024-03-16T10:48:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:boot 2024-03-16T10:48:25.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: fsmap 5 up:standby 2024-03-16T10:48:25.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:25 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:48:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: Deploying daemon mds.f on smithi174 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:boot 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: fsmap 5 up:standby 2024-03-16T10:48:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:25 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:48:25.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- 172.21.15.17:0/3177593466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c102a00 msgr2=0x7ff63c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 --2- 172.21.15.17:0/3177593466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c102a00 0x7ff63c102e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009900 tx=0x7ff62c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- 172.21.15.17:0/3177593466 shutdown_connections 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 --2- 172.21.15.17:0/3177593466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c1033c0 0x7ff63c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 --2- 172.21.15.17:0/3177593466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c102a00 0x7ff63c102e80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 --2- 172.21.15.17:0/3177593466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c101810 0x7ff63c101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- 172.21.15.17:0/3177593466 >> 172.21.15.17:0/3177593466 conn(0x7ff63c0fcdc0 msgr2=0x7ff63c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- 172.21.15.17:0/3177593466 shutdown_connections 2024-03-16T10:48:25.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- 172.21.15.17:0/3177593466 wait complete. 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 Processor -- start 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.815+0000 7ff6434f1640 1 -- start start 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c101810 0x7ff63c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c102a00 0x7ff63c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10d490 con 0x7ff63c1033c0 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10d310 con 0x7ff63c102a00 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10d610 con 0x7ff63c101810 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45360/0 (socket says 172.21.15.17:45360) 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 -- 172.21.15.17:0/366257034 learned_addr learned my addr 172.21.15.17:0/366257034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff64128d640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c101810 0x7ff63c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff640a8c640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c102a00 0x7ff63c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:25.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 -- 172.21.15.17:0/366257034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c101810 msgr2=0x7ff63c197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c101810 0x7ff63c197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 -- 172.21.15.17:0/366257034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c102a00 msgr2=0x7ff63c198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c102a00 0x7ff63c198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 -- 172.21.15.17:0/366257034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c19f750 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff641a8e640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff63400cad0 tx=0x7ff63400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63400ae20 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff634005020 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c19fa40 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63400f6f0 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.816+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c19ff60 con 0x7ff63c1033c0 2024-03-16T10:48:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.817+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c108b30 con 0x7ff63c1033c0 2024-03-16T10:48:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.818+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7ff6340051d0 con 0x7ff63c1033c0 2024-03-16T10:48:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.819+0000 7ff6327fc640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 0x7ff6280a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.819+0000 7ff64128d640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 0x7ff6280a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.819+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff6340ce8f0 con 0x7ff63c1033c0 2024-03-16T10:48:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.820+0000 7ff64128d640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 0x7ff6280a4cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff63c102860 tx=0x7ff63800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:25.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:25.823+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff634014030 con 0x7ff63c1033c0 2024-03-16T10:48:26.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.054+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff63c02d1b0 con 0x7ff63c1033c0 2024-03-16T10:48:26.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.055+0000 7ff6327fc640 1 -- 172.21.15.17:0/366257034 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4696 (secure 0 0 0) 0x7ff63409be30 con 0x7ff63c1033c0 2024-03-16T10:48:26.055 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:26.056 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-16T10:48:26.056 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 msgr2=0x7ff6280a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 0x7ff6280a4cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff63c102860 tx=0x7ff63800a2d0 comp rx=0 tx=0).stop 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 msgr2=0x7ff63c19f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff63400cad0 tx=0x7ff63400cf90 comp rx=0 tx=0).stop 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 shutdown_connections 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6280a2800 0x7ff6280a4cc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c1033c0 0x7ff63c19f0e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff63c102a00 0x7ff63c198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 --2- 172.21.15.17:0/366257034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff63c101810 0x7ff63c197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:26.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 >> 172.21.15.17:0/366257034 conn(0x7ff63c0fcdc0 msgr2=0x7ff63c105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:26.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 shutdown_connections 2024-03-16T10:48:26.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:26.058+0000 7ff6434f1640 1 -- 172.21.15.17:0/366257034 wait complete. 2024-03-16T10:48:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:26 smithi174 ceph-mon[36202]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:26 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/366257034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:26.563 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 systemd[1]: Starting Ceph mds.f for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:26 smithi017 ceph-mon[32078]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:26 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/366257034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:26 smithi111 ceph-mon[36315]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:26 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/366257034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:26.964 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 podman[66538]: 2024-03-16 10:48:26.583257916 +0000 UTC m=+0.017625646 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:26.964 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 podman[66538]: 2024-03-16 10:48:26.710576822 +0000 UTC m=+0.144944565 container create 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-16T10:48:26.964 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 podman[66538]: 2024-03-16 10:48:26.963421209 +0000 UTC m=+0.397788932 container init 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:27.313 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 podman[66538]: 2024-03-16 10:48:26.966070778 +0000 UTC m=+0.400438502 container start 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:48:27.313 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 ceph-mds[66558]: -- 172.21.15.174:0/3924083381 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56471ecc1a40 con 0x56471ec94c00 2024-03-16T10:48:27.313 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: starting mds.f at 2024-03-16T10:48:27.313 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:27 smithi174 bash[66538]: 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 2024-03-16T10:48:27.313 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:48:27 smithi174 systemd[1]: Started Ceph mds.f for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:28.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:28.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- 172.21.15.17:0/638265470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8102a10 msgr2=0x7f04e8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:28.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 --2- 172.21.15.17:0/638265470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8102a10 0x7f04e8102e90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009900 tx=0x7f04d802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:28.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- 172.21.15.17:0/638265470 shutdown_connections 2024-03-16T10:48:28.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 --2- 172.21.15.17:0/638265470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e81033d0 0x7f04e8109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 --2- 172.21.15.17:0/638265470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8102a10 0x7f04e8102e90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 --2- 172.21.15.17:0/638265470 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8101820 0x7f04e8101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- 172.21.15.17:0/638265470 >> 172.21.15.17:0/638265470 conn(0x7f04e80fcd90 msgr2=0x7f04e80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- 172.21.15.17:0/638265470 shutdown_connections 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- 172.21.15.17:0/638265470 wait complete. 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 Processor -- start 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.187+0000 7f04eff37640 1 -- start start 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e8101820 0x7f04e8075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 0x7f04e8073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d480 con 0x7f04e81033d0 2024-03-16T10:48:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d300 con 0x7f04e8102a10 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04e810d600 con 0x7f04e8101820 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45388/0 (socket says 172.21.15.17:45388) 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 -- 172.21.15.17:0/3712437561 learned_addr learned my addr 172.21.15.17:0/3712437561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04edcd3640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e8101820 0x7f04e8075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ed4d2640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 0x7f04e8073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 -- 172.21.15.17:0/3712437561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e8101820 msgr2=0x7f04e8075590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e8101820 0x7f04e8075590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 -- 172.21.15.17:0/3712437561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 msgr2=0x7f04e8073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 0x7f04e8073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 -- 172.21.15.17:0/3712437561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e80749a0 con 0x7f04e81033d0 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ed4d2640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 0x7f04e8073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04ee4d4640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f04e000eb10 tx=0x7f04e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004b20 con 0x7f04e81033d0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04e0004cc0 con 0x7f04e81033d0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.188+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e81a1c50 con 0x7f04e81033d0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.189+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0010760 con 0x7f04e81033d0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.189+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e81a2170 con 0x7f04e81033d0 2024-03-16T10:48:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.190+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e80685d0 con 0x7f04e81033d0 2024-03-16T10:48:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.191+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f04e0005020 con 0x7f04e81033d0 2024-03-16T10:48:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.191+0000 7f04deffd640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 0x7f04d40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.192+0000 7f04edcd3640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 0x7f04d40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.192+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f04e00cebd0 con 0x7f04e81033d0 2024-03-16T10:48:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.192+0000 7f04edcd3640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 0x7f04d40a4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04e8102870 tx=0x7f04e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.196+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f04e009c110 con 0x7f04e81033d0 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: Deploying daemon mds.c on smithi174 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6834/330421208,v1:172.21.15.174:6835/330421208] up:boot 2024-03-16T10:48:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: fsmap 6 up:standby 2024-03-16T10:48:28.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:28 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:48:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.420+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04e802d230 con 0x7f04e81033d0 2024-03-16T10:48:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.421+0000 7f04deffd640 1 -- 172.21.15.17:0/3712437561 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5521 (secure 0 0 0) 0x7f04e009ba10 con 0x7f04e81033d0 2024-03-16T10:48:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:28.421 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-16T10:48:28.422 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 msgr2=0x7f04d40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 0x7f04d40a4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04e8102870 tx=0x7f04e400b390 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 msgr2=0x7f04e8074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f04e000eb10 tx=0x7f04e000c2d0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 shutdown_connections 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f04d40a2880 0x7f04d40a4d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e81033d0 0x7f04e8074110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04e8102a10 0x7f04e8073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 --2- 172.21.15.17:0/3712437561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04e8101820 0x7f04e8075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 >> 172.21.15.17:0/3712437561 conn(0x7f04e80fcd90 msgr2=0x7f04e8105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 shutdown_connections 2024-03-16T10:48:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:28.423+0000 7f04eff37640 1 -- 172.21.15.17:0/3712437561 wait complete. 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: Deploying daemon mds.c on smithi174 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6834/330421208,v1:172.21.15.174:6835/330421208] up:boot 2024-03-16T10:48:28.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: fsmap 6 up:standby 2024-03-16T10:48:28.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:28 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: Deploying daemon mds.c on smithi174 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6834/330421208,v1:172.21.15.174:6835/330421208] up:boot 2024-03-16T10:48:28.487 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: fsmap 6 up:standby 2024-03-16T10:48:28.488 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:28 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:48:29.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:29 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3712437561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:29.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:29 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3712437561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:29.506 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 systemd[1]: Starting Ceph mds.c for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:29.506 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 podman[66845]: 2024-03-16 10:48:29.407973041 +0000 UTC m=+0.017814804 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:29 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3712437561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:29.813 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 podman[66845]: 2024-03-16 10:48:29.532325882 +0000 UTC m=+0.142167688 container create 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:30 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:30.313 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 podman[66845]: 2024-03-16 10:48:29.918578683 +0000 UTC m=+0.528420434 container init 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:30.314 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 podman[66845]: 2024-03-16 10:48:29.921281837 +0000 UTC m=+0.531123575 container start 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-16T10:48:30.314 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 ceph-mds[66864]: -- 172.21.15.174:0/3697228503 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561258ae5a40 con 0x561258ab9000 2024-03-16T10:48:30.314 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: starting mds.c at 2024-03-16T10:48:30.314 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:30 smithi174 bash[66845]: 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 2024-03-16T10:48:30.314 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:48:30 smithi174 systemd[1]: Started Ceph mds.c for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:30.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:30.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:30 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:30.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:30.465 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:30 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 -- 172.21.15.17:0/1854990695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8100710 msgr2=0x7f28f8100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 --2- 172.21.15.17:0/1854990695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8100710 0x7f28f8100b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009900 tx=0x7f28f402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 -- 172.21.15.17:0/1854990695 shutdown_connections 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 --2- 172.21.15.17:0/1854990695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 0x7f28f8108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 --2- 172.21.15.17:0/1854990695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8101900 0x7f28f8101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 --2- 172.21.15.17:0/1854990695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8100710 0x7f28f8100b30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 -- 172.21.15.17:0/1854990695 >> 172.21.15.17:0/1854990695 conn(0x7f28f80fbcc0 msgr2=0x7f28f80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 -- 172.21.15.17:0/1854990695 shutdown_connections 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.552+0000 7f28ff627640 1 -- 172.21.15.17:0/1854990695 wait complete. 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 Processor -- start 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 -- start start 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8100710 0x7f28f806a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 0x7f28f819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28f810c360 con 0x7f28f8101900 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f28f810c1e0 con 0x7f28f81022c0 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28ff627640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28f810c4e0 con 0x7f28f8100710 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34712/0 (socket says 172.21.15.17:34712) 2024-03-16T10:48:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 -- 172.21.15.17:0/447128412 learned_addr learned my addr 172.21.15.17:0/447128412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fdbc4640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 0x7f28f819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fd3c3640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8100710 0x7f28f806a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 -- 172.21.15.17:0/447128412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8100710 msgr2=0x7f28f806a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8100710 0x7f28f806a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 -- 172.21.15.17:0/447128412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 msgr2=0x7f28f819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 0x7f28f819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.553+0000 7f28fcbc2640 1 -- 172.21.15.17:0/447128412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f819f740 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28fcbc2640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28e800d950 tx=0x7f28e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8017030 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e8004020 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f819fa30 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80047a0 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.554+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f819ff80 con 0x7f28f8101900 2024-03-16T10:48:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.555+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f8107a30 con 0x7f28f8101900 2024-03-16T10:48:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.556+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f28e80041d0 con 0x7f28f8101900 2024-03-16T10:48:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.556+0000 7f28ee7fc640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 0x7f28e40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.557+0000 7f28fd3c3640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 0x7f28e40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.557+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f28e80ce610 con 0x7f28f8101900 2024-03-16T10:48:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.557+0000 7f28fd3c3640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 0x7f28e40a4cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.560+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f28e809bb50 con 0x7f28f8101900 2024-03-16T10:48:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.786+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28f802d420 con 0x7f28f8101900 2024-03-16T10:48:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.786+0000 7f28ee7fc640 1 -- 172.21.15.17:0/447128412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6349 (secure 0 0 0) 0x7f28e809b450 con 0x7f28f8101900 2024-03-16T10:48:30.787 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:30.788 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-16T10:48:30.788 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-03-16T10:48:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 msgr2=0x7f28e40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 0x7f28e40a4cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000c00 tx=0x7f28f4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 msgr2=0x7f28f819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28e800d950 tx=0x7f28e800de10 comp rx=0 tx=0).stop 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 shutdown_connections 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f28e40a2800 0x7f28e40a4cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28f81022c0 0x7f28f819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28f8101900 0x7f28f819c840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.788+0000 7f28ff627640 1 --2- 172.21.15.17:0/447128412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28f8100710 0x7f28f806a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.789+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 >> 172.21.15.17:0/447128412 conn(0x7f28f80fbcc0 msgr2=0x7f28f8104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.789+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 shutdown_connections 2024-03-16T10:48:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:30.789+0000 7f28ff627640 1 -- 172.21.15.17:0/447128412 wait complete. 2024-03-16T10:48:31.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:31 smithi111 ceph-mon[36315]: Deploying daemon mds.h on smithi111 2024-03-16T10:48:31.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:31 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6836/3507552570,v1:172.21.15.174:6837/3507552570] up:boot 2024-03-16T10:48:31.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:31 smithi111 ceph-mon[36315]: fsmap 7 up:standby 2024-03-16T10:48:31.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:31 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:48:31.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:31 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/447128412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:31.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:31 smithi174 ceph-mon[36202]: Deploying daemon mds.h on smithi111 2024-03-16T10:48:31.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:31 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6836/3507552570,v1:172.21.15.174:6837/3507552570] up:boot 2024-03-16T10:48:31.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:31 smithi174 ceph-mon[36202]: fsmap 7 up:standby 2024-03-16T10:48:31.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:31 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:48:31.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:31 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/447128412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:31 smithi017 ceph-mon[32078]: Deploying daemon mds.h on smithi111 2024-03-16T10:48:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:31 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6836/3507552570,v1:172.21.15.174:6837/3507552570] up:boot 2024-03-16T10:48:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:31 smithi017 ceph-mon[32078]: fsmap 7 up:standby 2024-03-16T10:48:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:31 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:48:31.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:31 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/447128412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:32.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:32 smithi111 ceph-mon[36315]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:32.412 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 systemd[1]: Starting Ceph mds.h for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:32.419 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:32 smithi174 ceph-mon[36202]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:32 smithi017 ceph-mon[32078]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:32.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:32.807 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 podman[66513]: 2024-03-16 10:48:32.445773875 +0000 UTC m=+0.017687759 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:32.807 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 podman[66513]: 2024-03-16 10:48:32.553927639 +0000 UTC m=+0.125841540 container create 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:48:32.807 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 podman[66513]: 2024-03-16 10:48:32.781988433 +0000 UTC m=+0.353902310 container init 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240307, ceph=True) 2024-03-16T10:48:32.807 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 podman[66513]: 2024-03-16 10:48:32.784461487 +0000 UTC m=+0.356375354 container start 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:48:32.807 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 ceph-mds[66532]: -- 172.21.15.111:0/1722579688 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564634b3ba40 con 0x564634b0ec00 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 -- 172.21.15.17:0/3270673186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba01022d0 msgr2=0x7f4ba0108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 --2- 172.21.15.17:0/3270673186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba01022d0 0x7f4ba0108b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009ca0 tx=0x7f4b9802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 -- 172.21.15.17:0/3270673186 shutdown_connections 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 --2- 172.21.15.17:0/3270673186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba01022d0 0x7f4ba0108b60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 --2- 172.21.15.17:0/3270673186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba0101910 0x7f4ba0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 --2- 172.21.15.17:0/3270673186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0100720 0x7f4ba0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 -- 172.21.15.17:0/3270673186 >> 172.21.15.17:0/3270673186 conn(0x7f4ba00fbc90 msgr2=0x7f4ba00fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 -- 172.21.15.17:0/3270673186 shutdown_connections 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.916+0000 7f4ba4897640 1 -- 172.21.15.17:0/3270673186 wait complete. 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 Processor -- start 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 -- start start 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 0x7f4ba0102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba01022d0 0x7f4ba0103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba010c3a0 con 0x7f4ba0100720 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba010c220 con 0x7f4ba01022d0 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4ba4897640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba010c520 con 0x7f4ba0101910 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34734/0 (socket says 172.21.15.17:34734) 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 -- 172.21.15.17:0/2604787261 learned_addr learned my addr 172.21.15.17:0/2604787261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:32.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9ed9d640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba01022d0 0x7f4ba0103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b97fff640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 0x7f4ba0102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 -- 172.21.15.17:0/2604787261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 msgr2=0x7f4ba0102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 0x7f4ba0102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 -- 172.21.15.17:0/2604787261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba01022d0 msgr2=0x7f4ba0103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba01022d0 0x7f4ba0103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b9e59c640 1 -- 172.21.15.17:0/2604787261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba0103ac0 con 0x7f4ba0100720 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.917+0000 7f4b97fff640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 0x7f4ba0102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4b9e59c640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d950 tx=0x7f4b9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4ba0100720 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba01a1c00 con 0x7f4ba0100720 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b90009c30 con 0x7f4ba0100720 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000f600 con 0x7f4ba0100720 2024-03-16T10:48:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.918+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba01a2100 con 0x7f4ba0100720 2024-03-16T10:48:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.919+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba01a22d0 con 0x7f4ba0100720 2024-03-16T10:48:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.920+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f4b9001a070 con 0x7f4ba0100720 2024-03-16T10:48:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.921+0000 7f4b977fe640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 0x7f4b8c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.921+0000 7f4b97fff640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 0x7f4b8c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.921+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f4b900ce050 con 0x7f4ba0100720 2024-03-16T10:48:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.921+0000 7f4b97fff640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 0x7f4b8c0a4cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0104420 tx=0x7f4b88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:32.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:32.924+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4b90009de0 con 0x7f4ba0100720 2024-03-16T10:48:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.151+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba01a2660 con 0x7f4ba0100720 2024-03-16T10:48:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.151+0000 7f4b977fe640 1 -- 172.21.15.17:0/2604787261 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7177 (secure 0 0 0) 0x7f4b9009b590 con 0x7f4ba0100720 2024-03-16T10:48:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:33.153 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-16T10:48:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-03-16T10:48:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 msgr2=0x7f4b8c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 0x7f4b8c0a4cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0104420 tx=0x7f4b88005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 msgr2=0x7f4ba01046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d950 tx=0x7f4b9000de10 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 shutdown_connections 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b8c0a2800 0x7f4b8c0a4cc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba01022d0 0x7f4ba0103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba0101910 0x7f4ba0102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 --2- 172.21.15.17:0/2604787261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba0100720 0x7f4ba01046b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 >> 172.21.15.17:0/2604787261 conn(0x7f4ba00fbc90 msgr2=0x7f4ba00fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 shutdown_connections 2024-03-16T10:48:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:33.153+0000 7f4ba4897640 1 -- 172.21.15.17:0/2604787261 wait complete. 2024-03-16T10:48:33.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: starting mds.h at 2024-03-16T10:48:33.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 bash[66513]: 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f 2024-03-16T10:48:33.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:48:32 smithi111 systemd[1]: Started Ceph mds.h for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:34.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: Deploying daemon mds.i on smithi174 2024-03-16T10:48:34.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:boot 2024-03-16T10:48:34.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: fsmap 8 up:standby 2024-03-16T10:48:34.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:48:34.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:33 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2604787261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: Deploying daemon mds.i on smithi174 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:boot 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: fsmap 8 up:standby 2024-03-16T10:48:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:48:34.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:33 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2604787261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:34.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: Deploying daemon mds.i on smithi174 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:boot 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: fsmap 8 up:standby 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:48:34.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:33 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2604787261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:35.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 -- 172.21.15.17:0/3906673971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6481075c0 msgr2=0x7ff6481099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 --2- 172.21.15.17:0/3906673971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6481075c0 0x7ff6481099b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff640009ca0 tx=0x7ff64002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 -- 172.21.15.17:0/3906673971 shutdown_connections 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 --2- 172.21.15.17:0/3906673971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6481075c0 0x7ff6481099b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 --2- 172.21.15.17:0/3906673971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff648104c90 0x7ff648107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 --2- 172.21.15.17:0/3906673971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 0x7ff648104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 -- 172.21.15.17:0/3906673971 >> 172.21.15.17:0/3906673971 conn(0x7ff6480fbd10 msgr2=0x7ff6480fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:35.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 -- 172.21.15.17:0/3906673971 shutdown_connections 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.281+0000 7ff64f97e640 1 -- 172.21.15.17:0/3906673971 wait complete. 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 Processor -- start 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 -- start start 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 0x7ff648197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6481075c0 0x7ff64819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810d4b0 con 0x7ff648104c90 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810d330 con 0x7ff6481075c0 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64f97e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff64810d630 con 0x7ff648102360 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34750/0 (socket says 172.21.15.17:34750) 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 -- 172.21.15.17:0/647657295 learned_addr learned my addr 172.21.15.17:0/647657295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64d71a640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 0x7ff648197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:35.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64df1b640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6481075c0 0x7ff64819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 -- 172.21.15.17:0/647657295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 msgr2=0x7ff648197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 0x7ff648197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 -- 172.21.15.17:0/647657295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6481075c0 msgr2=0x7ff64819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6481075c0 0x7ff64819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.282+0000 7ff64cf19640 1 -- 172.21.15.17:0/647657295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64819f660 con 0x7ff648104c90 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff64cf19640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff63800c970 tx=0x7ff63800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638014070 con 0x7ff648104c90 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64819f950 con 0x7ff648104c90 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff638004440 con 0x7ff648104c90 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63800f450 con 0x7ff648104c90 2024-03-16T10:48:35.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.283+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64819fea0 con 0x7ff648104c90 2024-03-16T10:48:35.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.284+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6480fd800 con 0x7ff648104c90 2024-03-16T10:48:35.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.285+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7ff638017070 con 0x7ff648104c90 2024-03-16T10:48:35.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.286+0000 7ff63e7fc640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 0x7ff6340a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.286+0000 7ff64d71a640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 0x7ff6340a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.286+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff6380ce420 con 0x7ff648104c90 2024-03-16T10:48:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.286+0000 7ff64d71a640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 0x7ff6340a4cc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff644005fd0 tx=0x7ff64400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:35.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.290+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff63801e020 con 0x7ff648104c90 2024-03-16T10:48:35.313 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 systemd[1]: Starting Ceph mds.i for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.511+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6480623e0 con 0x7ff648104c90 2024-03-16T10:48:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.511+0000 7ff63e7fc640 1 -- 172.21.15.17:0/647657295 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7177 (secure 0 0 0) 0x7ff63809b8c0 con 0x7ff648104c90 2024-03-16T10:48:35.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:35.512 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-16T10:48:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-03-16T10:48:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 msgr2=0x7ff6340a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 0x7ff6340a4cc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff644005fd0 tx=0x7ff64400b390 comp rx=0 tx=0).stop 2024-03-16T10:48:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 msgr2=0x7ff648197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff63800c970 tx=0x7ff63800ce30 comp rx=0 tx=0).stop 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 shutdown_connections 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff6340a2800 0x7ff6340a4cc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.513+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6481075c0 0x7ff64819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.514+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff648104c90 0x7ff648197f80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.514+0000 7ff64f97e640 1 --2- 172.21.15.17:0/647657295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff648102360 0x7ff648197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.514+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 >> 172.21.15.17:0/647657295 conn(0x7ff6480fbd10 msgr2=0x7ff648102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.514+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 shutdown_connections 2024-03-16T10:48:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:35.514+0000 7ff64f97e640 1 -- 172.21.15.17:0/647657295 wait complete. 2024-03-16T10:48:35.596 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 podman[67157]: 2024-03-16 10:48:35.244465397 +0000 UTC m=+0.017532843 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:35.597 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 podman[67157]: 2024-03-16 10:48:35.464542634 +0000 UTC m=+0.237610109 container create 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 podman[67157]: 2024-03-16 10:48:35.717234551 +0000 UTC m=+0.490301989 container init 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 podman[67157]: 2024-03-16 10:48:35.719755874 +0000 UTC m=+0.492823311 container start 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.license=GPLv2) 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mds[67176]: -- 172.21.15.174:0/1727490734 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5638d90d7a40 con 0x5638d90aa800 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: starting mds.i at 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 bash[67157]: 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c 2024-03-16T10:48:35.937 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:48:35 smithi174 systemd[1]: Started Ceph mds.i for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/647657295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:36.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:35 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/647657295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:36.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:35 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:36.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:36.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/647657295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:36.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:35 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:37.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:36 smithi017 ceph-mon[32078]: Deploying daemon mds.g on smithi017 2024-03-16T10:48:37.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:36 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:boot 2024-03-16T10:48:37.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:36 smithi017 ceph-mon[32078]: fsmap 9 up:standby 2024-03-16T10:48:37.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:36 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:48:37.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:36 smithi174 ceph-mon[36202]: Deploying daemon mds.g on smithi017 2024-03-16T10:48:37.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:36 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:boot 2024-03-16T10:48:37.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:36 smithi174 ceph-mon[36202]: fsmap 9 up:standby 2024-03-16T10:48:37.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:36 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:48:37.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:36 smithi111 ceph-mon[36315]: Deploying daemon mds.g on smithi017 2024-03-16T10:48:37.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:36 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:boot 2024-03-16T10:48:37.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:36 smithi111 ceph-mon[36315]: fsmap 9 up:standby 2024-03-16T10:48:37.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:36 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:48:37.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 -- 172.21.15.17:0/3447175544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c4100530 msgr2=0x7f91c4100950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 --2- 172.21.15.17:0/3447175544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c4100530 0x7f91c4100950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009900 tx=0x7f91bc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 -- 172.21.15.17:0/3447175544 shutdown_connections 2024-03-16T10:48:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 --2- 172.21.15.17:0/3447175544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c41020e0 0x7f91c4108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 --2- 172.21.15.17:0/3447175544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4101720 0x7f91c4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 --2- 172.21.15.17:0/3447175544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c4100530 0x7f91c4100950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 -- 172.21.15.17:0/3447175544 >> 172.21.15.17:0/3447175544 conn(0x7f91c40fbac0 msgr2=0x7f91c40fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:37.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 -- 172.21.15.17:0/3447175544 shutdown_connections 2024-03-16T10:48:37.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.645+0000 7f91c359e640 1 -- 172.21.15.17:0/3447175544 wait complete. 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 Processor -- start 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 -- start start 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4100530 0x7f91c4104450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4101720 0x7f91c4102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91c410c1c0 con 0x7f91c41020e0 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f91c410c040 con 0x7f91c4100530 2024-03-16T10:48:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c359e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91c410c340 con 0x7f91c4101720 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.646+0000 7f91c2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34776/0 (socket says 172.21.15.17:34776) 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 -- 172.21.15.17:0/1067887325 learned_addr learned my addr 172.21.15.17:0/1067887325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c259c640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4100530 0x7f91c4104450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c1d9b640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4101720 0x7f91c4102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 -- 172.21.15.17:0/1067887325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4101720 msgr2=0x7f91c4102b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4101720 0x7f91c4102b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 -- 172.21.15.17:0/1067887325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4100530 msgr2=0x7f91c4104450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4100530 0x7f91c4104450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 -- 172.21.15.17:0/1067887325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c4103860 con 0x7f91c41020e0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c2d9d640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91b400eaa0 tx=0x7f91b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b400cdb0 con 0x7f91c41020e0 2024-03-16T10:48:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91b4005020 con 0x7f91c41020e0 2024-03-16T10:48:37.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c41a1a80 con 0x7f91c41020e0 2024-03-16T10:48:37.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b40116b0 con 0x7f91c41020e0 2024-03-16T10:48:37.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.647+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41a2020 con 0x7f91c41020e0 2024-03-16T10:48:37.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.648+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c41a2250 con 0x7f91c41020e0 2024-03-16T10:48:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.649+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f91b4005560 con 0x7f91c41020e0 2024-03-16T10:48:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.650+0000 7f91bb7fe640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 0x7f91b00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.650+0000 7f91c259c640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 0x7f91b00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.650+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f91b40ce770 con 0x7f91c41020e0 2024-03-16T10:48:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.651+0000 7f91c259c640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 0x7f91b00a4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.655+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f91b4016030 con 0x7f91c41020e0 2024-03-16T10:48:37.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.918+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c41a2420 con 0x7f91c41020e0 2024-03-16T10:48:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.919+0000 7f91bb7fe640 1 -- 172.21.15.17:0/1067887325 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7f91b409b5c0 con 0x7f91c41020e0 2024-03-16T10:48:37.920 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:37.920 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-16T10:48:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2024-03-16T10:48:37.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 msgr2=0x7f91b00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:37.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 0x7f91b00a4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 msgr2=0x7f91c4103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:37.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91b400eaa0 tx=0x7f91b400ef60 comp rx=0 tx=0).stop 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 shutdown_connections 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f91b00a2880 0x7f91b00a4d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c41020e0 0x7f91c4103040 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91c4101720 0x7f91c4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 --2- 172.21.15.17:0/1067887325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91c4100530 0x7f91c4104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 >> 172.21.15.17:0/1067887325 conn(0x7f91c40fbac0 msgr2=0x7f91c40fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 shutdown_connections 2024-03-16T10:48:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:37.921+0000 7f91c359e640 1 -- 172.21.15.17:0/1067887325 wait complete. 2024-03-16T10:48:38.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:37 smithi017 ceph-mon[32078]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:38.267 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:37 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1067887325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:38.267 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 systemd[1]: Starting Ceph mds.g for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:38.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:37 smithi174 ceph-mon[36202]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:38.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:37 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1067887325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:38.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:37 smithi111 ceph-mon[36315]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:38.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:37 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1067887325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:38.561 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 podman[73150]: 2024-03-16 10:48:38.16895713 +0000 UTC m=+0.017955067 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:38.561 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 podman[73150]: 2024-03-16 10:48:38.282820144 +0000 UTC m=+0.131818125 container create 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-16T10:48:38.561 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 podman[73150]: 2024-03-16 10:48:38.561201982 +0000 UTC m=+0.410199918 container init 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2) 2024-03-16T10:48:38.840 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 podman[73150]: 2024-03-16 10:48:38.56394599 +0000 UTC m=+0.412943926 container start 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-16T10:48:38.840 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 ceph-mds[73169]: -- 172.21.15.17:0/2901398720 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3d77e1a40 con 0x55a3d77b4800 2024-03-16T10:48:38.840 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: starting mds.g at 2024-03-16T10:48:38.840 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 bash[73150]: 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b 2024-03-16T10:48:38.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:48:38 smithi017 systemd[1]: Started Ceph mds.g for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:39.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:39.962 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: Deploying daemon mds.a on smithi017 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6838/3638042020,v1:172.21.15.17:6839/3638042020] up:boot 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: fsmap 10 up:standby 2024-03-16T10:48:39.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:39 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- 172.21.15.17:0/1646180542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1018f0 msgr2=0x7f8ffc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 --2- 172.21.15.17:0/1646180542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc101d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff002bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- 172.21.15.17:0/1646180542 shutdown_connections 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 --2- 172.21.15.17:0/1646180542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 --2- 172.21.15.17:0/1646180542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc101d70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 --2- 172.21.15.17:0/1646180542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- 172.21.15.17:0/1646180542 >> 172.21.15.17:0/1646180542 conn(0x7f8ffc0fbc70 msgr2=0x7f8ffc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- 172.21.15.17:0/1646180542 shutdown_connections 2024-03-16T10:48:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- 172.21.15.17:0/1646180542 wait complete. 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 Processor -- start 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.044+0000 7f9004697640 1 -- start start 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10d4a0 con 0x7f8ffc1022b0 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10d320 con 0x7f8ffc1018f0 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10d620 con 0x7f8ffc100700 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55090/0 (socket says 172.21.15.17:55090) 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 -- 172.21.15.17:0/1453869866 learned_addr learned my addr 172.21.15.17:0/1453869866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9001c32640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002433640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 -- 172.21.15.17:0/1453869866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 msgr2=0x7f8ffc197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 -- 172.21.15.17:0/1453869866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1018f0 msgr2=0x7f8ffc197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 -- 172.21.15.17:0/1453869866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc19f690 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002433640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9002c34640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c970 tx=0x7f8fec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec007bb0 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc19f980 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fec007d50 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec018800 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.045+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc19fea0 con 0x7f8ffc1022b0 2024-03-16T10:48:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.046+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc107a20 con 0x7f8ffc1022b0 2024-03-16T10:48:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.047+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f8fec00fa50 con 0x7f8ffc1022b0 2024-03-16T10:48:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.048+0000 7f8ffb7fe640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 0x7f8fe40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.048+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8fec0ce610 con 0x7f8ffc1022b0 2024-03-16T10:48:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.048+0000 7f9002433640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 0x7f8fe40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:40.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.048+0000 7f9002433640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 0x7f8fe40a4cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc101750 tx=0x7f8ff40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.052+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8fec014030 con 0x7f8ffc1022b0 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: Deploying daemon mds.a on smithi017 2024-03-16T10:48:40.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6838/3638042020,v1:172.21.15.17:6839/3638042020] up:boot 2024-03-16T10:48:40.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: fsmap 10 up:standby 2024-03-16T10:48:40.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:39 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:48:40.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: Deploying daemon mds.a on smithi017 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6838/3638042020,v1:172.21.15.17:6839/3638042020] up:boot 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: fsmap 10 up:standby 2024-03-16T10:48:40.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:39 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:48:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.276+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ffc02d1b0 con 0x7f8ffc1022b0 2024-03-16T10:48:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.276+0000 7f8ffb7fe640 1 -- 172.21.15.17:0/1453869866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8833 (secure 0 0 0) 0x7f8fec09bb50 con 0x7f8ffc1022b0 2024-03-16T10:48:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:40.277 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-16T10:48:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-03-16T10:48:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 msgr2=0x7f8fe40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 0x7f8fe40a4cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc101750 tx=0x7f8ff40095c0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 msgr2=0x7f8ffc19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c970 tx=0x7f8fec00ce30 comp rx=0 tx=0).stop 2024-03-16T10:48:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 shutdown_connections 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8fe40a2800 0x7f8fe40a4cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ffc1022b0 0x7f8ffc19f020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ffc1018f0 0x7f8ffc197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 --2- 172.21.15.17:0/1453869866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ffc100700 0x7f8ffc197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 >> 172.21.15.17:0/1453869866 conn(0x7f8ffc0fbc70 msgr2=0x7f8ffc104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 shutdown_connections 2024-03-16T10:48:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:40.278+0000 7f9004697640 1 -- 172.21.15.17:0/1453869866 wait complete. 2024-03-16T10:48:41.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:40 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1453869866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:41.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:40 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1453869866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:41.090 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:40 smithi017 systemd[1]: Starting Ceph mds.a for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:41.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:40 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1453869866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:41.368 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 podman[73506]: 2024-03-16 10:48:41.000730274 +0000 UTC m=+0.022126896 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:41.368 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 podman[73506]: 2024-03-16 10:48:41.106535532 +0000 UTC m=+0.127932136 container create 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-16T10:48:41.369 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 podman[73506]: 2024-03-16 10:48:41.342592258 +0000 UTC m=+0.363988863 container init 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2) 2024-03-16T10:48:41.369 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 podman[73506]: 2024-03-16 10:48:41.345272816 +0000 UTC m=+0.366669423 container start 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-16T10:48:41.369 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mds[73527]: -- 172.21.15.17:0/230566765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c49e26da40 con 0x55c49e241000 2024-03-16T10:48:41.685 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: starting mds.a at 2024-03-16T10:48:41.686 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 bash[73506]: 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 2024-03-16T10:48:41.686 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:48:41 smithi017 systemd[1]: Started Ceph mds.a for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:42.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:42.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:42.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:42.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:42.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.161 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-16T10:48:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-16T10:48:42.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:42.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 -- 172.21.15.17:0/3804328114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 msgr2=0x7fe18c106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 --2- 172.21.15.17:0/3804328114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c106dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe174009900 tx=0x7fe17402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 -- 172.21.15.17:0/3804328114 shutdown_connections 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 --2- 172.21.15.17:0/3804328114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 0x7fe18c109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 --2- 172.21.15.17:0/3804328114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c106dd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 --2- 172.21.15.17:0/3804328114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c1044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 -- 172.21.15.17:0/3804328114 >> 172.21.15.17:0/3804328114 conn(0x7fe18c0fbac0 msgr2=0x7fe18c0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 -- 172.21.15.17:0/3804328114 shutdown_connections 2024-03-16T10:48:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.409+0000 7fe190f9d640 1 -- 172.21.15.17:0/3804328114 wait complete. 2024-03-16T10:48:42.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 Processor -- start 2024-03-16T10:48:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 -- start start 2024-03-16T10:48:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 0x7fe18c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10d2b0 con 0x7fe18c1049e0 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10d130 con 0x7fe18c107310 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe190f9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10d430 con 0x7fe18c1020b0 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55142/0 (socket says 172.21.15.17:55142) 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 -- 172.21.15.17:0/4253119859 learned_addr learned my addr 172.21.15.17:0/4253119859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18bfff640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 0x7fe18c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18b7fe640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 -- 172.21.15.17:0/4253119859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 msgr2=0x7fe18c197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 -- 172.21.15.17:0/4253119859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 msgr2=0x7fe18c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 0x7fe18c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18affd640 1 -- 172.21.15.17:0/4253119859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c19f540 con 0x7fe18c1049e0 2024-03-16T10:48:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.410+0000 7fe18b7fe640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe18affd640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe174005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174041070 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1740054e0 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c19f7d0 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174034440 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.411+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c19fcc0 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.412+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c0fd5b0 con 0x7fe18c1049e0 2024-03-16T10:48:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.413+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fe174044070 con 0x7fe18c1049e0 2024-03-16T10:48:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.413+0000 7fe188ff9640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 0x7fe1780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.414+0000 7fe18b7fe640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 0x7fe1780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.414+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe1740f0230 con 0x7fe18c1049e0 2024-03-16T10:48:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.414+0000 7fe18b7fe640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 0x7fe1780a4cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005fd0 tx=0x7fe17c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.418+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe1740bd770 con 0x7fe18c1049e0 2024-03-16T10:48:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.641+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe18c02d3d0 con 0x7fe18c1049e0 2024-03-16T10:48:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.641+0000 7fe188ff9640 1 -- 172.21.15.17:0/4253119859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9659 (secure 0 0 0) 0x7fe1740bd070 con 0x7fe18c1049e0 2024-03-16T10:48:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:42.642 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-16T10:48:42.643 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2024-03-16T10:48:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 msgr2=0x7fe1780a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 0x7fe1780a4cc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005fd0 tx=0x7fe17c009520 comp rx=0 tx=0).stop 2024-03-16T10:48:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 msgr2=0x7fe18c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe174005ab0 tx=0x7fe174005dc0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 shutdown_connections 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1780a2800 0x7fe1780a4cc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe18c107310 0x7fe18c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1049e0 0x7fe18c197e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 --2- 172.21.15.17:0/4253119859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe18c1020b0 0x7fe18c197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.643+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 >> 172.21.15.17:0/4253119859 conn(0x7fe18c0fbac0 msgr2=0x7fe18c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.644+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 shutdown_connections 2024-03-16T10:48:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:42.644+0000 7fe190f9d640 1 -- 172.21.15.17:0/4253119859 wait complete. 2024-03-16T10:48:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:42 smithi174 ceph-mon[36202]: Deploying daemon mds.b on smithi111 2024-03-16T10:48:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:42 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:boot 2024-03-16T10:48:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:42 smithi174 ceph-mon[36202]: fsmap 11 up:standby 2024-03-16T10:48:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:48:43.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:42 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4253119859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:42 smithi017 ceph-mon[32078]: Deploying daemon mds.b on smithi111 2024-03-16T10:48:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:42 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:boot 2024-03-16T10:48:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:42 smithi017 ceph-mon[32078]: fsmap 11 up:standby 2024-03-16T10:48:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:48:43.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:42 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4253119859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:43.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:42 smithi111 ceph-mon[36315]: Deploying daemon mds.b on smithi111 2024-03-16T10:48:43.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:42 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:boot 2024-03-16T10:48:43.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:42 smithi111 ceph-mon[36315]: fsmap 11 up:standby 2024-03-16T10:48:43.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:48:43.162 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:42 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4253119859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:43.911 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:43 smithi111 systemd[1]: Starting Ceph mds.b for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:48:43.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:43 smithi111 ceph-mon[36315]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:44.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:43 smithi174 ceph-mon[36202]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:44.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:43 smithi017 ceph-mon[32078]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:44.279 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 podman[66823]: 2024-03-16 10:48:43.904111993 +0000 UTC m=+0.018125532 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:48:44.279 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 podman[66823]: 2024-03-16 10:48:44.042609921 +0000 UTC m=+0.156623445 container create 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307) 2024-03-16T10:48:44.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:44.661 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 podman[66823]: 2024-03-16 10:48:44.278923797 +0000 UTC m=+0.392937331 container init 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD) 2024-03-16T10:48:44.662 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 podman[66823]: 2024-03-16 10:48:44.281468587 +0000 UTC m=+0.395482125 container start 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-16T10:48:44.662 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 ceph-mds[66842]: -- 172.21.15.111:0/4047262862 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56071a6e9a40 con 0x56071a6bd000 2024-03-16T10:48:44.662 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: starting mds.b at 2024-03-16T10:48:44.662 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 bash[66823]: 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb 2024-03-16T10:48:44.662 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:44 smithi111 systemd[1]: Started Ceph mds.b for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- 172.21.15.17:0/4113761197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 msgr2=0x7f746c104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 --2- 172.21.15.17:0/4113761197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c104670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f745c009900 tx=0x7f745c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- 172.21.15.17:0/4113761197 shutdown_connections 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 --2- 172.21.15.17:0/4113761197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c1074e0 0x7f746c109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 --2- 172.21.15.17:0/4113761197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c104bb0 0x7f746c106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 --2- 172.21.15.17:0/4113761197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c104670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- 172.21.15.17:0/4113761197 >> 172.21.15.17:0/4113761197 conn(0x7f746c0fbc70 msgr2=0x7f746c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- 172.21.15.17:0/4113761197 shutdown_connections 2024-03-16T10:48:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- 172.21.15.17:0/4113761197 wait complete. 2024-03-16T10:48:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 Processor -- start 2024-03-16T10:48:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.768+0000 7f74724b2640 1 -- start start 2024-03-16T10:48:44.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:44.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 0x7f746c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:44.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 0x7f746c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10d4a0 con 0x7f746c102280 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10d320 con 0x7f746c1074e0 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f74724b2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f746c10d620 con 0x7f746c104bb0 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55162/0 (socket says 172.21.15.17:55162) 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746bfff640 1 -- 172.21.15.17:0/3089431884 learned_addr learned my addr 172.21.15.17:0/3089431884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 0x7f746c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f7470a4f640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 0x7f746c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 -- 172.21.15.17:0/3089431884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 msgr2=0x7f746c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 0x7f746c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 -- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 msgr2=0x7f746c197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 -- 172.21.15.17:0/3089431884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c19f740 con 0x7f746c104bb0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f7470a4f640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 0x7f746c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746bfff640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.769+0000 7f746b7fe640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 0x7f746c198060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f746000e9c0 tx=0x7f746000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.770+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746000ccc0 con 0x7f746c104bb0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.770+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c19fa30 con 0x7f746c104bb0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.770+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7460010910 con 0x7f746c104bb0 2024-03-16T10:48:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.770+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460018880 con 0x7f746c104bb0 2024-03-16T10:48:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.770+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c19ff80 con 0x7f746c104bb0 2024-03-16T10:48:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.771+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c0fd760 con 0x7f746c104bb0 2024-03-16T10:48:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.772+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f7460010ac0 con 0x7f746c104bb0 2024-03-16T10:48:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.772+0000 7f74697fa640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 0x7f74540a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.772+0000 7f746bfff640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 0x7f74540a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:44.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.772+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f74600ce9c0 con 0x7f746c104bb0 2024-03-16T10:48:44.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.773+0000 7f746bfff640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 0x7f74540a4cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c02c880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:44.777+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f746009b810 con 0x7f746c104bb0 2024-03-16T10:48:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.022+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f746c0623e0 con 0x7f746c104bb0 2024-03-16T10:48:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.023+0000 7f74697fa640 1 -- 172.21.15.17:0/3089431884 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10488 (secure 0 0 0) 0x7f746009f8b0 con 0x7f746c104bb0 2024-03-16T10:48:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:45.024 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14643,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-03-16T10:48:45.024 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 msgr2=0x7f74540a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 0x7f74540a4cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c02c880 comp rx=0 tx=0).stop 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 msgr2=0x7f746c198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 0x7f746c198060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f746000e9c0 tx=0x7f746000ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 shutdown_connections 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74540a2800 0x7f74540a4cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746c1074e0 0x7f746c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f746c104bb0 0x7f746c198060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 --2- 172.21.15.17:0/3089431884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f746c102280 0x7f746c197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 >> 172.21.15.17:0/3089431884 conn(0x7f746c0fbc70 msgr2=0x7f746c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 shutdown_connections 2024-03-16T10:48:45.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.025+0000 7f74724b2640 1 -- 172.21.15.17:0/3089431884 wait complete. 2024-03-16T10:48:45.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 -- 172.21.15.17:0/185741014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c102a00 msgr2=0x7fd36c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 --2- 172.21.15.17:0/185741014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c102a00 0x7fd36c102e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd358009900 tx=0x7fd35802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 -- 172.21.15.17:0/185741014 shutdown_connections 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 --2- 172.21.15.17:0/185741014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c1033c0 0x7fd36c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 --2- 172.21.15.17:0/185741014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c102a00 0x7fd36c102e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 --2- 172.21.15.17:0/185741014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 -- 172.21.15.17:0/185741014 >> 172.21.15.17:0/185741014 conn(0x7fd36c0fcd80 msgr2=0x7fd36c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 -- 172.21.15.17:0/185741014 shutdown_connections 2024-03-16T10:48:45.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 -- 172.21.15.17:0/185741014 wait complete. 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.144+0000 7fd373110640 1 Processor -- start 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 -- start start 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 0x7fd36c073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 0x7fd36c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c10d470 con 0x7fd36c1033c0 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c10d2f0 con 0x7fd36c102a00 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd373110640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c10d5f0 con 0x7fd36c101810 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd3716ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 0x7fd36c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 0x7fd36c073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:51460/0 (socket says 172.21.15.17:51460) 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd36bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 0x7fd36c073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36304/0 (socket says 172.21.15.17:36304) 2024-03-16T10:48:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 -- 172.21.15.17:0/2613684166 learned_addr learned my addr 172.21.15.17:0/2613684166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd3716ad640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 0x7fd36c074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55182/0 (socket says 172.21.15.17:55182) 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 -- 172.21.15.17:0/2613684166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 msgr2=0x7fd36c073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 0x7fd36c073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 -- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 msgr2=0x7fd36c074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 0x7fd36c074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 -- 172.21.15.17:0/2613684166 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c0749a0 con 0x7fd36c101810 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.145+0000 7fd370eac640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd36000e9c0 tx=0x7fd36000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.146+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000cd80 con 0x7fd36c101810 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.146+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c1a1c40 con 0x7fd36c101810 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.146+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3600035f0 con 0x7fd36c101810 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.146+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360010690 con 0x7fd36c101810 2024-03-16T10:48:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.146+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c1a21b0 con 0x7fd36c101810 2024-03-16T10:48:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.147+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36c067d40 con 0x7fd36c101810 2024-03-16T10:48:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.148+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fd360004020 con 0x7fd36c101810 2024-03-16T10:48:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.149+0000 7fd369ffb640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 0x7fd35c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.149+0000 7fd36bfff640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 0x7fd35c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.149+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd3600ce9f0 con 0x7fd36c101810 2024-03-16T10:48:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.149+0000 7fd36bfff640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 0x7fd35c0a4cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd358009230 tx=0x7fd358005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.154+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd36009bf30 con 0x7fd36c101810 2024-03-16T10:48:45.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.351+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd36c062410 con 0x7fd36c101810 2024-03-16T10:48:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.353+0000 7fd369ffb640 1 -- 172.21.15.17:0/2613684166 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18468 (secure 0 0 0) 0x7fd36009b830 con 0x7fd36c101810 2024-03-16T10:48:45.354 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:45.354 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":81,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:47:58.188556+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 msgr2=0x7fd35c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 0x7fd35c0a4cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd358009230 tx=0x7fd358005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 msgr2=0x7fd36c075590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd36000e9c0 tx=0x7fd36000ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 shutdown_connections 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd35c0a2800 0x7fd35c0a4cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd36c1033c0 0x7fd36c074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd36c102a00 0x7fd36c073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 --2- 172.21.15.17:0/2613684166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd36c101810 0x7fd36c075590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 >> 172.21.15.17:0/2613684166 conn(0x7fd36c0fcd80 msgr2=0x7fd36c105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 shutdown_connections 2024-03-16T10:48:45.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.355+0000 7fd373110640 1 -- 172.21.15.17:0/2613684166 wait complete. 2024-03-16T10:48:45.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:48:45.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 -- 172.21.15.17:0/3042075707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 msgr2=0x7f8708073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3042075707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f8708073c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8704009900 tx=0x7f870402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 -- 172.21.15.17:0/3042075707 shutdown_connections 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3042075707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 0x7f870810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3042075707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f87080746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3042075707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f8708073c70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 -- 172.21.15.17:0/3042075707 >> 172.21.15.17:0/3042075707 conn(0x7f87080fcd60 msgr2=0x7f87080ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 -- 172.21.15.17:0/3042075707 shutdown_connections 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.477+0000 7f870f8dc640 1 -- 172.21.15.17:0/3042075707 wait complete. 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 Processor -- start 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 -- start start 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f8708199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 0x7f87081a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f870810f630 con 0x7f8708075820 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f870810f4b0 con 0x7f87081096b0 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870f8dc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f870810f7b0 con 0x7f8708074240 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870d678640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f8708199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55210/0 (socket says 172.21.15.17:55210) 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 -- 172.21.15.17:0/3755796119 learned_addr learned my addr 172.21.15.17:0/3755796119 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870de79640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 0x7f87081a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 -- 172.21.15.17:0/3755796119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 msgr2=0x7f8708199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f8708199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 -- 172.21.15.17:0/3755796119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 msgr2=0x7f87081a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 0x7f87081a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 -- 172.21.15.17:0/3755796119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87081a1960 con 0x7f8708075820 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870d678640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f8708199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.478+0000 7f870ce77640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86f800d950 tx=0x7f86f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.479+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8017030 con 0x7f8708075820 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.479+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87081a1c50 con 0x7f8708075820 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.479+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f8004020 con 0x7f8708075820 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.479+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80047a0 con 0x7f8708075820 2024-03-16T10:48:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.479+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87081a21a0 con 0x7f8708075820 2024-03-16T10:48:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.480+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87081083e0 con 0x7f8708075820 2024-03-16T10:48:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.481+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f86f80041d0 con 0x7f8708075820 2024-03-16T10:48:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.481+0000 7f86fe7fc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 0x7f86f40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.481+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f86f80ce020 con 0x7f8708075820 2024-03-16T10:48:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.482+0000 7f870d678640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 0x7f86f40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.482+0000 7f870d678640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 0x7f86f40a4cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f870819b220 tx=0x7f8704005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.486+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f86f809b560 con 0x7f8708075820 2024-03-16T10:48:45.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:boot 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: fsmap 12 up:standby 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3089431884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2613684166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.694+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f870802d360 con 0x7f8708075820 2024-03-16T10:48:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.694+0000 7f86fe7fc640 1 -- 172.21.15.17:0/3755796119 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f86f809ae60 con 0x7f8708075820 2024-03-16T10:48:45.695 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:48:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 msgr2=0x7f86f40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 0x7f86f40a4cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f870819b220 tx=0x7f8704005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 msgr2=0x7f870819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86f800d950 tx=0x7f86f800de10 comp rx=0 tx=0).stop 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 shutdown_connections 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f86f40a2800 0x7f86f40a4cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87081096b0 0x7f87081a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8708075820 0x7f870819a2e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 --2- 172.21.15.17:0/3755796119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8708074240 0x7f8708199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 >> 172.21.15.17:0/3755796119 conn(0x7f87080fcd60 msgr2=0x7f87081055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.696+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 shutdown_connections 2024-03-16T10:48:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.697+0000 7f870f8dc640 1 -- 172.21.15.17:0/3755796119 wait complete. 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:boot 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: fsmap 12 up:standby 2024-03-16T10:48:45.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:48:45.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3089431884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2613684166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T10:48:45.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:boot 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: fsmap 12 up:standby 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3089431884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2613684166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 -- 172.21.15.17:0/1967255707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97381029f0 msgr2=0x7f9738102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 --2- 172.21.15.17:0/1967255707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97381029f0 0x7f9738102e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9728009900 tx=0x7f972802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 -- 172.21.15.17:0/1967255707 shutdown_connections 2024-03-16T10:48:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 --2- 172.21.15.17:0/1967255707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 0x7f9738109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 --2- 172.21.15.17:0/1967255707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97381029f0 0x7f9738102e70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 --2- 172.21.15.17:0/1967255707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9738101800 0x7f9738101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 -- 172.21.15.17:0/1967255707 >> 172.21.15.17:0/1967255707 conn(0x7f97380fcd90 msgr2=0x7f97380ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 -- 172.21.15.17:0/1967255707 shutdown_connections 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.812+0000 7f973fc59640 1 -- 172.21.15.17:0/1967255707 wait complete. 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 Processor -- start 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 -- start start 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97381029f0 0x7f9738073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 0x7f9738074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f973810d480 con 0x7f9738101800 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f973810d300 con 0x7f97381033b0 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973fc59640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f973810d600 con 0x7f97381029f0 2024-03-16T10:48:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973d9f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973d9f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55230/0 (socket says 172.21.15.17:55230) 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973d9f5640 1 -- 172.21.15.17:0/2813644361 learned_addr learned my addr 172.21.15.17:0/2813644361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973d1f4640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97381029f0 0x7f9738073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.813+0000 7f973e1f6640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 0x7f9738074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 -- 172.21.15.17:0/2813644361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97381029f0 msgr2=0x7f9738073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97381029f0 0x7f9738073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 -- 172.21.15.17:0/2813644361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 msgr2=0x7f9738074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 0x7f9738074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 -- 172.21.15.17:0/2813644361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97380749a0 con 0x7f9738101800 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973d9f5640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f973400d950 tx=0x7f973400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734017070 con 0x7f9738101800 2024-03-16T10:48:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9734009c30 con 0x7f9738101800 2024-03-16T10:48:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97381a1c50 con 0x7f9738101800 2024-03-16T10:48:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973400f600 con 0x7f9738101800 2024-03-16T10:48:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.814+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97381a2120 con 0x7f9738101800 2024-03-16T10:48:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.815+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9738108b20 con 0x7f9738101800 2024-03-16T10:48:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.816+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f973401a070 con 0x7f9738101800 2024-03-16T10:48:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.817+0000 7f972effd640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 0x7f97240a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.817+0000 7f973d1f4640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 0x7f97240a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.817+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f97340ce0c0 con 0x7f9738101800 2024-03-16T10:48:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.817+0000 7f973d1f4640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 0x7f97240a4cc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f972802c7b0 tx=0x7f9728005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:45.821+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f9734009de0 con 0x7f9738101800 2024-03-16T10:48:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.017+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9738062410 con 0x7f9738101800 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.017+0000 7f972effd640 1 -- 172.21.15.17:0/2813644361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f973409b560 con 0x7f9738101800 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:48:46.018 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 msgr2=0x7f97240a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 0x7f97240a4cc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f972802c7b0 tx=0x7f9728005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 msgr2=0x7f9738075590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f973400d950 tx=0x7f973400de10 comp rx=0 tx=0).stop 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 shutdown_connections 2024-03-16T10:48:46.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f97240a2800 0x7f97240a4cc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97381033b0 0x7f9738074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97381029f0 0x7f9738073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 --2- 172.21.15.17:0/2813644361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9738101800 0x7f9738075590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 >> 172.21.15.17:0/2813644361 conn(0x7f97380fcd90 msgr2=0x7f9738105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 shutdown_connections 2024-03-16T10:48:46.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.019+0000 7f973fc59640 1 -- 172.21.15.17:0/2813644361 wait complete. 2024-03-16T10:48:46.031 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T10:48:46.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T10:48:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 -- 172.21.15.17:0/1041849494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1033a0 msgr2=0x7fbd1c109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/1041849494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c109c30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009900 tx=0x7fbd0c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 -- 172.21.15.17:0/1041849494 shutdown_connections 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/1041849494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c109c30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/1041849494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1029e0 0x7fbd1c102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/1041849494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 -- 172.21.15.17:0/1041849494 >> 172.21.15.17:0/1041849494 conn(0x7fbd1c0fcd40 msgr2=0x7fbd1c0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 -- 172.21.15.17:0/1041849494 shutdown_connections 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.157+0000 7fbd23ef8640 1 -- 172.21.15.17:0/1041849494 wait complete. 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 Processor -- start 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 -- start start 2024-03-16T10:48:46.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1029e0 0x7fbd1c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10d470 con 0x7fbd1c1033a0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10d2f0 con 0x7fbd1c1029e0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd23ef8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c10d5f0 con 0x7fbd1c1017f0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd22495640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd22495640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55248/0 (socket says 172.21.15.17:55248) 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd22495640 1 -- 172.21.15.17:0/2177822938 learned_addr learned my addr 172.21.15.17:0/2177822938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21493640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1029e0 0x7fbd1c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 -- 172.21.15.17:0/2177822938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1029e0 msgr2=0x7fbd1c198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:46.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1029e0 0x7fbd1c198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 -- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 msgr2=0x7fbd1c19f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd21c94640 1 -- 172.21.15.17:0/2177822938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c19f700 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.158+0000 7fbd22495640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd21c94640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c197ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005fd0 tx=0x7fbd1400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14003970 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd14004030 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c19f9f0 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140107f0 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.159+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c19ff40 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.160+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c108b10 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.161+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fbd140041e0 con 0x7fbd1c1017f0 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.161+0000 7fbd1affd640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 0x7fbd040a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:46.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.162+0000 7fbd21493640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 0x7fbd040a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.162+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbd140cede0 con 0x7fbd1c1017f0 2024-03-16T10:48:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.162+0000 7fbd21493640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 0x7fbd040a4cc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c198ff0 tx=0x7fbd10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.166+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbd1409c300 con 0x7fbd1c1017f0 2024-03-16T10:48:46.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:46.384+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd1c02d460 con 0x7fbd1c1017f0 2024-03-16T10:48:46.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3755796119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2813644361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:46.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:46 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3755796119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2813644361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:46 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3755796119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2813644361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:46 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.365 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-03-16T10:48:47.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.365+0000 7fbd1affd640 1 -- 172.21.15.17:0/2177822938 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fbd1409bc00 con 0x7fbd1c1017f0 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 msgr2=0x7fbd040a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 0x7fbd040a4cc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c198ff0 tx=0x7fbd10005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 msgr2=0x7fbd1c197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c197ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005fd0 tx=0x7fbd1400ef90 comp rx=0 tx=0).stop 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 shutdown_connections 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd040a2800 0x7fbd040a4cc0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c198ff0 tx=0x7fbd10005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd1c1033a0 0x7fbd1c19f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbd1c1029e0 0x7fbd1c198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 --2- 172.21.15.17:0/2177822938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd1c1017f0 0x7fbd1c197ae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 >> 172.21.15.17:0/2177822938 conn(0x7fbd1c0fcd40 msgr2=0x7fbd1c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.368+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 shutdown_connections 2024-03-16T10:48:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.369+0000 7fbd23ef8640 1 -- 172.21.15.17:0/2177822938 wait complete. 2024-03-16T10:48:47.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 -- 172.21.15.17:0/1538619291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7148102290 msgr2=0x7f7148108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 --2- 172.21.15.17:0/1538619291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7148102290 0x7f7148108b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7140009ca0 tx=0x7f714002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 -- 172.21.15.17:0/1538619291 shutdown_connections 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 --2- 172.21.15.17:0/1538619291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7148102290 0x7f7148108b20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 --2- 172.21.15.17:0/1538619291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71481018d0 0x7f7148101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 --2- 172.21.15.17:0/1538619291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481006e0 0x7f7148100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 -- 172.21.15.17:0/1538619291 >> 172.21.15.17:0/1538619291 conn(0x7f71480fbc70 msgr2=0x7f71480fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 -- 172.21.15.17:0/1538619291 shutdown_connections 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.491+0000 7f714cdd4640 1 -- 172.21.15.17:0/1538619291 wait complete. 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 Processor -- start 2024-03-16T10:48:47.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 -- start start 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481018d0 0x7f7148197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 0x7f714819f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f714810c340 con 0x7f71481006e0 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f714810c1c0 con 0x7f7148102290 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f714810c4c0 con 0x7f71481018d0 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55268/0 (socket says 172.21.15.17:55268) 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 -- 172.21.15.17:0/3865234439 learned_addr learned my addr 172.21.15.17:0/3865234439 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f7146d9d640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 0x7f714819f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f7145d9b640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481018d0 0x7f7148197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 -- 172.21.15.17:0/3865234439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481018d0 msgr2=0x7f7148197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481018d0 0x7f7148197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 -- 172.21.15.17:0/3865234439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 msgr2=0x7f714819f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 0x7f714819f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 -- 172.21.15.17:0/3865234439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714819f6c0 con 0x7f71481006e0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f7146d9d640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 0x7f714819f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714659c640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f713c00d950 tx=0x7f713c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c017020 con 0x7f71481006e0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.492+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714819f9b0 con 0x7f71481006e0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.493+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c009c30 con 0x7f71481006e0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.493+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714819ff50 con 0x7f71481006e0 2024-03-16T10:48:47.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.493+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c00f6b0 con 0x7f71481006e0 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.493+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71481a0240 con 0x7f71481006e0 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.495+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f713c01a020 con 0x7f71481006e0 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.495+0000 7f71377fe640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 0x7f71300a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.495+0000 7f7145d9b640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 0x7f71300a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.496+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f713c0ceab0 con 0x7f71481006e0 2024-03-16T10:48:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.496+0000 7f7145d9b640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 0x7f71300a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7148198fb0 tx=0x7f7138005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:47.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.504+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f713c021020 con 0x7f71481006e0 2024-03-16T10:48:47.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:47.696+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f71481a0990 con 0x7f71481006e0 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2177822938' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T10:48:47.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:47 smithi017 ceph-mon[32078]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T10:48:47.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2177822938' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T10:48:47.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:47 smithi111 ceph-mon[36315]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2177822938' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-16T10:48:47.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:47 smithi174 ceph-mon[36202]: osdmap e82: 12 total, 12 up, 12 in 2024-03-16T10:48:48.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.363+0000 7f71377fe640 1 -- 172.21.15.17:0/3865234439 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f713c09be80 con 0x7f71481006e0 2024-03-16T10:48:48.364 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-03-16T10:48:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 msgr2=0x7f71300a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 0x7f71300a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7148198fb0 tx=0x7f7138005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 msgr2=0x7f7148197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f713c00d950 tx=0x7f713c00de10 comp rx=0 tx=0).stop 2024-03-16T10:48:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 shutdown_connections 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71300a2800 0x7f71300a4cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7148102290 0x7f714819f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71481018d0 0x7f7148197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 --2- 172.21.15.17:0/3865234439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71481006e0 0x7f7148197aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.366+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 >> 172.21.15.17:0/3865234439 conn(0x7f71480fbc70 msgr2=0x7f71480fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.367+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 shutdown_connections 2024-03-16T10:48:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.367+0000 7f714cdd4640 1 -- 172.21.15.17:0/3865234439 wait complete. 2024-03-16T10:48:48.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 -- 172.21.15.17:0/2944848602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 msgr2=0x7f6014109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 --2- 172.21.15.17:0/2944848602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f6014109930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f600c009ca0 tx=0x7f600c02c100 comp rx=0 tx=0).stop 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 -- 172.21.15.17:0/2944848602 shutdown_connections 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 --2- 172.21.15.17:0/2944848602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f6014109930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 --2- 172.21.15.17:0/2944848602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6014104bf0 0x7f6014106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 --2- 172.21.15.17:0/2944848602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60141022c0 0x7f60141046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 -- 172.21.15.17:0/2944848602 >> 172.21.15.17:0/2944848602 conn(0x7f60140fbc90 msgr2=0x7f60140fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:48.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 -- 172.21.15.17:0/2944848602 shutdown_connections 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 -- 172.21.15.17:0/2944848602 wait complete. 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.504+0000 7f6019f59640 1 Processor -- start 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 -- start start 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60141022c0 0x7f6014197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 0x7f6014197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f601410d480 con 0x7f6014107520 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f601410d300 con 0x7f60141022c0 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6019f59640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f601410d600 con 0x7f6014104bf0 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6013fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6013fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55286/0 (socket says 172.21.15.17:55286) 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6013fff640 1 -- 172.21.15.17:0/2568758182 learned_addr learned my addr 172.21.15.17:0/2568758182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 0x7f6014197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f60137fe640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60141022c0 0x7f6014197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:48.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 -- 172.21.15.17:0/2568758182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60141022c0 msgr2=0x7f6014197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60141022c0 0x7f6014197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 -- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 msgr2=0x7f601419f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6012ffd640 1 -- 172.21.15.17:0/2568758182 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601419f6c0 con 0x7f6014104bf0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.505+0000 7f6013fff640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6012ffd640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 0x7f6014197fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f600800d6a0 tx=0x7f600800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008017070 con 0x7f6014104bf0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601419f9b0 con 0x7f6014104bf0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6008009820 con 0x7f6014104bf0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008004cd0 con 0x7f6014104bf0 2024-03-16T10:48:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.506+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601419ff50 con 0x7f6014104bf0 2024-03-16T10:48:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.507+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60140fd780 con 0x7f6014104bf0 2024-03-16T10:48:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.508+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f60080099d0 con 0x7f6014104bf0 2024-03-16T10:48:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.508+0000 7f6010ff9640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 0x7f5ffc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.509+0000 7f60137fe640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 0x7f5ffc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.509+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f60080ce5a0 con 0x7f6014104bf0 2024-03-16T10:48:48.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.509+0000 7f60137fe640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 0x7f5ffc0a4cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6004009bd0 tx=0x7f6004005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:48.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.514+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f600809b100 con 0x7f6014104bf0 2024-03-16T10:48:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:48.815+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f601402d1b0 con 0x7f6014104bf0 2024-03-16T10:48:48.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:48 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T10:48:48.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:48 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T10:48:48.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:48 smithi017 ceph-mon[32078]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T10:48:48.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:48 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T10:48:48.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:48 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T10:48:48.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:48 smithi111 ceph-mon[36315]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T10:48:49.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:48 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-16T10:48:49.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:48 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3865234439' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-16T10:48:49.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:48 smithi174 ceph-mon[36202]: osdmap e83: 12 total, 12 up, 12 in 2024-03-16T10:48:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.644+0000 7f6010ff9640 1 -- 172.21.15.17:0/2568758182 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f600809f1a0 con 0x7f6014104bf0 2024-03-16T10:48:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 msgr2=0x7f5ffc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 0x7f5ffc0a4cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6004009bd0 tx=0x7f6004005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 msgr2=0x7f6014197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 0x7f6014197fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f600800d6a0 tx=0x7f600800db60 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 shutdown_connections 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ffc0a2800 0x7f5ffc0a4cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6014107520 0x7f601419f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6014104bf0 0x7f6014197fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 --2- 172.21.15.17:0/2568758182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60141022c0 0x7f6014197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 >> 172.21.15.17:0/2568758182 conn(0x7f60140fbc90 msgr2=0x7f6014102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 shutdown_connections 2024-03-16T10:48:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.647+0000 7f6019f59640 1 -- 172.21.15.17:0/2568758182 wait complete. 2024-03-16T10:48:49.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- 172.21.15.17:0/3491851028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f141075a0 msgr2=0x7f1f14109990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 --2- 172.21.15.17:0/3491851028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f141075a0 0x7f1f14109990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009ca0 tx=0x7f1f0c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- 172.21.15.17:0/3491851028 shutdown_connections 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 --2- 172.21.15.17:0/3491851028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f141075a0 0x7f1f14109990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 --2- 172.21.15.17:0/3491851028 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14104c70 0x7f1f14107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 --2- 172.21.15.17:0/3491851028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14102340 0x7f1f14104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- 172.21.15.17:0/3491851028 >> 172.21.15.17:0/3491851028 conn(0x7f1f140fbc90 msgr2=0x7f1f140fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- 172.21.15.17:0/3491851028 shutdown_connections 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- 172.21.15.17:0/3491851028 wait complete. 2024-03-16T10:48:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 Processor -- start 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.773+0000 7f1f1b685640 1 -- start start 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14102340 0x7f1f14197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f141075a0 0x7f1f1419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1410d4a0 con 0x7f1f14104c70 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1410d320 con 0x7f1f14102340 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1410d620 con 0x7f1f141075a0 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59304/0 (socket says 172.21.15.17:59304) 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 -- 172.21.15.17:0/2103058311 learned_addr learned my addr 172.21.15.17:0/2103058311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f19421640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14102340 0x7f1f14197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f19c22640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f141075a0 0x7f1f1419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 -- 172.21.15.17:0/2103058311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f141075a0 msgr2=0x7f1f1419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f141075a0 0x7f1f1419f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 -- 172.21.15.17:0/2103058311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14102340 msgr2=0x7f1f14197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14102340 0x7f1f14197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 -- 172.21.15.17:0/2103058311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1419f6d0 con 0x7f1f14104c70 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f18c20640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9c0 tx=0x7f1f1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000cd80 con 0x7f1f14104c70 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1419f9c0 con 0x7f1f14104c70 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f10005500 con 0x7f1f14104c70 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.774+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10010690 con 0x7f1f14104c70 2024-03-16T10:48:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.775+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1419ff60 con 0x7f1f14104c70 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.776+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f140fd780 con 0x7f1f14104c70 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.777+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f1f100046c0 con 0x7f1f14104c70 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.777+0000 7f1f0a7fc640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 0x7f1f000a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.777+0000 7f1f19421640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 0x7f1f000a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.777+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f1f100cefb0 con 0x7f1f14104c70 2024-03-16T10:48:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.778+0000 7f1f19421640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 0x7f1f000a4cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005d00 tx=0x7f1f04005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.781+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f1f10053740 con 0x7f1f14104c70 2024-03-16T10:48:49.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: pgmap v287: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2568758182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:49 smithi111 ceph-mon[36315]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T10:48:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.969+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f1402d1b0 con 0x7f1f14104c70 2024-03-16T10:48:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.970+0000 7f1f0a7fc640 1 -- 172.21.15.17:0/2103058311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22231 (secure 0 0 0) 0x7f1f1009c100 con 0x7f1f14104c70 2024-03-16T10:48:49.971 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:49.971 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:48:49.836693+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:49.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 msgr2=0x7f1f000a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 0x7f1f000a4cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005d00 tx=0x7f1f04005c50 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 msgr2=0x7f1f14197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9c0 tx=0x7f1f1000ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 shutdown_connections 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1f000a2800 0x7f1f000a4cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f141075a0 0x7f1f1419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14104c70 0x7f1f14197ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 --2- 172.21.15.17:0/2103058311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1f14102340 0x7f1f14197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 >> 172.21.15.17:0/2103058311 conn(0x7f1f140fbc90 msgr2=0x7f1f14102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 shutdown_connections 2024-03-16T10:48:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:49.973+0000 7f1f1b685640 1 -- 172.21.15.17:0/2103058311 wait complete. 2024-03-16T10:48:49.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: pgmap v287: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:49.983 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2568758182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:49.984 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:49 smithi017 ceph-mon[32078]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T10:48:49.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: pgmap v287: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2568758182' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: osdmap e84: 12 total, 12 up, 12 in 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:49 smithi174 ceph-mon[36202]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 -- 172.21.15.17:0/303701974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98102280 msgr2=0x7fba98104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 --2- 172.21.15.17:0/303701974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98102280 0x7fba98104670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba90009900 tx=0x7fba9002bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 -- 172.21.15.17:0/303701974 shutdown_connections 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 --2- 172.21.15.17:0/303701974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba981074e0 0x7fba98109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 --2- 172.21.15.17:0/303701974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 0x7fba98106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.087+0000 7fba9cb10640 1 --2- 172.21.15.17:0/303701974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98102280 0x7fba98104670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- 172.21.15.17:0/303701974 >> 172.21.15.17:0/303701974 conn(0x7fba980fbc70 msgr2=0x7fba980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- 172.21.15.17:0/303701974 shutdown_connections 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- 172.21.15.17:0/303701974 wait complete. 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 Processor -- start 2024-03-16T10:48:50.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- start start 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba98102280 0x7fba98197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 0x7fba981980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba9810d4f0 con 0x7fba981074e0 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fba9810d370 con 0x7fba98104bb0 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.088+0000 7fba9cb10640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba9810d670 con 0x7fba98102280 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59316/0 (socket says 172.21.15.17:59316) 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 -- 172.21.15.17:0/343451962 learned_addr learned my addr 172.21.15.17:0/343451962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba9659c640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba98102280 0x7fba98197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba95d9b640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 0x7fba981980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 -- 172.21.15.17:0/343451962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba98102280 msgr2=0x7fba98197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba98102280 0x7fba98197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 -- 172.21.15.17:0/343451962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 msgr2=0x7fba981980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 0x7fba981980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 -- 172.21.15.17:0/343451962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9819f790 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba96d9d640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fba8800b970 tx=0x7fba8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88019070 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9819fa80 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba8800cb40 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88007610 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.089+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba981a0020 con 0x7fba981074e0 2024-03-16T10:48:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.090+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980fd760 con 0x7fba981074e0 2024-03-16T10:48:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.091+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fba8801c070 con 0x7fba981074e0 2024-03-16T10:48:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.092+0000 7fba877fe640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 0x7fba800a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.092+0000 7fba9659c640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 0x7fba800a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.092+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fba880ce310 con 0x7fba981074e0 2024-03-16T10:48:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.092+0000 7fba9659c640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 0x7fba800a4cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba9002c7b0 tx=0x7fba90005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:50.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.096+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fba8809aeb0 con 0x7fba981074e0 2024-03-16T10:48:50.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.286+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba9802d360 con 0x7fba981074e0 2024-03-16T10:48:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.287+0000 7fba877fe640 1 -- 172.21.15.17:0/343451962 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22231 (secure 0 0 0) 0x7fba8809ef50 con 0x7fba981074e0 2024-03-16T10:48:50.288 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:50.289 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:48:49.836693+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 msgr2=0x7fba800a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 0x7fba800a4cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba9002c7b0 tx=0x7fba90005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 msgr2=0x7fba9819f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fba8800b970 tx=0x7fba8800be30 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 shutdown_connections 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fba800a2800 0x7fba800a4cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba981074e0 0x7fba9819f120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba98104bb0 0x7fba981980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 --2- 172.21.15.17:0/343451962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba98102280 0x7fba98197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 >> 172.21.15.17:0/343451962 conn(0x7fba980fbc70 msgr2=0x7fba98102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 shutdown_connections 2024-03-16T10:48:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.290+0000 7fba9cb10640 1 -- 172.21.15.17:0/343451962 wait complete. 2024-03-16T10:48:50.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T10:48:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 -- 172.21.15.17:0/4178797724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc0ffae0 msgr2=0x7f30bc0fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/4178797724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc0ffae0 0x7f30bc0fff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009930 tx=0x7f30b802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 -- 172.21.15.17:0/4178797724 shutdown_connections 2024-03-16T10:48:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/4178797724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/4178797724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc102b50 0x7f30bc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/4178797724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc0ffae0 0x7f30bc0fff00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 -- 172.21.15.17:0/4178797724 >> 172.21.15.17:0/4178797724 conn(0x7f30bc0fb410 msgr2=0x7f30bc0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 -- 172.21.15.17:0/4178797724 shutdown_connections 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.407+0000 7f30c3ebf640 1 -- 172.21.15.17:0/4178797724 wait complete. 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 Processor -- start 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 -- start start 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc0ffae0 0x7f30bc1024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc101040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d4e0 con 0x7f30bc102b50 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d360 con 0x7f30bc0ffae0 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c3ebf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc10d660 con 0x7f30bc103510 2024-03-16T10:48:50.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59328/0 (socket says 172.21.15.17:59328) 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 -- 172.21.15.17:0/556844188 learned_addr learned my addr 172.21.15.17:0/556844188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c1c5b640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc0ffae0 0x7f30bc1024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c245c640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc101040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 -- 172.21.15.17:0/556844188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 msgr2=0x7f30bc101040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc101040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 -- 172.21.15.17:0/556844188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc0ffae0 msgr2=0x7f30bc1024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc0ffae0 0x7f30bc1024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 -- 172.21.15.17:0/556844188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc1018d0 con 0x7f30bc102b50 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c245c640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.408+0000 7f30c145a640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e9f0 tx=0x7f30ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00cd80 con 0x7f30bc102b50 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ac010910 con 0x7f30bc102b50 2024-03-16T10:48:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc1a1cd0 con 0x7f30bc102b50 2024-03-16T10:48:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac018990 con 0x7f30bc102b50 2024-03-16T10:48:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1a21c0 con 0x7f30bc102b50 2024-03-16T10:48:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.409+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc108cd0 con 0x7f30bc102b50 2024-03-16T10:48:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.411+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f30ac010ac0 con 0x7f30bc102b50 2024-03-16T10:48:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.411+0000 7f30b2ffd640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 0x7f30a80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.411+0000 7f30c1c5b640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 0x7f30a80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.411+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f30ac0cf040 con 0x7f30bc102b50 2024-03-16T10:48:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.412+0000 7f30c1c5b640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 0x7f30a80a4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30b802c7b0 tx=0x7f30b8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.415+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f30ac09c230 con 0x7f30bc102b50 2024-03-16T10:48:50.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:50.640+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f30bc02d3b0 con 0x7f30bc102b50 2024-03-16T10:48:50.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T10:48:50.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2103058311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:active 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/343451962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:50 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2103058311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:active 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/343451962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:51.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:50 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: osdmap e85: 12 total, 12 up, 12 in 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2103058311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] up:active 2024-03-16T10:48:51.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:51.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/343451962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:51.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:50 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-16T10:48:51.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.173+0000 7f30b2ffd640 1 -- 172.21.15.17:0/556844188 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f30ac09bb30 con 0x7f30bc102b50 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 msgr2=0x7f30a80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 0x7f30a80a4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f30b802c7b0 tx=0x7f30b8005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 msgr2=0x7f30bc100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e9f0 tx=0x7f30ac00eeb0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 shutdown_connections 2024-03-16T10:48:51.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30a80a2880 0x7f30a80a4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30bc103510 0x7f30bc101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30bc102b50 0x7f30bc100b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 --2- 172.21.15.17:0/556844188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30bc0ffae0 0x7f30bc1024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 >> 172.21.15.17:0/556844188 conn(0x7f30bc0fb410 msgr2=0x7f30bc105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 shutdown_connections 2024-03-16T10:48:51.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.176+0000 7f30c3ebf640 1 -- 172.21.15.17:0/556844188 wait complete. 2024-03-16T10:48:51.190 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-16T10:48:51.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-16T10:48:51.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2902153263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 msgr2=0x7fb1e0107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:51.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2902153263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0107000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009900 tx=0x7fb1d402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:51.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2902153263 shutdown_connections 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2902153263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 0x7fb1e0109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2902153263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0107000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2902153263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 0x7fb1e01046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2902153263 >> 172.21.15.17:0/2902153263 conn(0x7fb1e00fbc90 msgr2=0x7fb1e00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2902153263 shutdown_connections 2024-03-16T10:48:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.302+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2902153263 wait complete. 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 Processor -- start 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 -- start start 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 0x7fb1e0101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 0x7fb1e01007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:51.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010d470 con 0x7fb1e0104c10 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010d2f0 con 0x7fb1e0107540 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1e5dcd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010d5f0 con 0x7fb1e01022e0 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59350/0 (socket says 172.21.15.17:59350) 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.303+0000 7fb1deffd640 1 -- 172.21.15.17:0/2745813741 learned_addr learned my addr 172.21.15.17:0/2745813741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1dffff640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 0x7fb1e01007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1df7fe640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 0x7fb1e0101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 -- 172.21.15.17:0/2745813741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 msgr2=0x7fb1e0101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 0x7fb1e0101c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 -- 172.21.15.17:0/2745813741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 msgr2=0x7fb1e01007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 0x7fb1e01007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 -- 172.21.15.17:0/2745813741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e0101060 con 0x7fb1e0104c10 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1deffd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005ab0 tx=0x7fb1d4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4041070 con 0x7fb1e0104c10 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e01a1c30 con 0x7fb1e0104c10 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1d40054e0 con 0x7fb1e0104c10 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4034440 con 0x7fb1e0104c10 2024-03-16T10:48:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.304+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01a21d0 con 0x7fb1e0104c10 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.305+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e00fd780 con 0x7fb1e0104c10 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.306+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fb1d4044070 con 0x7fb1e0104c10 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.307+0000 7fb1dcff9640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 0x7fb1c80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.307+0000 7fb1df7fe640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 0x7fb1c80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.307+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb1d40f0520 con 0x7fb1e0104c10 2024-03-16T10:48:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.307+0000 7fb1df7fe640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 0x7fb1c80a4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00058c0 tx=0x7fb1d000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.311+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb1d40bd020 con 0x7fb1e0104c10 2024-03-16T10:48:51.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:51.534+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fb1e00623e0 con 0x7fb1e0104c10 2024-03-16T10:48:51.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: pgmap v290: 97 pgs: 12 creating+peering, 34 active+clean, 51 unknown; 578 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-03-16T10:48:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T10:48:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: Cluster is now healthy 2024-03-16T10:48:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T10:48:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:51.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:51 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-16T10:48:51.964 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: pgmap v290: 97 pgs: 12 creating+peering, 34 active+clean, 51 unknown; 578 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-03-16T10:48:51.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T10:48:51.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: Cluster is now healthy 2024-03-16T10:48:51.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T10:48:51.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:51.965 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:51 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-16T10:48:52.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: pgmap v290: 97 pgs: 12 creating+peering, 34 active+clean, 51 unknown; 578 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2024-03-16T10:48:52.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-16T10:48:52.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: Cluster is now healthy 2024-03-16T10:48:52.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/556844188' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-16T10:48:52.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:52.091 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:51 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-16T10:48:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.175+0000 7fb1dcff9640 1 -- 172.21.15.17:0/2745813741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7fb1d40c10c0 con 0x7fb1e0104c10 2024-03-16T10:48:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.177+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 msgr2=0x7fb1c80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.177+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 0x7fb1c80a4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00058c0 tx=0x7fb1d000a250 comp rx=0 tx=0).stop 2024-03-16T10:48:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.177+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 msgr2=0x7fb1e0100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.177+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005ab0 tx=0x7fb1d4005dc0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.177+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 shutdown_connections 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb1c80a2800 0x7fb1c80a4cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1e0107540 0x7fb1e01007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e0104c10 0x7fb1e0100290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 --2- 172.21.15.17:0/2745813741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1e01022e0 0x7fb1e0101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 >> 172.21.15.17:0/2745813741 conn(0x7fb1e00fbc90 msgr2=0x7fb1e0102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 shutdown_connections 2024-03-16T10:48:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.178+0000 7fb1e5dcd640 1 -- 172.21.15.17:0/2745813741 wait complete. 2024-03-16T10:48:52.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-16T10:48:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- 172.21.15.17:0/575858605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed01017d0 msgr2=0x7f9ed0101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 --2- 172.21.15.17:0/575858605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed01017d0 0x7f9ed0101c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009900 tx=0x7f9ec002bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- 172.21.15.17:0/575858605 shutdown_connections 2024-03-16T10:48:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 --2- 172.21.15.17:0/575858605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed0102190 0x7f9ed0108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 --2- 172.21.15.17:0/575858605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed01017d0 0x7f9ed0101c50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 --2- 172.21.15.17:0/575858605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 0x7f9ed0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- 172.21.15.17:0/575858605 >> 172.21.15.17:0/575858605 conn(0x7f9ed00fbb50 msgr2=0x7f9ed00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- 172.21.15.17:0/575858605 shutdown_connections 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- 172.21.15.17:0/575858605 wait complete. 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 Processor -- start 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.306+0000 7f9ed719f640 1 -- start start 2024-03-16T10:48:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 0x7f9ed0196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 0x7f9ed0196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed010c2c0 con 0x7f9ed0102190 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed010c140 con 0x7f9ed01005e0 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed010c440 con 0x7f9ed01017d0 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59356/0 (socket says 172.21.15.17:59356) 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 -- 172.21.15.17:0/2654666543 learned_addr learned my addr 172.21.15.17:0/2654666543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed619d640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 0x7f9ed0196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed599c640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 0x7f9ed0196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 -- 172.21.15.17:0/2654666543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 msgr2=0x7f9ed0196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 0x7f9ed0196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 -- 172.21.15.17:0/2654666543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 msgr2=0x7f9ed0196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 0x7f9ed0196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 -- 172.21.15.17:0/2654666543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed019e530 con 0x7f9ed0102190 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed599c640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 0x7f9ed0196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed699e640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800b970 tx=0x7f9ec800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8019070 con 0x7f9ed0102190 2024-03-16T10:48:52.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec800cb40 con 0x7f9ed0102190 2024-03-16T10:48:52.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed019e820 con 0x7f9ed0102190 2024-03-16T10:48:52.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8007650 con 0x7f9ed0102190 2024-03-16T10:48:52.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.307+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed019ed90 con 0x7f9ed0102190 2024-03-16T10:48:52.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.309+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0107900 con 0x7f9ed0102190 2024-03-16T10:48:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.309+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f9ec801c070 con 0x7f9ed0102190 2024-03-16T10:48:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.310+0000 7f9ec77fe640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 0x7f9ebc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.310+0000 7f9ed619d640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 0x7f9ebc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.310+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f9ec80cde20 con 0x7f9ed0102190 2024-03-16T10:48:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.310+0000 7f9ed619d640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 0x7f9ebc0a4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005fd0 tx=0x7f9ecc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.315+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f9ec809a9c0 con 0x7f9ed0102190 2024-03-16T10:48:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:52.538+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f9ed00623e0 con 0x7f9ed0102190 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-16T10:48:52.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:52 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T10:48:52.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T10:48:52.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-16T10:48:52.978 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T10:48:52.978 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:52.978 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-16T10:48:52.978 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-16T10:48:52.978 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:52 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2745813741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-16T10:48:53.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-16T10:48:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.185+0000 7f9ec77fe640 1 -- 172.21.15.17:0/2654666543 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f9ec809ea60 con 0x7f9ed0102190 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 msgr2=0x7f9ebc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 0x7f9ebc0a4d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005fd0 tx=0x7f9ecc00b410 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 msgr2=0x7f9ed019dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800b970 tx=0x7f9ec800be30 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 shutdown_connections 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9ebc0a2880 0x7f9ebc0a4d40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ed0102190 0x7f9ed019dec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ed01017d0 0x7f9ed0196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 --2- 172.21.15.17:0/2654666543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ed01005e0 0x7f9ed0196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 >> 172.21.15.17:0/2654666543 conn(0x7f9ed00fbb50 msgr2=0x7f9ed0104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 shutdown_connections 2024-03-16T10:48:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.189+0000 7f9ed719f640 1 -- 172.21.15.17:0/2654666543 wait complete. 2024-03-16T10:48:53.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- 172.21.15.17:0/1967871132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf8102290 msgr2=0x7fcaf8108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 --2- 172.21.15.17:0/1967871132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf8102290 0x7fcaf8108b20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ca0 tx=0x7fcaf002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- 172.21.15.17:0/1967871132 shutdown_connections 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 --2- 172.21.15.17:0/1967871132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf8102290 0x7fcaf8108b20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 --2- 172.21.15.17:0/1967871132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81018d0 0x7fcaf8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 --2- 172.21.15.17:0/1967871132 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf81006e0 0x7fcaf8100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- 172.21.15.17:0/1967871132 >> 172.21.15.17:0/1967871132 conn(0x7fcaf80fbc70 msgr2=0x7fcaf80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- 172.21.15.17:0/1967871132 shutdown_connections 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- 172.21.15.17:0/1967871132 wait complete. 2024-03-16T10:48:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 Processor -- start 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.318+0000 7fcafcba9640 1 -- start start 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81006e0 0x7fcaf8104620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf8102290 0x7fcaf81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf810c360 con 0x7fcaf81018d0 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf810c1e0 con 0x7fcaf8102290 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf810c4e0 con 0x7fcaf81006e0 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59374/0 (socket says 172.21.15.17:59374) 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 -- 172.21.15.17:0/2624126487 learned_addr learned my addr 172.21.15.17:0/2624126487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaf6d9d640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf8102290 0x7fcaf81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaf659c640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81006e0 0x7fcaf8104620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 -- 172.21.15.17:0/2624126487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81006e0 msgr2=0x7fcaf8104620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81006e0 0x7fcaf8104620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 -- 172.21.15.17:0/2624126487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf8102290 msgr2=0x7fcaf81031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf8102290 0x7fcaf81031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 -- 172.21.15.17:0/2624126487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf8103ab0 con 0x7fcaf81018d0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaeffff640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cd80 con 0x7fcaf81018d0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf81a1c80 con 0x7fcaf81018d0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae0005500 con 0x7fcaf81018d0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0010690 con 0x7fcaf81018d0 2024-03-16T10:48:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.319+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf81a21a0 con 0x7fcaf81018d0 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.321+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf81a23d0 con 0x7fcaf81018d0 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.321+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fcae00046c0 con 0x7fcaf81018d0 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.322+0000 7fcaef7fe640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 0x7fcae40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.322+0000 7fcaf659c640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 0x7fcae40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.322+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fcae00cece0 con 0x7fcaf81018d0 2024-03-16T10:48:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.322+0000 7fcaf659c640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 0x7fcae40a4cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8101730 tx=0x7fcae8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.326+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fcae009bed0 con 0x7fcaf81018d0 2024-03-16T10:48:53.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:53.553+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fcaf81a2720 con 0x7fcaf81018d0 2024-03-16T10:48:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.191+0000 7fcaef7fe640 1 -- 172.21.15.17:0/2624126487 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fcae009b7d0 con 0x7fcaf81018d0 2024-03-16T10:48:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 msgr2=0x7fcae40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 0x7fcae40a4cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8101730 tx=0x7fcae8005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 msgr2=0x7fcaf8102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000edf0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 shutdown_connections 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcae40a2800 0x7fcae40a4cc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf8102290 0x7fcaf81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf81018d0 0x7fcaf8102cb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 --2- 172.21.15.17:0/2624126487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcaf81006e0 0x7fcaf8104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.194+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 >> 172.21.15.17:0/2624126487 conn(0x7fcaf80fbc70 msgr2=0x7fcaf80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.195+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 shutdown_connections 2024-03-16T10:48:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.195+0000 7fcafcba9640 1 -- 172.21.15.17:0/2624126487 wait complete. 2024-03-16T10:48:54.213 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-03-16T10:48:54.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 -- 172.21.15.17:0/244357899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 msgr2=0x7f96b8100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 --2- 172.21.15.17:0/244357899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8100ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009860 tx=0x7f96a802bb70 comp rx=0 tx=0).stop 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 -- 172.21.15.17:0/244357899 shutdown_connections 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 --2- 172.21.15.17:0/244357899 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 0x7f96b8108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 --2- 172.21.15.17:0/244357899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 --2- 172.21.15.17:0/244357899 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8100ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 -- 172.21.15.17:0/244357899 >> 172.21.15.17:0/244357899 conn(0x7f96b80fbcf0 msgr2=0x7f96b80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 -- 172.21.15.17:0/244357899 shutdown_connections 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.324+0000 7f96bdf77640 1 -- 172.21.15.17:0/244357899 wait complete. 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 Processor -- start 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 -- start start 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 0x7f96b819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96b810d4b0 con 0x7f96b8101970 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f96b810d330 con 0x7f96b8100780 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96bdf77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96b810d630 con 0x7f96b8102330 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35702/0 (socket says 172.21.15.17:35702) 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 -- 172.21.15.17:0/438835038 learned_addr learned my addr 172.21.15.17:0/438835038 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b7fff640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 0x7f96b819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 -- 172.21.15.17:0/438835038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 msgr2=0x7f96b819f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 0x7f96b819f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 -- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 msgr2=0x7f96b81980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b81980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.325+0000 7f96b77fe640 1 -- 172.21.15.17:0/438835038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b819f7b0 con 0x7f96b8100780 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96b6ffd640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96b77fe640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96a802c0b0 tx=0x7f96a8032430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8041020 con 0x7f96b8100780 2024-03-16T10:48:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96a802c9f0 con 0x7f96b8100780 2024-03-16T10:48:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b819fa40 con 0x7f96b8100780 2024-03-16T10:48:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8039040 con 0x7f96b8100780 2024-03-16T10:48:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.326+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b819ff30 con 0x7f96b8100780 2024-03-16T10:48:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.327+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b8107af0 con 0x7f96b8100780 2024-03-16T10:48:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.328+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f96a8044020 con 0x7f96b8100780 2024-03-16T10:48:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.329+0000 7f96b4ff9640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 0x7f96a00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.329+0000 7f96b6ffd640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 0x7f96a00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.329+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f96a80f0610 con 0x7f96b8100780 2024-03-16T10:48:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.329+0000 7f96b6ffd640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 0x7f96a00a4cc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96b81990a0 tx=0x7f96ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.332+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f96a804b020 con 0x7f96b8100780 2024-03-16T10:48:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.544+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f96b8061c20 con 0x7f96a00a2800 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: pgmap v291: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-03-16T10:48:54.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: pgmap v291: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-03-16T10:48:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T10:48:54.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.567+0000 7f96b4ff9640 1 -- 172.21.15.17:0/438835038 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f96b8061c20 con 0x7f96a00a2800 2024-03-16T10:48:54.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.569+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 msgr2=0x7f96a00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 0x7f96a00a4cc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96b81990a0 tx=0x7f96ac009260 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 msgr2=0x7f96b8197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96a802c0b0 tx=0x7f96a8032430 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 shutdown_connections 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f96a00a2800 0x7f96a00a4cc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96b8102330 0x7f96b819f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96b8101970 0x7f96b81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 --2- 172.21.15.17:0/438835038 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f96b8100780 0x7f96b8197b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 >> 172.21.15.17:0/438835038 conn(0x7f96b80fbcf0 msgr2=0x7f96b8104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 shutdown_connections 2024-03-16T10:48:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.570+0000 7f96bdf77640 1 -- 172.21.15.17:0/438835038 wait complete. 2024-03-16T10:48:54.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: pgmap v291: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2654666543' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-16T10:48:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-03-16T10:48:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-03-16T10:48:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 -- 172.21.15.17:0/2885763520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 msgr2=0x7f52e8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 --2- 172.21.15.17:0/2885763520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8102e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009900 tx=0x7f52d802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 -- 172.21.15.17:0/2885763520 shutdown_connections 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 --2- 172.21.15.17:0/2885763520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e8109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 --2- 172.21.15.17:0/2885763520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8102e70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 --2- 172.21.15.17:0/2885763520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 0x7f52e8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 -- 172.21.15.17:0/2885763520 >> 172.21.15.17:0/2885763520 conn(0x7f52e80fcd90 msgr2=0x7f52e80ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 -- 172.21.15.17:0/2885763520 shutdown_connections 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.689+0000 7f52efab2640 1 -- 172.21.15.17:0/2885763520 wait complete. 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 Processor -- start 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 -- start start 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 0x7f52e8197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52e810d480 con 0x7f52e81029f0 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f52e810d300 con 0x7f52e8101800 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52efab2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f52e810d600 con 0x7f52e81033b0 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59434/0 (socket says 172.21.15.17:59434) 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 -- 172.21.15.17:0/1615380138 learned_addr learned my addr 172.21.15.17:0/1615380138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed84e640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 0x7f52e8197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ee04f640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 -- 172.21.15.17:0/1615380138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 msgr2=0x7f52e819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 -- 172.21.15.17:0/1615380138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 msgr2=0x7f52e8197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 0x7f52e8197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 -- 172.21.15.17:0/1615380138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e819f740 con 0x7f52e81029f0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ee04f640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.690+0000 7f52ed04d640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009230 tx=0x7f52d802c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.691+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8041070 con 0x7f52e81029f0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.691+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d8004450 con 0x7f52e81029f0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.691+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e819f9d0 con 0x7f52e81029f0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.691+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8003e20 con 0x7f52e81029f0 2024-03-16T10:48:54.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.691+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e819ff10 con 0x7f52e81029f0 2024-03-16T10:48:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.692+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8108b40 con 0x7f52e81029f0 2024-03-16T10:48:54.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.693+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7f52d8044070 con 0x7f52e81029f0 2024-03-16T10:48:54.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.693+0000 7f52deffd640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 0x7f52d40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:54.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.694+0000 7f52ed84e640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 0x7f52d40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:54.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.694+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f52d80f0560 con 0x7f52e81029f0 2024-03-16T10:48:54.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.694+0000 7f52ed84e640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 0x7f52d40a4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52e8102850 tx=0x7f52e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:54.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.698+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f52d80bd6b0 con 0x7f52e81029f0 2024-03-16T10:48:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:48:54.548+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:48:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:48:54.548+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:48:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:48:54.548+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:48:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:48:54.548+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:48:54.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:48:54 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:48:54.548+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:48:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.909+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f52e8061cb0 con 0x7f52d40a2880 2024-03-16T10:48:54.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.931+0000 7f52deffd640 1 -- 172.21.15.17:0/1615380138 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f52e8061cb0 con 0x7f52d40a2880 2024-03-16T10:48:54.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 msgr2=0x7f52d40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 0x7f52d40a4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52e8102850 tx=0x7f52e4005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 msgr2=0x7f52e8198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009230 tx=0x7f52d802c650 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 shutdown_connections 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52d40a2880 0x7f52d40a4d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e81033b0 0x7f52e819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52e81029f0 0x7f52e8198060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 --2- 172.21.15.17:0/1615380138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52e8101800 0x7f52e8197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 >> 172.21.15.17:0/1615380138 conn(0x7f52e80fcd90 msgr2=0x7f52e8105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 shutdown_connections 2024-03-16T10:48:54.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:54.933+0000 7f52efab2640 1 -- 172.21.15.17:0/1615380138 wait complete. 2024-03-16T10:48:54.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-16T10:48:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- 172.21.15.17:0/1281719233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd81018f0 msgr2=0x7fadd8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 --2- 172.21.15.17:0/1281719233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd81018f0 0x7fadd8101d70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009900 tx=0x7fadcc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- 172.21.15.17:0/1281719233 shutdown_connections 2024-03-16T10:48:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 --2- 172.21.15.17:0/1281719233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 0x7fadd8108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 --2- 172.21.15.17:0/1281719233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd81018f0 0x7fadd8101d70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 --2- 172.21.15.17:0/1281719233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd8100700 0x7fadd8100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- 172.21.15.17:0/1281719233 >> 172.21.15.17:0/1281719233 conn(0x7fadd80fbc90 msgr2=0x7fadd80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- 172.21.15.17:0/1281719233 shutdown_connections 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- 172.21.15.17:0/1281719233 wait complete. 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 Processor -- start 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.052+0000 7fadde989640 1 -- start start 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd81018f0 0x7fadd819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 0x7fadd819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810c360 con 0x7fadd8100700 2024-03-16T10:48:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810c1e0 con 0x7fadd81022b0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadde989640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fadd810c4e0 con 0x7fadd81018f0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59460/0 (socket says 172.21.15.17:59460) 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 -- 172.21.15.17:0/1958388863 learned_addr learned my addr 172.21.15.17:0/1958388863 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7faddcf26640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 0x7fadd819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd77fe640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd81018f0 0x7fadd819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 -- 172.21.15.17:0/1958388863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd81018f0 msgr2=0x7fadd819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd81018f0 0x7fadd819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 -- 172.21.15.17:0/1958388863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 msgr2=0x7fadd819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 0x7fadd819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 -- 172.21.15.17:0/1958388863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd819f7b0 con 0x7fadd8100700 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.053+0000 7fadd7fff640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9c0 tx=0x7fadc800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.054+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc800cd80 con 0x7fadd8100700 2024-03-16T10:48:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.054+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd819fa40 con 0x7fadd8100700 2024-03-16T10:48:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.054+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc80035f0 con 0x7fadd8100700 2024-03-16T10:48:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.054+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8010690 con 0x7fadd8100700 2024-03-16T10:48:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.054+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd819ffb0 con 0x7fadd8100700 2024-03-16T10:48:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.055+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8107a70 con 0x7fadd8100700 2024-03-16T10:48:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.056+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 137290+0+0 (secure 0 0 0) 0x7fadc80037a0 con 0x7fadd8100700 2024-03-16T10:48:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.056+0000 7fadd57fa640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 0x7fadc00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.056+0000 7fadd77fe640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 0x7fadc00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.057+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fadc80cee40 con 0x7fadd8100700 2024-03-16T10:48:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.057+0000 7fadd77fe640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 0x7fadc00a4cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fadcc02c7b0 tx=0x7fadcc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.060+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fadc809c020 con 0x7fadd8100700 2024-03-16T10:48:55.161 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:48:54.736+0000 7f38f806b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T10:48:55.162 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:48:54.736+0000 7f38f806b700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-16T10:48:55.162 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:48:54.736+0000 7f38f806b700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-03-16T10:48:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.214+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fadc8097f90 con 0x7fadd8100700 2024-03-16T10:48:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.283+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fadd8061cb0 con 0x7fadc00a2800 2024-03-16T10:48:55.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.287+0000 7fadd57fa640 1 -- 172.21.15.17:0/1958388863 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fadd8061cb0 con 0x7fadc00a2800 2024-03-16T10:48:55.288 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_0/c3d5b3ea-3c9d-4f8f-9c40-538c4d74894f 2024-03-16T10:48:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 msgr2=0x7fadc00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 0x7fadc00a4cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fadcc02c7b0 tx=0x7fadcc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 msgr2=0x7fadd806a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9c0 tx=0x7fadc800ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:55.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 shutdown_connections 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fadc00a2800 0x7fadc00a4cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadd81022b0 0x7fadd819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadd81018f0 0x7fadd819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 --2- 172.21.15.17:0/1958388863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd8100700 0x7fadd806a920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 >> 172.21.15.17:0/1958388863 conn(0x7fadd80fbc90 msgr2=0x7fadd8104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 shutdown_connections 2024-03-16T10:48:55.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.289+0000 7fadde989640 1 -- 172.21.15.17:0/1958388863 wait complete. 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-16T10:48:55.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T10:48:55.301 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: Cluster is now healthy 2024-03-16T10:48:55.301 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-03-16T10:48:55.301 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-03-16T10:48:55.301 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:55 smithi017 ceph-mon[32078]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-03-16T10:48:55.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-16T10:48:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 -- 172.21.15.17:0/1056216447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d0102a70 msgr2=0x7fb4d0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 --2- 172.21.15.17:0/1056216447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d0102a70 0x7fb4d0102ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009900 tx=0x7fb4c402bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 -- 172.21.15.17:0/1056216447 shutdown_connections 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 --2- 172.21.15.17:0/1056216447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 --2- 172.21.15.17:0/1056216447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d0102a70 0x7fb4d0102ef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 --2- 172.21.15.17:0/1056216447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d00ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 -- 172.21.15.17:0/1056216447 >> 172.21.15.17:0/1056216447 conn(0x7fb4d00fb3d0 msgr2=0x7fb4d00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.412+0000 7fb4d6697640 1 -- 172.21.15.17:0/1056216447 shutdown_connections 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 -- 172.21.15.17:0/1056216447 wait complete. 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 Processor -- start 2024-03-16T10:48:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 -- start start 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d01023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d010d480 con 0x7fb4d0103430 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d010d300 con 0x7fb4d00ffaa0 2024-03-16T10:48:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.413+0000 7fb4d6697640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d010d600 con 0x7fb4d0102a70 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d01023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4d4c34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:34502/0 (socket says 172.21.15.17:34502) 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d01023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35774/0 (socket says 172.21.15.17:35774) 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 -- 172.21.15.17:0/2243518283 learned_addr learned my addr 172.21.15.17:0/2243518283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 -- 172.21.15.17:0/2243518283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 msgr2=0x7fb4d01023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d01023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 -- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 msgr2=0x7fb4d0100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 -- 172.21.15.17:0/2243518283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d01017f0 con 0x7fb4d0102a70 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4d4c34640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cf7fe640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009230 tx=0x7fb4c402c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4043020 con 0x7fb4d0102a70 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d01a1ca0 con 0x7fb4d0102a70 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4c40054e0 con 0x7fb4d0102a70 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4003b80 con 0x7fb4d0102a70 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.414+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d01a21a0 con 0x7fb4d0102a70 2024-03-16T10:48:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.415+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d0108c70 con 0x7fb4d0102a70 2024-03-16T10:48:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.416+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fb4c4046020 con 0x7fb4d0102a70 2024-03-16T10:48:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.417+0000 7fb4cd7fa640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 0x7fb4b80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.417+0000 7fb4cffff640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 0x7fb4b80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.417+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb4c40f0a70 con 0x7fb4d0102a70 2024-03-16T10:48:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.417+0000 7fb4cffff640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 0x7fb4b80a4d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0068740 tx=0x7fb4c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.422+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb4c404d020 con 0x7fb4d0102a70 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-03-16T10:48:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: Cluster is now healthy 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-03-16T10:48:55.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:55 smithi174 ceph-mon[36202]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-03-16T10:48:55.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.634+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb4d0061c20 con 0x7fb4b80a2890 2024-03-16T10:48:55.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.655+0000 7fb4cd7fa640 1 -- 172.21.15.17:0/2243518283 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb4d0061c20 con 0x7fb4b80a2890 2024-03-16T10:48:55.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 msgr2=0x7fb4b80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 0x7fb4b80a4d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0068740 tx=0x7fb4c0005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 msgr2=0x7fb4d0100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009230 tx=0x7fb4c402c6c0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 shutdown_connections 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb4b80a2890 0x7fb4b80a4d50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4d0103430 0x7fb4d0100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4d0102a70 0x7fb4d0100a20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 --2- 172.21.15.17:0/2243518283 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d00ffaa0 0x7fb4d01023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.657+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 >> 172.21.15.17:0/2243518283 conn(0x7fb4d00fb3d0 msgr2=0x7fb4d0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.658+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 shutdown_connections 2024-03-16T10:48:55.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.658+0000 7fb4d6697640 1 -- 172.21.15.17:0/2243518283 wait complete. 2024-03-16T10:48:55.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2624126487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-16T10:48:55.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: Cluster is now healthy 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-03-16T10:48:55.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:55 smithi111 ceph-mon[36315]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-03-16T10:48:55.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-16T10:48:55.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 -- 172.21.15.17:0/2323736198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901022b0 msgr2=0x7ffa90108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2323736198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901022b0 0x7ffa90108b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009900 tx=0x7ffa8002bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 -- 172.21.15.17:0/2323736198 shutdown_connections 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2323736198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901022b0 0x7ffa90108b40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2323736198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901018f0 0x7ffa90101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2323736198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 0x7ffa90100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 -- 172.21.15.17:0/2323736198 >> 172.21.15.17:0/2323736198 conn(0x7ffa900fbc90 msgr2=0x7ffa900fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 -- 172.21.15.17:0/2323736198 shutdown_connections 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.776+0000 7ffa96b60640 1 -- 172.21.15.17:0/2323736198 wait complete. 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 Processor -- start 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 -- start start 2024-03-16T10:48:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 0x7ffa90197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901022b0 0x7ffa9019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9010c380 con 0x7ffa901018f0 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9010c200 con 0x7ffa90100700 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa96b60640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9010c500 con 0x7ffa901022b0 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59486/0 (socket says 172.21.15.17:59486) 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 -- 172.21.15.17:0/2784887441 learned_addr learned my addr 172.21.15.17:0/2784887441 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa948fc640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 0x7ffa90197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa950fd640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901022b0 0x7ffa9019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 -- 172.21.15.17:0/2784887441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901022b0 msgr2=0x7ffa9019f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901022b0 0x7ffa9019f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 -- 172.21.15.17:0/2784887441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 msgr2=0x7ffa90197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 0x7ffa90197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.777+0000 7ffa8ffff640 1 -- 172.21.15.17:0/2784887441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9019f700 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa8ffff640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400e9f0 tx=0x7ffa8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400cd80 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9019f9f0 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa84005500 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84010690 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.778+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9019fef0 con 0x7ffa901018f0 2024-03-16T10:48:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.779+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa901a0180 con 0x7ffa901018f0 2024-03-16T10:48:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.780+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7ffa840046c0 con 0x7ffa901018f0 2024-03-16T10:48:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.780+0000 7ffa8dffb640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 0x7ffa780a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.781+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ffa840cee30 con 0x7ffa901018f0 2024-03-16T10:48:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.781+0000 7ffa948fc640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 0x7ffa780a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.781+0000 7ffa948fc640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 0x7ffa780a4d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa90101750 tx=0x7ffa88009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:55.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.785+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ffa8409bf20 con 0x7ffa901018f0 2024-03-16T10:48:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:55.996+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ffa900fdde0 con 0x7ffa780a2890 2024-03-16T10:48:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.000+0000 7ffa8dffb640 1 -- 172.21.15.17:0/2784887441 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffa900fdde0 con 0x7ffa780a2890 2024-03-16T10:48:56.001 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28 2024-03-16T10:48:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 msgr2=0x7ffa780a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 0x7ffa780a4d50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa90101750 tx=0x7ffa88009500 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 msgr2=0x7ffa90198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400e9f0 tx=0x7ffa8400edf0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 shutdown_connections 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffa780a2890 0x7ffa780a4d50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa901022b0 0x7ffa9019f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa901018f0 0x7ffa90198020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 --2- 172.21.15.17:0/2784887441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa90100700 0x7ffa90197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 >> 172.21.15.17:0/2784887441 conn(0x7ffa900fbc90 msgr2=0x7ffa900fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 shutdown_connections 2024-03-16T10:48:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.002+0000 7ffa96b60640 1 -- 172.21.15.17:0/2784887441 wait complete. 2024-03-16T10:48:56.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:48:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 -- 172.21.15.17:0/3361476180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb708102a00 msgr2=0x7fb708102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 --2- 172.21.15.17:0/3361476180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb708102a00 0x7fb708102e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009900 tx=0x7fb6f802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 -- 172.21.15.17:0/3361476180 shutdown_connections 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 --2- 172.21.15.17:0/3361476180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7081033c0 0x7fb708109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 --2- 172.21.15.17:0/3361476180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb708102a00 0x7fb708102e80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 --2- 172.21.15.17:0/3361476180 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708101810 0x7fb708101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 -- 172.21.15.17:0/3361476180 >> 172.21.15.17:0/3361476180 conn(0x7fb7080fcd80 msgr2=0x7fb7080ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 -- 172.21.15.17:0/3361476180 shutdown_connections 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.116+0000 7fb7107d4640 1 -- 172.21.15.17:0/3361476180 wait complete. 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 Processor -- start 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 -- start start 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb708101810 0x7fb708197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708102a00 0x7fb708198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810d470 con 0x7fb7081033c0 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810d2f0 con 0x7fb708102a00 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb7107d4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810d5f0 con 0x7fb708101810 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59500/0 (socket says 172.21.15.17:59500) 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 -- 172.21.15.17:0/4187903122 learned_addr learned my addr 172.21.15.17:0/4187903122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70dd6f640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708102a00 0x7fb708198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70e570640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb708101810 0x7fb708197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 -- 172.21.15.17:0/4187903122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb708101810 msgr2=0x7fb708197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb708101810 0x7fb708197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 -- 172.21.15.17:0/4187903122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708102a00 msgr2=0x7fb708198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708102a00 0x7fb708198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.117+0000 7fb70ed71640 1 -- 172.21.15.17:0/4187903122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70819f730 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb70ed71640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb70400eb10 tx=0x7fb70400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704004b20 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb704004cc0 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70819fa20 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704010760 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.118+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70819fef0 con 0x7fb7081033c0 2024-03-16T10:48:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.119+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb708108bb0 con 0x7fb7081033c0 2024-03-16T10:48:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.120+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fb704005020 con 0x7fb7081033c0 2024-03-16T10:48:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.120+0000 7fb6ff7fe640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 0x7fb6f40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.120+0000 7fb70e570640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 0x7fb6f40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.120+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb7040cefb0 con 0x7fb7081033c0 2024-03-16T10:48:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.121+0000 7fb70e570640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 0x7fb6f40a4d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7000095f0 tx=0x7fb700005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.125+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb70409c0a0 con 0x7fb7081033c0 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-03-16T10:48:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:56 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:48:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.362+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70802d5d0 con 0x7fb7081033c0 2024-03-16T10:48:56.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.362+0000 7fb6ff7fe640 1 -- 172.21.15.17:0/4187903122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7fb70409b9a0 con 0x7fb7081033c0 2024-03-16T10:48:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:56.425 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:48:56.426 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 msgr2=0x7fb6f40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 0x7fb6f40a4d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7000095f0 tx=0x7fb700005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 msgr2=0x7fb70819f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb70400eb10 tx=0x7fb70400c2d0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 shutdown_connections 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb6f40a2890 0x7fb6f40a4d50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7081033c0 0x7fb70819f0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb708102a00 0x7fb708198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 --2- 172.21.15.17:0/4187903122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb708101810 0x7fb708197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 >> 172.21.15.17:0/4187903122 conn(0x7fb7080fcd80 msgr2=0x7fb708105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 shutdown_connections 2024-03-16T10:48:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.364+0000 7fb7107d4640 1 -- 172.21.15.17:0/4187903122 wait complete. 2024-03-16T10:48:56.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:48:56.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- 172.21.15.17:0/836920289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101810 msgr2=0x7f84b0101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 --2- 172.21.15.17:0/836920289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101810 0x7f84b0101c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009900 tx=0x7f84a802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- 172.21.15.17:0/836920289 shutdown_connections 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 --2- 172.21.15.17:0/836920289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b01033c0 0x7f84b0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 --2- 172.21.15.17:0/836920289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0102a00 0x7f84b0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 --2- 172.21.15.17:0/836920289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b0101810 0x7f84b0101c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- 172.21.15.17:0/836920289 >> 172.21.15.17:0/836920289 conn(0x7f84b00fcd80 msgr2=0x7f84b00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- 172.21.15.17:0/836920289 shutdown_connections 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- 172.21.15.17:0/836920289 wait complete. 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 Processor -- start 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.558+0000 7f84b5377640 1 -- start start 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 0x7f84b0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 0x7f84b0198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010d480 con 0x7f84b01033c0 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010d300 con 0x7f84b0102a00 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010d600 con 0x7f84b0101810 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 0x7f84b0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59522/0 (socket says 172.21.15.17:59522) 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 0x7f84b0197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:34570/0 (socket says 172.21.15.17:34570) 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 0x7f84b0198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84af7fe640 1 -- 172.21.15.17:0/188491925 learned_addr learned my addr 172.21.15.17:0/188491925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 -- 172.21.15.17:0/188491925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 msgr2=0x7f84b0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 0x7f84b0197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 -- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 msgr2=0x7f84b019f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 -- 172.21.15.17:0/188491925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b019f770 con 0x7f84b0102a00 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84af7fe640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84ae7fc640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 0x7f84b0198090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f849800e9f0 tx=0x7f849800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849800ccc0 con 0x7f84b0102a00 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8498005020 con 0x7f84b0102a00 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b019fa60 con 0x7f84b0102a00 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980049e0 con 0x7f84b0102a00 2024-03-16T10:48:56.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.559+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b019ff60 con 0x7f84b0102a00 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-03-16T10:48:56.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:56 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.561+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b0108bd0 con 0x7f84b0102a00 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.561+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f8498005560 con 0x7f84b0102a00 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.562+0000 7f84a7fff640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 0x7f849c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.562+0000 7f84aeffd640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 0x7f849c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.562+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f84980cea00 con 0x7f84b0102a00 2024-03-16T10:48:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.563+0000 7f84aeffd640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 0x7f849c0a4d50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000c00 tx=0x7f84a8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.566+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f84980051d0 con 0x7f84b0102a00 2024-03-16T10:48:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 9 op/s 2024-03-16T10:48:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-16T10:48:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:48:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-03-16T10:48:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:56 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:48:56.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.793+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84b002d3b0 con 0x7f84b0102a00 2024-03-16T10:48:56.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.795+0000 7f84a7fff640 1 -- 172.21.15.17:0/188491925 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22231 (secure 0 0 0) 0x7f849809baf0 con 0x7f84b0102a00 2024-03-16T10:48:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:56.796 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:48:49.836693+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:48:56.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 msgr2=0x7f849c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 0x7f849c0a4d50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000c00 tx=0x7f84a8005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 msgr2=0x7f84b0198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 0x7f84b0198090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f849800e9f0 tx=0x7f849800eeb0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 shutdown_connections 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f849c0a2890 0x7f849c0a4d50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b01033c0 0x7f84b019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b0102a00 0x7f84b0198090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 --2- 172.21.15.17:0/188491925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84b0101810 0x7f84b0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 >> 172.21.15.17:0/188491925 conn(0x7f84b00fcd80 msgr2=0x7f84b0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 shutdown_connections 2024-03-16T10:48:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.797+0000 7f84b5377640 1 -- 172.21.15.17:0/188491925 wait complete. 2024-03-16T10:48:56.811 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T10:48:56.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 -- 172.21.15.17:0/2692167477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 msgr2=0x7f1858101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 --2- 172.21.15.17:0/2692167477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f1858101d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f184c009900 tx=0x7f184c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 -- 172.21.15.17:0/2692167477 shutdown_connections 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 --2- 172.21.15.17:0/2692167477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18581022b0 0x7f1858108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 --2- 172.21.15.17:0/2692167477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f1858101d70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 --2- 172.21.15.17:0/2692167477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1858100700 0x7f1858100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 -- 172.21.15.17:0/2692167477 >> 172.21.15.17:0/2692167477 conn(0x7f18580fbc70 msgr2=0x7f18580fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 -- 172.21.15.17:0/2692167477 shutdown_connections 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.917+0000 7f185dd9e640 1 -- 172.21.15.17:0/2692167477 wait complete. 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 Processor -- start 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 -- start start 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 0x7f18580694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 0x7f185819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f185810c380 con 0x7f18581018f0 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f185810c200 con 0x7f18581022b0 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f185dd9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f185810c500 con 0x7f1858100700 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59538/0 (socket says 172.21.15.17:59538) 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 -- 172.21.15.17:0/1277234666 learned_addr learned my addr 172.21.15.17:0/1277234666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f18577fe640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 0x7f18580694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1857fff640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 0x7f185819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 -- 172.21.15.17:0/1277234666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 msgr2=0x7f18580694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 0x7f18580694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 -- 172.21.15.17:0/1277234666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 msgr2=0x7f185819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 0x7f185819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1856ffd640 1 -- 172.21.15.17:0/1277234666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185819f750 con 0x7f18581018f0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f1857fff640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 0x7f185819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.918+0000 7f18577fe640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 0x7f18580694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f1856ffd640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f184c009230 tx=0x7f184c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c041070 con 0x7f18581018f0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185819f9e0 con 0x7f18581018f0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c004450 con 0x7f18581018f0 2024-03-16T10:48:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c003e20 con 0x7f18581018f0 2024-03-16T10:48:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.919+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185819ff20 con 0x7f18581018f0 2024-03-16T10:48:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.920+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1858107a20 con 0x7f18581018f0 2024-03-16T10:48:56.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.921+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f184c044070 con 0x7f18581018f0 2024-03-16T10:48:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.921+0000 7f1854ff9640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 0x7f18400a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.921+0000 7f18577fe640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 0x7f18400a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.921+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f184c0f04c0 con 0x7f18581018f0 2024-03-16T10:48:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.922+0000 7f18577fe640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 0x7f18400a4d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1858101750 tx=0x7f1848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:56.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:56.926+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f184c0bd070 con 0x7f18581018f0 2024-03-16T10:48:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.173+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1858061c20 con 0x7f18400a2890 2024-03-16T10:48:57.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.185+0000 7f1854ff9640 1 -- 172.21.15.17:0/1277234666 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258941 (secure 0 0 0) 0x7f1858061c20 con 0x7f18400a2890 2024-03-16T10:48:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 msgr2=0x7f18400a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 0x7f18400a4d50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1858101750 tx=0x7f1848005f90 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 msgr2=0x7f185819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f184c009230 tx=0x7f184c02c650 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 shutdown_connections 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18400a2890 0x7f18400a4d50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18581022b0 0x7f185819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18581018f0 0x7f185819c850 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 --2- 172.21.15.17:0/1277234666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1858100700 0x7f18580694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 >> 172.21.15.17:0/1277234666 conn(0x7f18580fbc70 msgr2=0x7f1858104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 shutdown_connections 2024-03-16T10:48:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.188+0000 7f185dd9e640 1 -- 172.21.15.17:0/1277234666 wait complete. 2024-03-16T10:48:57.200 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-03-16T10:48:56.474979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617324,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":147,"num_read_kb":146,"num_write":361,"num_write_kb":3022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372808,"kb_used_data":11148,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569016,"statfs":{"total":1151940427776,"available":1151558672384,"internally_reserved":0,"allocated":11415552,"data_stored":7076544,"data_compressed":108255,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26956,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21,"num_read_kb":37,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001679"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941187+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:48:49.941187+0000","last_peered":"2024-03-16T10:48:49.941187+0000","last_clean":"2024-03-16T10:48:49.941187+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:48:49.941187+0000","last_undegraded":"2024-03-16T10:48:49.941187+0000","last_fullsized":"2024-03-16T10:48:49.941187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941083+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:48:49.941083+0000","last_peered":"2024-03-16T10:48:49.941083+0000","last_clean":"2024-03-16T10:48:49.941083+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:48:49.941083+0000","last_undegraded":"2024-03-16T10:48:49.941083+0000","last_fullsized":"2024-03-16T10:48:49.941083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940996+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:48:49.940996+0000","last_peered":"2024-03-16T10:48:49.940996+0000","last_clean":"2024-03-16T10:48:49.940996+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:48:49.940996+0000","last_undegraded":"2024-03-16T10:48:49.940996+0000","last_fullsized":"2024-03-16T10:48:49.940996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.897623+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:48:49.897623+0000","last_peered":"2024-03-16T10:48:49.897623+0000","last_clean":"2024-03-16T10:48:49.897623+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:48:49.897623+0000","last_undegraded":"2024-03-16T10:48:49.897623+0000","last_fullsized":"2024-03-16T10:48:49.897623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940587+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:48:49.940587+0000","last_peered":"2024-03-16T10:48:49.940587+0000","last_clean":"2024-03-16T10:48:49.940587+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:48:49.940587+0000","last_undegraded":"2024-03-16T10:48:49.940587+0000","last_fullsized":"2024-03-16T10:48:49.940587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840985+0000","last_change":"2024-03-16T10:48:48.853021+0000","last_active":"2024-03-16T10:48:49.840985+0000","last_peered":"2024-03-16T10:48:49.840985+0000","last_clean":"2024-03-16T10:48:49.840985+0000","last_became_active":"2024-03-16T10:48:48.852709+0000","last_became_peered":"2024-03-16T10:48:48.852709+0000","last_unstale":"2024-03-16T10:48:49.840985+0000","last_undegraded":"2024-03-16T10:48:49.840985+0000","last_fullsized":"2024-03-16T10:48:49.840985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:08:47.120299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986572+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:48:49.986572+0000","last_peered":"2024-03-16T10:48:49.986572+0000","last_clean":"2024-03-16T10:48:49.986572+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:48:49.986572+0000","last_undegraded":"2024-03-16T10:48:49.986572+0000","last_fullsized":"2024-03-16T10:48:49.986572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940128+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:48:49.940128+0000","last_peered":"2024-03-16T10:48:49.940128+0000","last_clean":"2024-03-16T10:48:49.940128+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:48:49.940128+0000","last_undegraded":"2024-03-16T10:48:49.940128+0000","last_fullsized":"2024-03-16T10:48:49.940128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940299+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:48:49.940299+0000","last_peered":"2024-03-16T10:48:49.940299+0000","last_clean":"2024-03-16T10:48:49.940299+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:48:49.940299+0000","last_undegraded":"2024-03-16T10:48:49.940299+0000","last_fullsized":"2024-03-16T10:48:49.940299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.841218+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:48:49.841218+0000","last_peered":"2024-03-16T10:48:49.841218+0000","last_clean":"2024-03-16T10:48:49.841218+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:48:49.841218+0000","last_undegraded":"2024-03-16T10:48:49.841218+0000","last_fullsized":"2024-03-16T10:48:49.841218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986948+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:48:49.986948+0000","last_peered":"2024-03-16T10:48:49.986948+0000","last_clean":"2024-03-16T10:48:49.986948+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:48:49.986948+0000","last_undegraded":"2024-03-16T10:48:49.986948+0000","last_fullsized":"2024-03-16T10:48:49.986948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.897579+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:48:49.897579+0000","last_peered":"2024-03-16T10:48:49.897579+0000","last_clean":"2024-03-16T10:48:49.897579+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:48:49.897579+0000","last_undegraded":"2024-03-16T10:48:49.897579+0000","last_fullsized":"2024-03-16T10:48:49.897579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940827+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:48:49.940827+0000","last_peered":"2024-03-16T10:48:49.940827+0000","last_clean":"2024-03-16T10:48:49.940827+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:48:49.940827+0000","last_undegraded":"2024-03-16T10:48:49.940827+0000","last_fullsized":"2024-03-16T10:48:49.940827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940692+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:48:49.940692+0000","last_peered":"2024-03-16T10:48:49.940692+0000","last_clean":"2024-03-16T10:48:49.940692+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:48:49.940692+0000","last_undegraded":"2024-03-16T10:48:49.940692+0000","last_fullsized":"2024-03-16T10:48:49.940692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941138+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:48:49.941138+0000","last_peered":"2024-03-16T10:48:49.941138+0000","last_clean":"2024-03-16T10:48:49.941138+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:48:49.941138+0000","last_undegraded":"2024-03-16T10:48:49.941138+0000","last_fullsized":"2024-03-16T10:48:49.941138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.939967+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:48:49.939967+0000","last_peered":"2024-03-16T10:48:49.939967+0000","last_clean":"2024-03-16T10:48:49.939967+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:48:49.939967+0000","last_undegraded":"2024-03-16T10:48:49.939967+0000","last_fullsized":"2024-03-16T10:48:49.939967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941544+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:48:49.941544+0000","last_peered":"2024-03-16T10:48:49.941544+0000","last_clean":"2024-03-16T10:48:49.941544+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:48:49.941544+0000","last_undegraded":"2024-03-16T10:48:49.941544+0000","last_fullsized":"2024-03-16T10:48:49.941544+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.839850+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:48:49.839850+0000","last_peered":"2024-03-16T10:48:49.839850+0000","last_clean":"2024-03-16T10:48:49.839850+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:48:49.839850+0000","last_undegraded":"2024-03-16T10:48:49.839850+0000","last_fullsized":"2024-03-16T10:48:49.839850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840591+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:48:49.840591+0000","last_peered":"2024-03-16T10:48:49.840591+0000","last_clean":"2024-03-16T10:48:49.840591+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:48:49.840591+0000","last_undegraded":"2024-03-16T10:48:49.840591+0000","last_fullsized":"2024-03-16T10:48:49.840591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179034+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:48:55.179034+0000","last_peered":"2024-03-16T10:48:55.179034+0000","last_clean":"2024-03-16T10:48:55.179034+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:48:55.179034+0000","last_undegraded":"2024-03-16T10:48:55.179034+0000","last_fullsized":"2024-03-16T10:48:55.179034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941514+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:48:49.941514+0000","last_peered":"2024-03-16T10:48:49.941514+0000","last_clean":"2024-03-16T10:48:49.941514+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:48:49.941514+0000","last_undegraded":"2024-03-16T10:48:49.941514+0000","last_fullsized":"2024-03-16T10:48:49.941514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.033472+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:48:50.033472+0000","last_peered":"2024-03-16T10:48:50.033472+0000","last_clean":"2024-03-16T10:48:50.033472+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:48:50.033472+0000","last_undegraded":"2024-03-16T10:48:50.033472+0000","last_fullsized":"2024-03-16T10:48:50.033472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941234+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:48:49.941234+0000","last_peered":"2024-03-16T10:48:49.941234+0000","last_clean":"2024-03-16T10:48:49.941234+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:48:49.941234+0000","last_undegraded":"2024-03-16T10:48:49.941234+0000","last_fullsized":"2024-03-16T10:48:49.941234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.199906+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:48:53.199906+0000","last_peered":"2024-03-16T10:48:53.199906+0000","last_clean":"2024-03-16T10:48:53.199906+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:48:53.199906+0000","last_undegraded":"2024-03-16T10:48:53.199906+0000","last_fullsized":"2024-03-16T10:48:53.199906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940114+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:48:49.940114+0000","last_peered":"2024-03-16T10:48:49.940114+0000","last_clean":"2024-03-16T10:48:49.940114+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:48:49.940114+0000","last_undegraded":"2024-03-16T10:48:49.940114+0000","last_fullsized":"2024-03-16T10:48:49.940114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.942068+0000","last_change":"2024-03-16T10:48:48.379450+0000","last_active":"2024-03-16T10:48:49.942068+0000","last_peered":"2024-03-16T10:48:49.942068+0000","last_clean":"2024-03-16T10:48:49.942068+0000","last_became_active":"2024-03-16T10:48:48.378566+0000","last_became_peered":"2024-03-16T10:48:48.378566+0000","last_unstale":"2024-03-16T10:48:49.942068+0000","last_undegraded":"2024-03-16T10:48:49.942068+0000","last_fullsized":"2024-03-16T10:48:49.942068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:30:39.043816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941439+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:48:49.941439+0000","last_peered":"2024-03-16T10:48:49.941439+0000","last_clean":"2024-03-16T10:48:49.941439+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:48:49.941439+0000","last_undegraded":"2024-03-16T10:48:49.941439+0000","last_fullsized":"2024-03-16T10:48:49.941439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.193437+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:48:52.193437+0000","last_peered":"2024-03-16T10:48:52.193437+0000","last_clean":"2024-03-16T10:48:52.193437+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:48:52.193437+0000","last_undegraded":"2024-03-16T10:48:52.193437+0000","last_fullsized":"2024-03-16T10:48:52.193437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940475+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:48:49.940475+0000","last_peered":"2024-03-16T10:48:49.940475+0000","last_clean":"2024-03-16T10:48:49.940475+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:48:49.940475+0000","last_undegraded":"2024-03-16T10:48:49.940475+0000","last_fullsized":"2024-03-16T10:48:49.940475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.206949+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:48:54.206949+0000","last_peered":"2024-03-16T10:48:54.206949+0000","last_clean":"2024-03-16T10:48:54.206949+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:48:54.206949+0000","last_undegraded":"2024-03-16T10:48:54.206949+0000","last_fullsized":"2024-03-16T10:48:54.206949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941532+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:48:49.941532+0000","last_peered":"2024-03-16T10:48:49.941532+0000","last_clean":"2024-03-16T10:48:49.941532+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:48:49.941532+0000","last_undegraded":"2024-03-16T10:48:49.941532+0000","last_fullsized":"2024-03-16T10:48:49.941532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.202951+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:48:53.202951+0000","last_peered":"2024-03-16T10:48:53.202951+0000","last_clean":"2024-03-16T10:48:53.202951+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:48:53.202951+0000","last_undegraded":"2024-03-16T10:48:53.202951+0000","last_fullsized":"2024-03-16T10:48:53.202951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941485+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:48:49.941485+0000","last_peered":"2024-03-16T10:48:49.941485+0000","last_clean":"2024-03-16T10:48:49.941485+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:48:49.941485+0000","last_undegraded":"2024-03-16T10:48:49.941485+0000","last_fullsized":"2024-03-16T10:48:49.941485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191080+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:48:52.191080+0000","last_peered":"2024-03-16T10:48:52.191080+0000","last_clean":"2024-03-16T10:48:52.191080+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:48:52.191080+0000","last_undegraded":"2024-03-16T10:48:52.191080+0000","last_fullsized":"2024-03-16T10:48:52.191080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.839714+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:48:49.839714+0000","last_peered":"2024-03-16T10:48:49.839714+0000","last_clean":"2024-03-16T10:48:49.839714+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:48:49.839714+0000","last_undegraded":"2024-03-16T10:48:49.839714+0000","last_fullsized":"2024-03-16T10:48:49.839714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.173174+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:48:55.173174+0000","last_peered":"2024-03-16T10:48:55.173174+0000","last_clean":"2024-03-16T10:48:55.173174+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:48:55.173174+0000","last_undegraded":"2024-03-16T10:48:55.173174+0000","last_fullsized":"2024-03-16T10:48:55.173174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940243+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:48:49.940243+0000","last_peered":"2024-03-16T10:48:49.940243+0000","last_clean":"2024-03-16T10:48:49.940243+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:48:49.940243+0000","last_undegraded":"2024-03-16T10:48:49.940243+0000","last_fullsized":"2024-03-16T10:48:49.940243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986790+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:48:49.986790+0000","last_peered":"2024-03-16T10:48:49.986790+0000","last_clean":"2024-03-16T10:48:49.986790+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:48:49.986790+0000","last_undegraded":"2024-03-16T10:48:49.986790+0000","last_fullsized":"2024-03-16T10:48:49.986790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941194+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:48:49.941194+0000","last_peered":"2024-03-16T10:48:49.941194+0000","last_clean":"2024-03-16T10:48:49.941194+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:48:49.941194+0000","last_undegraded":"2024-03-16T10:48:49.941194+0000","last_fullsized":"2024-03-16T10:48:49.941194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191557+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:48:52.191557+0000","last_peered":"2024-03-16T10:48:52.191557+0000","last_clean":"2024-03-16T10:48:52.191557+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:48:52.191557+0000","last_undegraded":"2024-03-16T10:48:52.191557+0000","last_fullsized":"2024-03-16T10:48:52.191557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940297+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:48:49.940297+0000","last_peered":"2024-03-16T10:48:49.940297+0000","last_clean":"2024-03-16T10:48:49.940297+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:48:49.940297+0000","last_undegraded":"2024-03-16T10:48:49.940297+0000","last_fullsized":"2024-03-16T10:48:49.940297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'17","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.181264+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:48:55.181264+0000","last_peered":"2024-03-16T10:48:55.181264+0000","last_clean":"2024-03-16T10:48:55.181264+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:48:55.181264+0000","last_undegraded":"2024-03-16T10:48:55.181264+0000","last_fullsized":"2024-03-16T10:48:55.181264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20895,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":22,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940977+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:48:49.940977+0000","last_peered":"2024-03-16T10:48:49.940977+0000","last_clean":"2024-03-16T10:48:49.940977+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:48:49.940977+0000","last_undegraded":"2024-03-16T10:48:49.940977+0000","last_fullsized":"2024-03-16T10:48:49.940977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179368+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:48:55.179368+0000","last_peered":"2024-03-16T10:48:55.179368+0000","last_clean":"2024-03-16T10:48:55.179368+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:48:55.179368+0000","last_undegraded":"2024-03-16T10:48:55.179368+0000","last_fullsized":"2024-03-16T10:48:55.179368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940319+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:48:49.940319+0000","last_peered":"2024-03-16T10:48:49.940319+0000","last_clean":"2024-03-16T10:48:49.940319+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:48:49.940319+0000","last_undegraded":"2024-03-16T10:48:49.940319+0000","last_fullsized":"2024-03-16T10:48:49.940319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191977+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:48:52.191977+0000","last_peered":"2024-03-16T10:48:52.191977+0000","last_clean":"2024-03-16T10:48:52.191977+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:48:52.191977+0000","last_undegraded":"2024-03-16T10:48:52.191977+0000","last_fullsized":"2024-03-16T10:48:52.191977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986933+0000","last_change":"2024-03-16T10:48:48.850996+0000","last_active":"2024-03-16T10:48:49.986933+0000","last_peered":"2024-03-16T10:48:49.986933+0000","last_clean":"2024-03-16T10:48:49.986933+0000","last_became_active":"2024-03-16T10:48:48.850670+0000","last_became_peered":"2024-03-16T10:48:48.850670+0000","last_unstale":"2024-03-16T10:48:49.986933+0000","last_undegraded":"2024-03-16T10:48:49.986933+0000","last_fullsized":"2024-03-16T10:48:49.986933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:35.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.173326+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:48:55.173326+0000","last_peered":"2024-03-16T10:48:55.173326+0000","last_clean":"2024-03-16T10:48:55.173326+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:48:55.173326+0000","last_undegraded":"2024-03-16T10:48:55.173326+0000","last_fullsized":"2024-03-16T10:48:55.173326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986541+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:48:49.986541+0000","last_peered":"2024-03-16T10:48:49.986541+0000","last_clean":"2024-03-16T10:48:49.986541+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:48:49.986541+0000","last_undegraded":"2024-03-16T10:48:49.986541+0000","last_fullsized":"2024-03-16T10:48:49.986541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.201446+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:48:53.201446+0000","last_peered":"2024-03-16T10:48:53.201446+0000","last_clean":"2024-03-16T10:48:53.201446+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:48:53.201446+0000","last_undegraded":"2024-03-16T10:48:53.201446+0000","last_fullsized":"2024-03-16T10:48:53.201446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940926+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:48:49.940926+0000","last_peered":"2024-03-16T10:48:49.940926+0000","last_clean":"2024-03-16T10:48:49.940926+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:48:49.940926+0000","last_undegraded":"2024-03-16T10:48:49.940926+0000","last_fullsized":"2024-03-16T10:48:49.940926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940778+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:48:49.940778+0000","last_peered":"2024-03-16T10:48:49.940778+0000","last_clean":"2024-03-16T10:48:49.940778+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:48:49.940778+0000","last_undegraded":"2024-03-16T10:48:49.940778+0000","last_fullsized":"2024-03-16T10:48:49.940778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940505+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:48:49.940505+0000","last_peered":"2024-03-16T10:48:49.940505+0000","last_clean":"2024-03-16T10:48:49.940505+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:48:49.940505+0000","last_undegraded":"2024-03-16T10:48:49.940505+0000","last_fullsized":"2024-03-16T10:48:49.940505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.595232+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:48:50.595232+0000","last_peered":"2024-03-16T10:48:50.595232+0000","last_clean":"2024-03-16T10:48:50.595232+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:48:50.595232+0000","last_undegraded":"2024-03-16T10:48:50.595232+0000","last_fullsized":"2024-03-16T10:48:50.595232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.233954+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:48:50.233954+0000","last_peered":"2024-03-16T10:48:50.233954+0000","last_clean":"2024-03-16T10:48:50.233954+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:48:50.233954+0000","last_undegraded":"2024-03-16T10:48:50.233954+0000","last_fullsized":"2024-03-16T10:48:50.233954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986597+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:48:49.986597+0000","last_peered":"2024-03-16T10:48:49.986597+0000","last_clean":"2024-03-16T10:48:49.986597+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:48:49.986597+0000","last_undegraded":"2024-03-16T10:48:49.986597+0000","last_fullsized":"2024-03-16T10:48:49.986597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.841124+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:48:49.841124+0000","last_peered":"2024-03-16T10:48:49.841124+0000","last_clean":"2024-03-16T10:48:49.841124+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:48:49.841124+0000","last_undegraded":"2024-03-16T10:48:49.841124+0000","last_fullsized":"2024-03-16T10:48:49.841124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940634+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:48:49.940634+0000","last_peered":"2024-03-16T10:48:49.940634+0000","last_clean":"2024-03-16T10:48:49.940634+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:48:49.940634+0000","last_undegraded":"2024-03-16T10:48:49.940634+0000","last_fullsized":"2024-03-16T10:48:49.940634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.172969+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:48:55.172969+0000","last_peered":"2024-03-16T10:48:55.172969+0000","last_clean":"2024-03-16T10:48:55.172969+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:48:55.172969+0000","last_undegraded":"2024-03-16T10:48:55.172969+0000","last_fullsized":"2024-03-16T10:48:55.172969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941437+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:48:49.941437+0000","last_peered":"2024-03-16T10:48:49.941437+0000","last_clean":"2024-03-16T10:48:49.941437+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:48:49.941437+0000","last_undegraded":"2024-03-16T10:48:49.941437+0000","last_fullsized":"2024-03-16T10:48:49.941437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.171816+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:48:55.171816+0000","last_peered":"2024-03-16T10:48:55.171816+0000","last_clean":"2024-03-16T10:48:55.171816+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:48:55.171816+0000","last_undegraded":"2024-03-16T10:48:55.171816+0000","last_fullsized":"2024-03-16T10:48:55.171816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986451+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:48:49.986451+0000","last_peered":"2024-03-16T10:48:49.986451+0000","last_clean":"2024-03-16T10:48:49.986451+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:48:49.986451+0000","last_undegraded":"2024-03-16T10:48:49.986451+0000","last_fullsized":"2024-03-16T10:48:49.986451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.939939+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:48:49.939939+0000","last_peered":"2024-03-16T10:48:49.939939+0000","last_clean":"2024-03-16T10:48:49.939939+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:48:49.939939+0000","last_undegraded":"2024-03-16T10:48:49.939939+0000","last_fullsized":"2024-03-16T10:48:49.939939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986762+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:48:49.986762+0000","last_peered":"2024-03-16T10:48:49.986762+0000","last_clean":"2024-03-16T10:48:49.986762+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:48:49.986762+0000","last_undegraded":"2024-03-16T10:48:49.986762+0000","last_fullsized":"2024-03-16T10:48:49.986762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941143+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:48:49.941143+0000","last_peered":"2024-03-16T10:48:49.941143+0000","last_clean":"2024-03-16T10:48:49.941143+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:48:49.941143+0000","last_undegraded":"2024-03-16T10:48:49.941143+0000","last_fullsized":"2024-03-16T10:48:49.941143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941273+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:48:49.941273+0000","last_peered":"2024-03-16T10:48:49.941273+0000","last_clean":"2024-03-16T10:48:49.941273+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:48:49.941273+0000","last_undegraded":"2024-03-16T10:48:49.941273+0000","last_fullsized":"2024-03-16T10:48:49.941273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.208796+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:48:54.208796+0000","last_peered":"2024-03-16T10:48:54.208796+0000","last_clean":"2024-03-16T10:48:54.208796+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:48:54.208796+0000","last_undegraded":"2024-03-16T10:48:54.208796+0000","last_fullsized":"2024-03-16T10:48:54.208796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941316+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:48:49.941316+0000","last_peered":"2024-03-16T10:48:49.941316+0000","last_clean":"2024-03-16T10:48:49.941316+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:48:49.941316+0000","last_undegraded":"2024-03-16T10:48:49.941316+0000","last_fullsized":"2024-03-16T10:48:49.941316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.181152+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:48:55.181152+0000","last_peered":"2024-03-16T10:48:55.181152+0000","last_clean":"2024-03-16T10:48:55.181152+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:48:55.181152+0000","last_undegraded":"2024-03-16T10:48:55.181152+0000","last_fullsized":"2024-03-16T10:48:55.181152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941311+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:48:49.941311+0000","last_peered":"2024-03-16T10:48:49.941311+0000","last_clean":"2024-03-16T10:48:49.941311+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:48:49.941311+0000","last_undegraded":"2024-03-16T10:48:49.941311+0000","last_fullsized":"2024-03-16T10:48:49.941311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191357+0000","last_change":"2024-03-16T10:48:48.382720+0000","last_active":"2024-03-16T10:48:52.191357+0000","last_peered":"2024-03-16T10:48:52.191357+0000","last_clean":"2024-03-16T10:48:52.191357+0000","last_became_active":"2024-03-16T10:48:48.382363+0000","last_became_peered":"2024-03-16T10:48:48.382363+0000","last_unstale":"2024-03-16T10:48:52.191357+0000","last_undegraded":"2024-03-16T10:48:52.191357+0000","last_fullsized":"2024-03-16T10:48:52.191357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:29:03.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940237+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:48:49.940237+0000","last_peered":"2024-03-16T10:48:49.940237+0000","last_clean":"2024-03-16T10:48:49.940237+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:48:49.940237+0000","last_undegraded":"2024-03-16T10:48:49.940237+0000","last_fullsized":"2024-03-16T10:48:49.940237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.205180+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:48:54.205180+0000","last_peered":"2024-03-16T10:48:54.205180+0000","last_clean":"2024-03-16T10:48:54.205180+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:48:54.205180+0000","last_undegraded":"2024-03-16T10:48:54.205180+0000","last_fullsized":"2024-03-16T10:48:54.205180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940146+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:48:49.940146+0000","last_peered":"2024-03-16T10:48:49.940146+0000","last_clean":"2024-03-16T10:48:49.940146+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:48:49.940146+0000","last_undegraded":"2024-03-16T10:48:49.940146+0000","last_fullsized":"2024-03-16T10:48:49.940146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.207143+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:48:54.207143+0000","last_peered":"2024-03-16T10:48:54.207143+0000","last_clean":"2024-03-16T10:48:54.207143+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:48:54.207143+0000","last_undegraded":"2024-03-16T10:48:54.207143+0000","last_fullsized":"2024-03-16T10:48:54.207143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941697+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:48:49.941697+0000","last_peered":"2024-03-16T10:48:49.941697+0000","last_clean":"2024-03-16T10:48:49.941697+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:48:49.941697+0000","last_undegraded":"2024-03-16T10:48:49.941697+0000","last_fullsized":"2024-03-16T10:48:49.941697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.190985+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:48:52.190985+0000","last_peered":"2024-03-16T10:48:52.190985+0000","last_clean":"2024-03-16T10:48:52.190985+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:48:52.190985+0000","last_undegraded":"2024-03-16T10:48:52.190985+0000","last_fullsized":"2024-03-16T10:48:52.190985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986777+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:48:49.986777+0000","last_peered":"2024-03-16T10:48:49.986777+0000","last_clean":"2024-03-16T10:48:49.986777+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:48:49.986777+0000","last_undegraded":"2024-03-16T10:48:49.986777+0000","last_fullsized":"2024-03-16T10:48:49.986777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.174621+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:48:55.174621+0000","last_peered":"2024-03-16T10:48:55.174621+0000","last_clean":"2024-03-16T10:48:55.174621+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:48:55.174621+0000","last_undegraded":"2024-03-16T10:48:55.174621+0000","last_fullsized":"2024-03-16T10:48:55.174621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986927+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:48:49.986927+0000","last_peered":"2024-03-16T10:48:49.986927+0000","last_clean":"2024-03-16T10:48:49.986927+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:48:49.986927+0000","last_undegraded":"2024-03-16T10:48:49.986927+0000","last_fullsized":"2024-03-16T10:48:49.986927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.965045+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:48:49.965045+0000","last_peered":"2024-03-16T10:48:49.965045+0000","last_clean":"2024-03-16T10:48:49.965045+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:48:49.965045+0000","last_undegraded":"2024-03-16T10:48:49.965045+0000","last_fullsized":"2024-03-16T10:48:49.965045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986883+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:48:49.986883+0000","last_peered":"2024-03-16T10:48:49.986883+0000","last_clean":"2024-03-16T10:48:49.986883+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:48:49.986883+0000","last_undegraded":"2024-03-16T10:48:49.986883+0000","last_fullsized":"2024-03-16T10:48:49.986883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179902+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:48:55.179902+0000","last_peered":"2024-03-16T10:48:55.179902+0000","last_clean":"2024-03-16T10:48:55.179902+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:48:55.179902+0000","last_undegraded":"2024-03-16T10:48:55.179902+0000","last_fullsized":"2024-03-16T10:48:55.179902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986912+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:48:49.986912+0000","last_peered":"2024-03-16T10:48:49.986912+0000","last_clean":"2024-03-16T10:48:49.986912+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:48:49.986912+0000","last_undegraded":"2024-03-16T10:48:49.986912+0000","last_fullsized":"2024-03-16T10:48:49.986912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940185+0000","last_change":"2024-03-16T10:48:48.843259+0000","last_active":"2024-03-16T10:48:49.940185+0000","last_peered":"2024-03-16T10:48:49.940185+0000","last_clean":"2024-03-16T10:48:49.940185+0000","last_became_active":"2024-03-16T10:48:48.842775+0000","last_became_peered":"2024-03-16T10:48:48.842775+0000","last_unstale":"2024-03-16T10:48:49.940185+0000","last_undegraded":"2024-03-16T10:48:49.940185+0000","last_fullsized":"2024-03-16T10:48:49.940185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:01.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840561+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:48:49.840561+0000","last_peered":"2024-03-16T10:48:49.840561+0000","last_clean":"2024-03-16T10:48:49.840561+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:48:49.840561+0000","last_undegraded":"2024-03-16T10:48:49.840561+0000","last_fullsized":"2024-03-16T10:48:49.840561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840437+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:48:49.840437+0000","last_peered":"2024-03-16T10:48:49.840437+0000","last_clean":"2024-03-16T10:48:49.840437+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:48:49.840437+0000","last_undegraded":"2024-03-16T10:48:49.840437+0000","last_fullsized":"2024-03-16T10:48:49.840437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941839+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:48:49.941839+0000","last_peered":"2024-03-16T10:48:49.941839+0000","last_clean":"2024-03-16T10:48:49.941839+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:48:49.941839+0000","last_undegraded":"2024-03-16T10:48:49.941839+0000","last_fullsized":"2024-03-16T10:48:49.941839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940856+0000","last_change":"2024-03-16T10:48:48.850402+0000","last_active":"2024-03-16T10:48:49.940856+0000","last_peered":"2024-03-16T10:48:49.940856+0000","last_clean":"2024-03-16T10:48:49.940856+0000","last_became_active":"2024-03-16T10:48:48.850077+0000","last_became_peered":"2024-03-16T10:48:48.850077+0000","last_unstale":"2024-03-16T10:48:49.940856+0000","last_undegraded":"2024-03-16T10:48:49.940856+0000","last_fullsized":"2024-03-16T10:48:49.940856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:37.517229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941070+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:48:49.941070+0000","last_peered":"2024-03-16T10:48:49.941070+0000","last_clean":"2024-03-16T10:48:49.941070+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:48:49.941070+0000","last_undegraded":"2024-03-16T10:48:49.941070+0000","last_fullsized":"2024-03-16T10:48:49.941070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840780+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:48:49.840780+0000","last_peered":"2024-03-16T10:48:49.840780+0000","last_clean":"2024-03-16T10:48:49.840780+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:48:49.840780+0000","last_undegraded":"2024-03-16T10:48:49.840780+0000","last_fullsized":"2024-03-16T10:48:49.840780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941156+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:48:49.941156+0000","last_peered":"2024-03-16T10:48:49.941156+0000","last_clean":"2024-03-16T10:48:49.941156+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:48:49.941156+0000","last_undegraded":"2024-03-16T10:48:49.941156+0000","last_fullsized":"2024-03-16T10:48:49.941156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940579+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:48:49.940579+0000","last_peered":"2024-03-16T10:48:49.940579+0000","last_clean":"2024-03-16T10:48:49.940579+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:48:49.940579+0000","last_undegraded":"2024-03-16T10:48:49.940579+0000","last_fullsized":"2024-03-16T10:48:49.940579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940209+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:48:49.940209+0000","last_peered":"2024-03-16T10:48:49.940209+0000","last_clean":"2024-03-16T10:48:49.940209+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:48:49.940209+0000","last_undegraded":"2024-03-16T10:48:49.940209+0000","last_fullsized":"2024-03-16T10:48:49.940209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940058+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:48:49.940058+0000","last_peered":"2024-03-16T10:48:49.940058+0000","last_clean":"2024-03-16T10:48:49.940058+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:48:49.940058+0000","last_undegraded":"2024-03-16T10:48:49.940058+0000","last_fullsized":"2024-03-16T10:48:49.940058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940715+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:48:49.940715+0000","last_peered":"2024-03-16T10:48:49.940715+0000","last_clean":"2024-03-16T10:48:49.940715+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:48:49.940715+0000","last_undegraded":"2024-03-16T10:48:49.940715+0000","last_fullsized":"2024-03-16T10:48:49.940715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940577+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:48:49.940577+0000","last_peered":"2024-03-16T10:48:49.940577+0000","last_clean":"2024-03-16T10:48:49.940577+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:48:49.940577+0000","last_undegraded":"2024-03-16T10:48:49.940577+0000","last_fullsized":"2024-03-16T10:48:49.940577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26839,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":21,"num_read_kb":37,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":73960,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383692,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":1039194,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":439553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":1029471,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":439360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":440133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":925696,"data_stored":439215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":461779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":438929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":1031518,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":40556,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:48:57.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T10:48:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- 172.21.15.17:0/3072448274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8101900 msgr2=0x7f06f8101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 --2- 172.21.15.17:0/3072448274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8101900 0x7f06f8101d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009900 tx=0x7f06e802bc30 comp rx=0 tx=0).stop 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- 172.21.15.17:0/3072448274 shutdown_connections 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 --2- 172.21.15.17:0/3072448274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f81022c0 0x7f06f8108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 --2- 172.21.15.17:0/3072448274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8101900 0x7f06f8101d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 --2- 172.21.15.17:0/3072448274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f8100710 0x7f06f8100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- 172.21.15.17:0/3072448274 >> 172.21.15.17:0/3072448274 conn(0x7f06f80fbcc0 msgr2=0x7f06f80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- 172.21.15.17:0/3072448274 shutdown_connections 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- 172.21.15.17:0/3072448274 wait complete. 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 Processor -- start 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.347+0000 7f06fe83f640 1 -- start start 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f8101900 0x7f06f81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f81022c0 0x7f06f819f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06f810d4b0 con 0x7f06f8100710 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f06f810d330 con 0x7f06f8101900 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fe83f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06f810d630 con 0x7f06f81022c0 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59550/0 (socket says 172.21.15.17:59550) 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 -- 172.21.15.17:0/798218675 learned_addr learned my addr 172.21.15.17:0/798218675 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f77fe640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f8101900 0x7f06f81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06fcddc640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f81022c0 0x7f06f819f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 -- 172.21.15.17:0/798218675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f81022c0 msgr2=0x7f06f819f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f81022c0 0x7f06f819f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 -- 172.21.15.17:0/798218675 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f8101900 msgr2=0x7f06f81980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f8101900 0x7f06f81980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 -- 172.21.15.17:0/798218675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f819f780 con 0x7f06f8100710 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f7fff640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9c0 tx=0x7f06e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.348+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e000cd80 con 0x7f06f8100710 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.349+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f819fa70 con 0x7f06f8100710 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.349+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e00035f0 con 0x7f06f8100710 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.349+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0010690 con 0x7f06f8100710 2024-03-16T10:48:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.349+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f819ff40 con 0x7f06f8100710 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.350+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f8107a80 con 0x7f06f8100710 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.351+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f06e00037a0 con 0x7f06f8100710 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.351+0000 7f06f57fa640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 0x7f06e40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.351+0000 7f06f77fe640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 0x7f06e40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.351+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f06e00ceda0 con 0x7f06f8100710 2024-03-16T10:48:57.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.352+0000 7f06f77fe640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 0x7f06e40a4d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06e802c7b0 tx=0x7f06e8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.356+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f06e009be90 con 0x7f06f8100710 2024-03-16T10:48:57.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.537+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06f8061c20 con 0x7f06e40a2890 2024-03-16T10:48:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.549+0000 7f06f57fa640 1 -- 172.21.15.17:0/798218675 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258941 (secure 0 0 0) 0x7f06f8061c20 con 0x7f06e40a2890 2024-03-16T10:48:57.552 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:48:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 msgr2=0x7f06e40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 0x7f06e40a4d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06e802c7b0 tx=0x7f06e8005fd0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 msgr2=0x7f06f8197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9c0 tx=0x7f06e000ee80 comp rx=0 tx=0).stop 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 shutdown_connections 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f06e40a2890 0x7f06e40a4d50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06f81022c0 0x7f06f819f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06f8101900 0x7f06f81980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 --2- 172.21.15.17:0/798218675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06f8100710 0x7f06f8197b60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 >> 172.21.15.17:0/798218675 conn(0x7f06f80fbcc0 msgr2=0x7f06f8104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 shutdown_connections 2024-03-16T10:48:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:57.553+0000 7f06fe83f640 1 -- 172.21.15.17:0/798218675 wait complete. 2024-03-16T10:48:57.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:57 smithi174 ceph-mon[36202]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:57 smithi174 ceph-mon[36202]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4187903122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/188491925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:57 smithi017 ceph-mon[32078]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:57 smithi017 ceph-mon[32078]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4187903122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/188491925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.565 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-03-16T10:48:56.474979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617324,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":147,"num_read_kb":146,"num_write":361,"num_write_kb":3022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372808,"kb_used_data":11148,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569016,"statfs":{"total":1151940427776,"available":1151558672384,"internally_reserved":0,"allocated":11415552,"data_stored":7076544,"data_compressed":108255,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26956,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":21,"num_read_kb":37,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001679"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941187+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:48:49.941187+0000","last_peered":"2024-03-16T10:48:49.941187+0000","last_clean":"2024-03-16T10:48:49.941187+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:48:49.941187+0000","last_undegraded":"2024-03-16T10:48:49.941187+0000","last_fullsized":"2024-03-16T10:48:49.941187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941083+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:48:49.941083+0000","last_peered":"2024-03-16T10:48:49.941083+0000","last_clean":"2024-03-16T10:48:49.941083+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:48:49.941083+0000","last_undegraded":"2024-03-16T10:48:49.941083+0000","last_fullsized":"2024-03-16T10:48:49.941083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940996+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:48:49.940996+0000","last_peered":"2024-03-16T10:48:49.940996+0000","last_clean":"2024-03-16T10:48:49.940996+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:48:49.940996+0000","last_undegraded":"2024-03-16T10:48:49.940996+0000","last_fullsized":"2024-03-16T10:48:49.940996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.897623+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:48:49.897623+0000","last_peered":"2024-03-16T10:48:49.897623+0000","last_clean":"2024-03-16T10:48:49.897623+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:48:49.897623+0000","last_undegraded":"2024-03-16T10:48:49.897623+0000","last_fullsized":"2024-03-16T10:48:49.897623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940587+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:48:49.940587+0000","last_peered":"2024-03-16T10:48:49.940587+0000","last_clean":"2024-03-16T10:48:49.940587+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:48:49.940587+0000","last_undegraded":"2024-03-16T10:48:49.940587+0000","last_fullsized":"2024-03-16T10:48:49.940587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840985+0000","last_change":"2024-03-16T10:48:48.853021+0000","last_active":"2024-03-16T10:48:49.840985+0000","last_peered":"2024-03-16T10:48:49.840985+0000","last_clean":"2024-03-16T10:48:49.840985+0000","last_became_active":"2024-03-16T10:48:48.852709+0000","last_became_peered":"2024-03-16T10:48:48.852709+0000","last_unstale":"2024-03-16T10:48:49.840985+0000","last_undegraded":"2024-03-16T10:48:49.840985+0000","last_fullsized":"2024-03-16T10:48:49.840985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:08:47.120299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986572+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:48:49.986572+0000","last_peered":"2024-03-16T10:48:49.986572+0000","last_clean":"2024-03-16T10:48:49.986572+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:48:49.986572+0000","last_undegraded":"2024-03-16T10:48:49.986572+0000","last_fullsized":"2024-03-16T10:48:49.986572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940128+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:48:49.940128+0000","last_peered":"2024-03-16T10:48:49.940128+0000","last_clean":"2024-03-16T10:48:49.940128+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:48:49.940128+0000","last_undegraded":"2024-03-16T10:48:49.940128+0000","last_fullsized":"2024-03-16T10:48:49.940128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940299+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:48:49.940299+0000","last_peered":"2024-03-16T10:48:49.940299+0000","last_clean":"2024-03-16T10:48:49.940299+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:48:49.940299+0000","last_undegraded":"2024-03-16T10:48:49.940299+0000","last_fullsized":"2024-03-16T10:48:49.940299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.841218+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:48:49.841218+0000","last_peered":"2024-03-16T10:48:49.841218+0000","last_clean":"2024-03-16T10:48:49.841218+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:48:49.841218+0000","last_undegraded":"2024-03-16T10:48:49.841218+0000","last_fullsized":"2024-03-16T10:48:49.841218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986948+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:48:49.986948+0000","last_peered":"2024-03-16T10:48:49.986948+0000","last_clean":"2024-03-16T10:48:49.986948+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:48:49.986948+0000","last_undegraded":"2024-03-16T10:48:49.986948+0000","last_fullsized":"2024-03-16T10:48:49.986948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.897579+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:48:49.897579+0000","last_peered":"2024-03-16T10:48:49.897579+0000","last_clean":"2024-03-16T10:48:49.897579+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:48:49.897579+0000","last_undegraded":"2024-03-16T10:48:49.897579+0000","last_fullsized":"2024-03-16T10:48:49.897579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940827+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:48:49.940827+0000","last_peered":"2024-03-16T10:48:49.940827+0000","last_clean":"2024-03-16T10:48:49.940827+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:48:49.940827+0000","last_undegraded":"2024-03-16T10:48:49.940827+0000","last_fullsized":"2024-03-16T10:48:49.940827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940692+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:48:49.940692+0000","last_peered":"2024-03-16T10:48:49.940692+0000","last_clean":"2024-03-16T10:48:49.940692+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:48:49.940692+0000","last_undegraded":"2024-03-16T10:48:49.940692+0000","last_fullsized":"2024-03-16T10:48:49.940692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941138+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:48:49.941138+0000","last_peered":"2024-03-16T10:48:49.941138+0000","last_clean":"2024-03-16T10:48:49.941138+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:48:49.941138+0000","last_undegraded":"2024-03-16T10:48:49.941138+0000","last_fullsized":"2024-03-16T10:48:49.941138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.939967+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:48:49.939967+0000","last_peered":"2024-03-16T10:48:49.939967+0000","last_clean":"2024-03-16T10:48:49.939967+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:48:49.939967+0000","last_undegraded":"2024-03-16T10:48:49.939967+0000","last_fullsized":"2024-03-16T10:48:49.939967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941544+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:48:49.941544+0000","last_peered":"2024-03-16T10:48:49.941544+0000","last_clean":"2024-03-16T10:48:49.941544+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:48:49.941544+0000","last_undegraded":"2024-03-16T10:48:49.941544+0000","last_fullsized":"2024-03-16T10:48:49.941544+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.839850+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:48:49.839850+0000","last_peered":"2024-03-16T10:48:49.839850+0000","last_clean":"2024-03-16T10:48:49.839850+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:48:49.839850+0000","last_undegraded":"2024-03-16T10:48:49.839850+0000","last_fullsized":"2024-03-16T10:48:49.839850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840591+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:48:49.840591+0000","last_peered":"2024-03-16T10:48:49.840591+0000","last_clean":"2024-03-16T10:48:49.840591+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:48:49.840591+0000","last_undegraded":"2024-03-16T10:48:49.840591+0000","last_fullsized":"2024-03-16T10:48:49.840591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179034+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:48:55.179034+0000","last_peered":"2024-03-16T10:48:55.179034+0000","last_clean":"2024-03-16T10:48:55.179034+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:48:55.179034+0000","last_undegraded":"2024-03-16T10:48:55.179034+0000","last_fullsized":"2024-03-16T10:48:55.179034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941514+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:48:49.941514+0000","last_peered":"2024-03-16T10:48:49.941514+0000","last_clean":"2024-03-16T10:48:49.941514+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:48:49.941514+0000","last_undegraded":"2024-03-16T10:48:49.941514+0000","last_fullsized":"2024-03-16T10:48:49.941514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.033472+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:48:50.033472+0000","last_peered":"2024-03-16T10:48:50.033472+0000","last_clean":"2024-03-16T10:48:50.033472+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:48:50.033472+0000","last_undegraded":"2024-03-16T10:48:50.033472+0000","last_fullsized":"2024-03-16T10:48:50.033472+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941234+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:48:49.941234+0000","last_peered":"2024-03-16T10:48:49.941234+0000","last_clean":"2024-03-16T10:48:49.941234+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:48:49.941234+0000","last_undegraded":"2024-03-16T10:48:49.941234+0000","last_fullsized":"2024-03-16T10:48:49.941234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.199906+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:48:53.199906+0000","last_peered":"2024-03-16T10:48:53.199906+0000","last_clean":"2024-03-16T10:48:53.199906+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:48:53.199906+0000","last_undegraded":"2024-03-16T10:48:53.199906+0000","last_fullsized":"2024-03-16T10:48:53.199906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940114+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:48:49.940114+0000","last_peered":"2024-03-16T10:48:49.940114+0000","last_clean":"2024-03-16T10:48:49.940114+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:48:49.940114+0000","last_undegraded":"2024-03-16T10:48:49.940114+0000","last_fullsized":"2024-03-16T10:48:49.940114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.942068+0000","last_change":"2024-03-16T10:48:48.379450+0000","last_active":"2024-03-16T10:48:49.942068+0000","last_peered":"2024-03-16T10:48:49.942068+0000","last_clean":"2024-03-16T10:48:49.942068+0000","last_became_active":"2024-03-16T10:48:48.378566+0000","last_became_peered":"2024-03-16T10:48:48.378566+0000","last_unstale":"2024-03-16T10:48:49.942068+0000","last_undegraded":"2024-03-16T10:48:49.942068+0000","last_fullsized":"2024-03-16T10:48:49.942068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:30:39.043816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941439+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:48:49.941439+0000","last_peered":"2024-03-16T10:48:49.941439+0000","last_clean":"2024-03-16T10:48:49.941439+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:48:49.941439+0000","last_undegraded":"2024-03-16T10:48:49.941439+0000","last_fullsized":"2024-03-16T10:48:49.941439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.193437+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:48:52.193437+0000","last_peered":"2024-03-16T10:48:52.193437+0000","last_clean":"2024-03-16T10:48:52.193437+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:48:52.193437+0000","last_undegraded":"2024-03-16T10:48:52.193437+0000","last_fullsized":"2024-03-16T10:48:52.193437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940475+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:48:49.940475+0000","last_peered":"2024-03-16T10:48:49.940475+0000","last_clean":"2024-03-16T10:48:49.940475+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:48:49.940475+0000","last_undegraded":"2024-03-16T10:48:49.940475+0000","last_fullsized":"2024-03-16T10:48:49.940475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.206949+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:48:54.206949+0000","last_peered":"2024-03-16T10:48:54.206949+0000","last_clean":"2024-03-16T10:48:54.206949+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:48:54.206949+0000","last_undegraded":"2024-03-16T10:48:54.206949+0000","last_fullsized":"2024-03-16T10:48:54.206949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941532+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:48:49.941532+0000","last_peered":"2024-03-16T10:48:49.941532+0000","last_clean":"2024-03-16T10:48:49.941532+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:48:49.941532+0000","last_undegraded":"2024-03-16T10:48:49.941532+0000","last_fullsized":"2024-03-16T10:48:49.941532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.202951+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:48:53.202951+0000","last_peered":"2024-03-16T10:48:53.202951+0000","last_clean":"2024-03-16T10:48:53.202951+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:48:53.202951+0000","last_undegraded":"2024-03-16T10:48:53.202951+0000","last_fullsized":"2024-03-16T10:48:53.202951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941485+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:48:49.941485+0000","last_peered":"2024-03-16T10:48:49.941485+0000","last_clean":"2024-03-16T10:48:49.941485+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:48:49.941485+0000","last_undegraded":"2024-03-16T10:48:49.941485+0000","last_fullsized":"2024-03-16T10:48:49.941485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191080+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:48:52.191080+0000","last_peered":"2024-03-16T10:48:52.191080+0000","last_clean":"2024-03-16T10:48:52.191080+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:48:52.191080+0000","last_undegraded":"2024-03-16T10:48:52.191080+0000","last_fullsized":"2024-03-16T10:48:52.191080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.839714+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:48:49.839714+0000","last_peered":"2024-03-16T10:48:49.839714+0000","last_clean":"2024-03-16T10:48:49.839714+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:48:49.839714+0000","last_undegraded":"2024-03-16T10:48:49.839714+0000","last_fullsized":"2024-03-16T10:48:49.839714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.173174+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:48:55.173174+0000","last_peered":"2024-03-16T10:48:55.173174+0000","last_clean":"2024-03-16T10:48:55.173174+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:48:55.173174+0000","last_undegraded":"2024-03-16T10:48:55.173174+0000","last_fullsized":"2024-03-16T10:48:55.173174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940243+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:48:49.940243+0000","last_peered":"2024-03-16T10:48:49.940243+0000","last_clean":"2024-03-16T10:48:49.940243+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:48:49.940243+0000","last_undegraded":"2024-03-16T10:48:49.940243+0000","last_fullsized":"2024-03-16T10:48:49.940243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986790+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:48:49.986790+0000","last_peered":"2024-03-16T10:48:49.986790+0000","last_clean":"2024-03-16T10:48:49.986790+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:48:49.986790+0000","last_undegraded":"2024-03-16T10:48:49.986790+0000","last_fullsized":"2024-03-16T10:48:49.986790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941194+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:48:49.941194+0000","last_peered":"2024-03-16T10:48:49.941194+0000","last_clean":"2024-03-16T10:48:49.941194+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:48:49.941194+0000","last_undegraded":"2024-03-16T10:48:49.941194+0000","last_fullsized":"2024-03-16T10:48:49.941194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191557+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:48:52.191557+0000","last_peered":"2024-03-16T10:48:52.191557+0000","last_clean":"2024-03-16T10:48:52.191557+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:48:52.191557+0000","last_undegraded":"2024-03-16T10:48:52.191557+0000","last_fullsized":"2024-03-16T10:48:52.191557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940297+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:48:49.940297+0000","last_peered":"2024-03-16T10:48:49.940297+0000","last_clean":"2024-03-16T10:48:49.940297+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:48:49.940297+0000","last_undegraded":"2024-03-16T10:48:49.940297+0000","last_fullsized":"2024-03-16T10:48:49.940297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'17","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.181264+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:48:55.181264+0000","last_peered":"2024-03-16T10:48:55.181264+0000","last_clean":"2024-03-16T10:48:55.181264+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:48:55.181264+0000","last_undegraded":"2024-03-16T10:48:55.181264+0000","last_fullsized":"2024-03-16T10:48:55.181264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20895,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":22,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940977+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:48:49.940977+0000","last_peered":"2024-03-16T10:48:49.940977+0000","last_clean":"2024-03-16T10:48:49.940977+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:48:49.940977+0000","last_undegraded":"2024-03-16T10:48:49.940977+0000","last_fullsized":"2024-03-16T10:48:49.940977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179368+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:48:55.179368+0000","last_peered":"2024-03-16T10:48:55.179368+0000","last_clean":"2024-03-16T10:48:55.179368+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:48:55.179368+0000","last_undegraded":"2024-03-16T10:48:55.179368+0000","last_fullsized":"2024-03-16T10:48:55.179368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940319+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:48:49.940319+0000","last_peered":"2024-03-16T10:48:49.940319+0000","last_clean":"2024-03-16T10:48:49.940319+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:48:49.940319+0000","last_undegraded":"2024-03-16T10:48:49.940319+0000","last_fullsized":"2024-03-16T10:48:49.940319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191977+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:48:52.191977+0000","last_peered":"2024-03-16T10:48:52.191977+0000","last_clean":"2024-03-16T10:48:52.191977+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:48:52.191977+0000","last_undegraded":"2024-03-16T10:48:52.191977+0000","last_fullsized":"2024-03-16T10:48:52.191977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986933+0000","last_change":"2024-03-16T10:48:48.850996+0000","last_active":"2024-03-16T10:48:49.986933+0000","last_peered":"2024-03-16T10:48:49.986933+0000","last_clean":"2024-03-16T10:48:49.986933+0000","last_became_active":"2024-03-16T10:48:48.850670+0000","last_became_peered":"2024-03-16T10:48:48.850670+0000","last_unstale":"2024-03-16T10:48:49.986933+0000","last_undegraded":"2024-03-16T10:48:49.986933+0000","last_fullsized":"2024-03-16T10:48:49.986933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:35.917978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.173326+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:48:55.173326+0000","last_peered":"2024-03-16T10:48:55.173326+0000","last_clean":"2024-03-16T10:48:55.173326+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:48:55.173326+0000","last_undegraded":"2024-03-16T10:48:55.173326+0000","last_fullsized":"2024-03-16T10:48:55.173326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986541+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:48:49.986541+0000","last_peered":"2024-03-16T10:48:49.986541+0000","last_clean":"2024-03-16T10:48:49.986541+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:48:49.986541+0000","last_undegraded":"2024-03-16T10:48:49.986541+0000","last_fullsized":"2024-03-16T10:48:49.986541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:53.201446+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:48:53.201446+0000","last_peered":"2024-03-16T10:48:53.201446+0000","last_clean":"2024-03-16T10:48:53.201446+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:48:53.201446+0000","last_undegraded":"2024-03-16T10:48:53.201446+0000","last_fullsized":"2024-03-16T10:48:53.201446+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940926+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:48:49.940926+0000","last_peered":"2024-03-16T10:48:49.940926+0000","last_clean":"2024-03-16T10:48:49.940926+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:48:49.940926+0000","last_undegraded":"2024-03-16T10:48:49.940926+0000","last_fullsized":"2024-03-16T10:48:49.940926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940778+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:48:49.940778+0000","last_peered":"2024-03-16T10:48:49.940778+0000","last_clean":"2024-03-16T10:48:49.940778+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:48:49.940778+0000","last_undegraded":"2024-03-16T10:48:49.940778+0000","last_fullsized":"2024-03-16T10:48:49.940778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940505+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:48:49.940505+0000","last_peered":"2024-03-16T10:48:49.940505+0000","last_clean":"2024-03-16T10:48:49.940505+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:48:49.940505+0000","last_undegraded":"2024-03-16T10:48:49.940505+0000","last_fullsized":"2024-03-16T10:48:49.940505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.595232+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:48:50.595232+0000","last_peered":"2024-03-16T10:48:50.595232+0000","last_clean":"2024-03-16T10:48:50.595232+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:48:50.595232+0000","last_undegraded":"2024-03-16T10:48:50.595232+0000","last_fullsized":"2024-03-16T10:48:50.595232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:50.233954+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:48:50.233954+0000","last_peered":"2024-03-16T10:48:50.233954+0000","last_clean":"2024-03-16T10:48:50.233954+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:48:50.233954+0000","last_undegraded":"2024-03-16T10:48:50.233954+0000","last_fullsized":"2024-03-16T10:48:50.233954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986597+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:48:49.986597+0000","last_peered":"2024-03-16T10:48:49.986597+0000","last_clean":"2024-03-16T10:48:49.986597+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:48:49.986597+0000","last_undegraded":"2024-03-16T10:48:49.986597+0000","last_fullsized":"2024-03-16T10:48:49.986597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.841124+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:48:49.841124+0000","last_peered":"2024-03-16T10:48:49.841124+0000","last_clean":"2024-03-16T10:48:49.841124+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:48:49.841124+0000","last_undegraded":"2024-03-16T10:48:49.841124+0000","last_fullsized":"2024-03-16T10:48:49.841124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940634+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:48:49.940634+0000","last_peered":"2024-03-16T10:48:49.940634+0000","last_clean":"2024-03-16T10:48:49.940634+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:48:49.940634+0000","last_undegraded":"2024-03-16T10:48:49.940634+0000","last_fullsized":"2024-03-16T10:48:49.940634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.172969+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:48:55.172969+0000","last_peered":"2024-03-16T10:48:55.172969+0000","last_clean":"2024-03-16T10:48:55.172969+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:48:55.172969+0000","last_undegraded":"2024-03-16T10:48:55.172969+0000","last_fullsized":"2024-03-16T10:48:55.172969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941437+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:48:49.941437+0000","last_peered":"2024-03-16T10:48:49.941437+0000","last_clean":"2024-03-16T10:48:49.941437+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:48:49.941437+0000","last_undegraded":"2024-03-16T10:48:49.941437+0000","last_fullsized":"2024-03-16T10:48:49.941437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.171816+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:48:55.171816+0000","last_peered":"2024-03-16T10:48:55.171816+0000","last_clean":"2024-03-16T10:48:55.171816+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:48:55.171816+0000","last_undegraded":"2024-03-16T10:48:55.171816+0000","last_fullsized":"2024-03-16T10:48:55.171816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986451+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:48:49.986451+0000","last_peered":"2024-03-16T10:48:49.986451+0000","last_clean":"2024-03-16T10:48:49.986451+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:48:49.986451+0000","last_undegraded":"2024-03-16T10:48:49.986451+0000","last_fullsized":"2024-03-16T10:48:49.986451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.939939+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:48:49.939939+0000","last_peered":"2024-03-16T10:48:49.939939+0000","last_clean":"2024-03-16T10:48:49.939939+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:48:49.939939+0000","last_undegraded":"2024-03-16T10:48:49.939939+0000","last_fullsized":"2024-03-16T10:48:49.939939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986762+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:48:49.986762+0000","last_peered":"2024-03-16T10:48:49.986762+0000","last_clean":"2024-03-16T10:48:49.986762+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:48:49.986762+0000","last_undegraded":"2024-03-16T10:48:49.986762+0000","last_fullsized":"2024-03-16T10:48:49.986762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941143+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:48:49.941143+0000","last_peered":"2024-03-16T10:48:49.941143+0000","last_clean":"2024-03-16T10:48:49.941143+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:48:49.941143+0000","last_undegraded":"2024-03-16T10:48:49.941143+0000","last_fullsized":"2024-03-16T10:48:49.941143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941273+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:48:49.941273+0000","last_peered":"2024-03-16T10:48:49.941273+0000","last_clean":"2024-03-16T10:48:49.941273+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:48:49.941273+0000","last_undegraded":"2024-03-16T10:48:49.941273+0000","last_fullsized":"2024-03-16T10:48:49.941273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.208796+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:48:54.208796+0000","last_peered":"2024-03-16T10:48:54.208796+0000","last_clean":"2024-03-16T10:48:54.208796+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:48:54.208796+0000","last_undegraded":"2024-03-16T10:48:54.208796+0000","last_fullsized":"2024-03-16T10:48:54.208796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941316+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:48:49.941316+0000","last_peered":"2024-03-16T10:48:49.941316+0000","last_clean":"2024-03-16T10:48:49.941316+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:48:49.941316+0000","last_undegraded":"2024-03-16T10:48:49.941316+0000","last_fullsized":"2024-03-16T10:48:49.941316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.181152+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:48:55.181152+0000","last_peered":"2024-03-16T10:48:55.181152+0000","last_clean":"2024-03-16T10:48:55.181152+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:48:55.181152+0000","last_undegraded":"2024-03-16T10:48:55.181152+0000","last_fullsized":"2024-03-16T10:48:55.181152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941311+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:48:49.941311+0000","last_peered":"2024-03-16T10:48:49.941311+0000","last_clean":"2024-03-16T10:48:49.941311+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:48:49.941311+0000","last_undegraded":"2024-03-16T10:48:49.941311+0000","last_fullsized":"2024-03-16T10:48:49.941311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.191357+0000","last_change":"2024-03-16T10:48:48.382720+0000","last_active":"2024-03-16T10:48:52.191357+0000","last_peered":"2024-03-16T10:48:52.191357+0000","last_clean":"2024-03-16T10:48:52.191357+0000","last_became_active":"2024-03-16T10:48:48.382363+0000","last_became_peered":"2024-03-16T10:48:48.382363+0000","last_unstale":"2024-03-16T10:48:52.191357+0000","last_undegraded":"2024-03-16T10:48:52.191357+0000","last_fullsized":"2024-03-16T10:48:52.191357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:29:03.395738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940237+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:48:49.940237+0000","last_peered":"2024-03-16T10:48:49.940237+0000","last_clean":"2024-03-16T10:48:49.940237+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:48:49.940237+0000","last_undegraded":"2024-03-16T10:48:49.940237+0000","last_fullsized":"2024-03-16T10:48:49.940237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.205180+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:48:54.205180+0000","last_peered":"2024-03-16T10:48:54.205180+0000","last_clean":"2024-03-16T10:48:54.205180+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:48:54.205180+0000","last_undegraded":"2024-03-16T10:48:54.205180+0000","last_fullsized":"2024-03-16T10:48:54.205180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940146+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:48:49.940146+0000","last_peered":"2024-03-16T10:48:49.940146+0000","last_clean":"2024-03-16T10:48:49.940146+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:48:49.940146+0000","last_undegraded":"2024-03-16T10:48:49.940146+0000","last_fullsized":"2024-03-16T10:48:49.940146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:54.207143+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:48:54.207143+0000","last_peered":"2024-03-16T10:48:54.207143+0000","last_clean":"2024-03-16T10:48:54.207143+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:48:54.207143+0000","last_undegraded":"2024-03-16T10:48:54.207143+0000","last_fullsized":"2024-03-16T10:48:54.207143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941697+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:48:49.941697+0000","last_peered":"2024-03-16T10:48:49.941697+0000","last_clean":"2024-03-16T10:48:49.941697+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:48:49.941697+0000","last_undegraded":"2024-03-16T10:48:49.941697+0000","last_fullsized":"2024-03-16T10:48:49.941697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:52.190985+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:48:52.190985+0000","last_peered":"2024-03-16T10:48:52.190985+0000","last_clean":"2024-03-16T10:48:52.190985+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:48:52.190985+0000","last_undegraded":"2024-03-16T10:48:52.190985+0000","last_fullsized":"2024-03-16T10:48:52.190985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986777+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:48:49.986777+0000","last_peered":"2024-03-16T10:48:49.986777+0000","last_clean":"2024-03-16T10:48:49.986777+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:48:49.986777+0000","last_undegraded":"2024-03-16T10:48:49.986777+0000","last_fullsized":"2024-03-16T10:48:49.986777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.174621+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:48:55.174621+0000","last_peered":"2024-03-16T10:48:55.174621+0000","last_clean":"2024-03-16T10:48:55.174621+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:48:55.174621+0000","last_undegraded":"2024-03-16T10:48:55.174621+0000","last_fullsized":"2024-03-16T10:48:55.174621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986927+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:48:49.986927+0000","last_peered":"2024-03-16T10:48:49.986927+0000","last_clean":"2024-03-16T10:48:49.986927+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:48:49.986927+0000","last_undegraded":"2024-03-16T10:48:49.986927+0000","last_fullsized":"2024-03-16T10:48:49.986927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.965045+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:48:49.965045+0000","last_peered":"2024-03-16T10:48:49.965045+0000","last_clean":"2024-03-16T10:48:49.965045+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:48:49.965045+0000","last_undegraded":"2024-03-16T10:48:49.965045+0000","last_fullsized":"2024-03-16T10:48:49.965045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986883+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:48:49.986883+0000","last_peered":"2024-03-16T10:48:49.986883+0000","last_clean":"2024-03-16T10:48:49.986883+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:48:49.986883+0000","last_undegraded":"2024-03-16T10:48:49.986883+0000","last_fullsized":"2024-03-16T10:48:49.986883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:55.179902+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:48:55.179902+0000","last_peered":"2024-03-16T10:48:55.179902+0000","last_clean":"2024-03-16T10:48:55.179902+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:48:55.179902+0000","last_undegraded":"2024-03-16T10:48:55.179902+0000","last_fullsized":"2024-03-16T10:48:55.179902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.986912+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:48:49.986912+0000","last_peered":"2024-03-16T10:48:49.986912+0000","last_clean":"2024-03-16T10:48:49.986912+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:48:49.986912+0000","last_undegraded":"2024-03-16T10:48:49.986912+0000","last_fullsized":"2024-03-16T10:48:49.986912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940185+0000","last_change":"2024-03-16T10:48:48.843259+0000","last_active":"2024-03-16T10:48:49.940185+0000","last_peered":"2024-03-16T10:48:49.940185+0000","last_clean":"2024-03-16T10:48:49.940185+0000","last_became_active":"2024-03-16T10:48:48.842775+0000","last_became_peered":"2024-03-16T10:48:48.842775+0000","last_unstale":"2024-03-16T10:48:49.940185+0000","last_undegraded":"2024-03-16T10:48:49.940185+0000","last_fullsized":"2024-03-16T10:48:49.940185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:01.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840561+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:48:49.840561+0000","last_peered":"2024-03-16T10:48:49.840561+0000","last_clean":"2024-03-16T10:48:49.840561+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:48:49.840561+0000","last_undegraded":"2024-03-16T10:48:49.840561+0000","last_fullsized":"2024-03-16T10:48:49.840561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840437+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:48:49.840437+0000","last_peered":"2024-03-16T10:48:49.840437+0000","last_clean":"2024-03-16T10:48:49.840437+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:48:49.840437+0000","last_undegraded":"2024-03-16T10:48:49.840437+0000","last_fullsized":"2024-03-16T10:48:49.840437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941839+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:48:49.941839+0000","last_peered":"2024-03-16T10:48:49.941839+0000","last_clean":"2024-03-16T10:48:49.941839+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:48:49.941839+0000","last_undegraded":"2024-03-16T10:48:49.941839+0000","last_fullsized":"2024-03-16T10:48:49.941839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940856+0000","last_change":"2024-03-16T10:48:48.850402+0000","last_active":"2024-03-16T10:48:49.940856+0000","last_peered":"2024-03-16T10:48:49.940856+0000","last_clean":"2024-03-16T10:48:49.940856+0000","last_became_active":"2024-03-16T10:48:48.850077+0000","last_became_peered":"2024-03-16T10:48:48.850077+0000","last_unstale":"2024-03-16T10:48:49.940856+0000","last_undegraded":"2024-03-16T10:48:49.940856+0000","last_fullsized":"2024-03-16T10:48:49.940856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:37.517229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941070+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:48:49.941070+0000","last_peered":"2024-03-16T10:48:49.941070+0000","last_clean":"2024-03-16T10:48:49.941070+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:48:49.941070+0000","last_undegraded":"2024-03-16T10:48:49.941070+0000","last_fullsized":"2024-03-16T10:48:49.941070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.840780+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:48:49.840780+0000","last_peered":"2024-03-16T10:48:49.840780+0000","last_clean":"2024-03-16T10:48:49.840780+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:48:49.840780+0000","last_undegraded":"2024-03-16T10:48:49.840780+0000","last_fullsized":"2024-03-16T10:48:49.840780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.941156+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:48:49.941156+0000","last_peered":"2024-03-16T10:48:49.941156+0000","last_clean":"2024-03-16T10:48:49.941156+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:48:49.941156+0000","last_undegraded":"2024-03-16T10:48:49.941156+0000","last_fullsized":"2024-03-16T10:48:49.941156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940579+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:48:49.940579+0000","last_peered":"2024-03-16T10:48:49.940579+0000","last_clean":"2024-03-16T10:48:49.940579+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:48:49.940579+0000","last_undegraded":"2024-03-16T10:48:49.940579+0000","last_fullsized":"2024-03-16T10:48:49.940579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940209+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:48:49.940209+0000","last_peered":"2024-03-16T10:48:49.940209+0000","last_clean":"2024-03-16T10:48:49.940209+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:48:49.940209+0000","last_undegraded":"2024-03-16T10:48:49.940209+0000","last_fullsized":"2024-03-16T10:48:49.940209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940058+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:48:49.940058+0000","last_peered":"2024-03-16T10:48:49.940058+0000","last_clean":"2024-03-16T10:48:49.940058+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:48:49.940058+0000","last_undegraded":"2024-03-16T10:48:49.940058+0000","last_fullsized":"2024-03-16T10:48:49.940058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940715+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:48:49.940715+0000","last_peered":"2024-03-16T10:48:49.940715+0000","last_clean":"2024-03-16T10:48:49.940715+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:48:49.940715+0000","last_undegraded":"2024-03-16T10:48:49.940715+0000","last_fullsized":"2024-03-16T10:48:49.940715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-16T10:48:49.940577+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:48:49.940577+0000","last_peered":"2024-03-16T10:48:49.940577+0000","last_clean":"2024-03-16T10:48:49.940577+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:48:49.940577+0000","last_undegraded":"2024-03-16T10:48:49.940577+0000","last_fullsized":"2024-03-16T10:48:49.940577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26839,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":21,"num_read_kb":37,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":73960,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383692,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1019904,"data_stored":1039194,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":439553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":1029471,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":439360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":440133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":925696,"data_stored":439215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":461779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":438929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757293,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":1003520,"data_stored":1031518,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":40556,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:48:57.569 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T10:48:57.570 INFO:tasks.cephadm:Setting up client nodes... 2024-03-16T10:48:57.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-16T10:48:57.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:57 smithi111 ceph-mon[36315]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:57 smithi111 ceph-mon[36315]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:48:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4187903122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/188491925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:48:57.849 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:48:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:58 smithi017 ceph-mon[32078]: pgmap v293: 97 pgs: 97 active+clean; 603 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-03-16T10:48:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:58 smithi017 ceph-mon[32078]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:58 smithi174 ceph-mon[36202]: pgmap v293: 97 pgs: 97 active+clean; 603 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-03-16T10:48:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:58 smithi174 ceph-mon[36202]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:58 smithi111 ceph-mon[36315]: pgmap v293: 97 pgs: 97 active+clean; 603 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-03-16T10:48:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:58 smithi111 ceph-mon[36315]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:59.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:48:59 smithi017 ceph-mon[32078]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 -- 172.21.15.17:0/2941506662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103520 msgr2=0x7f8b0c103980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/2941506662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103520 0x7f8b0c103980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8af40099c0 tx=0x7f8af4009cd0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 -- 172.21.15.17:0/2941506662 shutdown_connections 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/2941506662 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c10a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/2941506662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/2941506662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103520 0x7f8b0c103980 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 -- 172.21.15.17:0/2941506662 >> 172.21.15.17:0/2941506662 conn(0x7f8b0c0fd8e0 msgr2=0x7f8b0c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 -- 172.21.15.17:0/2941506662 shutdown_connections 2024-03-16T10:48:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.541+0000 7f8b11cb7700 1 -- 172.21.15.17:0/2941506662 wait complete. 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 Processor -- start 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 -- start start 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103520 0x7f8b0c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c10df10 con 0x7f8b0c103ec0 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c10dd90 con 0x7f8b0c103520 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b11cb7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c10e090 con 0x7f8b0c102320 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b0bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b0bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48852/0 (socket says 172.21.15.17:48852) 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b0bfff700 1 -- 172.21.15.17:0/3319397190 learned_addr learned my addr 172.21.15.17:0/3319397190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b0b7fe700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.542+0000 7f8b02ffd700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103520 0x7f8b0c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 -- 172.21.15.17:0/3319397190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 msgr2=0x7f8b0c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 -- 172.21.15.17:0/3319397190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103520 msgr2=0x7f8b0c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103520 0x7f8b0c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 -- 172.21.15.17:0/3319397190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c1a0090 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0b7fe700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b0bfff700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400ef60 tx=0x7f8b0400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b040092e0 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b04004bb0 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c1a0320 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04004280 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.543+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c1a0810 con 0x7f8b0c103ec0 2024-03-16T10:48:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.544+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0c0507e0 con 0x7f8b0c103ec0 2024-03-16T10:48:59.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.545+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f8b0401b030 con 0x7f8b0c103ec0 2024-03-16T10:48:59.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.546+0000 7f8b097fa700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 0x7f8af80a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:48:59.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.546+0000 7f8b0b7fe700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 0x7f8af80a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:48:59.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.546+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f8b040ce4b0 con 0x7f8b0c103ec0 2024-03-16T10:48:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.546+0000 7f8b0b7fe700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 0x7f8af80a4e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c103380 tx=0x7f8afc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:48:59.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.553+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8b04022020 con 0x7f8b0c103ec0 2024-03-16T10:48:59.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:48:59 smithi174 ceph-mon[36202]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:48:59 smithi111 ceph-mon[36315]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:48:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.843+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8b0c02db70 con 0x7f8b0c103ec0 2024-03-16T10:48:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.845+0000 7f8b097fa700 1 -- 172.21.15.17:0/3319397190 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f8b04010040 con 0x7f8b0c103ec0 2024-03-16T10:48:59.846 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-03-16T10:48:59.846 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAbefVlZ9ZaMhAAYW6rErtlSetOJV/pg/NzDA== 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 msgr2=0x7f8af80a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 0x7f8af80a4e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c103380 tx=0x7f8afc009260 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 msgr2=0x7f8b0c19f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400ef60 tx=0x7f8b0400ef90 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 shutdown_connections 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8af80a29d0 0x7f8af80a4e90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b0c103ec0 0x7f8b0c19f9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b0c102320 0x7f8b0c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 --2- 172.21.15.17:0/3319397190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b0c103520 0x7f8b0c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 >> 172.21.15.17:0/3319397190 conn(0x7f8b0c0fd8e0 msgr2=0x7f8b0c106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 shutdown_connections 2024-03-16T10:48:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:48:59.848+0000 7f8b11cb7700 1 -- 172.21.15.17:0/3319397190 wait complete. 2024-03-16T10:49:00.161 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:59 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:48:59.736+0000 7f38f806b700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-16T10:49:00.161 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:48:59 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:48:59.736+0000 7f38f806b700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-16T10:49:00.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:00 smithi017 ceph-mon[32078]: pgmap v294: 97 pgs: 97 active+clean; 604 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.9 KiB/s wr, 22 op/s 2024-03-16T10:49:00.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:00 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T10:49:00.488 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:00 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T10:49:00.514 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:49:00.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-16T10:49:00.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-16T10:49:00.557 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-16T10:49:00.557 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-16T10:49:00.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph mgr dump --format=json 2024-03-16T10:49:00.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:00 smithi174 ceph-mon[36202]: pgmap v294: 97 pgs: 97 active+clean; 604 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.9 KiB/s wr, 22 op/s 2024-03-16T10:49:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:00 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T10:49:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:00 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T10:49:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:00 smithi111 ceph-mon[36315]: pgmap v294: 97 pgs: 97 active+clean; 604 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.9 KiB/s wr, 22 op/s 2024-03-16T10:49:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:00 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-16T10:49:00.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:00 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3319397190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-16T10:49:00.846 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:02.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:02 smithi017 ceph-mon[32078]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 27 op/s 2024-03-16T10:49:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:02 smithi174 ceph-mon[36202]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 27 op/s 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 -- 172.21.15.17:0/469988233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478101b70 msgr2=0x7f447810e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 --2- 172.21.15.17:0/469988233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478101b70 0x7f447810e050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f447000b0a0 tx=0x7f447000b3b0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 -- 172.21.15.17:0/469988233 shutdown_connections 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 --2- 172.21.15.17:0/469988233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478107210 0x7f44781075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 --2- 172.21.15.17:0/469988233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478101b70 0x7f447810e050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 --2- 172.21.15.17:0/469988233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f4478101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 -- 172.21.15.17:0/469988233 >> 172.21.15.17:0/469988233 conn(0x7f4478078100 msgr2=0x7f4478078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 -- 172.21.15.17:0/469988233 shutdown_connections 2024-03-16T10:49:02.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.603+0000 7f447f8d0700 1 -- 172.21.15.17:0/469988233 wait complete. 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 Processor -- start 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 -- start start 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478101b70 0x7f447819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4478111460 con 0x7f4478107210 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f44781112e0 con 0x7f4478101b70 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447f8d0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f44781115e0 con 0x7f44781011d0 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447de6d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447d66c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447ce6b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478101b70 0x7f447819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447d66c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:41492/0 (socket says 172.21.15.17:41492) 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447d66c700 1 -- 172.21.15.17:0/1385910447 learned_addr learned my addr 172.21.15.17:0/1385910447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.604+0000 7f447de6d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48878/0 (socket says 172.21.15.17:48878) 2024-03-16T10:49:02.607 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:02 smithi111 ceph-mon[36315]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 10 KiB/s wr, 27 op/s 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 -- 172.21.15.17:0/1385910447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 msgr2=0x7f447819e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 -- 172.21.15.17:0/1385910447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478101b70 msgr2=0x7f447819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478101b70 0x7f447819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 -- 172.21.15.17:0/1385910447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478198f80 con 0x7f4478107210 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447d66c700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447de6d700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f447000b0a0 tx=0x7f4470004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470021070 con 0x7f4478107210 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4478199210 con 0x7f4478107210 2024-03-16T10:49:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4470007b80 con 0x7f4478107210 2024-03-16T10:49:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700052a0 con 0x7f4478107210 2024-03-16T10:49:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.605+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781a5480 con 0x7f4478107210 2024-03-16T10:49:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.606+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44781028c0 con 0x7f4478107210 2024-03-16T10:49:02.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.608+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f4470024070 con 0x7f4478107210 2024-03-16T10:49:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.609+0000 7f446e7fc700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 0x7f44640a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.609+0000 7f447d66c700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 0x7f44640a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.609+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f447000f020 con 0x7f4478107210 2024-03-16T10:49:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.609+0000 7f447d66c700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 0x7f44640a4de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44680103d0 tx=0x7f4468007480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:02.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.613+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f447002b020 con 0x7f4478107210 2024-03-16T10:49:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.876+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f44781a56b0 con 0x7f4478107210 2024-03-16T10:49:02.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.881+0000 7f446e7fc700 1 -- 172.21.15.17:0/1385910447 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+262660 (secure 0 0 0) 0x7f447009d510 con 0x7f4478107210 2024-03-16T10:49:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:49:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 msgr2=0x7f44640a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 0x7f44640a4de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44680103d0 tx=0x7f4468007480 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 msgr2=0x7f44781987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f447000b0a0 tx=0x7f4470004d00 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 shutdown_connections 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44640a2920 0x7f44640a4de0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4478107210 0x7f44781987a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44781011d0 0x7f447819e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 --2- 172.21.15.17:0/1385910447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4478101b70 0x7f447819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.884+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 >> 172.21.15.17:0/1385910447 conn(0x7f4478078100 msgr2=0x7f4478100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.885+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 shutdown_connections 2024-03-16T10:49:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:02.885+0000 7f447f8d0700 1 -- 172.21.15.17:0/1385910447 wait complete. 2024-03-16T10:49:03.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:03 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1385910447' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T10:49:03.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:03 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1385910447' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T10:49:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3813203524},{"type":"v1","addr":"172.21.15.17:6801","nonce":3813203524}]},"active_addr":"172.21.15.17:6801/3813203524","active_change":"2024-03-16T10:41:40.392146+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":765455589}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1996049653}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2536654620}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":4080420466}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3658372031}]}]} 2024-03-16T10:49:03.638 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-16T10:49:03.638 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-16T10:49:03.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T10:49:03.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:03 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1385910447' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-16T10:49:03.885 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:04.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:04 smithi017 ceph-mon[32078]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2024-03-16T10:49:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:04 smithi174 ceph-mon[36202]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2024-03-16T10:49:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:04 smithi111 ceph-mon[36315]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2024-03-16T10:49:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 -- 172.21.15.17:0/3471272559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 msgr2=0x7fbf2c101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 --2- 172.21.15.17:0/3471272559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c101630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf200098f0 tx=0x7fbf20009c00 comp rx=0 tx=0).stop 2024-03-16T10:49:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 -- 172.21.15.17:0/3471272559 shutdown_connections 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 --2- 172.21.15.17:0/3471272559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c10e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 --2- 172.21.15.17:0/3471272559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 --2- 172.21.15.17:0/3471272559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c101630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 -- 172.21.15.17:0/3471272559 >> 172.21.15.17:0/3471272559 conn(0x7fbf2c078100 msgr2=0x7fbf2c078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 -- 172.21.15.17:0/3471272559 shutdown_connections 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.631+0000 7fbf3232b700 1 -- 172.21.15.17:0/3471272559 wait complete. 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 Processor -- start 2024-03-16T10:49:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 -- start start 2024-03-16T10:49:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c111470 con 0x7fbf2c101b70 2024-03-16T10:49:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1112f0 con 0x7fbf2c1011d0 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf3232b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1115f0 con 0x7fbf2c107210 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf2b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf2bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:58376/0 (socket says 172.21.15.17:58376) 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.632+0000 7fbf2bfff700 1 -- 172.21.15.17:0/650061820 learned_addr learned my addr 172.21.15.17:0/650061820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf308c8700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 -- 172.21.15.17:0/650061820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 msgr2=0x7fbf2c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 -- 172.21.15.17:0/650061820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 msgr2=0x7fbf2c1977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 -- 172.21.15.17:0/650061820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1a7030 con 0x7fbf2c101b70 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2bfff700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf308c8700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf2b7fe700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c197d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c010 tx=0x7fbf2000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20005180 con 0x7fbf2c101b70 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c1a72c0 con 0x7fbf2c101b70 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf2000b560 con 0x7fbf2c101b70 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003a80 con 0x7fbf2c101b70 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.633+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c1a7770 con 0x7fbf2c101b70 2024-03-16T10:49:05.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.634+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c068f90 con 0x7fbf2c101b70 2024-03-16T10:49:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.635+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fbf2000b710 con 0x7fbf2c101b70 2024-03-16T10:49:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.636+0000 7fbf297fa700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 0x7fbf140a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.636+0000 7fbf2bfff700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 0x7fbf140a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.636+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fbf200cf8c0 con 0x7fbf2c101b70 2024-03-16T10:49:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.636+0000 7fbf2bfff700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 0x7fbf140a4de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011550 tx=0x7fbf1c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:05.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.640+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbf20013030 con 0x7fbf2c101b70 2024-03-16T10:49:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.845+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf2c02db70 con 0x7fbf2c101b70 2024-03-16T10:49:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.846+0000 7fbf297fa700 1 -- 172.21.15.17:0/650061820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22231 (secure 0 0 0) 0x7fbf200816f0 con 0x7fbf2c101b70 2024-03-16T10:49:05.847 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:49:05.847 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:48:49.836693+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:49:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.848+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 msgr2=0x7fbf140a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 0x7fbf140a4de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011550 tx=0x7fbf1c009260 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 msgr2=0x7fbf2c197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c197d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c010 tx=0x7fbf2000fa70 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 shutdown_connections 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbf140a2920 0x7fbf140a4de0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf2c1011d0 0x7fbf2c1977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf2c107210 0x7fbf2c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 --2- 172.21.15.17:0/650061820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf2c101b70 0x7fbf2c197d00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 >> 172.21.15.17:0/650061820 conn(0x7fbf2c078100 msgr2=0x7fbf2c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 shutdown_connections 2024-03-16T10:49:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:05.849+0000 7fbf3232b700 1 -- 172.21.15.17:0/650061820 wait complete. 2024-03-16T10:49:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:06 smithi174 ceph-mon[36202]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 24 op/s 2024-03-16T10:49:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:06 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/650061820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:06.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:06 smithi017 ceph-mon[32078]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 24 op/s 2024-03-16T10:49:06.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:06 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/650061820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:06.627 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-16T10:49:06.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-16T10:49:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:06 smithi111 ceph-mon[36315]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 24 op/s 2024-03-16T10:49:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:06 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/650061820' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:06.908 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:08.442 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:08 smithi017 ceph-mon[32078]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 26 op/s 2024-03-16T10:49:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:08 smithi174 ceph-mon[36202]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 26 op/s 2024-03-16T10:49:08.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:08 smithi111 ceph-mon[36315]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 26 op/s 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 -- 172.21.15.17:0/787455364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 msgr2=0x7f9f20108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 --2- 172.21.15.17:0/787455364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20108780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009990 tx=0x7f9f10009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 -- 172.21.15.17:0/787455364 shutdown_connections 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 --2- 172.21.15.17:0/787455364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2010f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 --2- 172.21.15.17:0/787455364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20108780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 --2- 172.21.15.17:0/787455364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f201027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.661+0000 7f9f27334700 1 -- 172.21.15.17:0/787455364 >> 172.21.15.17:0/787455364 conn(0x7f9f20079420 msgr2=0x7f9f20079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:08.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- 172.21.15.17:0/787455364 shutdown_connections 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- 172.21.15.17:0/787455364 wait complete. 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 Processor -- start 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- start start 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f2019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f201125e0 con 0x7f9f201083a0 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20112460 con 0x7f9f20102350 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.662+0000 7f9f27334700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20112760 con 0x7f9f20102d10 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f258d1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f250d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f2019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:41536/0 (socket says 172.21.15.17:41536) 2024-03-16T10:49:08.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 -- 172.21.15.17:0/1589545746 learned_addr learned my addr 172.21.15.17:0/1589545746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f250d0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f2019e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:58384/0 (socket says 172.21.15.17:58384) 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 -- 172.21.15.17:0/1589545746 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 msgr2=0x7f9f2019e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f2019e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 -- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 msgr2=0x7f9f20198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 -- 172.21.15.17:0/1589545746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f20199000 con 0x7f9f20102d10 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f248cf700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e9a0 tx=0x7f9f1400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400ca10 con 0x7f9f20102d10 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f201992f0 con 0x7f9f20102d10 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f1400cbb0 con 0x7f9f20102d10 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14018680 con 0x7f9f20102d10 2024-03-16T10:49:08.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.663+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f201a5500 con 0x7f9f20102d10 2024-03-16T10:49:08.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.664+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2010a860 con 0x7f9f20102d10 2024-03-16T10:49:08.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.665+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f9f14047a90 con 0x7f9f20102d10 2024-03-16T10:49:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.666+0000 7f9f1e7fc700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 0x7f9f080a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.666+0000 7f9f250d0700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 0x7f9f080a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.666+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f9f140ced30 con 0x7f9f20102d10 2024-03-16T10:49:08.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.666+0000 7f9f250d0700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 0x7f9f080a4de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b2e0 tx=0x7f9f10005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:08.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.669+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f9f1409bd60 con 0x7f9f20102d10 2024-03-16T10:49:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.933+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f20199d50 con 0x7f9f20102d10 2024-03-16T10:49:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.935+0000 7f9f1e7fc700 1 -- 172.21.15.17:0/1589545746 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22231 (secure 0 0 0) 0x7f9f1409b660 con 0x7f9f20102d10 2024-03-16T10:49:08.936 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:49:08.936 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:48:49.836693+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:49:08.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 msgr2=0x7f9f080a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 0x7f9f080a4de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b2e0 tx=0x7f9f10005960 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 msgr2=0x7f9f2019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400e9a0 tx=0x7f9f1400ecb0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 shutdown_connections 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f080a2920 0x7f9f080a4de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f20102350 0x7f9f2019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f201083a0 0x7f9f20198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 --2- 172.21.15.17:0/1589545746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f20102d10 0x7f9f2019ebe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 >> 172.21.15.17:0/1589545746 conn(0x7f9f20079420 msgr2=0x7f9f20100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 shutdown_connections 2024-03-16T10:49:08.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:08.937+0000 7f9f27334700 1 -- 172.21.15.17:0/1589545746 wait complete. 2024-03-16T10:49:09.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:09 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1589545746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:09.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:09 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1589545746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:09.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:09 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1589545746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:49:09.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-16T10:49:09.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-16T10:49:09.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-16T10:49:09.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-16T10:49:09.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-16T10:49:09.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-16T10:49:09.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-16T10:49:09.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-16T10:49:09.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-16T10:49:09.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-16T10:49:09.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-16T10:49:09.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-16T10:49:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:10.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:10 smithi017 ceph-mon[32078]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-03-16T10:49:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:10 smithi174 ceph-mon[36202]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-03-16T10:49:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:10 smithi111 ceph-mon[36315]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-03-16T10:49:10.693 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:12 smithi174 ceph-mon[36202]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-03-16T10:49:12.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:12 smithi017 ceph-mon[32078]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-03-16T10:49:12.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:12 smithi111 ceph-mon[36315]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 -- 172.21.15.17:0/845000708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b810ecd0 msgr2=0x7f51b81110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/845000708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b810ecd0 0x7f51b81110c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f51b000b0a0 tx=0x7f51b000b3b0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 -- 172.21.15.17:0/845000708 shutdown_connections 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/845000708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b810ecd0 0x7f51b81110c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/845000708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 0x7f51b80748e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/845000708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b8074e20 0x7f51b810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 -- 172.21.15.17:0/845000708 >> 172.21.15.17:0/845000708 conn(0x7f51b8079400 msgr2=0x7f51b8079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 -- 172.21.15.17:0/845000708 shutdown_connections 2024-03-16T10:49:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.514+0000 7f51bcbc7700 1 -- 172.21.15.17:0/845000708 wait complete. 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 Processor -- start 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 -- start start 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 0x7f51b81a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 0x7f51b81a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 0x7f51b819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8114790 con 0x7f51b8074e20 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8114610 con 0x7f51b810ecd0 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51bcbc7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8114910 con 0x7f51b8074500 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 0x7f51b81a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.515+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 0x7f51b819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 0x7f51b81a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59856/0 (socket says 172.21.15.17:59856) 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 0x7f51b819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:60284/0 (socket says 172.21.15.17:60284) 2024-03-16T10:49:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 -- 172.21.15.17:0/1481203784 learned_addr learned my addr 172.21.15.17:0/1481203784 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b659c700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 0x7f51b81a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 -- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 msgr2=0x7f51b81a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 0x7f51b81a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 -- 172.21.15.17:0/1481203784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 msgr2=0x7f51b819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 0x7f51b819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b819b1d0 con 0x7f51b8074e20 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b6d9d700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51b810ecd0 0x7f51b819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b659c700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51b8074500 0x7f51b81a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51b5d9b700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 0x7f51b81a0df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e9a0 tx=0x7f51a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a800ca10 con 0x7f51b8074e20 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b819b4c0 con 0x7f51b8074e20 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a800cbb0 con 0x7f51b8074e20 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8018680 con 0x7f51b8074e20 2024-03-16T10:49:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.516+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b81a7780 con 0x7f51b8074e20 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.517+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51b8100f10 con 0x7f51b8074e20 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.518+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f51a8010430 con 0x7f51b8074e20 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51af7fe700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51a40a2a20 0x7f51a40a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51b659c700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51a40a2a20 0x7f51a40a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f51a80cf4a0 con 0x7f51b8074e20 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51af7fe700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] conn(0x7f51a40ac200 0x7f51a40ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51a801bec0 con 0x7f51a40ac200 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f51a80cf890 con 0x7f51b8074e20 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.519+0000 7f51b659c700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51a40a2a20 0x7f51a40a4ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51b819bbb0 tx=0x7f51a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.520+0000 7f51b6d9d700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] conn(0x7f51a40ac200 0x7f51a40ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.520+0000 7f51b6d9d700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] conn(0x7f51a40ac200 0x7f51a40ae620 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.521+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== osd.2 v2:172.21.15.174:6800/1400344146 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51a801bec0 con 0x7f51a40ac200 2024-03-16T10:49:13.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.537+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 --> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51b8075ba0 con 0x7f51a40ac200 2024-03-16T10:49:13.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.537+0000 7f51af7fe700 1 -- 172.21.15.17:0/1481203784 <== osd.2 v2:172.21.15.174:6800/1400344146 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f51b8075ba0 con 0x7f51a40ac200 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] conn(0x7f51a40ac200 msgr2=0x7f51a40ae620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] conn(0x7f51a40ac200 0x7f51a40ae620 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51a40a2a20 msgr2=0x7f51a40a4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51a40a2a20 0x7f51a40a4ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51b819bbb0 tx=0x7f51a0009260 comp rx=0 tx=0).stop 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 msgr2=0x7f51b81a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 --2- 172.21.15.17:0/1481203784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b8074e20 0x7f51b81a0df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e9a0 tx=0x7f51a800ecb0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51b6d9d700 1 -- 172.21.15.17:0/1481203784 reap_dead start 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 shutdown_connections 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 >> 172.21.15.17:0/1481203784 conn(0x7f51b8079400 msgr2=0x7f51b8100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 shutdown_connections 2024-03-16T10:49:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.538+0000 7f51bcbc7700 1 -- 172.21.15.17:0/1481203784 wait complete. 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- 172.21.15.17:0/125692980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c104ec0 msgr2=0x7f7e1c111380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/125692980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c111380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400b0d0 tx=0x7f7e1400b3e0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- 172.21.15.17:0/125692980 shutdown_connections 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/125692980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c10a5b0 0x7f7e1c10a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/125692980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c111380 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/125692980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104500 0x7f7e1c104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- 172.21.15.17:0/125692980 >> 172.21.15.17:0/125692980 conn(0x7f7e1c0fffd0 msgr2=0x7f7e1c1023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- 172.21.15.17:0/125692980 shutdown_connections 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- 172.21.15.17:0/125692980 wait complete. 2024-03-16T10:49:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 Processor -- start 2024-03-16T10:49:13.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.728+0000 7f7e21c0e700 1 -- start start 2024-03-16T10:49:13.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c104500 0x7f7e1c1a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c10a5b0 0x7f7e1c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c114840 con 0x7f7e1c10a5b0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c1146c0 con 0x7f7e1c104500 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e21c0e700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c1149c0 con 0x7f7e1c104ec0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c104500 0x7f7e1c1a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c10a5b0 0x7f7e1c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c104500 0x7f7e1c1a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:60306/0 (socket says 172.21.15.17:60306) 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1b7fe700 1 -- 172.21.15.17:0/3924922968 learned_addr learned my addr 172.21.15.17:0/3924922968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 -- 172.21.15.17:0/3924922968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c104500 msgr2=0x7f7e1c1a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c104500 0x7f7e1c1a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 -- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c10a5b0 msgr2=0x7f7e1c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c10a5b0 0x7f7e1c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c19b160 con 0x7f7e1c104ec0 2024-03-16T10:49:13.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1bfff700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e1c10a5b0 0x7f7e1c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.729+0000 7f7e1affd700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c1a0d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9f0 tx=0x7f7e1000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000cb70 con 0x7f7e1c104ec0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e1000ee90 con 0x7f7e1c104ec0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c19b450 con 0x7f7e1c104ec0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10003dc0 con 0x7f7e1c104ec0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c1a76c0 con 0x7f7e1c104ec0 2024-03-16T10:49:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.730+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e1c062a60 con 0x7f7e1c104ec0 2024-03-16T10:49:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f7e10003f60 con 0x7f7e1c104ec0 2024-03-16T10:49:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e040a29a0 0x7f7e040a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e1b7fe700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e040a29a0 0x7f7e040a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f7e100cee70 con 0x7f7e1c104ec0 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] conn(0x7f7e040ac180 0x7f7e040ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e10012ec0 con 0x7f7e040ac180 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.732+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f7e100cf220 con 0x7f7e1c104ec0 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.733+0000 7f7e1bfff700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] conn(0x7f7e040ac180 0x7f7e040ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.733+0000 7f7e1b7fe700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e040a29a0 0x7f7e040a4e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c109550 tx=0x7f7e0c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.733+0000 7f7e1bfff700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] conn(0x7f7e040ac180 0x7f7e040ae5a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.734+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== osd.3 v2:172.21.15.17:6810/3346256775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e10012ec0 con 0x7f7e040ac180 2024-03-16T10:49:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 --> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e1c062e60 con 0x7f7e040ac180 2024-03-16T10:49:13.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e18ff9700 1 -- 172.21.15.17:0/3924922968 <== osd.3 v2:172.21.15.17:6810/3346256775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7e1c062e60 con 0x7f7e040ac180 2024-03-16T10:49:13.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] conn(0x7f7e040ac180 msgr2=0x7f7e040ae5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] conn(0x7f7e040ac180 0x7f7e040ae5a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e040a29a0 msgr2=0x7f7e040a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e040a29a0 0x7f7e040a4e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c109550 tx=0x7f7e0c009260 comp rx=0 tx=0).stop 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104ec0 msgr2=0x7f7e1c1a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e21c0e700 1 --2- 172.21.15.17:0/3924922968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e1c104ec0 0x7f7e1c1a0d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9f0 tx=0x7f7e1000ed00 comp rx=0 tx=0).stop 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.754+0000 7f7e1bfff700 1 -- 172.21.15.17:0/3924922968 reap_dead start 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.755+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 shutdown_connections 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.755+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 >> 172.21.15.17:0/3924922968 conn(0x7f7e1c0fffd0 msgr2=0x7f7e1c101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.755+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 shutdown_connections 2024-03-16T10:49:13.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:13.755+0000 7f7e21c0e700 1 -- 172.21.15.17:0/3924922968 wait complete. 2024-03-16T10:49:14.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:14 smithi174 ceph-mon[36202]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-03-16T10:49:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:14 smithi017 ceph-mon[32078]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-03-16T10:49:14.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:14 smithi111 ceph-mon[36315]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-03-16T10:49:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:107374182459 2024-03-16T10:49:14.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-16T10:49:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:14.720 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:15.173 INFO:teuthology.orchestra.run.smithi017.stdout:77309411393 2024-03-16T10:49:15.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-16T10:49:16.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:16 smithi017 ceph-mon[32078]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T10:49:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:16 smithi174 ceph-mon[36202]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T10:49:16.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:16 smithi111 ceph-mon[36315]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-16T10:49:18.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:18 smithi017 ceph-mon[32078]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:49:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:18 smithi174 ceph-mon[36202]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:49:18.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:18 smithi111 ceph-mon[36315]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:49:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:20 smithi174 ceph-mon[36202]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:20 smithi017 ceph-mon[32078]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:20.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:20 smithi111 ceph-mon[36315]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 -- 172.21.15.17:0/2766160614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc44101b70 msgr2=0x7fbc4410e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/2766160614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc44101b70 0x7fbc4410e050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00b0a0 tx=0x7fbc3c00b3b0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 -- 172.21.15.17:0/2766160614 shutdown_connections 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/2766160614 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc44107210 0x7fbc441075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/2766160614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc44101b70 0x7fbc4410e050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/2766160614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc441011d0 0x7fbc44101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 -- 172.21.15.17:0/2766160614 >> 172.21.15.17:0/2766160614 conn(0x7fbc44078100 msgr2=0x7fbc44078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 -- 172.21.15.17:0/2766160614 shutdown_connections 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.376+0000 7fbc49a2c700 1 -- 172.21.15.17:0/2766160614 wait complete. 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 Processor -- start 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 -- start start 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 0x7fbc44102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc44101b70 0x7fbc441033c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc44107210 0x7fbc44103900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44111490 con 0x7fbc441011d0 2024-03-16T10:49:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44111310 con 0x7fbc44107210 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.377+0000 7fbc49a2c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44111610 con 0x7fbc44101b70 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 0x7fbc44102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 0x7fbc44102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51228/0 (socket says 172.21.15.17:51228) 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc427fc700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc44101b70 0x7fbc441033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 -- 172.21.15.17:0/3116104027 learned_addr learned my addr 172.21.15.17:0/3116104027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc437fe700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc44107210 0x7fbc44103900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 -- 172.21.15.17:0/3116104027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc44101b70 msgr2=0x7fbc441033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc44101b70 0x7fbc441033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 -- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc44107210 msgr2=0x7fbc44103900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc44107210 0x7fbc44103900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc441a6fc0 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc427fc700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc44101b70 0x7fbc441033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc42ffd700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 0x7fbc44102e80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9a0 tx=0x7fbc3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400ca10 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc441a72b0 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc3400cbb0 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34018680 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.378+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441a7840 con 0x7fbc441011d0 2024-03-16T10:49:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.379+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc44105290 con 0x7fbc441011d0 2024-03-16T10:49:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.380+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fbc34010430 con 0x7fbc441011d0 2024-03-16T10:49:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc48a2a700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc2c0a2920 0x7fbc2c0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc427fc700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc2c0a2920 0x7fbc2c0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fbc340cf3f0 con 0x7fbc441011d0 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc48a2a700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] conn(0x7fbc2c0ac100 0x7fbc2c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc3401bec0 con 0x7fbc2c0ac100 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.381+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fbc340cf8d0 con 0x7fbc441011d0 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.382+0000 7fbc427fc700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc2c0a2920 0x7fbc2c0a4de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbc44078700 tx=0x7fbc38009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.382+0000 7fbc437fe700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] conn(0x7fbc2c0ac100 0x7fbc2c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.382+0000 7fbc437fe700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] conn(0x7fbc2c0ac100 0x7fbc2c0ae520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.383+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== osd.7 v2:172.21.15.111:6816/2270288694 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc3401bec0 con 0x7fbc2c0ac100 2024-03-16T10:49:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.399+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 --> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc441028c0 con 0x7fbc2c0ac100 2024-03-16T10:49:22.401 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:22 smithi017 ceph-mon[32078]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc48a2a700 1 -- 172.21.15.17:0/3116104027 <== osd.7 v2:172.21.15.111:6816/2270288694 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc441028c0 con 0x7fbc2c0ac100 2024-03-16T10:49:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] conn(0x7fbc2c0ac100 msgr2=0x7fbc2c0ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] conn(0x7fbc2c0ac100 0x7fbc2c0ae520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc2c0a2920 msgr2=0x7fbc2c0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc2c0a2920 0x7fbc2c0a4de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbc44078700 tx=0x7fbc38009260 comp rx=0 tx=0).stop 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 msgr2=0x7fbc44102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 --2- 172.21.15.17:0/3116104027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc441011d0 0x7fbc44102e80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9a0 tx=0x7fbc3400ecb0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc437fe700 1 -- 172.21.15.17:0/3116104027 reap_dead start 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 shutdown_connections 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 >> 172.21.15.17:0/3116104027 conn(0x7fbc44078100 msgr2=0x7fbc44100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 shutdown_connections 2024-03-16T10:49:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.400+0000 7fbc49a2c700 1 -- 172.21.15.17:0/3116104027 wait complete. 2024-03-16T10:49:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:22 smithi174 ceph-mon[36202]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 -- 172.21.15.17:0/2174875044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 msgr2=0x7f2210108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 --2- 172.21.15.17:0/2174875044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 0x7f2210108700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f220c0098f0 tx=0x7f220c009c00 comp rx=0 tx=0).stop 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 -- 172.21.15.17:0/2174875044 shutdown_connections 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 --2- 172.21.15.17:0/2174875044 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 0x7f2210108700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 --2- 172.21.15.17:0/2174875044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221006a920 0x7f221010f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 --2- 172.21.15.17:0/2174875044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2210069f80 0x7f221006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 -- 172.21.15.17:0/2174875044 >> 172.21.15.17:0/2174875044 conn(0x7f2210078100 msgr2=0x7f2210078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:22.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 -- 172.21.15.17:0/2174875044 shutdown_connections 2024-03-16T10:49:22.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.587+0000 7f22178ca700 1 -- 172.21.15.17:0/2174875044 wait complete. 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.588+0000 7f22178ca700 1 Processor -- start 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.588+0000 7f22178ca700 1 -- start start 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.588+0000 7f22178ca700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 0x7f221019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.588+0000 7f22178ca700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f221006a920 0x7f221019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.588+0000 7f22178ca700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 0x7f22101988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22178ca700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2210112560 con 0x7f2210069f80 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22178ca700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f22101123e0 con 0x7f2210108320 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22178ca700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f22101126e0 con 0x7f221006a920 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 0x7f221019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 0x7f221019e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51238/0 (socket says 172.21.15.17:51238) 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 -- 172.21.15.17:0/3960703788 learned_addr learned my addr 172.21.15.17:0/3960703788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215e67700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 0x7f22101988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2214e65700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f221006a920 0x7f221019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 -- 172.21.15.17:0/3960703788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f221006a920 msgr2=0x7f221019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f221006a920 0x7f221019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 -- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 msgr2=0x7f22101988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2210108320 0x7f22101988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2210199040 con 0x7f2210069f80 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f2215666700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 0x7f221019e6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f220c009230 tx=0x7f220c00ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c005490 con 0x7f2210069f80 2024-03-16T10:49:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22101992d0 con 0x7f2210069f80 2024-03-16T10:49:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22101a55a0 con 0x7f2210069f80 2024-03-16T10:49:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f220c005630 con 0x7f2210069f80 2024-03-16T10:49:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.589+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c003de0 con 0x7f2210069f80 2024-03-16T10:49:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.590+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2210062a60 con 0x7f2210069f80 2024-03-16T10:49:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.592+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f220c00b560 con 0x7f2210069f80 2024-03-16T10:49:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f22067fc700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21fc0a2920 0x7f21fc0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f220c0cf5d0 con 0x7f2210069f80 2024-03-16T10:49:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f2214e65700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21fc0a2920 0x7f21fc0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f22067fc700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] conn(0x7f21fc0ac100 0x7f21fc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f220c00bde0 con 0x7f21fc0ac100 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f220c0cf980 con 0x7f2210069f80 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f2215e67700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] conn(0x7f21fc0ac100 0x7f21fc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.593+0000 7f2214e65700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21fc0a2920 0x7f21fc0a4de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2200009680 tx=0x7f2200009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.594+0000 7f2215e67700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] conn(0x7f21fc0ac100 0x7f21fc0ae520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.595+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== osd.10 v2:172.21.15.111:6824/3614977703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f220c00bde0 con 0x7f21fc0ac100 2024-03-16T10:49:22.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.611+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 --> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2210062e60 con 0x7f21fc0ac100 2024-03-16T10:49:22.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.611+0000 7f22067fc700 1 -- 172.21.15.17:0/3960703788 <== osd.10 v2:172.21.15.111:6824/3614977703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2210062e60 con 0x7f21fc0ac100 2024-03-16T10:49:22.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] conn(0x7f21fc0ac100 msgr2=0x7f21fc0ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] conn(0x7f21fc0ac100 0x7f21fc0ae520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:22.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21fc0a2920 msgr2=0x7f21fc0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21fc0a2920 0x7f21fc0a4de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2200009680 tx=0x7f2200009260 comp rx=0 tx=0).stop 2024-03-16T10:49:22.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 msgr2=0x7f221019e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 --2- 172.21.15.17:0/3960703788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210069f80 0x7f221019e6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f220c009230 tx=0x7f220c00ff20 comp rx=0 tx=0).stop 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f2215e67700 1 -- 172.21.15.17:0/3960703788 reap_dead start 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 shutdown_connections 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 >> 172.21.15.17:0/3960703788 conn(0x7f2210078100 msgr2=0x7f22100fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 shutdown_connections 2024-03-16T10:49:22.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:22.612+0000 7f22178ca700 1 -- 172.21.15.17:0/3960703788 wait complete. 2024-03-16T10:49:22.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:22 smithi111 ceph-mon[36315]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:23.055 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:23.056 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:24.250 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:24 smithi017 ceph-mon[32078]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:24 smithi174 ceph-mon[36202]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:24 smithi111 ceph-mon[36315]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-16T10:49:25.949 INFO:teuthology.orchestra.run.smithi017.stdout:309237645337 2024-03-16T10:49:25.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 -- 172.21.15.17:0/2772134299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4954101e10 msgr2=0x7f4954105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 --2- 172.21.15.17:0/2772134299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4954101e10 0x7f4954105dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4948009920 tx=0x7f4948009c30 comp rx=0 tx=0).stop 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 -- 172.21.15.17:0/2772134299 shutdown_connections 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 --2- 172.21.15.17:0/2772134299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49541064b0 0x7f495410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 --2- 172.21.15.17:0/2772134299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 0x7f4954101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 --2- 172.21.15.17:0/2772134299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4954101e10 0x7f4954105dd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 -- 172.21.15.17:0/2772134299 >> 172.21.15.17:0/2772134299 conn(0x7f4954077220 msgr2=0x7f4954077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 -- 172.21.15.17:0/2772134299 shutdown_connections 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.174+0000 7f4959bbb700 1 -- 172.21.15.17:0/2772134299 wait complete. 2024-03-16T10:49:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.175+0000 7f4959bbb700 1 Processor -- start 2024-03-16T10:49:26.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.175+0000 7f4959bbb700 1 -- start start 2024-03-16T10:49:26.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 0x7f495419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 0x7f495419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49541064b0 0x7f4954197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4954111470 con 0x7f49541064b0 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f49541112f0 con 0x7f4954101e10 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4959bbb700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f49541115f0 con 0x7f4954101460 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 0x7f495419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 0x7f495419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:56984/0 (socket says 172.21.15.17:56984) 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 -- 172.21.15.17:0/3909587293 learned_addr learned my addr 172.21.15.17:0/3909587293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4953fff700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49541064b0 0x7f4954197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:26.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f49537fe700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 0x7f495419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 -- 172.21.15.17:0/3909587293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 msgr2=0x7f495419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 0x7f495419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 -- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49541064b0 msgr2=0x7f4954197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49541064b0 0x7f4954197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f4952ffd700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4954198010 con 0x7f4954101e10 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.176+0000 7f49537fe700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4954101460 0x7f495419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4952ffd700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 0x7f495419dbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4948009230 tx=0x7f4948005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49480055d0 con 0x7f4954101e10 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49541982a0 con 0x7f4954101e10 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f494800ba40 con 0x7f4954101e10 2024-03-16T10:49:26.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495406a810 con 0x7f4954101e10 2024-03-16T10:49:26.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.177+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494801e4d0 con 0x7f4954101e10 2024-03-16T10:49:26.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.178+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4940001030 con 0x7f4954101e10 2024-03-16T10:49:26.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.180+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f4948003680 con 0x7f4954101e10 2024-03-16T10:49:26.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4950ff9700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f493c0a29a0 0x7f493c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:26.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f49480d3d10 con 0x7f4954101e10 2024-03-16T10:49:26.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f49537fe700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f493c0a29a0 0x7f493c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:26.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4950ff9700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] conn(0x7f493c0ac180 0x7f493c0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:26.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f493c0aec50 con 0x7f493c0ac180 2024-03-16T10:49:26.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f49480d41f0 con 0x7f4954101e10 2024-03-16T10:49:26.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f4953fff700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] conn(0x7f493c0ac180 0x7f493c0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:26.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.181+0000 7f49537fe700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f493c0a29a0 0x7f493c0a4e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f494400bc10 tx=0x7f494400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:26.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.182+0000 7f4953fff700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] conn(0x7f493c0ac180 0x7f493c0ae5a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:26.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.183+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== osd.4 v2:172.21.15.111:6808/4209940365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f493c0aec50 con 0x7f493c0ac180 2024-03-16T10:49:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.202+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 --> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4940002e60 con 0x7f493c0ac180 2024-03-16T10:49:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.202+0000 7f4950ff9700 1 -- 172.21.15.17:0/3909587293 <== osd.4 v2:172.21.15.111:6808/4209940365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4940002e60 con 0x7f493c0ac180 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] conn(0x7f493c0ac180 msgr2=0x7f493c0ae5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] conn(0x7f493c0ac180 0x7f493c0ae5a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f493c0a29a0 msgr2=0x7f493c0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f493c0a29a0 0x7f493c0a4e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f494400bc10 tx=0x7f494400b5f0 comp rx=0 tx=0).stop 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 msgr2=0x7f495419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 --2- 172.21.15.17:0/3909587293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4954101e10 0x7f495419dbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4948009230 tx=0x7f4948005970 comp rx=0 tx=0).stop 2024-03-16T10:49:26.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4953fff700 1 -- 172.21.15.17:0/3909587293 reap_dead start 2024-03-16T10:49:26.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 shutdown_connections 2024-03-16T10:49:26.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 >> 172.21.15.17:0/3909587293 conn(0x7f4954077220 msgr2=0x7f49540ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:26.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 shutdown_connections 2024-03-16T10:49:26.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:26.203+0000 7f4959bbb700 1 -- 172.21.15.17:0/3909587293 wait complete. 2024-03-16T10:49:26.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:26 smithi017 ceph-mon[32078]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:26 smithi174 ceph-mon[36202]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:26 smithi111 ceph-mon[36315]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:49:26.977 INFO:teuthology.orchestra.run.smithi017.stdout:219043332137 2024-03-16T10:49:26.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-16T10:49:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:141733920826 2024-03-16T10:49:27.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-16T10:49:28.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 -- 172.21.15.17:0/2732840790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202006a920 msgr2=0x7f202010f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 --2- 172.21.15.17:0/2732840790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202006a920 0x7f202010f160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f201800b0d0 tx=0x7f201800b3e0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 -- 172.21.15.17:0/2732840790 shutdown_connections 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 --2- 172.21.15.17:0/2732840790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2020108320 0x7f2020108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 --2- 172.21.15.17:0/2732840790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202006a920 0x7f202010f160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 --2- 172.21.15.17:0/2732840790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2020069f80 0x7f202006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 -- 172.21.15.17:0/2732840790 >> 172.21.15.17:0/2732840790 conn(0x7f2020078100 msgr2=0x7f2020078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 -- 172.21.15.17:0/2732840790 shutdown_connections 2024-03-16T10:49:28.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.088+0000 7f20260b3700 1 -- 172.21.15.17:0/2732840790 wait complete. 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 Processor -- start 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 -- start start 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2020069f80 0x7f20201a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 0x7f20201a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2020108320 0x7f202019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20201125a0 con 0x7f2020108320 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2020112420 con 0x7f202006a920 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f20260b3700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2020112720 con 0x7f2020069f80 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f201effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 0x7f20201a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f201ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2020108320 0x7f202019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f201effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 0x7f20201a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:56996/0 (socket says 172.21.15.17:56996) 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f201effd700 1 -- 172.21.15.17:0/695828943 learned_addr learned my addr 172.21.15.17:0/695828943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.089+0000 7f201f7fe700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2020069f80 0x7f20201a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 -- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2020069f80 msgr2=0x7f20201a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2020069f80 0x7f20201a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 -- 172.21.15.17:0/695828943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 msgr2=0x7f20201a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 0x7f20201a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202019b160 con 0x7f2020108320 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201effd700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f202006a920 0x7f20201a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201ffff700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2020108320 0x7f202019aa00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f201800b770 tx=0x7f2018007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018021020 con 0x7f2020108320 2024-03-16T10:49:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202019b3f0 con 0x7f2020108320 2024-03-16T10:49:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201a7710 con 0x7f2020108320 2024-03-16T10:49:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2018004c50 con 0x7f2020108320 2024-03-16T10:49:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.090+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20180052b0 con 0x7f2020108320 2024-03-16T10:49:28.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.091+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f202010df10 con 0x7f2020108320 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.092+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f2018024020 con 0x7f2020108320 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201cff9700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20080a2920 0x7f20080a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201f7fe700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20080a2920 0x7f20080a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f201800f020 con 0x7f2020108320 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201cff9700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] conn(0x7f20080ac100 0x7f20080ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20080aebd0 con 0x7f20080ac100 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.093+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f20180d0500 con 0x7f2020108320 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.094+0000 7f201effd700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] conn(0x7f20080ac100 0x7f20080ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.094+0000 7f201f7fe700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20080a2920 0x7f20080a4de0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f202019bb40 tx=0x7f2010009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.094+0000 7f201effd700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] conn(0x7f20080ac100 0x7f20080ae520 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.095+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== osd.8 v2:172.21.15.174:6816/3711712891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20080aebd0 con 0x7f20080ac100 2024-03-16T10:49:28.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.118+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 --> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20201039d0 con 0x7f20080ac100 2024-03-16T10:49:28.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.118+0000 7f201cff9700 1 -- 172.21.15.17:0/695828943 <== osd.8 v2:172.21.15.174:6816/3711712891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f20201039d0 con 0x7f20080ac100 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] conn(0x7f20080ac100 msgr2=0x7f20080ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] conn(0x7f20080ac100 0x7f20080ae520 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20080a2920 msgr2=0x7f20080a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20080a2920 0x7f20080a4de0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f202019bb40 tx=0x7f2010009260 comp rx=0 tx=0).stop 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2020108320 msgr2=0x7f202019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 --2- 172.21.15.17:0/695828943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2020108320 0x7f202019aa00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f201800b770 tx=0x7f2018007a20 comp rx=0 tx=0).stop 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f201ffff700 1 -- 172.21.15.17:0/695828943 reap_dead start 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 shutdown_connections 2024-03-16T10:49:28.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 >> 172.21.15.17:0/695828943 conn(0x7f2020078100 msgr2=0x7f202010d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 shutdown_connections 2024-03-16T10:49:28.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:28.119+0000 7f20260b3700 1 -- 172.21.15.17:0/695828943 wait complete. 2024-03-16T10:49:28.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:28 smithi174 ceph-mon[36202]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-03-16T10:49:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:28 smithi017 ceph-mon[32078]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-03-16T10:49:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:28 smithi111 ceph-mon[36315]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 596 B/s wr, 12 op/s 2024-03-16T10:49:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 -- 172.21.15.17:0/2086322079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 msgr2=0x7fed9c105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 --2- 172.21.15.17:0/2086322079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 0x7fed9c105dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009920 tx=0x7fed8c009c30 comp rx=0 tx=0).stop 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 -- 172.21.15.17:0/2086322079 shutdown_connections 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 --2- 172.21.15.17:0/2086322079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 --2- 172.21.15.17:0/2086322079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed9c1064b0 0x7fed9c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 --2- 172.21.15.17:0/2086322079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 0x7fed9c105dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.717+0000 7feda17a2700 1 -- 172.21.15.17:0/2086322079 >> 172.21.15.17:0/2086322079 conn(0x7fed9c077220 msgr2=0x7fed9c077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.718+0000 7feda17a2700 1 -- 172.21.15.17:0/2086322079 shutdown_connections 2024-03-16T10:49:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.718+0000 7feda17a2700 1 -- 172.21.15.17:0/2086322079 wait complete. 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.718+0000 7feda17a2700 1 Processor -- start 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 -- start start 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 0x7fed9c1033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed9c1064b0 0x7fed9c1038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c1114c0 con 0x7fed9c1064b0 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c111340 con 0x7fed9c101460 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7feda17a2700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c111640 con 0x7fed9c101e10 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38490/0 (socket says 172.21.15.17:38490) 2024-03-16T10:49:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 -- 172.21.15.17:0/3967989679 learned_addr learned my addr 172.21.15.17:0/3967989679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9b7fe700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed9c1064b0 0x7fed9c1038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 -- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 msgr2=0x7fed9c1033b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed9c101e10 0x7fed9c1033b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 -- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed9c1064b0 msgr2=0x7fed9c1038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed9c1064b0 0x7fed9c1038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.719+0000 7fed9affd700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c1a70b0 con 0x7fed9c101460 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7fed9affd700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c102e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed9000d980 tx=0x7fed9000dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90016070 con 0x7fed9c101460 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed9000de60 con 0x7fed9c101460 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c1a73a0 con 0x7fed9c101460 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9000f3c0 con 0x7fed9c101460 2024-03-16T10:49:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.720+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c1a7930 con 0x7fed9c101460 2024-03-16T10:49:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.721+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed9c0629e0 con 0x7fed9c101460 2024-03-16T10:49:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.722+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fed90019070 con 0x7fed9c101460 2024-03-16T10:49:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed83fff700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed840a29a0 0x7fed840a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed9a7fc700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed840a29a0 0x7fed840a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fed900cebc0 con 0x7fed9c101460 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed83fff700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] conn(0x7fed840ac180 0x7fed840ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed90023e50 con 0x7fed840ac180 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fed900cef70 con 0x7fed9c101460 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed9b7fe700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] conn(0x7fed840ac180 0x7fed840ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.723+0000 7fed9a7fc700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed840a29a0 0x7fed840a4e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009680 tx=0x7fed8c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.724+0000 7fed9b7fe700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] conn(0x7fed840ac180 0x7fed840ae5a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.724+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== osd.5 v2:172.21.15.174:6808/3274269229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed90023e50 con 0x7fed840ac180 2024-03-16T10:49:29.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.741+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 --> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed9c062e10 con 0x7fed840ac180 2024-03-16T10:49:29.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.741+0000 7fed83fff700 1 -- 172.21.15.17:0/3967989679 <== osd.5 v2:172.21.15.174:6808/3274269229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed9c062e10 con 0x7fed840ac180 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] conn(0x7fed840ac180 msgr2=0x7fed840ae5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] conn(0x7fed840ac180 0x7fed840ae5a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed840a29a0 msgr2=0x7fed840a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed840a29a0 0x7fed840a4e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009680 tx=0x7fed8c005da0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 msgr2=0x7fed9c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 --2- 172.21.15.17:0/3967989679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed9c101460 0x7fed9c102e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed9000d980 tx=0x7fed9000dd40 comp rx=0 tx=0).stop 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7fed9b7fe700 1 -- 172.21.15.17:0/3967989679 reap_dead start 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 shutdown_connections 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 >> 172.21.15.17:0/3967989679 conn(0x7fed9c077220 msgr2=0x7fed9c06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 shutdown_connections 2024-03-16T10:49:29.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.742+0000 7feda17a2700 1 -- 172.21.15.17:0/3967989679 wait complete. 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 -- 172.21.15.17:0/1338076083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104108320 msgr2=0x7fc104108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 --2- 172.21.15.17:0/1338076083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104108320 0x7fc104108700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc10000fb90 tx=0x7fc10000fea0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 -- 172.21.15.17:0/1338076083 shutdown_connections 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 --2- 172.21.15.17:0/1338076083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc10406a920 0x7fc10410f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 --2- 172.21.15.17:0/1338076083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104108320 0x7fc104108700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 --2- 172.21.15.17:0/1338076083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc104069f80 0x7fc10406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 -- 172.21.15.17:0/1338076083 >> 172.21.15.17:0/1338076083 conn(0x7fc104078100 msgr2=0x7fc104078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 -- 172.21.15.17:0/1338076083 shutdown_connections 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.597+0000 7fc10b448700 1 -- 172.21.15.17:0/1338076083 wait complete. 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 Processor -- start 2024-03-16T10:49:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 -- start start 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104069f80 0x7fc10419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10406a920 0x7fc10419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 0x7fc104196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041104a0 con 0x7fc10406a920 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc104110320 con 0x7fc104108320 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc10b448700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc104110620 con 0x7fc104069f80 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc1099e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 0x7fc104196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc1099e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 0x7fc104196680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38472/0 (socket says 172.21.15.17:38472) 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc1099e5700 1 -- 172.21.15.17:0/2182348315 learned_addr learned my addr 172.21.15.17:0/2182348315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.598+0000 7fc1091e4700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104069f80 0x7fc10419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 -- 172.21.15.17:0/2182348315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104069f80 msgr2=0x7fc10419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104069f80 0x7fc10419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 -- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10406a920 msgr2=0x7fc10419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1089e3700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10406a920 0x7fc10419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10406a920 0x7fc10419caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc104196f60 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1091e4700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc104069f80 0x7fc10419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1089e3700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10406a920 0x7fc10419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc1099e5700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 0x7fc104196680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.599+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00dbd0 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.600+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc104197250 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.600+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0fc00dd70 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.600+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0133f0 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.600+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1041a3530 con 0x7fc104108320 2024-03-16T10:49:29.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.600+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc104062a20 con 0x7fc104108320 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.602+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fc0fc01a020 con 0x7fc104108320 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.602+0000 7fc0fa7fc700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0f00a2920 0x7fc0f00a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.602+0000 7fc1091e4700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0f00a2920 0x7fc0f00a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.602+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc0fc0cebc0 con 0x7fc104108320 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc0fa7fc700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] conn(0x7fc0f00ac100 0x7fc0f00ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0fc01fe50 con 0x7fc0f00ac100 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc0fc0cef70 con 0x7fc104108320 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc1089e3700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] conn(0x7fc0f00ac100 0x7fc0f00ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc1091e4700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0f00a2920 0x7fc0f00a4de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc10000f8f0 tx=0x7fc100024040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.603+0000 7fc1089e3700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] conn(0x7fc0f00ac100 0x7fc0f00ae520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.604+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== osd.9 v2:172.21.15.17:6826/4098561509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0fc01fe50 con 0x7fc0f00ac100 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.624+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 --> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc104062ea0 con 0x7fc0f00ac100 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.624+0000 7fc0fa7fc700 1 -- 172.21.15.17:0/2182348315 <== osd.9 v2:172.21.15.17:6826/4098561509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc104062ea0 con 0x7fc0f00ac100 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] conn(0x7fc0f00ac100 msgr2=0x7fc0f00ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] conn(0x7fc0f00ac100 0x7fc0f00ae520 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0f00a2920 msgr2=0x7fc0f00a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0f00a2920 0x7fc0f00a4de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc10000f8f0 tx=0x7fc100024040 comp rx=0 tx=0).stop 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 msgr2=0x7fc104196680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 --2- 172.21.15.17:0/2182348315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc104108320 0x7fc104196680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc00d3b0 comp rx=0 tx=0).stop 2024-03-16T10:49:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc1099e5700 1 -- 172.21.15.17:0/2182348315 reap_dead start 2024-03-16T10:49:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 shutdown_connections 2024-03-16T10:49:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 >> 172.21.15.17:0/2182348315 conn(0x7fc104078100 msgr2=0x7fc104100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 shutdown_connections 2024-03-16T10:49:29.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:29.625+0000 7fc10b448700 1 -- 172.21.15.17:0/2182348315 wait complete. 2024-03-16T10:49:30.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:30 smithi017 ceph-mon[32078]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:30.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:30 smithi174 ceph-mon[36202]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:30.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:30 smithi111 ceph-mon[36315]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:31.620 INFO:teuthology.orchestra.run.smithi017.stdout:287762808864 2024-03-16T10:49:31.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-16T10:49:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 -- 172.21.15.17:0/4260542011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 msgr2=0x7fc9bc101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 --2- 172.21.15.17:0/4260542011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc101840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80099c0 tx=0x7fc9b8009cd0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 -- 172.21.15.17:0/4260542011 shutdown_connections 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 --2- 172.21.15.17:0/4260542011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9bc1064b0 0x7fc9bc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 --2- 172.21.15.17:0/4260542011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc101840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 --2- 172.21.15.17:0/4260542011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 0x7fc9bc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 -- 172.21.15.17:0/4260542011 >> 172.21.15.17:0/4260542011 conn(0x7fc9bc077220 msgr2=0x7fc9bc077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 -- 172.21.15.17:0/4260542011 shutdown_connections 2024-03-16T10:49:32.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.084+0000 7fc9c35df700 1 -- 172.21.15.17:0/4260542011 wait complete. 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.085+0000 7fc9c35df700 1 Processor -- start 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.085+0000 7fc9c35df700 1 -- start start 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 0x7fc9bc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9bc1064b0 0x7fc9bc197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc111490 con 0x7fc9bc101460 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc111310 con 0x7fc9bc1064b0 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c35df700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc111610 con 0x7fc9bc101e10 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:32.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33824/0 (socket says 172.21.15.17:33824) 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 -- 172.21.15.17:0/3463998434 learned_addr learned my addr 172.21.15.17:0/3463998434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c0b7a700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 0x7fc9bc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c1b7c700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9bc1064b0 0x7fc9bc197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 -- 172.21.15.17:0/3463998434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 msgr2=0x7fc9bc19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 0x7fc9bc19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 -- 172.21.15.17:0/3463998434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9bc1064b0 msgr2=0x7fc9bc197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9bc1064b0 0x7fc9bc197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc198070 con 0x7fc9bc101460 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c0b7a700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc9bc101e10 0x7fc9bc19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.086+0000 7fc9c137b700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc19d670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006010 tx=0x7fc9b8003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8003680 con 0x7fc9bc101460 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b8003e50 con 0x7fc9bc101460 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc198300 con 0x7fc9bc101460 2024-03-16T10:49:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800f460 con 0x7fc9bc101460 2024-03-16T10:49:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc06a810 con 0x7fc9bc101460 2024-03-16T10:49:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.087+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9bc06adc0 con 0x7fc9bc101460 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.089+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fc9b8019600 con 0x7fc9bc101460 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.089+0000 7fc9b27fc700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc9a80a2ac0 0x7fc9a80a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.089+0000 7fc9c0b7a700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc9a80a2ac0 0x7fc9a80a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc9b80d1ce0 con 0x7fc9bc101460 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9b27fc700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] conn(0x7fc9a80ac2a0 0x7fc9a80ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9b8015ec0 con 0x7fc9a80ac2a0 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc9b80d21c0 con 0x7fc9bc101460 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9c1b7c700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] conn(0x7fc9a80ac2a0 0x7fc9a80ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9c0b7a700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc9a80a2ac0 0x7fc9a80a4f80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009680 tx=0x7fc9ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.090+0000 7fc9c1b7c700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] conn(0x7fc9a80ac2a0 0x7fc9a80ae6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:32.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.091+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== osd.6 v2:172.21.15.17:6818/3796077791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9b8015ec0 con 0x7fc9a80ac2a0 2024-03-16T10:49:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 --> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9bc06b240 con 0x7fc9a80ac2a0 2024-03-16T10:49:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9b27fc700 1 -- 172.21.15.17:0/3463998434 <== osd.6 v2:172.21.15.17:6818/3796077791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc9bc06b240 con 0x7fc9a80ac2a0 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] conn(0x7fc9a80ac2a0 msgr2=0x7fc9a80ae6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] conn(0x7fc9a80ac2a0 0x7fc9a80ae6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc9a80a2ac0 msgr2=0x7fc9a80a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc9a80a2ac0 0x7fc9a80a4f80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009680 tx=0x7fc9ac009260 comp rx=0 tx=0).stop 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 msgr2=0x7fc9bc19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c35df700 1 --2- 172.21.15.17:0/3463998434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc101460 0x7fc9bc19d670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006010 tx=0x7fc9b8003a90 comp rx=0 tx=0).stop 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.116+0000 7fc9c1b7c700 1 -- 172.21.15.17:0/3463998434 reap_dead start 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.117+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 shutdown_connections 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.117+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 >> 172.21.15.17:0/3463998434 conn(0x7fc9bc077220 msgr2=0x7fc9bc100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.117+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 shutdown_connections 2024-03-16T10:49:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.117+0000 7fc9c35df700 1 -- 172.21.15.17:0/3463998434 wait complete. 2024-03-16T10:49:32.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:32 smithi017 ceph-mon[32078]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:32.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:32 smithi174 ceph-mon[36202]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:32 smithi111 ceph-mon[36315]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:33.260 INFO:teuthology.orchestra.run.smithi017.stdout:197568495665 2024-03-16T10:49:33.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-16T10:49:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:33.976 INFO:teuthology.orchestra.run.smithi017.stdout:253403070501 2024-03-16T10:49:33.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-16T10:49:34.418 INFO:teuthology.orchestra.run.smithi017.stdout:163208757300 2024-03-16T10:49:34.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-16T10:49:34.509 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:34 smithi017 ceph-mon[32078]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:34.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:34 smithi174 ceph-mon[36202]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:34.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:34 smithi111 ceph-mon[36315]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:49:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 -- 172.21.15.17:0/3079561386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 msgr2=0x7f52ec101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 --2- 172.21.15.17:0/3079561386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec101630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009990 tx=0x7f52d8009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 -- 172.21.15.17:0/3079561386 shutdown_connections 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 --2- 172.21.15.17:0/3079561386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52ec107210 0x7f52ec1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 --2- 172.21.15.17:0/3079561386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec101b70 0x7f52ec10e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 --2- 172.21.15.17:0/3079561386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec101630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 -- 172.21.15.17:0/3079561386 >> 172.21.15.17:0/3079561386 conn(0x7f52ec078100 msgr2=0x7f52ec078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 -- 172.21.15.17:0/3079561386 shutdown_connections 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.992+0000 7f52f30ce700 1 -- 172.21.15.17:0/3079561386 wait complete. 2024-03-16T10:49:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 Processor -- start 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 -- start start 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52ec101b70 0x7f52ec19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec107210 0x7f52ec1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111490 con 0x7f52ec1011d0 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111310 con 0x7f52ec101b70 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f30ce700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111610 con 0x7f52ec107210 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33846/0 (socket says 172.21.15.17:33846) 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 -- 172.21.15.17:0/473840604 learned_addr learned my addr 172.21.15.17:0/473840604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52ebfff700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52ec101b70 0x7f52ec19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f166b700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec107210 0x7f52ec1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 -- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec107210 msgr2=0x7f52ec1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec107210 0x7f52ec1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 -- 172.21.15.17:0/473840604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52ec101b70 msgr2=0x7f52ec19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.993+0000 7f52f0e6a700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52ec101b70 0x7f52ec19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52f0e6a700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec197f90 con 0x7f52ec1011d0 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52f0e6a700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec19d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52e000e9a0 tx=0x7f52e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e000ca10 con 0x7f52ec1011d0 2024-03-16T10:49:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec198280 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52e000cbb0 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0018680 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.994+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a4490 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.995+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52ec0629e0 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f52e0010430 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52dc0a2920 0x7f52dc0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52ebfff700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52dc0a2920 0x7f52dc0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f52e00cf3f0 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] conn(0x7f52dc0ac100 0x7f52dc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52e001bec0 con 0x7f52dc0ac100 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.997+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f52e00cf8d0 con 0x7f52ec1011d0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.998+0000 7f52f166b700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] conn(0x7f52dc0ac100 0x7f52dc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.998+0000 7f52ebfff700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52dc0a2920 0x7f52dc0a4de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52d800b2e0 tx=0x7f52d8005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.998+0000 7f52f166b700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] conn(0x7f52dc0ac100 0x7f52dc0ae520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:32.999+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== osd.11 v2:172.21.15.174:6824/850467808 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52e001bec0 con 0x7f52dc0ac100 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.015+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 --> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52ec062e60 con 0x7f52dc0ac100 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.015+0000 7f52e9ffb700 1 -- 172.21.15.17:0/473840604 <== osd.11 v2:172.21.15.174:6824/850467808 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f52ec062e60 con 0x7f52dc0ac100 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] conn(0x7f52dc0ac100 msgr2=0x7f52dc0ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] conn(0x7f52dc0ac100 0x7f52dc0ae520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52dc0a2920 msgr2=0x7f52dc0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52dc0a2920 0x7f52dc0a4de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52d800b2e0 tx=0x7f52d8005960 comp rx=0 tx=0).stop 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 msgr2=0x7f52ec19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 --2- 172.21.15.17:0/473840604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec1011d0 0x7f52ec19d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52e000e9a0 tx=0x7f52e000ecb0 comp rx=0 tx=0).stop 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f166b700 1 -- 172.21.15.17:0/473840604 reap_dead start 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 shutdown_connections 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 >> 172.21.15.17:0/473840604 conn(0x7f52ec078100 msgr2=0x7f52ec100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 shutdown_connections 2024-03-16T10:49:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:33.016+0000 7f52f30ce700 1 -- 172.21.15.17:0/473840604 wait complete. 2024-03-16T10:49:35.268 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:35.703 INFO:teuthology.orchestra.run.smithi017.stdout:343597383701 2024-03-16T10:49:35.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.213+0000 7fab1475b700 1 -- 172.21.15.17:0/1451847073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c1008c0 msgr2=0x7fab0c100d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.213+0000 7fab1475b700 1 --2- 172.21.15.17:0/1451847073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c1008c0 0x7fab0c100d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faafc009990 tx=0x7faafc009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 -- 172.21.15.17:0/1451847073 shutdown_connections 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 --2- 172.21.15.17:0/1451847073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab0c101280 0x7fab0c10f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 --2- 172.21.15.17:0/1451847073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c107340 0x7fab0c107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 --2- 172.21.15.17:0/1451847073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c1008c0 0x7fab0c100d40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 -- 172.21.15.17:0/1451847073 >> 172.21.15.17:0/1451847073 conn(0x7fab0c0777d0 msgr2=0x7fab0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 -- 172.21.15.17:0/1451847073 shutdown_connections 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 -- 172.21.15.17:0/1451847073 wait complete. 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 Processor -- start 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.214+0000 7fab1475b700 1 -- start start 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 0x7fab0c101aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c101280 0x7fab0c101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab0c107340 0x7fab0c102520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c112770 con 0x7fab0c101280 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1125f0 con 0x7fab0c107340 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab1475b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c1128f0 con 0x7fab0c1008c0 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 0x7fab0c101aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 0x7fab0c101aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:43404/0 (socket says 172.21.15.17:43404) 2024-03-16T10:49:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab11cf6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c101280 0x7fab0c101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 -- 172.21.15.17:0/1848704862 learned_addr learned my addr 172.21.15.17:0/1848704862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab12cf8700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab0c107340 0x7fab0c102520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 -- 172.21.15.17:0/1848704862 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab0c107340 msgr2=0x7fab0c102520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab0c107340 0x7fab0c102520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 -- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c101280 msgr2=0x7fab0c101fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c101280 0x7fab0c101fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c1a7130 con 0x7fab0c1008c0 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab11cf6700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab0c101280 0x7fab0c101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.215+0000 7fab124f7700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 0x7fab0c101aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e9c0 tx=0x7fab0800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.216+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0800cbd0 con 0x7fab0c1008c0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.216+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c1a7420 con 0x7fab0c1008c0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.216+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0800ee60 con 0x7fab0c1008c0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.217+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08005630 con 0x7fab0c1008c0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.217+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c1a7960 con 0x7fab0c1008c0 2024-03-16T10:49:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.217+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab0c0629e0 con 0x7fab0c1008c0 2024-03-16T10:49:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.219+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fab08004750 con 0x7fab0c1008c0 2024-03-16T10:49:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.219+0000 7fab037fe700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faaf80a2920 0x7faaf80a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab11cf6700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faaf80a2920 0x7faaf80a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fab080cec60 con 0x7fab0c1008c0 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab037fe700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] conn(0x7faaf80ac100 0x7faaf80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab0800ae50 con 0x7faaf80ac100 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fab080d13b0 con 0x7fab0c1008c0 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab12cf8700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] conn(0x7faaf80ac100 0x7faaf80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.220+0000 7fab11cf6700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faaf80a2920 0x7faaf80a4de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ffea0 tx=0x7faafc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.221+0000 7fab12cf8700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] conn(0x7faaf80ac100 0x7faaf80ae520 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.222+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== osd.0 v2:172.21.15.17:6802/1731197906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab0800ae50 con 0x7faaf80ac100 2024-03-16T10:49:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.249+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 --> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab0c062de0 con 0x7faaf80ac100 2024-03-16T10:49:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab037fe700 1 -- 172.21.15.17:0/1848704862 <== osd.0 v2:172.21.15.17:6802/1731197906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab0c062de0 con 0x7faaf80ac100 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] conn(0x7faaf80ac100 msgr2=0x7faaf80ae520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] conn(0x7faaf80ac100 0x7faaf80ae520 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faaf80a2920 msgr2=0x7faaf80a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faaf80a2920 0x7faaf80a4de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ffea0 tx=0x7faafc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 msgr2=0x7fab0c101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab1475b700 1 --2- 172.21.15.17:0/1848704862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab0c1008c0 0x7fab0c101aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e9c0 tx=0x7fab0800ecd0 comp rx=0 tx=0).stop 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.250+0000 7fab12cf8700 1 -- 172.21.15.17:0/1848704862 reap_dead start 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.251+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 shutdown_connections 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.251+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 >> 172.21.15.17:0/1848704862 conn(0x7fab0c0777d0 msgr2=0x7fab0c1053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.251+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 shutdown_connections 2024-03-16T10:49:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:36.251+0000 7fab1475b700 1 -- 172.21.15.17:0/1848704862 wait complete. 2024-03-16T10:49:36.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:36 smithi174 ceph-mon[36202]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:36.568 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:36 smithi017 ceph-mon[32078]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:36 smithi111 ceph-mon[36315]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:49:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:38.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:38 smithi017 ceph-mon[32078]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-16T10:49:38.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:38 smithi174 ceph-mon[36202]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-16T10:49:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:38 smithi111 ceph-mon[36315]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-16T10:49:38.876 INFO:teuthology.orchestra.run.smithi017.stdout:34359738447 2024-03-16T10:49:38.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-16T10:49:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:40 smithi174 ceph-mon[36202]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:49:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:40 smithi017 ceph-mon[32078]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:49:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:40.655 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:40.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:40 smithi111 ceph-mon[36315]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:49:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:41 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:41 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-03-16T10:49:41.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-03-16T10:49:41.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-03-16T10:49:41.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-03-16T10:49:41.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-03-16T10:49:41.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:41 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- 172.21.15.17:0/3772912058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 msgr2=0x7fe824108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/3772912058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe824108780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe820009990 tx=0x7fe820009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- 172.21.15.17:0/3772912058 shutdown_connections 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/3772912058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 0x7fe82410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/3772912058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe824108780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/3772912058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe8241027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- 172.21.15.17:0/3772912058 >> 172.21.15.17:0/3772912058 conn(0x7fe824079390 msgr2=0x7fe8240797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- 172.21.15.17:0/3772912058 shutdown_connections 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- 172.21.15.17:0/3772912058 wait complete. 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 Processor -- start 2024-03-16T10:49:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.940+0000 7fe82c6f0700 1 -- start start 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe82419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 0x7fe82419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe8241987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe824112580 con 0x7fe8241083a0 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe824112400 con 0x7fe824102350 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82c6f0700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe824112700 con 0x7fe824102d10 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe82419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe82419e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:51168/0 (socket says 172.21.15.17:51168) 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 -- 172.21.15.17:0/2525858684 learned_addr learned my addr 172.21.15.17:0/2525858684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe829c8b700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 0x7fe82419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82ac8d700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe8241987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 -- 172.21.15.17:0/2525858684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 msgr2=0x7fe82419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 0x7fe82419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 -- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 msgr2=0x7fe8241987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe8241987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe824198fc0 con 0x7fe824102350 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe829c8b700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe824102d10 0x7fe82419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82ac8d700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8241083a0 0x7fe8241987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.941+0000 7fe82a48c700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe82419e660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe820000c00 tx=0x7fe82000bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.942+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820027070 con 0x7fe824102350 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.942+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe824199250 con 0x7fe824102350 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.942+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe820003d70 con 0x7fe824102350 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.942+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82000f460 con 0x7fe824102350 2024-03-16T10:49:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.942+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8241a54c0 con 0x7fe824102350 2024-03-16T10:49:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.943+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe824062a60 con 0x7fe824102350 2024-03-16T10:49:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fe82002a070 con 0x7fe824102350 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8100a29a0 0x7fe8100a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe829c8b700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8100a29a0 0x7fe8100a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8153+0+0 (secure 0 0 0) 0x7fe8200cff70 con 0x7fe824102350 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] conn(0x7fe8100ac3e0 0x7fe8100ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.945+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8200043d0 con 0x7fe8100ac3e0 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.946+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe8200d0450 con 0x7fe824102350 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.946+0000 7fe82ac8d700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] conn(0x7fe8100ac3e0 0x7fe8100ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.946+0000 7fe829c8b700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8100a29a0 0x7fe8100a4e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe824079990 tx=0x7fe814009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.946+0000 7fe82ac8d700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] conn(0x7fe8100ac3e0 0x7fe8100ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.948+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== osd.1 v2:172.21.15.111:6800/135053879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8200043d0 con 0x7fe8100ac3e0 2024-03-16T10:49:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 --> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe824062e90 con 0x7fe8100ac3e0 2024-03-16T10:49:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe81b7fe700 1 -- 172.21.15.17:0/2525858684 <== osd.1 v2:172.21.15.111:6800/135053879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe824062e90 con 0x7fe8100ac3e0 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] conn(0x7fe8100ac3e0 msgr2=0x7fe8100ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] conn(0x7fe8100ac3e0 0x7fe8100ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8100a29a0 msgr2=0x7fe8100a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8100a29a0 0x7fe8100a4e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe824079990 tx=0x7fe814009260 comp rx=0 tx=0).stop 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 msgr2=0x7fe82419e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 --2- 172.21.15.17:0/2525858684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe824102350 0x7fe82419e660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe820000c00 tx=0x7fe82000bab0 comp rx=0 tx=0).stop 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82ac8d700 1 -- 172.21.15.17:0/2525858684 reap_dead start 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 shutdown_connections 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.970+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 >> 172.21.15.17:0/2525858684 conn(0x7fe824079390 msgr2=0x7fe8241010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.971+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 shutdown_connections 2024-03-16T10:49:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:41.971+0000 7fe82c6f0700 1 -- 172.21.15.17:0/2525858684 wait complete. 2024-03-16T10:49:42.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:49:42.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-03-16T10:49:42.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-03-16T10:49:42.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-16T10:49:42.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-03-16T10:49:42.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-03-16T10:49:42.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-03-16T10:49:42.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:42 smithi017 ceph-mon[32078]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-03-16T10:49:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:42 smithi174 ceph-mon[36202]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T10:49:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:49:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-03-16T10:49:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-03-16T10:49:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-16T10:49:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-03-16T10:49:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-03-16T10:49:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-03-16T10:49:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:42 smithi111 ceph-mon[36315]: osdmap e86: 12 total, 12 up, 12 in 2024-03-16T10:49:43.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:43 smithi017 ceph-mon[32078]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T10:49:43.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:43 smithi174 ceph-mon[36202]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T10:49:43.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:43 smithi111 ceph-mon[36315]: osdmap e87: 12 total, 12 up, 12 in 2024-03-16T10:49:44.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:44 smithi017 ceph-mon[32078]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-03-16T10:49:44.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:44 smithi174 ceph-mon[36202]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-03-16T10:49:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:44 smithi111 ceph-mon[36315]: pgmap v318: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-03-16T10:49:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 -- 172.21.15.17:0/3900793056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 msgr2=0x7fd5281075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 --2- 172.21.15.17:0/3900793056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd5281075c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd5180099c0 tx=0x7fd518009cd0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 -- 172.21.15.17:0/3900793056 shutdown_connections 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 --2- 172.21.15.17:0/3900793056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd5281075c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 --2- 172.21.15.17:0/3900793056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 --2- 172.21.15.17:0/3900793056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd528101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 -- 172.21.15.17:0/3900793056 >> 172.21.15.17:0/3900793056 conn(0x7fd5280771c0 msgr2=0x7fd5280775d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 -- 172.21.15.17:0/3900793056 shutdown_connections 2024-03-16T10:49:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.048+0000 7fd52d183700 1 -- 172.21.15.17:0/3900793056 wait complete. 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.049+0000 7fd52d183700 1 Processor -- start 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.049+0000 7fd52d183700 1 -- start start 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd52819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd528198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5281114e0 con 0x7fd528101200 2024-03-16T10:49:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd528111360 con 0x7fd5281071e0 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52d183700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd528111660 con 0x7fd528101bc0 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd526d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd52819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:43646/0 (socket says 172.21.15.17:43646) 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd526d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd52819e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50480/0 (socket says 172.21.15.17:50480) 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 -- 172.21.15.17:0/3973243578 learned_addr learned my addr 172.21.15.17:0/3973243578 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd52759e700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd528198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 -- 172.21.15.17:0/3973243578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 msgr2=0x7fd528198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd528198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 -- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 msgr2=0x7fd52819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd52819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 -- 172.21.15.17:0/3973243578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd528199010 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.050+0000 7fd51e59c700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd51000eb30 tx=0x7fd51000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.051+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000cbd0 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.051+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd510004500 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.051+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd528199300 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.051+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510010430 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.051+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd528102d80 con 0x7fd528101bc0 2024-03-16T10:49:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.052+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd528102890 con 0x7fd528101bc0 2024-03-16T10:49:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.053+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fd510003f00 con 0x7fd528101bc0 2024-03-16T10:49:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.053+0000 7fd524d99700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 0x7fd5140a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.054+0000 7fd526d9d700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 0x7fd5140a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.054+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd5100ceea0 con 0x7fd528101bc0 2024-03-16T10:49:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.054+0000 7fd526d9d700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 0x7fd5140a4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.062+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd51009bde0 con 0x7fd528101bc0 2024-03-16T10:49:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.291+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd528103090 con 0x7fd528101bc0 2024-03-16T10:49:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.292+0000 7fd524d99700 1 -- 172.21.15.17:0/3973243578 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd51009b6e0 con 0x7fd528101bc0 2024-03-16T10:49:46.293 INFO:teuthology.orchestra.run.smithi017.stdout:309237645341 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 msgr2=0x7fd5140a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 0x7fd5140a4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518005fb0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 msgr2=0x7fd52819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd51000eb30 tx=0x7fd51000ee40 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 shutdown_connections 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd5140a29a0 0x7fd5140a4e60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd5281071e0 0x7fd528198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd528101200 0x7fd52819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 --2- 172.21.15.17:0/3973243578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd528101bc0 0x7fd52819eba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 >> 172.21.15.17:0/3973243578 conn(0x7fd5280771c0 msgr2=0x7fd528100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 shutdown_connections 2024-03-16T10:49:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.294+0000 7fd52d183700 1 -- 172.21.15.17:0/3973243578 wait complete. 2024-03-16T10:49:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:46 smithi174 ceph-mon[36202]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-16T10:49:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:46 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4067606332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T10:49:46.584 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:46 smithi017 ceph-mon[32078]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-16T10:49:46.584 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:46 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4067606332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T10:49:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:46 smithi111 ceph-mon[36315]: pgmap v319: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-16T10:49:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:46 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4067606332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-16T10:49:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 -- 172.21.15.17:0/3929194412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 msgr2=0x7fe5f010f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/3929194412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f010f160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800b0d0 tx=0x7fe5e800b3e0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 -- 172.21.15.17:0/3929194412 shutdown_connections 2024-03-16T10:49:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/3929194412 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 0x7fe5f0108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/3929194412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f010f160 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/3929194412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 -- 172.21.15.17:0/3929194412 >> 172.21.15.17:0/3929194412 conn(0x7fe5f0078100 msgr2=0x7fe5f0078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 -- 172.21.15.17:0/3929194412 shutdown_connections 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.930+0000 7fe5f7b66700 1 -- 172.21.15.17:0/3929194412 wait complete. 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 Processor -- start 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 -- start start 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f019e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 0x7fe5f0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01125a0 con 0x7fe5f006a920 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0112420 con 0x7fe5f0108320 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f7b66700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0112720 con 0x7fe5f0069f80 2024-03-16T10:49:46.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f5101700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f5902700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f019e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f5101700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50496/0 (socket says 172.21.15.17:50496) 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f5101700 1 -- 172.21.15.17:0/1596365891 learned_addr learned my addr 172.21.15.17:0/1596365891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.931+0000 7fe5f6103700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 0x7fe5f0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 -- 172.21.15.17:0/1596365891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 msgr2=0x7fe5f019e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f019e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 -- 172.21.15.17:0/1596365891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 msgr2=0x7fe5f0198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 0x7fe5f0198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 -- 172.21.15.17:0/1596365891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f0199040 con 0x7fe5f006a920 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5902700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f019e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f5101700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e9c0 tx=0x7fe5e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000cbd0 con 0x7fe5f006a920 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e000ee60 con 0x7fe5f006a920 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f0199330 con 0x7fe5f006a920 2024-03-16T10:49:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005630 con 0x7fe5f006a920 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.932+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f01a54f0 con 0x7fe5f006a920 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.933+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f01039d0 con 0x7fe5f006a920 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.934+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fe5e0004750 con 0x7fe5f006a920 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.935+0000 7fe5e6ffd700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 0x7fe5dc0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.935+0000 7fe5f5902700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 0x7fe5dc0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.935+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe5e00cef00 con 0x7fe5f006a920 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.935+0000 7fe5f5902700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 0x7fe5dc0a4e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009fd0 tx=0x7fe5ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.939+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe5e0053740 con 0x7fe5f006a920 2024-03-16T10:49:47.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.144+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe5f002db70 con 0x7fe5f006a920 2024-03-16T10:49:47.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.145+0000 7fe5e6ffd700 1 -- 172.21.15.17:0/1596365891 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe5e009bf40 con 0x7fe5f006a920 2024-03-16T10:49:47.145 INFO:teuthology.orchestra.run.smithi017.stdout:141733920829 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 msgr2=0x7fe5dc0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 0x7fe5dc0a4e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009fd0 tx=0x7fe5ec009260 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 msgr2=0x7fe5f019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e9c0 tx=0x7fe5e000ecd0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 shutdown_connections 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5dc0a29a0 0x7fe5dc0a4e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5f0108320 0x7fe5f0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5f0069f80 0x7fe5f019e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 --2- 172.21.15.17:0/1596365891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5f006a920 0x7fe5f019ebd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 >> 172.21.15.17:0/1596365891 conn(0x7fe5f0078100 msgr2=0x7fe5f00ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:47.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 shutdown_connections 2024-03-16T10:49:47.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:47.147+0000 7fe5f7b66700 1 -- 172.21.15.17:0/1596365891 wait complete. 2024-03-16T10:49:47.445 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:47 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3973243578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T10:49:47.445 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:47 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1596365891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T10:49:47.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:47 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3973243578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T10:49:47.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:47 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1596365891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T10:49:47.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:47 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3973243578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-16T10:49:47.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:47 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1596365891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- 172.21.15.17:0/600023215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 msgr2=0x7f9cc006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 --2- 172.21.15.17:0/600023215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc006aea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009920 tx=0x7f9cb0009c30 comp rx=0 tx=0).stop 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- 172.21.15.17:0/600023215 shutdown_connections 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 --2- 172.21.15.17:0/600023215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 0x7f9cc010f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 --2- 172.21.15.17:0/600023215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc01086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 --2- 172.21.15.17:0/600023215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc006aea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- 172.21.15.17:0/600023215 >> 172.21.15.17:0/600023215 conn(0x7f9cc00781e0 msgr2=0x7f9cc00785f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- 172.21.15.17:0/600023215 shutdown_connections 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- 172.21.15.17:0/600023215 wait complete. 2024-03-16T10:49:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 Processor -- start 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.939+0000 7f9cc8519700 1 -- start start 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc0101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 0x7f9cc01017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01125d0 con 0x7f9cc0108300 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0112450 con 0x7f9cc006aa20 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0112750 con 0x7f9cc006b3e0 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc62b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc0101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50462/0 (socket says 172.21.15.17:50462) 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 -- 172.21.15.17:0/4067606332 learned_addr learned my addr 172.21.15.17:0/4067606332 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc5ab4700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 0x7f9cc01017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 -- 172.21.15.17:0/4067606332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 msgr2=0x7f9cc01017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 0x7f9cc01017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 -- 172.21.15.17:0/4067606332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 msgr2=0x7f9cc0101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc0101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 -- 172.21.15.17:0/4067606332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01a7060 con 0x7f9cc0108300 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc6ab6700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ef30 tx=0x7f9cb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80092e0 con 0x7f9cc0108300 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01a72f0 con 0x7f9cc0108300 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stdout:77309411399 2024-03-16T10:49:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cb8004bb0 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.940+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8004280 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.941+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01a7850 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.942+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc0068f90 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.943+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f9cb801b030 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.944+0000 7f9cb77fe700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 0x7f9cac0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.944+0000 7f9cc62b5700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 0x7f9cac0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.944+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9cb80cefc0 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.944+0000 7f9cc62b5700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 0x7f9cac0a4de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005fd0 tx=0x7f9cbc009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:45.949+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f9cb8022020 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.186+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9cc0102760 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.186+0000 7f9cb77fe700 1 -- 172.21.15.17:0/4067606332 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cb8084e20 con 0x7f9cc0108300 2024-03-16T10:49:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 msgr2=0x7f9cac0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 0x7f9cac0a4de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005fd0 tx=0x7f9cbc009310 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 msgr2=0x7f9cc0101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ef30 tx=0x7f9cb800c3a0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 shutdown_connections 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9cac0a2920 0x7f9cac0a4de0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cc006aa20 0x7f9cc0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cc0108300 0x7f9cc0101d00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 --2- 172.21.15.17:0/4067606332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cc006b3e0 0x7f9cc01017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 >> 172.21.15.17:0/4067606332 conn(0x7f9cc00781e0 msgr2=0x7f9cc00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.188+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 shutdown_connections 2024-03-16T10:49:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:46.189+0000 7f9cc8519700 1 -- 172.21.15.17:0/4067606332 wait complete. 2024-03-16T10:49:48.435 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:48 smithi017 ceph-mon[32078]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-03-16T10:49:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:48 smithi174 ceph-mon[36202]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-03-16T10:49:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:48 smithi111 ceph-mon[36315]: pgmap v320: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-03-16T10:49:48.865 INFO:teuthology.orchestra.run.smithi017.stdout:55834574923 2024-03-16T10:49:48.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-16T10:49:49.404 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411399 for osd.2 2024-03-16T10:49:49.404 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:49.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:49 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:49:49.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:49 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:49:49.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:49 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:49:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 -- 172.21.15.17:0/949016815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068107630 msgr2=0x7f006810f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 --2- 172.21.15.17:0/949016815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068107630 0x7f006810f200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f006000b0d0 tx=0x7f006000b3e0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 -- 172.21.15.17:0/949016815 shutdown_connections 2024-03-16T10:49:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 --2- 172.21.15.17:0/949016815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102550 0x7f0068102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 --2- 172.21.15.17:0/949016815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068107630 0x7f006810f200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 --2- 172.21.15.17:0/949016815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068102f00 0x7f0068106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 -- 172.21.15.17:0/949016815 >> 172.21.15.17:0/949016815 conn(0x7f00680fdde0 msgr2=0x7f0068100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 -- 172.21.15.17:0/949016815 shutdown_connections 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.332+0000 7f00707fe700 1 -- 172.21.15.17:0/949016815 wait complete. 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 Processor -- start 2024-03-16T10:49:50.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 -- start start 2024-03-16T10:49:50.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:50.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102f00 0x7f006819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068107630 0x7f0068198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0068112640 con 0x7f0068102550 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f00681124c0 con 0x7f0068102f00 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f00707fe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00681127c0 con 0x7f0068107630 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40308/0 (socket says 172.21.15.17:40308) 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 -- 172.21.15.17:0/4294458943 learned_addr learned my addr 172.21.15.17:0/4294458943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006ed9b700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068107630 0x7f0068198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006dd99700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102f00 0x7f006819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 -- 172.21.15.17:0/4294458943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068107630 msgr2=0x7f0068198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068107630 0x7f0068198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 -- 172.21.15.17:0/4294458943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102f00 msgr2=0x7f006819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102f00 0x7f006819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.333+0000 7f006e59a700 1 -- 172.21.15.17:0/4294458943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0068199020 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f006e59a700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f006400e9a0 tx=0x7f006400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006400ca10 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f006400cbb0 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0068199310 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064018680 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.334+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00681a5520 con 0x7f0068102550 2024-03-16T10:49:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.335+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0068103a30 con 0x7f0068102550 2024-03-16T10:49:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.336+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f0064010430 con 0x7f0068102550 2024-03-16T10:49:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.336+0000 7f005f7fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 0x7f00540a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.337+0000 7f006dd99700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 0x7f00540a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.337+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f00640ced30 con 0x7f0068102550 2024-03-16T10:49:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.337+0000 7f006dd99700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 0x7f00540a4de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00681014a0 tx=0x7f0058009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.341+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f006409bd70 con 0x7f0068102550 2024-03-16T10:49:50.358 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:50.361 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:50 smithi174 ceph-mon[36202]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 72 B/s, 0 objects/s recovering 2024-03-16T10:49:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:50 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2797990864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T10:49:50.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.563+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f00681a5750 con 0x7f0068102550 2024-03-16T10:49:50.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:50 smithi017 ceph-mon[32078]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 72 B/s, 0 objects/s recovering 2024-03-16T10:49:50.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:50 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2797990864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T10:49:50.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.564+0000 7f005f7fe700 1 -- 172.21.15.17:0/4294458943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f006409b670 con 0x7f0068102550 2024-03-16T10:49:50.565 INFO:teuthology.orchestra.run.smithi017.stdout:163208757304 2024-03-16T10:49:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 msgr2=0x7f00540a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 0x7f00540a4de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00681014a0 tx=0x7f0058009260 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 msgr2=0x7f006819e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f006400e9a0 tx=0x7f006400ecb0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 shutdown_connections 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f00540a2920 0x7f00540a4de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0068107630 0x7f0068198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0068102550 0x7f006819e6c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 --2- 172.21.15.17:0/4294458943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0068102f00 0x7f006819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 >> 172.21.15.17:0/4294458943 conn(0x7f00680fdde0 msgr2=0x7f00680fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 shutdown_connections 2024-03-16T10:49:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.566+0000 7f00707fe700 1 -- 172.21.15.17:0/4294458943 wait complete. 2024-03-16T10:49:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:50 smithi111 ceph-mon[36315]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 72 B/s, 0 objects/s recovering 2024-03-16T10:49:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:50 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2797990864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-16T10:49:50.825 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920826 got 141733920829 for osd.4 2024-03-16T10:49:50.826 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2106378759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30107210 msgr2=0x7f5c301075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2106378759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30107210 0x7f5c301075f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009990 tx=0x7f5c20009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2106378759 shutdown_connections 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2106378759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c30101b70 0x7f5c3010e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2106378759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30107210 0x7f5c301075f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2106378759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c301011d0 0x7f5c30101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2106378759 >> 172.21.15.17:0/2106378759 conn(0x7f5c30078100 msgr2=0x7f5c30078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2106378759 shutdown_connections 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.891+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2106378759 wait complete. 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 Processor -- start 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 -- start start 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 0x7f5c30199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 0x7f5c301a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c30111470 con 0x7f5c30101b70 2024-03-16T10:49:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c301112f0 con 0x7f5c30107210 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.892+0000 7f5c36e9a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c301115f0 con 0x7f5c301011d0 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:50260/0 (socket says 172.21.15.17:50260) 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 -- 172.21.15.17:0/2797990864 learned_addr learned my addr 172.21.15.17:0/2797990864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c2ffff700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 0x7f5c30199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c35437700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 0x7f5c301a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 -- 172.21.15.17:0/2797990864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 msgr2=0x7f5c301a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 0x7f5c301a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 -- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 msgr2=0x7f5c30199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 0x7f5c30199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 -- 172.21.15.17:0/2797990864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c301a4e70 con 0x7f5c301011d0 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c35437700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 0x7f5c301a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c2ffff700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 0x7f5c30199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c34c36700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000c00 tx=0x7f5c2000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20027070 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c301a5040 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c20003d70 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.893+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000f460 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.894+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c301a54f0 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.894+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c30068f90 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.896+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f5c2002a070 con 0x7f5c301011d0 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.896+0000 7f5c2dffb700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 0x7f5c1c0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:107374182466 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.897+0000 7f5c2ffff700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 0x7f5c1c0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.897+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5c200cfcc0 con 0x7f5c301011d0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.897+0000 7f5c2ffff700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 0x7f5c1c0a4de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c300787e0 tx=0x7f5c18009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:49.900+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5c20013070 con 0x7f5c301011d0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.110+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5c3002db70 con 0x7f5c301011d0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.111+0000 7f5c2dffb700 1 -- 172.21.15.17:0/2797990864 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5c2009cc90 con 0x7f5c301011d0 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 msgr2=0x7f5c1c0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 0x7f5c1c0a4de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c300787e0 tx=0x7f5c18009260 comp rx=0 tx=0).stop 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 msgr2=0x7f5c301998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000c00 tx=0x7f5c2000bab0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 shutdown_connections 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5c1c0a2920 0x7f5c1c0a4de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c30107210 0x7f5c301a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c301011d0 0x7f5c301998b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 --2- 172.21.15.17:0/2797990864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c30101b70 0x7f5c30199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 >> 172.21.15.17:0/2797990864 conn(0x7f5c30078100 msgr2=0x7f5c300fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 shutdown_connections 2024-03-16T10:49:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:50.113+0000 7f5c36e9a700 1 -- 172.21.15.17:0/2797990864 wait complete. 2024-03-16T10:49:51.372 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:51.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:51 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4294458943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T10:49:51.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.501 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:51 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:51 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4294458943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T10:49:51.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:51 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:51 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4294458943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-16T10:49:51.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:51.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:51 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:49:52.265 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182459 got 107374182466 for osd.3 2024-03-16T10:49:52.266 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:52.562 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:52 smithi111 ceph-mon[36315]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 63 B/s, 0 objects/s recovering 2024-03-16T10:49:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:52 smithi174 ceph-mon[36202]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 63 B/s, 0 objects/s recovering 2024-03-16T10:49:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:52 smithi017 ceph-mon[32078]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 63 B/s, 0 objects/s recovering 2024-03-16T10:49:53.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645337 got 309237645341 for osd.10 2024-03-16T10:49:53.341 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:54.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- 172.21.15.17:0/856041688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f406b420 msgr2=0x7f02f4106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/856041688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f406b420 0x7f02f4106f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02e00098f0 tx=0x7f02e0009c00 comp rx=0 tx=0).stop 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- 172.21.15.17:0/856041688 shutdown_connections 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/856041688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f4107650 0x7f02f410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/856041688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406aa70 0x7f02f406ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/856041688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f406b420 0x7f02f4106f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- 172.21.15.17:0/856041688 >> 172.21.15.17:0/856041688 conn(0x7f02f4077220 msgr2=0x7f02f4077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- 172.21.15.17:0/856041688 shutdown_connections 2024-03-16T10:49:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- 172.21.15.17:0/856041688 wait complete. 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 Processor -- start 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.105+0000 7f02fb0d4700 1 -- start start 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 0x7f02f4101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f4107650 0x7f02f4101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f02f41125a0 con 0x7f02f406aa70 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4112420 con 0x7f02f4107650 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4112720 con 0x7f02f406b420 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40346/0 (socket says 172.21.15.17:40346) 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 -- 172.21.15.17:0/1397476963 learned_addr learned my addr 172.21.15.17:0/1397476963 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f9671700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f4107650 0x7f02f4101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f3fff700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 0x7f02f4101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 -- 172.21.15.17:0/1397476963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 msgr2=0x7f02f4101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 0x7f02f4101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 -- 172.21.15.17:0/1397476963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f4107650 msgr2=0x7f02f4101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f4107650 0x7f02f4101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 -- 172.21.15.17:0/1397476963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f41a70f0 con 0x7f02f406aa70 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f3fff700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 0x7f02f4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f8e70700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eb30 tx=0x7f02e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cc90 con 0x7f02f406aa70 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f41a73e0 con 0x7f02f406aa70 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.106+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e8004500 con 0x7f02f406aa70 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.107+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41a7940 con 0x7f02f406aa70 2024-03-16T10:49:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.107+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8010430 con 0x7f02f406aa70 2024-03-16T10:49:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.108+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f4103a00 con 0x7f02f406aa70 2024-03-16T10:49:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.109+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f02e8003680 con 0x7f02f406aa70 2024-03-16T10:49:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.109+0000 7f02f1ffb700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 0x7f02e40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.109+0000 7f02f3fff700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 0x7f02e40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.110+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f02e80ced70 con 0x7f02f406aa70 2024-03-16T10:49:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.110+0000 7f02f3fff700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 0x7f02e40a4cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009810 tx=0x7f02e0005b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.117+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f02e809bdd0 con 0x7f02f406aa70 2024-03-16T10:49:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.331+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f02f4068f90 con 0x7f02f406aa70 2024-03-16T10:49:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.331+0000 7f02f1ffb700 1 -- 172.21.15.17:0/1397476963 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f02e80860e0 con 0x7f02f406aa70 2024-03-16T10:49:54.333 INFO:teuthology.orchestra.run.smithi017.stdout:287762808869 2024-03-16T10:49:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 msgr2=0x7f02e40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 0x7f02e40a4cc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009810 tx=0x7f02e0005b80 comp rx=0 tx=0).stop 2024-03-16T10:49:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 msgr2=0x7f02f41012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f02e800eb30 tx=0x7f02e800ee40 comp rx=0 tx=0).stop 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 shutdown_connections 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02e40a2800 0x7f02e40a4cc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02f4107650 0x7f02f4101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02f406aa70 0x7f02f41012d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 --2- 172.21.15.17:0/1397476963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02f406b420 0x7f02f4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 >> 172.21.15.17:0/1397476963 conn(0x7f02f4077220 msgr2=0x7f02f40ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 shutdown_connections 2024-03-16T10:49:54.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.334+0000 7f02fb0d4700 1 -- 172.21.15.17:0/1397476963 wait complete. 2024-03-16T10:49:54.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:54 smithi174 ceph-mon[36202]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 56 B/s, 0 objects/s recovering 2024-03-16T10:49:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1872956568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T10:49:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:54 smithi017 ceph-mon[32078]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 56 B/s, 0 objects/s recovering 2024-03-16T10:49:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1872956568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T10:49:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:54 smithi111 ceph-mon[36315]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 56 B/s, 0 objects/s recovering 2024-03-16T10:49:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1872956568' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-16T10:49:55.023 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808864 got 287762808869 for osd.9 2024-03-16T10:49:55.023 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- 172.21.15.17:0/3110329675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 msgr2=0x7fc0cc06a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 --2- 172.21.15.17:0/3110329675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc06a360 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009990 tx=0x7fc0bc009ca0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- 172.21.15.17:0/3110329675 shutdown_connections 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 --2- 172.21.15.17:0/3110329675 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc10ed80 0x7fc0cc111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 --2- 172.21.15.17:0/3110329675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc06a360 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 --2- 172.21.15.17:0/3110329675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- 172.21.15.17:0/3110329675 >> 172.21.15.17:0/3110329675 conn(0x7fc0cc078100 msgr2=0x7fc0cc078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- 172.21.15.17:0/3110329675 shutdown_connections 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- 172.21.15.17:0/3110329675 wait complete. 2024-03-16T10:49:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 Processor -- start 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.218+0000 7fc0d1539700 1 -- start start 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc10ed80 0x7fc0cc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1147b0 con 0x7fc0cc069f80 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc114630 con 0x7fc0cc06a8a0 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0d1539700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc114930 con 0x7fc0cc10ed80 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40360/0 (socket says 172.21.15.17:40360) 2024-03-16T10:49:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 -- 172.21.15.17:0/1883489518 learned_addr learned my addr 172.21.15.17:0/1883489518 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0ca7fc700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0cb7fe700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc10ed80 0x7fc0cc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 -- 172.21.15.17:0/1883489518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc10ed80 msgr2=0x7fc0cc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc10ed80 0x7fc0cc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 -- 172.21.15.17:0/1883489518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 msgr2=0x7fc0cc1a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc1a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 -- 172.21.15.17:0/1883489518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc19b250 con 0x7fc0cc069f80 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0ca7fc700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0caffd700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.219+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc027070 con 0x7fc0cc069f80 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.220+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc19b4e0 con 0x7fc0cc069f80 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.220+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc003d70 con 0x7fc0cc069f80 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.220+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00f460 con 0x7fc0cc069f80 2024-03-16T10:49:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.220+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc1a7800 con 0x7fc0cc069f80 2024-03-16T10:49:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.221+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0cc068f90 con 0x7fc0cc069f80 2024-03-16T10:49:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.222+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fc0bc02a070 con 0x7fc0cc069f80 2024-03-16T10:49:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.222+0000 7fc0b3fff700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 0x7fc0b40a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.222+0000 7fc0ca7fc700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 0x7fc0b40a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.222+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc0bc0cfc10 con 0x7fc0cc069f80 2024-03-16T10:49:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.223+0000 7fc0ca7fc700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 0x7fc0b40a4de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc102750 tx=0x7fc0c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.227+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fc0bc013070 con 0x7fc0cc069f80 2024-03-16T10:49:55.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1383401010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041025e0 msgr2=0x7f6a04105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1383401010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041025e0 0x7f6a04105e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69f80099c0 tx=0x7f69f8009cd0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1383401010 shutdown_connections 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1383401010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a04101c30 0x7f6a04102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1383401010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04106550 0x7f6a0410e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1383401010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041025e0 0x7f6a04105e70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.982+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1383401010 >> 172.21.15.17:0/1383401010 conn(0x7f6a040777d0 msgr2=0x7f6a040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.983+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1383401010 shutdown_connections 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.983+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1383401010 wait complete. 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.984+0000 7f6a0a91b700 1 Processor -- start 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.984+0000 7f6a0a91b700 1 -- start start 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04101c30 0x7f6a0419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a041025e0 0x7f6a0419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a04111530 con 0x7f6a04106550 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041113b0 con 0x7f6a041025e0 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a0a91b700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a041116b0 con 0x7f6a04101c30 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40332/0 (socket says 172.21.15.17:40332) 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 -- 172.21.15.17:0/1872956568 learned_addr learned my addr 172.21.15.17:0/1872956568 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a037fe700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a041025e0 0x7f6a0419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a03fff700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04101c30 0x7f6a0419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 -- 172.21.15.17:0/1872956568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04101c30 msgr2=0x7f6a0419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04101c30 0x7f6a0419e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 -- 172.21.15.17:0/1872956568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a041025e0 msgr2=0x7f6a0419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a041025e0 0x7f6a0419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 -- 172.21.15.17:0/1872956568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a04199040 con 0x7f6a04106550 2024-03-16T10:49:55.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.985+0000 7f6a08eb8700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ef30 tx=0x7f69fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.986+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0092e0 con 0x7f6a04106550 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.986+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a041992d0 con 0x7f6a04106550 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.986+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69fc004bb0 con 0x7f6a04106550 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stdout:219043332143 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.986+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc004280 con 0x7f6a04106550 2024-03-16T10:49:55.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.986+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a040fcbe0 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.987+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a04199e10 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.988+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f69fc01b030 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.989+0000 7f6a017fa700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 0x7f69ec0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.989+0000 7f6a03fff700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 0x7f69ec0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.989+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f69fc0cefe0 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.990+0000 7f6a03fff700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 0x7f69ec0a4de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6a04199a20 tx=0x7f69f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:53.993+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f69fc022020 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.227+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6a040fce40 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.227+0000 7f6a017fa700 1 -- 172.21.15.17:0/1872956568 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f69fc010040 con 0x7f6a04106550 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.229+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 msgr2=0x7f69ec0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.229+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 0x7f69ec0a4de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6a04199a20 tx=0x7f69f4009260 comp rx=0 tx=0).stop 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.229+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 msgr2=0x7f6a041988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.229+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00ef30 tx=0x7f69fc00c3a0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 shutdown_connections 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69ec0a2920 0x7f69ec0a4de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a04106550 0x7f6a041988e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a04101c30 0x7f6a0419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 --2- 172.21.15.17:0/1872956568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a041025e0 0x7f6a0419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 >> 172.21.15.17:0/1872956568 conn(0x7f6a040777d0 msgr2=0x7f6a04100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 shutdown_connections 2024-03-16T10:49:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:54.230+0000 7f6a0a91b700 1 -- 172.21.15.17:0/1872956568 wait complete. 2024-03-16T10:49:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.435+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc0cc02db70 con 0x7fc0cc069f80 2024-03-16T10:49:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.435+0000 7fc0b3fff700 1 -- 172.21.15.17:0/1883489518 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc0bc09cce0 con 0x7fc0cc069f80 2024-03-16T10:49:55.436 INFO:teuthology.orchestra.run.smithi017.stdout:197568495669 2024-03-16T10:49:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 msgr2=0x7fc0b40a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 0x7fc0b40a4de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc102750 tx=0x7fc0c0009260 comp rx=0 tx=0).stop 2024-03-16T10:49:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 msgr2=0x7fc0cc1a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc00bab0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 shutdown_connections 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc0b40a2920 0x7fc0b40a4de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.437+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0cc10ed80 0x7fc0cc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.438+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc069f80 0x7fc0cc1a0930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.438+0000 7fc0d1539700 1 --2- 172.21.15.17:0/1883489518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0cc06a8a0 0x7fc0cc1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.438+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 >> 172.21.15.17:0/1883489518 conn(0x7fc0cc078100 msgr2=0x7fc0cc1103f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.438+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 shutdown_connections 2024-03-16T10:49:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:49:55.438+0000 7fc0d1539700 1 -- 172.21.15.17:0/1883489518 wait complete. 2024-03-16T10:49:55.556 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:55 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1397476963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T10:49:55.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:55 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1397476963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T10:49:55.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:55 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1397476963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-16T10:49:56.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495665 got 197568495669 for osd.6 2024-03-16T10:49:56.211 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:56 smithi174 ceph-mon[36202]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:56 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1883489518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T10:49:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:56 smithi017 ceph-mon[32078]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:49:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:56 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1883489518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T10:49:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:56 smithi111 ceph-mon[36315]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:49:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:56 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1883489518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-16T10:49:56.709 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332137 got 219043332143 for osd.7 2024-03-16T10:49:56.710 DEBUG:teuthology.parallel:result is None 2024-03-16T10:49:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:49:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:49:58 smithi174 ceph-mon[36202]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:49:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:49:58 smithi017 ceph-mon[32078]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:49:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:49:58 smithi111 ceph-mon[36315]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:50:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:00 smithi174 ceph-mon[36202]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:50:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:00 smithi174 ceph-mon[36202]: overall HEALTH_OK 2024-03-16T10:50:00.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:00 smithi017 ceph-mon[32078]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:50:00.564 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:00 smithi017 ceph-mon[32078]: overall HEALTH_OK 2024-03-16T10:50:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:00 smithi111 ceph-mon[36315]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 48 B/s, 0 objects/s recovering 2024-03-16T10:50:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:00 smithi111 ceph-mon[36315]: overall HEALTH_OK 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 -- 172.21.15.17:0/754643700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e01064b0 msgr2=0x7f08e010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 --2- 172.21.15.17:0/754643700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e01064b0 0x7f08e010e080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08d800b0a0 tx=0x7f08d800b3b0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 -- 172.21.15.17:0/754643700 shutdown_connections 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 --2- 172.21.15.17:0/754643700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e01064b0 0x7f08e010e080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 --2- 172.21.15.17:0/754643700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e0101460 0x7f08e0101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 --2- 172.21.15.17:0/754643700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e0105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 -- 172.21.15.17:0/754643700 >> 172.21.15.17:0/754643700 conn(0x7f08e0077220 msgr2=0x7f08e0077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 -- 172.21.15.17:0/754643700 shutdown_connections 2024-03-16T10:50:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.135+0000 7f08e5c09700 1 -- 172.21.15.17:0/754643700 wait complete. 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 Processor -- start 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 -- start start 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 0x7f08e019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 0x7f08e0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01114a0 con 0x7f08e0101e10 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0111320 con 0x7f08e0101460 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08e5c09700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f08e0111620 con 0x7f08e01064b0 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08deffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08deffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54146/0 (socket says 172.21.15.17:54146) 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.136+0000 7f08deffd700 1 -- 172.21.15.17:0/459482767 learned_addr learned my addr 172.21.15.17:0/459482767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 0x7f08e019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08dffff700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 0x7f08e0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 -- 172.21.15.17:0/459482767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 msgr2=0x7f08e0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 0x7f08e0198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 -- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 msgr2=0x7f08e019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 -- 172.21.15.17:0/459482767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e0199030 con 0x7f08e0101460 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08dffff700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 0x7f08e0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08deffd700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08df7fe700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 0x7f08e019e6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009c50 tx=0x7f08d0009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d001e070 con 0x7f08e0101460 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08d0019410 con 0x7f08e0101460 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0018610 con 0x7f08e0101460 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e0199320 con 0x7f08e0101460 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.137+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e0102da0 con 0x7f08e0101460 2024-03-16T10:50:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.138+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e01028b0 con 0x7f08e0101460 2024-03-16T10:50:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.140+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f08d0021070 con 0x7f08e0101460 2024-03-16T10:50:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.141+0000 7f08dcff9700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 0x7f08c80a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.141+0000 7f08deffd700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 0x7f08c80a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.142+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f08d00d2460 con 0x7f08e0101460 2024-03-16T10:50:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.142+0000 7f08deffd700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 0x7f08c80a4e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08e0107aa0 tx=0x7f08d400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:01.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.143+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f08d009f4a0 con 0x7f08e0101460 2024-03-16T10:50:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.350+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f08e002db70 con 0x7f08e0101460 2024-03-16T10:50:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.350+0000 7f08dcff9700 1 -- 172.21.15.17:0/459482767 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f08d009eda0 con 0x7f08e0101460 2024-03-16T10:50:01.351 INFO:teuthology.orchestra.run.smithi017.stdout:343597383706 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 msgr2=0x7f08c80a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 0x7f08c80a4e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08e0107aa0 tx=0x7f08d400b480 comp rx=0 tx=0).stop 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 msgr2=0x7f08e019e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 0x7f08e019e6d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009c50 tx=0x7f08d0009f60 comp rx=0 tx=0).stop 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 shutdown_connections 2024-03-16T10:50:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f08c80a29a0 0x7f08c80a4e60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08e0101460 0x7f08e019e6d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e01064b0 0x7f08e0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 --2- 172.21.15.17:0/459482767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08e0101e10 0x7f08e019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 >> 172.21.15.17:0/459482767 conn(0x7f08e0077220 msgr2=0x7f08e006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 shutdown_connections 2024-03-16T10:50:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:01.352+0000 7f08e5c09700 1 -- 172.21.15.17:0/459482767 wait complete. 2024-03-16T10:50:02.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 -- 172.21.15.17:0/1363233006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 msgr2=0x7f7d10101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 --2- 172.21.15.17:0/1363233006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d10101630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009990 tx=0x7f7d0c009ca0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 -- 172.21.15.17:0/1363233006 shutdown_connections 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 --2- 172.21.15.17:0/1363233006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 --2- 172.21.15.17:0/1363233006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 0x7f7d1010e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 --2- 172.21.15.17:0/1363233006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d10101630 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 -- 172.21.15.17:0/1363233006 >> 172.21.15.17:0/1363233006 conn(0x7f7d10078100 msgr2=0x7f7d10078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 -- 172.21.15.17:0/1363233006 shutdown_connections 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.536+0000 7f7d1875d700 1 -- 172.21.15.17:0/1363233006 wait complete. 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 Processor -- start 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 -- start start 2024-03-16T10:50:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 0x7f7d10199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10111490 con 0x7f7d101011d0 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10111310 con 0x7f7d10107210 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d1875d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10111610 con 0x7f7d10101b70 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54174/0 (socket says 172.21.15.17:54174) 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 -- 172.21.15.17:0/4085940864 learned_addr learned my addr 172.21.15.17:0/4085940864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d16cfa700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d15cf8700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 0x7f7d10199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 -- 172.21.15.17:0/4085940864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 msgr2=0x7f7d10199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 0x7f7d10199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 -- 172.21.15.17:0/4085940864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 msgr2=0x7f7d101a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d164f9700 1 -- 172.21.15.17:0/4085940864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d101a4e90 con 0x7f7d101011d0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.537+0000 7f7d16cfa700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d164f9700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000ca10 con 0x7f7d101011d0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d101a50c0 con 0x7f7d101011d0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0000cbb0 con 0x7f7d101011d0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00018680 con 0x7f7d101011d0 2024-03-16T10:50:02.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.538+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d101a5620 con 0x7f7d101011d0 2024-03-16T10:50:02.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.539+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d10068f90 con 0x7f7d101011d0 2024-03-16T10:50:02.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.540+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f7d00010430 con 0x7f7d101011d0 2024-03-16T10:50:02.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.540+0000 7f7d077fe700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 0x7f7cfc0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.541+0000 7f7d15cf8700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 0x7f7cfc0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.541+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7d000cecb0 con 0x7f7d101011d0 2024-03-16T10:50:02.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.541+0000 7f7d15cf8700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 0x7f7cfc0a4de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b2e0 tx=0x7f7d0c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:02.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.545+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f7d0009bcf0 con 0x7f7d101011d0 2024-03-16T10:50:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:02 smithi174 ceph-mon[36202]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-03-16T10:50:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:02 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/459482767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T10:50:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:02 smithi017 ceph-mon[32078]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-03-16T10:50:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:02 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/459482767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T10:50:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:02 smithi111 ceph-mon[36315]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-03-16T10:50:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:02 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/459482767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 -- 172.21.15.17:0/2381832082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa394101e10 msgr2=0x7fa394105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 --2- 172.21.15.17:0/2381832082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa394101e10 0x7fa394105dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099c0 tx=0x7fa384009cd0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 -- 172.21.15.17:0/2381832082 shutdown_connections 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 --2- 172.21.15.17:0/2381832082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3941064b0 0x7fa39410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 --2- 172.21.15.17:0/2381832082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101460 0x7fa394101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 --2- 172.21.15.17:0/2381832082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa394101e10 0x7fa394105dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 -- 172.21.15.17:0/2381832082 >> 172.21.15.17:0/2381832082 conn(0x7fa394077220 msgr2=0x7fa394077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:02.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 -- 172.21.15.17:0/2381832082 shutdown_connections 2024-03-16T10:50:02.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.743+0000 7fa398d95700 1 -- 172.21.15.17:0/2381832082 wait complete. 2024-03-16T10:50:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 Processor -- start 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 -- start start 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101e10 0x7fa3941033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa394111490 con 0x7fa3941064b0 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa394111310 con 0x7fa394101460 2024-03-16T10:50:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa398d95700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa394111610 con 0x7fa394101e10 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa39259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa392d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa39259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41630/0 (socket says 172.21.15.17:41630) 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa392d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54184/0 (socket says 172.21.15.17:54184) 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa39259c700 1 -- 172.21.15.17:0/1528268579 learned_addr learned my addr 172.21.15.17:0/1528268579 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.744+0000 7fa391d9b700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101e10 0x7fa3941033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 -- 172.21.15.17:0/1528268579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101e10 msgr2=0x7fa3941033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101e10 0x7fa3941033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 -- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 msgr2=0x7fa3941038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 -- 172.21.15.17:0/1528268579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3941a6fc0 con 0x7fa394101460 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa392d9d700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa39259c700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa38800e9c0 tx=0x7fa38800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38800cbd0 con 0x7fa394101460 2024-03-16T10:50:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa38800ee60 con 0x7fa394101460 2024-03-16T10:50:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3941a72b0 con 0x7fa394101460 2024-03-16T10:50:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388005630 con 0x7fa394101460 2024-03-16T10:50:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.745+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941a77c0 con 0x7fa394101460 2024-03-16T10:50:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.747+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394068f90 con 0x7fa394101460 2024-03-16T10:50:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.748+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fa388004750 con 0x7fa394101460 2024-03-16T10:50:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.748+0000 7fa3837fe700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 0x7fa37c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.748+0000 7fa391d9b700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 0x7fa37c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.748+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa3880cecd0 con 0x7fa394101460 2024-03-16T10:50:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.749+0000 7fa391d9b700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 0x7fa37c0a4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa384000c00 tx=0x7fa384005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.753+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa38809bd10 con 0x7fa394101460 2024-03-16T10:50:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.806+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7d1002db70 con 0x7f7d101011d0 2024-03-16T10:50:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.806+0000 7f7d077fe700 1 -- 172.21.15.17:0/4085940864 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d0009b5f0 con 0x7f7d101011d0 2024-03-16T10:50:02.808 INFO:teuthology.orchestra.run.smithi017.stdout:253403070508 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 msgr2=0x7f7cfc0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 0x7f7cfc0a4de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b2e0 tx=0x7f7d0c005960 comp rx=0 tx=0).stop 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 msgr2=0x7f7d101998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ecb0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 shutdown_connections 2024-03-16T10:50:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7cfc0a2920 0x7f7cfc0a4de0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d10107210 0x7f7d101a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d101011d0 0x7f7d101998d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 --2- 172.21.15.17:0/4085940864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d10101b70 0x7f7d10199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 >> 172.21.15.17:0/4085940864 conn(0x7f7d10078100 msgr2=0x7f7d10100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.809+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 shutdown_connections 2024-03-16T10:50:02.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.810+0000 7f7d1875d700 1 -- 172.21.15.17:0/4085940864 wait complete. 2024-03-16T10:50:02.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.979+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa39402db70 con 0x7fa394101460 2024-03-16T10:50:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.979+0000 7fa3837fe700 1 -- 172.21.15.17:0/1528268579 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa38809b610 con 0x7fa394101460 2024-03-16T10:50:03.034 INFO:teuthology.orchestra.run.smithi017.stdout:34359738452 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 msgr2=0x7fa37c0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 0x7fa37c0a4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa384000c00 tx=0x7fa384005fb0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 msgr2=0x7fa394102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa38800e9c0 tx=0x7fa38800ecd0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 shutdown_connections 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa37c0a29a0 0x7fa37c0a4e60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa394101460 0x7fa394102e70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3941064b0 0x7fa3941038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 --2- 172.21.15.17:0/1528268579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa394101e10 0x7fa3941033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.981+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 >> 172.21.15.17:0/1528268579 conn(0x7fa394077220 msgr2=0x7fa39406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.982+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 shutdown_connections 2024-03-16T10:50:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:02.982+0000 7fa398d95700 1 -- 172.21.15.17:0/1528268579 wait complete. 2024-03-16T10:50:03.237 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383701 got 343597383706 for osd.11 2024-03-16T10:50:03.237 DEBUG:teuthology.parallel:result is None 2024-03-16T10:50:03.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:03 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4085940864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T10:50:03.515 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:03 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1528268579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T10:50:03.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:03 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4085940864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T10:50:03.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:03 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1528268579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T10:50:03.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:03 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4085940864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-16T10:50:03.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:03 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1528268579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-16T10:50:03.833 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757300 got 163208757304 for osd.5 2024-03-16T10:50:03.833 DEBUG:teuthology.parallel:result is None 2024-03-16T10:50:04.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:04 smithi017 ceph-mon[32078]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-03-16T10:50:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:04 smithi111 ceph-mon[36315]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-03-16T10:50:04.758 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738452 for osd.0 2024-03-16T10:50:04.758 DEBUG:teuthology.parallel:result is None 2024-03-16T10:50:04.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:04 smithi174 ceph-mon[36202]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-03-16T10:50:05.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 -- 172.21.15.17:0/3559613589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 msgr2=0x7f80c410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:05.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 --2- 172.21.15.17:0/3559613589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c410e080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00b0d0 tx=0x7f80bc00b3e0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 -- 172.21.15.17:0/3559613589 shutdown_connections 2024-03-16T10:50:05.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 --2- 172.21.15.17:0/3559613589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c410e080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 --2- 172.21.15.17:0/3559613589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101460 0x7f80c4101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 --2- 172.21.15.17:0/3559613589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101e10 0x7f80c4105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 -- 172.21.15.17:0/3559613589 >> 172.21.15.17:0/3559613589 conn(0x7f80c4077220 msgr2=0x7f80c4077630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 -- 172.21.15.17:0/3559613589 shutdown_connections 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 -- 172.21.15.17:0/3559613589 wait complete. 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.515+0000 7f80ca026700 1 Processor -- start 2024-03-16T10:50:05.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 -- start start 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101e10 0x7f80c41033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41114a0 con 0x7f80c41064b0 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4111320 con 0x7f80c4101460 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80ca026700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4111620 con 0x7f80c4101e10 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41652/0 (socket says 172.21.15.17:41652) 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 -- 172.21.15.17:0/1683073777 learned_addr learned my addr 172.21.15.17:0/1683073777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54198/0 (socket says 172.21.15.17:54198) 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c2ffd700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101e10 0x7f80c41033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 -- 172.21.15.17:0/1683073777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101e10 msgr2=0x7f80c41033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101e10 0x7f80c41033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 -- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 msgr2=0x7f80c41038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 -- 172.21.15.17:0/1683073777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41a6f40 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c3fff700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.516+0000 7f80c37fe700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9a0 tx=0x7f80b400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.517+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b400ca10 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.517+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b400cbb0 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.517+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41a7230 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.517+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4018680 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.517+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41a7770 con 0x7f80c4101460 2024-03-16T10:50:05.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.518+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4068f90 con 0x7f80c4101460 2024-03-16T10:50:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.519+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f80b4047a90 con 0x7f80c4101460 2024-03-16T10:50:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.519+0000 7f80c0ff9700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 0x7f80b00a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.519+0000 7f80c2ffd700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 0x7f80b00a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.519+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f80b40cee70 con 0x7f80c4101460 2024-03-16T10:50:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.520+0000 7f80c2ffd700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 0x7f80b00a4de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f80c4107950 tx=0x7f80ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.527+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f80b409bdb0 con 0x7f80c4101460 2024-03-16T10:50:05.573 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070501 got 253403070508 for osd.8 2024-03-16T10:50:05.573 DEBUG:teuthology.parallel:result is None 2024-03-16T10:50:05.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.779+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f80c402db70 con 0x7f80c4101460 2024-03-16T10:50:05.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.780+0000 7f80c0ff9700 1 -- 172.21.15.17:0/1683073777 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80b40bb090 con 0x7f80c4101460 2024-03-16T10:50:05.780 INFO:teuthology.orchestra.run.smithi017.stdout:55834574928 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 msgr2=0x7f80b00a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 0x7f80b00a4de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f80c4107950 tx=0x7f80ac009260 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 msgr2=0x7f80c4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e9a0 tx=0x7f80b400ecb0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 shutdown_connections 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f80b00a2920 0x7f80b00a4de0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80c4101460 0x7f80c4102e70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80c41064b0 0x7f80c41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 --2- 172.21.15.17:0/1683073777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4101e10 0x7f80c41033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 >> 172.21.15.17:0/1683073777 conn(0x7f80c4077220 msgr2=0x7f80c406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 shutdown_connections 2024-03-16T10:50:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:05.782+0000 7f80ca026700 1 -- 172.21.15.17:0/1683073777 wait complete. 2024-03-16T10:50:06.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:06 smithi017 ceph-mon[32078]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-16T10:50:06.425 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:06 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1683073777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T10:50:06.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574928 for osd.1 2024-03-16T10:50:06.454 DEBUG:teuthology.parallel:result is None 2024-03-16T10:50:06.454 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-16T10:50:06.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-16T10:50:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:06 smithi111 ceph-mon[36315]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-16T10:50:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:06 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1683073777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T10:50:06.726 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:06.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:06 smithi174 ceph-mon[36202]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-16T10:50:06.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:06 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1683073777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-16T10:50:07.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:07 smithi017 ceph-mon[32078]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-03-16T10:50:07.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:07.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:07 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:07.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:07 smithi111 ceph-mon[36315]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-03-16T10:50:07.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:07.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:07 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:07 smithi174 ceph-mon[36202]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-03-16T10:50:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:08.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:07 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:08.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 -- 172.21.15.17:0/1104441557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c1011d0 msgr2=0x7fbc4c101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/1104441557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c101630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009990 tx=0x7fbc34009ca0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 -- 172.21.15.17:0/1104441557 shutdown_connections 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/1104441557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c107210 0x7fbc4c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/1104441557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c101b70 0x7fbc4c10e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/1104441557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c101630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.498+0000 7fbc50cf7700 1 -- 172.21.15.17:0/1104441557 >> 172.21.15.17:0/1104441557 conn(0x7fbc4c078100 msgr2=0x7fbc4c078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.499+0000 7fbc50cf7700 1 -- 172.21.15.17:0/1104441557 shutdown_connections 2024-03-16T10:50:08.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.499+0000 7fbc50cf7700 1 -- 172.21.15.17:0/1104441557 wait complete. 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.499+0000 7fbc50cf7700 1 Processor -- start 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.499+0000 7fbc50cf7700 1 -- start start 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c101b70 0x7fbc4c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c107210 0x7fbc4c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c111470 con 0x7fbc4c101b70 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c1112f0 con 0x7fbc4c1011d0 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c1115f0 con 0x7fbc4c107210 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc49d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c101b70 0x7fbc4c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41674/0 (socket says 172.21.15.17:41674) 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 -- 172.21.15.17:0/404777744 learned_addr learned my addr 172.21.15.17:0/404777744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4ad9d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c107210 0x7fbc4c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 -- 172.21.15.17:0/404777744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c107210 msgr2=0x7fbc4c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c107210 0x7fbc4c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 -- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c101b70 msgr2=0x7fbc4c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c101b70 0x7fbc4c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 -- 172.21.15.17:0/404777744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c198fc0 con 0x7fbc4c1011d0 2024-03-16T10:50:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc4a59c700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00ef10 tx=0x7fbc3c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00c9c0 con 0x7fbc4c1011d0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc3c019070 con 0x7fbc4c1011d0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.500+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c199250 con 0x7fbc4c1011d0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.501+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c007e60 con 0x7fbc4c1011d0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.501+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c1a5570 con 0x7fbc4c1011d0 2024-03-16T10:50:08.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.501+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c068f90 con 0x7fbc4c1011d0 2024-03-16T10:50:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.503+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7fbc3c012050 con 0x7fbc4c1011d0 2024-03-16T10:50:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.503+0000 7fbc437fe700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 0x7fbc380a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.504+0000 7fbc49d9b700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 0x7fbc380a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.504+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbc3c0cf170 con 0x7fbc4c1011d0 2024-03-16T10:50:08.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.504+0000 7fbc49d9b700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 0x7fbc380a4de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b2e0 tx=0x7fbc34005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:08.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.507+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbc3c010040 con 0x7fbc4c1011d0 2024-03-16T10:50:08.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.708+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc4c104fc0 con 0x7fbc380a2920 2024-03-16T10:50:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.715+0000 7fbc437fe700 1 -- 172.21.15.17:0/404777744 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258983 (secure 0 0 0) 0x7fbc4c104fc0 con 0x7fbc380a2920 2024-03-16T10:50:08.720 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:08.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 msgr2=0x7fbc380a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:08.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 0x7fbc380a4de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b2e0 tx=0x7fbc34005960 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 msgr2=0x7fbc4c19e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00ef10 tx=0x7fbc3c00c3a0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 shutdown_connections 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbc380a2920 0x7fbc380a4de0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc4c1011d0 0x7fbc4c19e6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c107210 0x7fbc4c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 --2- 172.21.15.17:0/404777744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc4c101b70 0x7fbc4c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 >> 172.21.15.17:0/404777744 conn(0x7fbc4c078100 msgr2=0x7fbc4c100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 shutdown_connections 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:08.719+0000 7fbc50cf7700 1 -- 172.21.15.17:0/404777744 wait complete. 2024-03-16T10:50:08.723 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:50:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:50:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:50:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:08.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:50:08.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:50:08.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:09.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:50:09.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:50:09.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:50:09.443 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-03-16T10:50:08.500770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658852,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":866,"num_read_kb":552,"num_write":422,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373392,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568432,"statfs":{"total":1151940427776,"available":1151558074368,"internally_reserved":0,"allocated":11980800,"data_stored":7441848,"data_compressed":113883,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002696"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273424+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:49:42.273424+0000","last_peered":"2024-03-16T10:49:42.273424+0000","last_clean":"2024-03-16T10:49:42.273424+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:49:42.273424+0000","last_undegraded":"2024-03-16T10:49:42.273424+0000","last_fullsized":"2024-03-16T10:49:42.273424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277169+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:49:42.277169+0000","last_peered":"2024-03-16T10:49:42.277169+0000","last_clean":"2024-03-16T10:49:42.277169+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:49:42.277169+0000","last_undegraded":"2024-03-16T10:49:42.277169+0000","last_fullsized":"2024-03-16T10:49:42.277169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276926+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:49:42.276926+0000","last_peered":"2024-03-16T10:49:42.276926+0000","last_clean":"2024-03-16T10:49:42.276926+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:49:42.276926+0000","last_undegraded":"2024-03-16T10:49:42.276926+0000","last_fullsized":"2024-03-16T10:49:42.276926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272372+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:49:42.272372+0000","last_peered":"2024-03-16T10:49:42.272372+0000","last_clean":"2024-03-16T10:49:42.272372+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:49:42.272372+0000","last_undegraded":"2024-03-16T10:49:42.272372+0000","last_fullsized":"2024-03-16T10:49:42.272372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275014+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:49:42.275014+0000","last_peered":"2024-03-16T10:49:42.275014+0000","last_clean":"2024-03-16T10:49:42.275014+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:49:42.275014+0000","last_undegraded":"2024-03-16T10:49:42.275014+0000","last_fullsized":"2024-03-16T10:49:42.275014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791331+0000","last_change":"2024-03-16T10:49:42.791331+0000","last_active":"2024-03-16T10:49:42.791331+0000","last_peered":"2024-03-16T10:49:42.791331+0000","last_clean":"2024-03-16T10:49:42.791331+0000","last_became_active":"2024-03-16T10:49:42.791066+0000","last_became_peered":"2024-03-16T10:49:42.791066+0000","last_unstale":"2024-03-16T10:49:42.791331+0000","last_undegraded":"2024-03-16T10:49:42.791331+0000","last_fullsized":"2024-03-16T10:49:42.791331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:01.493249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274853+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:49:42.274853+0000","last_peered":"2024-03-16T10:49:42.274853+0000","last_clean":"2024-03-16T10:49:42.274853+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:49:42.274853+0000","last_undegraded":"2024-03-16T10:49:42.274853+0000","last_fullsized":"2024-03-16T10:49:42.274853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271528+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:49:42.271528+0000","last_peered":"2024-03-16T10:49:42.271528+0000","last_clean":"2024-03-16T10:49:42.271528+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:49:42.271528+0000","last_undegraded":"2024-03-16T10:49:42.271528+0000","last_fullsized":"2024-03-16T10:49:42.271528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274985+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:49:42.274985+0000","last_peered":"2024-03-16T10:49:42.274985+0000","last_clean":"2024-03-16T10:49:42.274985+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:49:42.274985+0000","last_undegraded":"2024-03-16T10:49:42.274985+0000","last_fullsized":"2024-03-16T10:49:42.274985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274219+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:49:42.274219+0000","last_peered":"2024-03-16T10:49:42.274219+0000","last_clean":"2024-03-16T10:49:42.274219+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:49:42.274219+0000","last_undegraded":"2024-03-16T10:49:42.274219+0000","last_fullsized":"2024-03-16T10:49:42.274219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275513+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:49:42.275513+0000","last_peered":"2024-03-16T10:49:42.275513+0000","last_clean":"2024-03-16T10:49:42.275513+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:49:42.275513+0000","last_undegraded":"2024-03-16T10:49:42.275513+0000","last_fullsized":"2024-03-16T10:49:42.275513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272277+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:49:42.272277+0000","last_peered":"2024-03-16T10:49:42.272277+0000","last_clean":"2024-03-16T10:49:42.272277+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:49:42.272277+0000","last_undegraded":"2024-03-16T10:49:42.272277+0000","last_fullsized":"2024-03-16T10:49:42.272277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274671+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:49:42.274671+0000","last_peered":"2024-03-16T10:49:42.274671+0000","last_clean":"2024-03-16T10:49:42.274671+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:49:42.274671+0000","last_undegraded":"2024-03-16T10:49:42.274671+0000","last_fullsized":"2024-03-16T10:49:42.274671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276304+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:49:42.276304+0000","last_peered":"2024-03-16T10:49:42.276304+0000","last_clean":"2024-03-16T10:49:42.276304+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:49:42.276304+0000","last_undegraded":"2024-03-16T10:49:42.276304+0000","last_fullsized":"2024-03-16T10:49:42.276304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276343+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:49:42.276343+0000","last_peered":"2024-03-16T10:49:42.276343+0000","last_clean":"2024-03-16T10:49:42.276343+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:49:42.276343+0000","last_undegraded":"2024-03-16T10:49:42.276343+0000","last_fullsized":"2024-03-16T10:49:42.276343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274516+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:49:42.274516+0000","last_peered":"2024-03-16T10:49:42.274516+0000","last_clean":"2024-03-16T10:49:42.274516+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:49:42.274516+0000","last_undegraded":"2024-03-16T10:49:42.274516+0000","last_fullsized":"2024-03-16T10:49:42.274516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273682+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:49:42.273682+0000","last_peered":"2024-03-16T10:49:42.273682+0000","last_clean":"2024-03-16T10:49:42.273682+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:49:42.273682+0000","last_undegraded":"2024-03-16T10:49:42.273682+0000","last_fullsized":"2024-03-16T10:49:42.273682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791184+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:49:42.791184+0000","last_peered":"2024-03-16T10:49:42.791184+0000","last_clean":"2024-03-16T10:49:42.791184+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:49:42.791184+0000","last_undegraded":"2024-03-16T10:49:42.791184+0000","last_fullsized":"2024-03-16T10:49:42.791184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271829+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:49:42.271829+0000","last_peered":"2024-03-16T10:49:42.271829+0000","last_clean":"2024-03-16T10:49:42.271829+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:49:42.271829+0000","last_undegraded":"2024-03-16T10:49:42.271829+0000","last_fullsized":"2024-03-16T10:49:42.271829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":103,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.254751+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:50:04.254751+0000","last_peered":"2024-03-16T10:50:04.254751+0000","last_clean":"2024-03-16T10:50:04.254751+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:50:04.254751+0000","last_undegraded":"2024-03-16T10:50:04.254751+0000","last_fullsized":"2024-03-16T10:50:04.254751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272007+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:49:42.272007+0000","last_peered":"2024-03-16T10:49:42.272007+0000","last_clean":"2024-03-16T10:49:42.272007+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:49:42.272007+0000","last_undegraded":"2024-03-16T10:49:42.272007+0000","last_fullsized":"2024-03-16T10:49:42.272007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272144+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:49:42.272144+0000","last_peered":"2024-03-16T10:49:42.272144+0000","last_clean":"2024-03-16T10:49:42.272144+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:49:42.272144+0000","last_undegraded":"2024-03-16T10:49:42.272144+0000","last_fullsized":"2024-03-16T10:49:42.272144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277106+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:49:42.277106+0000","last_peered":"2024-03-16T10:49:42.277106+0000","last_clean":"2024-03-16T10:49:42.277106+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:49:42.277106+0000","last_undegraded":"2024-03-16T10:49:42.277106+0000","last_fullsized":"2024-03-16T10:49:42.277106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275771+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:49:42.275771+0000","last_peered":"2024-03-16T10:49:42.275771+0000","last_clean":"2024-03-16T10:49:42.275771+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:49:42.275771+0000","last_undegraded":"2024-03-16T10:49:42.275771+0000","last_fullsized":"2024-03-16T10:49:42.275771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275202+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:49:42.275202+0000","last_peered":"2024-03-16T10:49:42.275202+0000","last_clean":"2024-03-16T10:49:42.275202+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:49:42.275202+0000","last_undegraded":"2024-03-16T10:49:42.275202+0000","last_fullsized":"2024-03-16T10:49:42.275202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.282326+0000","last_change":"2024-03-16T10:49:42.282326+0000","last_active":"2024-03-16T10:49:42.282326+0000","last_peered":"2024-03-16T10:49:42.282326+0000","last_clean":"2024-03-16T10:49:42.282326+0000","last_became_active":"2024-03-16T10:49:42.277256+0000","last_became_peered":"2024-03-16T10:49:42.277256+0000","last_unstale":"2024-03-16T10:49:42.282326+0000","last_undegraded":"2024-03-16T10:49:42.282326+0000","last_fullsized":"2024-03-16T10:49:42.282326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:18.193268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275384+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:49:42.275384+0000","last_peered":"2024-03-16T10:49:42.275384+0000","last_clean":"2024-03-16T10:49:42.275384+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:49:42.275384+0000","last_undegraded":"2024-03-16T10:49:42.275384+0000","last_fullsized":"2024-03-16T10:49:42.275384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:03.248212+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:50:03.248212+0000","last_peered":"2024-03-16T10:50:03.248212+0000","last_clean":"2024-03-16T10:50:03.248212+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:50:03.248212+0000","last_undegraded":"2024-03-16T10:50:03.248212+0000","last_fullsized":"2024-03-16T10:50:03.248212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276343+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:49:42.276343+0000","last_peered":"2024-03-16T10:49:42.276343+0000","last_clean":"2024-03-16T10:49:42.276343+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:49:42.276343+0000","last_undegraded":"2024-03-16T10:49:42.276343+0000","last_fullsized":"2024-03-16T10:49:42.276343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274044+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:49:42.274044+0000","last_peered":"2024-03-16T10:49:42.274044+0000","last_clean":"2024-03-16T10:49:42.274044+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:49:42.274044+0000","last_undegraded":"2024-03-16T10:49:42.274044+0000","last_fullsized":"2024-03-16T10:49:42.274044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275414+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:49:42.275414+0000","last_peered":"2024-03-16T10:49:42.275414+0000","last_clean":"2024-03-16T10:49:42.275414+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:49:42.275414+0000","last_undegraded":"2024-03-16T10:49:42.275414+0000","last_fullsized":"2024-03-16T10:49:42.275414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274332+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:49:42.274332+0000","last_peered":"2024-03-16T10:49:42.274332+0000","last_clean":"2024-03-16T10:49:42.274332+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:49:42.274332+0000","last_undegraded":"2024-03-16T10:49:42.274332+0000","last_fullsized":"2024-03-16T10:49:42.274332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271464+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:49:42.271464+0000","last_peered":"2024-03-16T10:49:42.271464+0000","last_clean":"2024-03-16T10:49:42.271464+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:49:42.271464+0000","last_undegraded":"2024-03-16T10:49:42.271464+0000","last_fullsized":"2024-03-16T10:49:42.271464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275292+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:49:42.275292+0000","last_peered":"2024-03-16T10:49:42.275292+0000","last_clean":"2024-03-16T10:49:42.275292+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:49:42.275292+0000","last_undegraded":"2024-03-16T10:49:42.275292+0000","last_fullsized":"2024-03-16T10:49:42.275292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791065+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:49:42.791065+0000","last_peered":"2024-03-16T10:49:42.791065+0000","last_clean":"2024-03-16T10:49:42.791065+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:49:42.791065+0000","last_undegraded":"2024-03-16T10:49:42.791065+0000","last_fullsized":"2024-03-16T10:49:42.791065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.248866+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:50:04.248866+0000","last_peered":"2024-03-16T10:50:04.248866+0000","last_clean":"2024-03-16T10:50:04.248866+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:50:04.248866+0000","last_undegraded":"2024-03-16T10:50:04.248866+0000","last_fullsized":"2024-03-16T10:50:04.248866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274618+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:49:42.274618+0000","last_peered":"2024-03-16T10:49:42.274618+0000","last_clean":"2024-03-16T10:49:42.274618+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:49:42.274618+0000","last_undegraded":"2024-03-16T10:49:42.274618+0000","last_fullsized":"2024-03-16T10:49:42.274618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275650+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:49:42.275650+0000","last_peered":"2024-03-16T10:49:42.275650+0000","last_clean":"2024-03-16T10:49:42.275650+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:49:42.275650+0000","last_undegraded":"2024-03-16T10:49:42.275650+0000","last_fullsized":"2024-03-16T10:49:42.275650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277078+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:49:42.277078+0000","last_peered":"2024-03-16T10:49:42.277078+0000","last_clean":"2024-03-16T10:49:42.277078+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:49:42.277078+0000","last_undegraded":"2024-03-16T10:49:42.277078+0000","last_fullsized":"2024-03-16T10:49:42.277078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275492+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:49:42.275492+0000","last_peered":"2024-03-16T10:49:42.275492+0000","last_clean":"2024-03-16T10:49:42.275492+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:49:42.275492+0000","last_undegraded":"2024-03-16T10:49:42.275492+0000","last_fullsized":"2024-03-16T10:49:42.275492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275404+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:49:42.275404+0000","last_peered":"2024-03-16T10:49:42.275404+0000","last_clean":"2024-03-16T10:49:42.275404+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:49:42.275404+0000","last_undegraded":"2024-03-16T10:49:42.275404+0000","last_fullsized":"2024-03-16T10:49:42.275404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'30","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.251332+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:50:04.251332+0000","last_peered":"2024-03-16T10:50:04.251332+0000","last_clean":"2024-03-16T10:50:04.251332+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:50:04.251332+0000","last_undegraded":"2024-03-16T10:50:04.251332+0000","last_fullsized":"2024-03-16T10:50:04.251332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275482+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:49:42.275482+0000","last_peered":"2024-03-16T10:49:42.275482+0000","last_clean":"2024-03-16T10:49:42.275482+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:49:42.275482+0000","last_undegraded":"2024-03-16T10:49:42.275482+0000","last_fullsized":"2024-03-16T10:49:42.275482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271826+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:49:42.271826+0000","last_peered":"2024-03-16T10:49:42.271826+0000","last_clean":"2024-03-16T10:49:42.271826+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:49:42.271826+0000","last_undegraded":"2024-03-16T10:49:42.271826+0000","last_fullsized":"2024-03-16T10:49:42.271826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274472+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:49:42.274472+0000","last_peered":"2024-03-16T10:49:42.274472+0000","last_clean":"2024-03-16T10:49:42.274472+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:49:42.274472+0000","last_undegraded":"2024-03-16T10:49:42.274472+0000","last_fullsized":"2024-03-16T10:49:42.274472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275782+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:49:42.275782+0000","last_peered":"2024-03-16T10:49:42.275782+0000","last_clean":"2024-03-16T10:49:42.275782+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:49:42.275782+0000","last_undegraded":"2024-03-16T10:49:42.275782+0000","last_fullsized":"2024-03-16T10:49:42.275782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792180+0000","last_change":"2024-03-16T10:49:42.792180+0000","last_active":"2024-03-16T10:49:42.792180+0000","last_peered":"2024-03-16T10:49:42.792180+0000","last_clean":"2024-03-16T10:49:42.792180+0000","last_became_active":"2024-03-16T10:49:42.791813+0000","last_became_peered":"2024-03-16T10:49:42.791813+0000","last_unstale":"2024-03-16T10:49:42.792180+0000","last_undegraded":"2024-03-16T10:49:42.792180+0000","last_fullsized":"2024-03-16T10:49:42.792180+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:48.571823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.248775+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:50:04.248775+0000","last_peered":"2024-03-16T10:50:04.248775+0000","last_clean":"2024-03-16T10:50:04.248775+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:50:04.248775+0000","last_undegraded":"2024-03-16T10:50:04.248775+0000","last_fullsized":"2024-03-16T10:50:04.248775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274619+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:49:42.274619+0000","last_peered":"2024-03-16T10:49:42.274619+0000","last_clean":"2024-03-16T10:49:42.274619+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:49:42.274619+0000","last_undegraded":"2024-03-16T10:49:42.274619+0000","last_fullsized":"2024-03-16T10:49:42.274619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275173+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:49:42.275173+0000","last_peered":"2024-03-16T10:49:42.275173+0000","last_clean":"2024-03-16T10:49:42.275173+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:49:42.275173+0000","last_undegraded":"2024-03-16T10:49:42.275173+0000","last_fullsized":"2024-03-16T10:49:42.275173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275515+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:49:42.275515+0000","last_peered":"2024-03-16T10:49:42.275515+0000","last_clean":"2024-03-16T10:49:42.275515+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:49:42.275515+0000","last_undegraded":"2024-03-16T10:49:42.275515+0000","last_fullsized":"2024-03-16T10:49:42.275515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275702+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:49:42.275702+0000","last_peered":"2024-03-16T10:49:42.275702+0000","last_clean":"2024-03-16T10:49:42.275702+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:49:42.275702+0000","last_undegraded":"2024-03-16T10:49:42.275702+0000","last_fullsized":"2024-03-16T10:49:42.275702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273289+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:49:42.273289+0000","last_peered":"2024-03-16T10:49:42.273289+0000","last_clean":"2024-03-16T10:49:42.273289+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:49:42.273289+0000","last_undegraded":"2024-03-16T10:49:42.273289+0000","last_fullsized":"2024-03-16T10:49:42.273289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791042+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:49:42.791042+0000","last_peered":"2024-03-16T10:49:42.791042+0000","last_clean":"2024-03-16T10:49:42.791042+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:49:42.791042+0000","last_undegraded":"2024-03-16T10:49:42.791042+0000","last_fullsized":"2024-03-16T10:49:42.791042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274245+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:49:42.274245+0000","last_peered":"2024-03-16T10:49:42.274245+0000","last_clean":"2024-03-16T10:49:42.274245+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:49:42.274245+0000","last_undegraded":"2024-03-16T10:49:42.274245+0000","last_fullsized":"2024-03-16T10:49:42.274245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:05.256071+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:50:05.256071+0000","last_peered":"2024-03-16T10:50:05.256071+0000","last_clean":"2024-03-16T10:50:05.256071+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:50:05.256071+0000","last_undegraded":"2024-03-16T10:50:05.256071+0000","last_fullsized":"2024-03-16T10:50:05.256071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274017+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:49:42.274017+0000","last_peered":"2024-03-16T10:49:42.274017+0000","last_clean":"2024-03-16T10:49:42.274017+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:49:42.274017+0000","last_undegraded":"2024-03-16T10:49:42.274017+0000","last_fullsized":"2024-03-16T10:49:42.274017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275493+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:49:42.275493+0000","last_peered":"2024-03-16T10:49:42.275493+0000","last_clean":"2024-03-16T10:49:42.275493+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:49:42.275493+0000","last_undegraded":"2024-03-16T10:49:42.275493+0000","last_fullsized":"2024-03-16T10:49:42.275493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.248389+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:50:04.248389+0000","last_peered":"2024-03-16T10:50:04.248389+0000","last_clean":"2024-03-16T10:50:04.248389+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:50:04.248389+0000","last_undegraded":"2024-03-16T10:50:04.248389+0000","last_fullsized":"2024-03-16T10:50:04.248389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271801+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:49:42.271801+0000","last_peered":"2024-03-16T10:49:42.271801+0000","last_clean":"2024-03-16T10:49:42.271801+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:49:42.271801+0000","last_undegraded":"2024-03-16T10:49:42.271801+0000","last_fullsized":"2024-03-16T10:49:42.271801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272073+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:49:42.272073+0000","last_peered":"2024-03-16T10:49:42.272073+0000","last_clean":"2024-03-16T10:49:42.272073+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:49:42.272073+0000","last_undegraded":"2024-03-16T10:49:42.272073+0000","last_fullsized":"2024-03-16T10:49:42.272073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274623+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:49:42.274623+0000","last_peered":"2024-03-16T10:49:42.274623+0000","last_clean":"2024-03-16T10:49:42.274623+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:49:42.274623+0000","last_undegraded":"2024-03-16T10:49:42.274623+0000","last_fullsized":"2024-03-16T10:49:42.274623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274211+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:49:42.274211+0000","last_peered":"2024-03-16T10:49:42.274211+0000","last_clean":"2024-03-16T10:49:42.274211+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:49:42.274211+0000","last_undegraded":"2024-03-16T10:49:42.274211+0000","last_fullsized":"2024-03-16T10:49:42.274211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274812+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:49:42.274812+0000","last_peered":"2024-03-16T10:49:42.274812+0000","last_clean":"2024-03-16T10:49:42.274812+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:49:42.274812+0000","last_undegraded":"2024-03-16T10:49:42.274812+0000","last_fullsized":"2024-03-16T10:49:42.274812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275583+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:49:42.275583+0000","last_peered":"2024-03-16T10:49:42.275583+0000","last_clean":"2024-03-16T10:49:42.275583+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:49:42.275583+0000","last_undegraded":"2024-03-16T10:49:42.275583+0000","last_fullsized":"2024-03-16T10:49:42.275583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274670+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:49:42.274670+0000","last_peered":"2024-03-16T10:49:42.274670+0000","last_clean":"2024-03-16T10:49:42.274670+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:49:42.274670+0000","last_undegraded":"2024-03-16T10:49:42.274670+0000","last_fullsized":"2024-03-16T10:49:42.274670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'13","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791225+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:49:42.791225+0000","last_peered":"2024-03-16T10:49:42.791225+0000","last_clean":"2024-03-16T10:49:42.791225+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:49:42.791225+0000","last_undegraded":"2024-03-16T10:49:42.791225+0000","last_fullsized":"2024-03-16T10:49:42.791225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272292+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:49:42.272292+0000","last_peered":"2024-03-16T10:49:42.272292+0000","last_clean":"2024-03-16T10:49:42.272292+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:49:42.272292+0000","last_undegraded":"2024-03-16T10:49:42.272292+0000","last_fullsized":"2024-03-16T10:49:42.272292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272671+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:49:42.272671+0000","last_peered":"2024-03-16T10:49:42.272671+0000","last_clean":"2024-03-16T10:49:42.272671+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:49:42.272671+0000","last_undegraded":"2024-03-16T10:49:42.272671+0000","last_fullsized":"2024-03-16T10:49:42.272671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277216+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:49:42.277216+0000","last_peered":"2024-03-16T10:49:42.277216+0000","last_clean":"2024-03-16T10:49:42.277216+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:49:42.277216+0000","last_undegraded":"2024-03-16T10:49:42.277216+0000","last_fullsized":"2024-03-16T10:49:42.277216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.280047+0000","last_change":"2024-03-16T10:49:42.280047+0000","last_active":"2024-03-16T10:49:42.280047+0000","last_peered":"2024-03-16T10:49:42.280047+0000","last_clean":"2024-03-16T10:49:42.280047+0000","last_became_active":"2024-03-16T10:49:42.277477+0000","last_became_peered":"2024-03-16T10:49:42.277477+0000","last_unstale":"2024-03-16T10:49:42.280047+0000","last_undegraded":"2024-03-16T10:49:42.280047+0000","last_fullsized":"2024-03-16T10:49:42.280047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:04.299467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275285+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:49:42.275285+0000","last_peered":"2024-03-16T10:49:42.275285+0000","last_clean":"2024-03-16T10:49:42.275285+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:49:42.275285+0000","last_undegraded":"2024-03-16T10:49:42.275285+0000","last_fullsized":"2024-03-16T10:49:42.275285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271623+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:49:42.271623+0000","last_peered":"2024-03-16T10:49:42.271623+0000","last_clean":"2024-03-16T10:49:42.271623+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:49:42.271623+0000","last_undegraded":"2024-03-16T10:49:42.271623+0000","last_fullsized":"2024-03-16T10:49:42.271623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273044+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:49:42.273044+0000","last_peered":"2024-03-16T10:49:42.273044+0000","last_clean":"2024-03-16T10:49:42.273044+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:49:42.273044+0000","last_undegraded":"2024-03-16T10:49:42.273044+0000","last_fullsized":"2024-03-16T10:49:42.273044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272057+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:49:42.272057+0000","last_peered":"2024-03-16T10:49:42.272057+0000","last_clean":"2024-03-16T10:49:42.272057+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:49:42.272057+0000","last_undegraded":"2024-03-16T10:49:42.272057+0000","last_fullsized":"2024-03-16T10:49:42.272057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271972+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:49:42.271972+0000","last_peered":"2024-03-16T10:49:42.271972+0000","last_clean":"2024-03-16T10:49:42.271972+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:49:42.271972+0000","last_undegraded":"2024-03-16T10:49:42.271972+0000","last_fullsized":"2024-03-16T10:49:42.271972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275122+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:49:42.275122+0000","last_peered":"2024-03-16T10:49:42.275122+0000","last_clean":"2024-03-16T10:49:42.275122+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:49:42.275122+0000","last_undegraded":"2024-03-16T10:49:42.275122+0000","last_fullsized":"2024-03-16T10:49:42.275122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275395+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:49:42.275395+0000","last_peered":"2024-03-16T10:49:42.275395+0000","last_clean":"2024-03-16T10:49:42.275395+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:49:42.275395+0000","last_undegraded":"2024-03-16T10:49:42.275395+0000","last_fullsized":"2024-03-16T10:49:42.275395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.249426+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:50:04.249426+0000","last_peered":"2024-03-16T10:50:04.249426+0000","last_clean":"2024-03-16T10:50:04.249426+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:50:04.249426+0000","last_undegraded":"2024-03-16T10:50:04.249426+0000","last_fullsized":"2024-03-16T10:50:04.249426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275540+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:49:42.275540+0000","last_peered":"2024-03-16T10:49:42.275540+0000","last_clean":"2024-03-16T10:49:42.275540+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:49:42.275540+0000","last_undegraded":"2024-03-16T10:49:42.275540+0000","last_fullsized":"2024-03-16T10:49:42.275540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275274+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:49:42.275274+0000","last_peered":"2024-03-16T10:49:42.275274+0000","last_clean":"2024-03-16T10:49:42.275274+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:49:42.275274+0000","last_undegraded":"2024-03-16T10:49:42.275274+0000","last_fullsized":"2024-03-16T10:49:42.275274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275421+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:49:42.275421+0000","last_peered":"2024-03-16T10:49:42.275421+0000","last_clean":"2024-03-16T10:49:42.275421+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:49:42.275421+0000","last_undegraded":"2024-03-16T10:49:42.275421+0000","last_fullsized":"2024-03-16T10:49:42.275421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274672+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:49:42.274672+0000","last_peered":"2024-03-16T10:49:42.274672+0000","last_clean":"2024-03-16T10:49:42.274672+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:49:42.274672+0000","last_undegraded":"2024-03-16T10:49:42.274672+0000","last_fullsized":"2024-03-16T10:49:42.274672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275835+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:49:42.275835+0000","last_peered":"2024-03-16T10:49:42.275835+0000","last_clean":"2024-03-16T10:49:42.275835+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:49:42.275835+0000","last_undegraded":"2024-03-16T10:49:42.275835+0000","last_fullsized":"2024-03-16T10:49:42.275835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792025+0000","last_change":"2024-03-16T10:49:42.792025+0000","last_active":"2024-03-16T10:49:42.792025+0000","last_peered":"2024-03-16T10:49:42.792025+0000","last_clean":"2024-03-16T10:49:42.792025+0000","last_became_active":"2024-03-16T10:49:42.791745+0000","last_became_peered":"2024-03-16T10:49:42.791745+0000","last_unstale":"2024-03-16T10:49:42.792025+0000","last_undegraded":"2024-03-16T10:49:42.792025+0000","last_fullsized":"2024-03-16T10:49:42.792025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:50:32.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271692+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:49:42.271692+0000","last_peered":"2024-03-16T10:49:42.271692+0000","last_clean":"2024-03-16T10:49:42.271692+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:49:42.271692+0000","last_undegraded":"2024-03-16T10:49:42.271692+0000","last_fullsized":"2024-03-16T10:49:42.271692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271930+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:49:42.271930+0000","last_peered":"2024-03-16T10:49:42.271930+0000","last_clean":"2024-03-16T10:49:42.271930+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:49:42.271930+0000","last_undegraded":"2024-03-16T10:49:42.271930+0000","last_fullsized":"2024-03-16T10:49:42.271930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276617+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:49:42.276617+0000","last_peered":"2024-03-16T10:49:42.276617+0000","last_clean":"2024-03-16T10:49:42.276617+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:49:42.276617+0000","last_undegraded":"2024-03-16T10:49:42.276617+0000","last_fullsized":"2024-03-16T10:49:42.276617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792395+0000","last_change":"2024-03-16T10:49:42.792395+0000","last_active":"2024-03-16T10:49:42.792395+0000","last_peered":"2024-03-16T10:49:42.792395+0000","last_clean":"2024-03-16T10:49:42.792395+0000","last_became_active":"2024-03-16T10:49:42.791992+0000","last_became_peered":"2024-03-16T10:49:42.791992+0000","last_unstale":"2024-03-16T10:49:42.792395+0000","last_undegraded":"2024-03-16T10:49:42.792395+0000","last_fullsized":"2024-03-16T10:49:42.792395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:15:16.825389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273166+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:49:42.273166+0000","last_peered":"2024-03-16T10:49:42.273166+0000","last_clean":"2024-03-16T10:49:42.273166+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:49:42.273166+0000","last_undegraded":"2024-03-16T10:49:42.273166+0000","last_fullsized":"2024-03-16T10:49:42.273166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272165+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:49:42.272165+0000","last_peered":"2024-03-16T10:49:42.272165+0000","last_clean":"2024-03-16T10:49:42.272165+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:49:42.272165+0000","last_undegraded":"2024-03-16T10:49:42.272165+0000","last_fullsized":"2024-03-16T10:49:42.272165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272198+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:49:42.272198+0000","last_peered":"2024-03-16T10:49:42.272198+0000","last_clean":"2024-03-16T10:49:42.272198+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:49:42.272198+0000","last_undegraded":"2024-03-16T10:49:42.272198+0000","last_fullsized":"2024-03-16T10:49:42.272198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275384+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:49:42.275384+0000","last_peered":"2024-03-16T10:49:42.275384+0000","last_clean":"2024-03-16T10:49:42.275384+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:49:42.275384+0000","last_undegraded":"2024-03-16T10:49:42.275384+0000","last_fullsized":"2024-03-16T10:49:42.275384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271486+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:49:42.271486+0000","last_peered":"2024-03-16T10:49:42.271486+0000","last_clean":"2024-03-16T10:49:42.271486+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:49:42.271486+0000","last_undegraded":"2024-03-16T10:49:42.271486+0000","last_fullsized":"2024-03-16T10:49:42.271486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273802+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:49:42.273802+0000","last_peered":"2024-03-16T10:49:42.273802+0000","last_clean":"2024-03-16T10:49:42.273802+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:49:42.273802+0000","last_undegraded":"2024-03-16T10:49:42.273802+0000","last_fullsized":"2024-03-16T10:49:42.273802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274658+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:49:42.274658+0000","last_peered":"2024-03-16T10:49:42.274658+0000","last_clean":"2024-03-16T10:49:42.274658+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:49:42.274658+0000","last_undegraded":"2024-03-16T10:49:42.274658+0000","last_fullsized":"2024-03-16T10:49:42.274658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273216+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:49:42.273216+0000","last_peered":"2024-03-16T10:49:42.273216+0000","last_clean":"2024-03-16T10:49:42.273216+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:49:42.273216+0000","last_undegraded":"2024-03-16T10:49:42.273216+0000","last_fullsized":"2024-03-16T10:49:42.273216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68250,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":740,"num_read_kb":443,"num_write":239,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":204750,"data_compressed":5628,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383708,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":457215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":1109099,"data_compressed":37961,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070509,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":456359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1024000,"data_stored":1049850,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":958464,"data_stored":456280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":518239,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":457619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1036288,"data_stored":518850,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757308,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1049137,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62798,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63409,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63173,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:50:09.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-16T10:50:09.697 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:10.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:10 smithi017 ceph-mon[32078]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:10.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:10 smithi017 ceph-mon[32078]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:10.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:10 smithi174 ceph-mon[36202]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:10.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:10 smithi174 ceph-mon[36202]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:10.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:10 smithi111 ceph-mon[36315]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:10.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:10 smithi111 ceph-mon[36315]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:11.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 -- 172.21.15.17:0/2957667204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 msgr2=0x7f62d4101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 --2- 172.21.15.17:0/2957667204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d4101630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009990 tx=0x7f62bc009ca0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 -- 172.21.15.17:0/2957667204 shutdown_connections 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 --2- 172.21.15.17:0/2957667204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 0x7f62d41075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 --2- 172.21.15.17:0/2957667204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 --2- 172.21.15.17:0/2957667204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d4101630 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 -- 172.21.15.17:0/2957667204 >> 172.21.15.17:0/2957667204 conn(0x7f62d4078100 msgr2=0x7f62d4078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 -- 172.21.15.17:0/2957667204 shutdown_connections 2024-03-16T10:50:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.331+0000 7f62d9126700 1 -- 172.21.15.17:0/2957667204 wait complete. 2024-03-16T10:50:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 Processor -- start 2024-03-16T10:50:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 -- start start 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 0x7f62d4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62d4111470 con 0x7f62d41011d0 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41112f0 con 0x7f62d4107210 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d9126700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f62d41115f0 con 0x7f62d4101b70 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45634/0 (socket says 172.21.15.17:45634) 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d2d9d700 1 -- 172.21.15.17:0/2293619592 learned_addr learned my addr 172.21.15.17:0/2293619592 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62d359e700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 0x7f62d4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.332+0000 7f62cbfff700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 -- 172.21.15.17:0/2293619592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 msgr2=0x7f62d419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 -- 172.21.15.17:0/2293619592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 msgr2=0x7f62d4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 0x7f62d4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 -- 172.21.15.17:0/2293619592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d4198fc0 con 0x7f62d41011d0 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62cbfff700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d2d9d700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62c400eb30 tx=0x7f62c400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c400cbd0 con 0x7f62d41011d0 2024-03-16T10:50:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d41992b0 con 0x7f62d41011d0 2024-03-16T10:50:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c4004500 con 0x7f62d41011d0 2024-03-16T10:50:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4010430 con 0x7f62d41011d0 2024-03-16T10:50:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.333+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d41a5570 con 0x7f62d41011d0 2024-03-16T10:50:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.334+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d4068f90 con 0x7f62d41011d0 2024-03-16T10:50:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.336+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 137341+0+0 (secure 0 0 0) 0x7f62c4003f00 con 0x7f62d41011d0 2024-03-16T10:50:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.336+0000 7f62d0d99700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 0x7f62c00a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.336+0000 7f62cbfff700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 0x7f62c00a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.337+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f62c40cedb0 con 0x7f62d41011d0 2024-03-16T10:50:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.337+0000 7f62cbfff700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 0x7f62c00a4de0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00b2e0 tx=0x7f62bc005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:11.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.344+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f62c409bdf0 con 0x7f62d41011d0 2024-03-16T10:50:11.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.545+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62d4104fc0 con 0x7f62c00a2920 2024-03-16T10:50:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.554+0000 7f62d0d99700 1 -- 172.21.15.17:0/2293619592 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258984 (secure 0 0 0) 0x7f62bc0673c0 con 0x7f62c00a2920 2024-03-16T10:50:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 msgr2=0x7f62c00a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 0x7f62c00a4de0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00b2e0 tx=0x7f62bc005960 comp rx=0 tx=0).stop 2024-03-16T10:50:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 msgr2=0x7f62d419e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62c400eb30 tx=0x7f62c400ee40 comp rx=0 tx=0).stop 2024-03-16T10:50:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 shutdown_connections 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f62c00a2920 0x7f62c00a4de0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62d4107210 0x7f62d4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d41011d0 0x7f62d419e6a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 --2- 172.21.15.17:0/2293619592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62d4101b70 0x7f62d419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 >> 172.21.15.17:0/2293619592 conn(0x7f62d4078100 msgr2=0x7f62d4100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 shutdown_connections 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:11.557+0000 7f62d9126700 1 -- 172.21.15.17:0/2293619592 wait complete. 2024-03-16T10:50:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:50:12.244 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:12 smithi017 ceph-mon[32078]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:12.272 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-03-16T10:50:10.501193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658852,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":891,"num_read_kb":567,"num_write":422,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373392,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568432,"statfs":{"total":1151940427776,"available":1151558074368,"internally_reserved":0,"allocated":11980800,"data_stored":7441848,"data_compressed":113883,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002670"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273424+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:49:42.273424+0000","last_peered":"2024-03-16T10:49:42.273424+0000","last_clean":"2024-03-16T10:49:42.273424+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:49:42.273424+0000","last_undegraded":"2024-03-16T10:49:42.273424+0000","last_fullsized":"2024-03-16T10:49:42.273424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277169+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:49:42.277169+0000","last_peered":"2024-03-16T10:49:42.277169+0000","last_clean":"2024-03-16T10:49:42.277169+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:49:42.277169+0000","last_undegraded":"2024-03-16T10:49:42.277169+0000","last_fullsized":"2024-03-16T10:49:42.277169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276926+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:49:42.276926+0000","last_peered":"2024-03-16T10:49:42.276926+0000","last_clean":"2024-03-16T10:49:42.276926+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:49:42.276926+0000","last_undegraded":"2024-03-16T10:49:42.276926+0000","last_fullsized":"2024-03-16T10:49:42.276926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272372+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:49:42.272372+0000","last_peered":"2024-03-16T10:49:42.272372+0000","last_clean":"2024-03-16T10:49:42.272372+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:49:42.272372+0000","last_undegraded":"2024-03-16T10:49:42.272372+0000","last_fullsized":"2024-03-16T10:49:42.272372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275014+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:49:42.275014+0000","last_peered":"2024-03-16T10:49:42.275014+0000","last_clean":"2024-03-16T10:49:42.275014+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:49:42.275014+0000","last_undegraded":"2024-03-16T10:49:42.275014+0000","last_fullsized":"2024-03-16T10:49:42.275014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791331+0000","last_change":"2024-03-16T10:49:42.791331+0000","last_active":"2024-03-16T10:49:42.791331+0000","last_peered":"2024-03-16T10:49:42.791331+0000","last_clean":"2024-03-16T10:49:42.791331+0000","last_became_active":"2024-03-16T10:49:42.791066+0000","last_became_peered":"2024-03-16T10:49:42.791066+0000","last_unstale":"2024-03-16T10:49:42.791331+0000","last_undegraded":"2024-03-16T10:49:42.791331+0000","last_fullsized":"2024-03-16T10:49:42.791331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:01.493249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274853+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:49:42.274853+0000","last_peered":"2024-03-16T10:49:42.274853+0000","last_clean":"2024-03-16T10:49:42.274853+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:49:42.274853+0000","last_undegraded":"2024-03-16T10:49:42.274853+0000","last_fullsized":"2024-03-16T10:49:42.274853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271528+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:49:42.271528+0000","last_peered":"2024-03-16T10:49:42.271528+0000","last_clean":"2024-03-16T10:49:42.271528+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:49:42.271528+0000","last_undegraded":"2024-03-16T10:49:42.271528+0000","last_fullsized":"2024-03-16T10:49:42.271528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274985+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:49:42.274985+0000","last_peered":"2024-03-16T10:49:42.274985+0000","last_clean":"2024-03-16T10:49:42.274985+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:49:42.274985+0000","last_undegraded":"2024-03-16T10:49:42.274985+0000","last_fullsized":"2024-03-16T10:49:42.274985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274219+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:49:42.274219+0000","last_peered":"2024-03-16T10:49:42.274219+0000","last_clean":"2024-03-16T10:49:42.274219+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:49:42.274219+0000","last_undegraded":"2024-03-16T10:49:42.274219+0000","last_fullsized":"2024-03-16T10:49:42.274219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275513+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:49:42.275513+0000","last_peered":"2024-03-16T10:49:42.275513+0000","last_clean":"2024-03-16T10:49:42.275513+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:49:42.275513+0000","last_undegraded":"2024-03-16T10:49:42.275513+0000","last_fullsized":"2024-03-16T10:49:42.275513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272277+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:49:42.272277+0000","last_peered":"2024-03-16T10:49:42.272277+0000","last_clean":"2024-03-16T10:49:42.272277+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:49:42.272277+0000","last_undegraded":"2024-03-16T10:49:42.272277+0000","last_fullsized":"2024-03-16T10:49:42.272277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274671+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:49:42.274671+0000","last_peered":"2024-03-16T10:49:42.274671+0000","last_clean":"2024-03-16T10:49:42.274671+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:49:42.274671+0000","last_undegraded":"2024-03-16T10:49:42.274671+0000","last_fullsized":"2024-03-16T10:49:42.274671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276304+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:49:42.276304+0000","last_peered":"2024-03-16T10:49:42.276304+0000","last_clean":"2024-03-16T10:49:42.276304+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:49:42.276304+0000","last_undegraded":"2024-03-16T10:49:42.276304+0000","last_fullsized":"2024-03-16T10:49:42.276304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276343+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:49:42.276343+0000","last_peered":"2024-03-16T10:49:42.276343+0000","last_clean":"2024-03-16T10:49:42.276343+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:49:42.276343+0000","last_undegraded":"2024-03-16T10:49:42.276343+0000","last_fullsized":"2024-03-16T10:49:42.276343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274516+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:49:42.274516+0000","last_peered":"2024-03-16T10:49:42.274516+0000","last_clean":"2024-03-16T10:49:42.274516+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:49:42.274516+0000","last_undegraded":"2024-03-16T10:49:42.274516+0000","last_fullsized":"2024-03-16T10:49:42.274516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273682+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:49:42.273682+0000","last_peered":"2024-03-16T10:49:42.273682+0000","last_clean":"2024-03-16T10:49:42.273682+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:49:42.273682+0000","last_undegraded":"2024-03-16T10:49:42.273682+0000","last_fullsized":"2024-03-16T10:49:42.273682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791184+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:49:42.791184+0000","last_peered":"2024-03-16T10:49:42.791184+0000","last_clean":"2024-03-16T10:49:42.791184+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:49:42.791184+0000","last_undegraded":"2024-03-16T10:49:42.791184+0000","last_fullsized":"2024-03-16T10:49:42.791184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271829+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:49:42.271829+0000","last_peered":"2024-03-16T10:49:42.271829+0000","last_clean":"2024-03-16T10:49:42.271829+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:49:42.271829+0000","last_undegraded":"2024-03-16T10:49:42.271829+0000","last_fullsized":"2024-03-16T10:49:42.271829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":103,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.254751+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:50:04.254751+0000","last_peered":"2024-03-16T10:50:04.254751+0000","last_clean":"2024-03-16T10:50:04.254751+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:50:04.254751+0000","last_undegraded":"2024-03-16T10:50:04.254751+0000","last_fullsized":"2024-03-16T10:50:04.254751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272007+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:49:42.272007+0000","last_peered":"2024-03-16T10:49:42.272007+0000","last_clean":"2024-03-16T10:49:42.272007+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:49:42.272007+0000","last_undegraded":"2024-03-16T10:49:42.272007+0000","last_fullsized":"2024-03-16T10:49:42.272007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272144+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:49:42.272144+0000","last_peered":"2024-03-16T10:49:42.272144+0000","last_clean":"2024-03-16T10:49:42.272144+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:49:42.272144+0000","last_undegraded":"2024-03-16T10:49:42.272144+0000","last_fullsized":"2024-03-16T10:49:42.272144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277106+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:49:42.277106+0000","last_peered":"2024-03-16T10:49:42.277106+0000","last_clean":"2024-03-16T10:49:42.277106+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:49:42.277106+0000","last_undegraded":"2024-03-16T10:49:42.277106+0000","last_fullsized":"2024-03-16T10:49:42.277106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275771+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:49:42.275771+0000","last_peered":"2024-03-16T10:49:42.275771+0000","last_clean":"2024-03-16T10:49:42.275771+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:49:42.275771+0000","last_undegraded":"2024-03-16T10:49:42.275771+0000","last_fullsized":"2024-03-16T10:49:42.275771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275202+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:49:42.275202+0000","last_peered":"2024-03-16T10:49:42.275202+0000","last_clean":"2024-03-16T10:49:42.275202+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:49:42.275202+0000","last_undegraded":"2024-03-16T10:49:42.275202+0000","last_fullsized":"2024-03-16T10:49:42.275202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.282326+0000","last_change":"2024-03-16T10:49:42.282326+0000","last_active":"2024-03-16T10:49:42.282326+0000","last_peered":"2024-03-16T10:49:42.282326+0000","last_clean":"2024-03-16T10:49:42.282326+0000","last_became_active":"2024-03-16T10:49:42.277256+0000","last_became_peered":"2024-03-16T10:49:42.277256+0000","last_unstale":"2024-03-16T10:49:42.282326+0000","last_undegraded":"2024-03-16T10:49:42.282326+0000","last_fullsized":"2024-03-16T10:49:42.282326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:18.193268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275384+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:49:42.275384+0000","last_peered":"2024-03-16T10:49:42.275384+0000","last_clean":"2024-03-16T10:49:42.275384+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:49:42.275384+0000","last_undegraded":"2024-03-16T10:49:42.275384+0000","last_fullsized":"2024-03-16T10:49:42.275384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:08.253598+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:50:08.253598+0000","last_peered":"2024-03-16T10:50:08.253598+0000","last_clean":"2024-03-16T10:50:08.253598+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:50:08.253598+0000","last_undegraded":"2024-03-16T10:50:08.253598+0000","last_fullsized":"2024-03-16T10:50:08.253598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276343+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:49:42.276343+0000","last_peered":"2024-03-16T10:49:42.276343+0000","last_clean":"2024-03-16T10:49:42.276343+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:49:42.276343+0000","last_undegraded":"2024-03-16T10:49:42.276343+0000","last_fullsized":"2024-03-16T10:49:42.276343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274044+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:49:42.274044+0000","last_peered":"2024-03-16T10:49:42.274044+0000","last_clean":"2024-03-16T10:49:42.274044+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:49:42.274044+0000","last_undegraded":"2024-03-16T10:49:42.274044+0000","last_fullsized":"2024-03-16T10:49:42.274044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275414+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:49:42.275414+0000","last_peered":"2024-03-16T10:49:42.275414+0000","last_clean":"2024-03-16T10:49:42.275414+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:49:42.275414+0000","last_undegraded":"2024-03-16T10:49:42.275414+0000","last_fullsized":"2024-03-16T10:49:42.275414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274332+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:49:42.274332+0000","last_peered":"2024-03-16T10:49:42.274332+0000","last_clean":"2024-03-16T10:49:42.274332+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:49:42.274332+0000","last_undegraded":"2024-03-16T10:49:42.274332+0000","last_fullsized":"2024-03-16T10:49:42.274332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271464+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:49:42.271464+0000","last_peered":"2024-03-16T10:49:42.271464+0000","last_clean":"2024-03-16T10:49:42.271464+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:49:42.271464+0000","last_undegraded":"2024-03-16T10:49:42.271464+0000","last_fullsized":"2024-03-16T10:49:42.271464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275292+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:49:42.275292+0000","last_peered":"2024-03-16T10:49:42.275292+0000","last_clean":"2024-03-16T10:49:42.275292+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:49:42.275292+0000","last_undegraded":"2024-03-16T10:49:42.275292+0000","last_fullsized":"2024-03-16T10:49:42.275292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791065+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:49:42.791065+0000","last_peered":"2024-03-16T10:49:42.791065+0000","last_clean":"2024-03-16T10:49:42.791065+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:49:42.791065+0000","last_undegraded":"2024-03-16T10:49:42.791065+0000","last_fullsized":"2024-03-16T10:49:42.791065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:09.254205+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:50:09.254205+0000","last_peered":"2024-03-16T10:50:09.254205+0000","last_clean":"2024-03-16T10:50:09.254205+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:50:09.254205+0000","last_undegraded":"2024-03-16T10:50:09.254205+0000","last_fullsized":"2024-03-16T10:50:09.254205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274618+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:49:42.274618+0000","last_peered":"2024-03-16T10:49:42.274618+0000","last_clean":"2024-03-16T10:49:42.274618+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:49:42.274618+0000","last_undegraded":"2024-03-16T10:49:42.274618+0000","last_fullsized":"2024-03-16T10:49:42.274618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275650+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:49:42.275650+0000","last_peered":"2024-03-16T10:49:42.275650+0000","last_clean":"2024-03-16T10:49:42.275650+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:49:42.275650+0000","last_undegraded":"2024-03-16T10:49:42.275650+0000","last_fullsized":"2024-03-16T10:49:42.275650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277078+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:49:42.277078+0000","last_peered":"2024-03-16T10:49:42.277078+0000","last_clean":"2024-03-16T10:49:42.277078+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:49:42.277078+0000","last_undegraded":"2024-03-16T10:49:42.277078+0000","last_fullsized":"2024-03-16T10:49:42.277078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275492+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:49:42.275492+0000","last_peered":"2024-03-16T10:49:42.275492+0000","last_clean":"2024-03-16T10:49:42.275492+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:49:42.275492+0000","last_undegraded":"2024-03-16T10:49:42.275492+0000","last_fullsized":"2024-03-16T10:49:42.275492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275404+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:49:42.275404+0000","last_peered":"2024-03-16T10:49:42.275404+0000","last_clean":"2024-03-16T10:49:42.275404+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:49:42.275404+0000","last_undegraded":"2024-03-16T10:49:42.275404+0000","last_fullsized":"2024-03-16T10:49:42.275404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'30","reported_seq":206,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:09.255632+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:50:09.255632+0000","last_peered":"2024-03-16T10:50:09.255632+0000","last_clean":"2024-03-16T10:50:09.255632+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:50:09.255632+0000","last_undegraded":"2024-03-16T10:50:09.255632+0000","last_fullsized":"2024-03-16T10:50:09.255632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":157,"num_read_kb":138,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275482+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:49:42.275482+0000","last_peered":"2024-03-16T10:49:42.275482+0000","last_clean":"2024-03-16T10:49:42.275482+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:49:42.275482+0000","last_undegraded":"2024-03-16T10:49:42.275482+0000","last_fullsized":"2024-03-16T10:49:42.275482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271826+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:49:42.271826+0000","last_peered":"2024-03-16T10:49:42.271826+0000","last_clean":"2024-03-16T10:49:42.271826+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:49:42.271826+0000","last_undegraded":"2024-03-16T10:49:42.271826+0000","last_fullsized":"2024-03-16T10:49:42.271826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274472+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:49:42.274472+0000","last_peered":"2024-03-16T10:49:42.274472+0000","last_clean":"2024-03-16T10:49:42.274472+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:49:42.274472+0000","last_undegraded":"2024-03-16T10:49:42.274472+0000","last_fullsized":"2024-03-16T10:49:42.274472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275782+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:49:42.275782+0000","last_peered":"2024-03-16T10:49:42.275782+0000","last_clean":"2024-03-16T10:49:42.275782+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:49:42.275782+0000","last_undegraded":"2024-03-16T10:49:42.275782+0000","last_fullsized":"2024-03-16T10:49:42.275782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792180+0000","last_change":"2024-03-16T10:49:42.792180+0000","last_active":"2024-03-16T10:49:42.792180+0000","last_peered":"2024-03-16T10:49:42.792180+0000","last_clean":"2024-03-16T10:49:42.792180+0000","last_became_active":"2024-03-16T10:49:42.791813+0000","last_became_peered":"2024-03-16T10:49:42.791813+0000","last_unstale":"2024-03-16T10:49:42.792180+0000","last_undegraded":"2024-03-16T10:49:42.792180+0000","last_fullsized":"2024-03-16T10:49:42.792180+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:48.571823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.248775+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:50:04.248775+0000","last_peered":"2024-03-16T10:50:04.248775+0000","last_clean":"2024-03-16T10:50:04.248775+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:50:04.248775+0000","last_undegraded":"2024-03-16T10:50:04.248775+0000","last_fullsized":"2024-03-16T10:50:04.248775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274619+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:49:42.274619+0000","last_peered":"2024-03-16T10:49:42.274619+0000","last_clean":"2024-03-16T10:49:42.274619+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:49:42.274619+0000","last_undegraded":"2024-03-16T10:49:42.274619+0000","last_fullsized":"2024-03-16T10:49:42.274619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275173+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:49:42.275173+0000","last_peered":"2024-03-16T10:49:42.275173+0000","last_clean":"2024-03-16T10:49:42.275173+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:49:42.275173+0000","last_undegraded":"2024-03-16T10:49:42.275173+0000","last_fullsized":"2024-03-16T10:49:42.275173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275515+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:49:42.275515+0000","last_peered":"2024-03-16T10:49:42.275515+0000","last_clean":"2024-03-16T10:49:42.275515+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:49:42.275515+0000","last_undegraded":"2024-03-16T10:49:42.275515+0000","last_fullsized":"2024-03-16T10:49:42.275515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275702+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:49:42.275702+0000","last_peered":"2024-03-16T10:49:42.275702+0000","last_clean":"2024-03-16T10:49:42.275702+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:49:42.275702+0000","last_undegraded":"2024-03-16T10:49:42.275702+0000","last_fullsized":"2024-03-16T10:49:42.275702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273289+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:49:42.273289+0000","last_peered":"2024-03-16T10:49:42.273289+0000","last_clean":"2024-03-16T10:49:42.273289+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:49:42.273289+0000","last_undegraded":"2024-03-16T10:49:42.273289+0000","last_fullsized":"2024-03-16T10:49:42.273289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791042+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:49:42.791042+0000","last_peered":"2024-03-16T10:49:42.791042+0000","last_clean":"2024-03-16T10:49:42.791042+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:49:42.791042+0000","last_undegraded":"2024-03-16T10:49:42.791042+0000","last_fullsized":"2024-03-16T10:49:42.791042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274245+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:49:42.274245+0000","last_peered":"2024-03-16T10:49:42.274245+0000","last_clean":"2024-03-16T10:49:42.274245+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:49:42.274245+0000","last_undegraded":"2024-03-16T10:49:42.274245+0000","last_fullsized":"2024-03-16T10:49:42.274245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:05.256071+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:50:05.256071+0000","last_peered":"2024-03-16T10:50:05.256071+0000","last_clean":"2024-03-16T10:50:05.256071+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:50:05.256071+0000","last_undegraded":"2024-03-16T10:50:05.256071+0000","last_fullsized":"2024-03-16T10:50:05.256071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274017+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:49:42.274017+0000","last_peered":"2024-03-16T10:49:42.274017+0000","last_clean":"2024-03-16T10:49:42.274017+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:49:42.274017+0000","last_undegraded":"2024-03-16T10:49:42.274017+0000","last_fullsized":"2024-03-16T10:49:42.274017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275493+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:49:42.275493+0000","last_peered":"2024-03-16T10:49:42.275493+0000","last_clean":"2024-03-16T10:49:42.275493+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:49:42.275493+0000","last_undegraded":"2024-03-16T10:49:42.275493+0000","last_fullsized":"2024-03-16T10:49:42.275493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.248389+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:50:04.248389+0000","last_peered":"2024-03-16T10:50:04.248389+0000","last_clean":"2024-03-16T10:50:04.248389+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:50:04.248389+0000","last_undegraded":"2024-03-16T10:50:04.248389+0000","last_fullsized":"2024-03-16T10:50:04.248389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271801+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:49:42.271801+0000","last_peered":"2024-03-16T10:49:42.271801+0000","last_clean":"2024-03-16T10:49:42.271801+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:49:42.271801+0000","last_undegraded":"2024-03-16T10:49:42.271801+0000","last_fullsized":"2024-03-16T10:49:42.271801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272073+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:49:42.272073+0000","last_peered":"2024-03-16T10:49:42.272073+0000","last_clean":"2024-03-16T10:49:42.272073+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:49:42.272073+0000","last_undegraded":"2024-03-16T10:49:42.272073+0000","last_fullsized":"2024-03-16T10:49:42.272073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274623+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:49:42.274623+0000","last_peered":"2024-03-16T10:49:42.274623+0000","last_clean":"2024-03-16T10:49:42.274623+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:49:42.274623+0000","last_undegraded":"2024-03-16T10:49:42.274623+0000","last_fullsized":"2024-03-16T10:49:42.274623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274211+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:49:42.274211+0000","last_peered":"2024-03-16T10:49:42.274211+0000","last_clean":"2024-03-16T10:49:42.274211+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:49:42.274211+0000","last_undegraded":"2024-03-16T10:49:42.274211+0000","last_fullsized":"2024-03-16T10:49:42.274211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274812+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:49:42.274812+0000","last_peered":"2024-03-16T10:49:42.274812+0000","last_clean":"2024-03-16T10:49:42.274812+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:49:42.274812+0000","last_undegraded":"2024-03-16T10:49:42.274812+0000","last_fullsized":"2024-03-16T10:49:42.274812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275583+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:49:42.275583+0000","last_peered":"2024-03-16T10:49:42.275583+0000","last_clean":"2024-03-16T10:49:42.275583+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:49:42.275583+0000","last_undegraded":"2024-03-16T10:49:42.275583+0000","last_fullsized":"2024-03-16T10:49:42.275583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274670+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:49:42.274670+0000","last_peered":"2024-03-16T10:49:42.274670+0000","last_clean":"2024-03-16T10:49:42.274670+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:49:42.274670+0000","last_undegraded":"2024-03-16T10:49:42.274670+0000","last_fullsized":"2024-03-16T10:49:42.274670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'13","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791225+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:49:42.791225+0000","last_peered":"2024-03-16T10:49:42.791225+0000","last_clean":"2024-03-16T10:49:42.791225+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:49:42.791225+0000","last_undegraded":"2024-03-16T10:49:42.791225+0000","last_fullsized":"2024-03-16T10:49:42.791225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272292+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:49:42.272292+0000","last_peered":"2024-03-16T10:49:42.272292+0000","last_clean":"2024-03-16T10:49:42.272292+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:49:42.272292+0000","last_undegraded":"2024-03-16T10:49:42.272292+0000","last_fullsized":"2024-03-16T10:49:42.272292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272671+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:49:42.272671+0000","last_peered":"2024-03-16T10:49:42.272671+0000","last_clean":"2024-03-16T10:49:42.272671+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:49:42.272671+0000","last_undegraded":"2024-03-16T10:49:42.272671+0000","last_fullsized":"2024-03-16T10:49:42.272671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.277216+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:49:42.277216+0000","last_peered":"2024-03-16T10:49:42.277216+0000","last_clean":"2024-03-16T10:49:42.277216+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:49:42.277216+0000","last_undegraded":"2024-03-16T10:49:42.277216+0000","last_fullsized":"2024-03-16T10:49:42.277216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.280047+0000","last_change":"2024-03-16T10:49:42.280047+0000","last_active":"2024-03-16T10:49:42.280047+0000","last_peered":"2024-03-16T10:49:42.280047+0000","last_clean":"2024-03-16T10:49:42.280047+0000","last_became_active":"2024-03-16T10:49:42.277477+0000","last_became_peered":"2024-03-16T10:49:42.277477+0000","last_unstale":"2024-03-16T10:49:42.280047+0000","last_undegraded":"2024-03-16T10:49:42.280047+0000","last_fullsized":"2024-03-16T10:49:42.280047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:04.299467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275285+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:49:42.275285+0000","last_peered":"2024-03-16T10:49:42.275285+0000","last_clean":"2024-03-16T10:49:42.275285+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:49:42.275285+0000","last_undegraded":"2024-03-16T10:49:42.275285+0000","last_fullsized":"2024-03-16T10:49:42.275285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271623+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:49:42.271623+0000","last_peered":"2024-03-16T10:49:42.271623+0000","last_clean":"2024-03-16T10:49:42.271623+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:49:42.271623+0000","last_undegraded":"2024-03-16T10:49:42.271623+0000","last_fullsized":"2024-03-16T10:49:42.271623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273044+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:49:42.273044+0000","last_peered":"2024-03-16T10:49:42.273044+0000","last_clean":"2024-03-16T10:49:42.273044+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:49:42.273044+0000","last_undegraded":"2024-03-16T10:49:42.273044+0000","last_fullsized":"2024-03-16T10:49:42.273044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272057+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:49:42.272057+0000","last_peered":"2024-03-16T10:49:42.272057+0000","last_clean":"2024-03-16T10:49:42.272057+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:49:42.272057+0000","last_undegraded":"2024-03-16T10:49:42.272057+0000","last_fullsized":"2024-03-16T10:49:42.272057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271972+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:49:42.271972+0000","last_peered":"2024-03-16T10:49:42.271972+0000","last_clean":"2024-03-16T10:49:42.271972+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:49:42.271972+0000","last_undegraded":"2024-03-16T10:49:42.271972+0000","last_fullsized":"2024-03-16T10:49:42.271972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275122+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:49:42.275122+0000","last_peered":"2024-03-16T10:49:42.275122+0000","last_clean":"2024-03-16T10:49:42.275122+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:49:42.275122+0000","last_undegraded":"2024-03-16T10:49:42.275122+0000","last_fullsized":"2024-03-16T10:49:42.275122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275395+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:49:42.275395+0000","last_peered":"2024-03-16T10:49:42.275395+0000","last_clean":"2024-03-16T10:49:42.275395+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:49:42.275395+0000","last_undegraded":"2024-03-16T10:49:42.275395+0000","last_fullsized":"2024-03-16T10:49:42.275395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:04.249426+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:50:04.249426+0000","last_peered":"2024-03-16T10:50:04.249426+0000","last_clean":"2024-03-16T10:50:04.249426+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:50:04.249426+0000","last_undegraded":"2024-03-16T10:50:04.249426+0000","last_fullsized":"2024-03-16T10:50:04.249426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275540+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:49:42.275540+0000","last_peered":"2024-03-16T10:49:42.275540+0000","last_clean":"2024-03-16T10:49:42.275540+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:49:42.275540+0000","last_undegraded":"2024-03-16T10:49:42.275540+0000","last_fullsized":"2024-03-16T10:49:42.275540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275274+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:49:42.275274+0000","last_peered":"2024-03-16T10:49:42.275274+0000","last_clean":"2024-03-16T10:49:42.275274+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:49:42.275274+0000","last_undegraded":"2024-03-16T10:49:42.275274+0000","last_fullsized":"2024-03-16T10:49:42.275274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275421+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:49:42.275421+0000","last_peered":"2024-03-16T10:49:42.275421+0000","last_clean":"2024-03-16T10:49:42.275421+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:49:42.275421+0000","last_undegraded":"2024-03-16T10:49:42.275421+0000","last_fullsized":"2024-03-16T10:49:42.275421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274672+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:49:42.274672+0000","last_peered":"2024-03-16T10:49:42.274672+0000","last_clean":"2024-03-16T10:49:42.274672+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:49:42.274672+0000","last_undegraded":"2024-03-16T10:49:42.274672+0000","last_fullsized":"2024-03-16T10:49:42.274672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275835+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:49:42.275835+0000","last_peered":"2024-03-16T10:49:42.275835+0000","last_clean":"2024-03-16T10:49:42.275835+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:49:42.275835+0000","last_undegraded":"2024-03-16T10:49:42.275835+0000","last_fullsized":"2024-03-16T10:49:42.275835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792025+0000","last_change":"2024-03-16T10:49:42.792025+0000","last_active":"2024-03-16T10:49:42.792025+0000","last_peered":"2024-03-16T10:49:42.792025+0000","last_clean":"2024-03-16T10:49:42.792025+0000","last_became_active":"2024-03-16T10:49:42.791745+0000","last_became_peered":"2024-03-16T10:49:42.791745+0000","last_unstale":"2024-03-16T10:49:42.792025+0000","last_undegraded":"2024-03-16T10:49:42.792025+0000","last_fullsized":"2024-03-16T10:49:42.792025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:50:32.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271692+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:49:42.271692+0000","last_peered":"2024-03-16T10:49:42.271692+0000","last_clean":"2024-03-16T10:49:42.271692+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:49:42.271692+0000","last_undegraded":"2024-03-16T10:49:42.271692+0000","last_fullsized":"2024-03-16T10:49:42.271692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271930+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:49:42.271930+0000","last_peered":"2024-03-16T10:49:42.271930+0000","last_clean":"2024-03-16T10:49:42.271930+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:49:42.271930+0000","last_undegraded":"2024-03-16T10:49:42.271930+0000","last_fullsized":"2024-03-16T10:49:42.271930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.276617+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:49:42.276617+0000","last_peered":"2024-03-16T10:49:42.276617+0000","last_clean":"2024-03-16T10:49:42.276617+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:49:42.276617+0000","last_undegraded":"2024-03-16T10:49:42.276617+0000","last_fullsized":"2024-03-16T10:49:42.276617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.792395+0000","last_change":"2024-03-16T10:49:42.792395+0000","last_active":"2024-03-16T10:49:42.792395+0000","last_peered":"2024-03-16T10:49:42.792395+0000","last_clean":"2024-03-16T10:49:42.792395+0000","last_became_active":"2024-03-16T10:49:42.791992+0000","last_became_peered":"2024-03-16T10:49:42.791992+0000","last_unstale":"2024-03-16T10:49:42.792395+0000","last_undegraded":"2024-03-16T10:49:42.792395+0000","last_fullsized":"2024-03-16T10:49:42.792395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:15:16.825389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273166+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:49:42.273166+0000","last_peered":"2024-03-16T10:49:42.273166+0000","last_clean":"2024-03-16T10:49:42.273166+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:49:42.273166+0000","last_undegraded":"2024-03-16T10:49:42.273166+0000","last_fullsized":"2024-03-16T10:49:42.273166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272165+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:49:42.272165+0000","last_peered":"2024-03-16T10:49:42.272165+0000","last_clean":"2024-03-16T10:49:42.272165+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:49:42.272165+0000","last_undegraded":"2024-03-16T10:49:42.272165+0000","last_fullsized":"2024-03-16T10:49:42.272165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272198+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:49:42.272198+0000","last_peered":"2024-03-16T10:49:42.272198+0000","last_clean":"2024-03-16T10:49:42.272198+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:49:42.272198+0000","last_undegraded":"2024-03-16T10:49:42.272198+0000","last_fullsized":"2024-03-16T10:49:42.272198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275384+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:49:42.275384+0000","last_peered":"2024-03-16T10:49:42.275384+0000","last_clean":"2024-03-16T10:49:42.275384+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:49:42.275384+0000","last_undegraded":"2024-03-16T10:49:42.275384+0000","last_fullsized":"2024-03-16T10:49:42.275384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271486+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:49:42.271486+0000","last_peered":"2024-03-16T10:49:42.271486+0000","last_clean":"2024-03-16T10:49:42.271486+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:49:42.271486+0000","last_undegraded":"2024-03-16T10:49:42.271486+0000","last_fullsized":"2024-03-16T10:49:42.271486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273802+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:49:42.273802+0000","last_peered":"2024-03-16T10:49:42.273802+0000","last_clean":"2024-03-16T10:49:42.273802+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:49:42.273802+0000","last_undegraded":"2024-03-16T10:49:42.273802+0000","last_fullsized":"2024-03-16T10:49:42.273802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274658+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:49:42.274658+0000","last_peered":"2024-03-16T10:49:42.274658+0000","last_clean":"2024-03-16T10:49:42.274658+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:49:42.274658+0000","last_undegraded":"2024-03-16T10:49:42.274658+0000","last_fullsized":"2024-03-16T10:49:42.274658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.273216+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:49:42.273216+0000","last_peered":"2024-03-16T10:49:42.273216+0000","last_clean":"2024-03-16T10:49:42.273216+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:49:42.273216+0000","last_undegraded":"2024-03-16T10:49:42.273216+0000","last_fullsized":"2024-03-16T10:49:42.273216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68250,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":765,"num_read_kb":458,"num_write":239,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":204750,"data_compressed":5628,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383708,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":457215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645347,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":1109099,"data_compressed":37961,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":456359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1024000,"data_stored":1049850,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495672,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":958464,"data_stored":456280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":518239,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":457619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1036288,"data_stored":518850,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":456532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":1049137,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62798,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63409,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63173,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:50:12.276 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-16T10:50:12.276 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-16T10:50:12.276 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-16T10:50:12.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph health --format=json 2024-03-16T10:50:12.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:12 smithi174 ceph-mon[36202]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:12.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:12 smithi111 ceph-mon[36315]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:12.531 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:13.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:13 smithi174 ceph-mon[36202]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:13.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:13 smithi174 ceph-mon[36202]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-16T10:50:13.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:13 smithi017 ceph-mon[32078]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:13.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:13 smithi017 ceph-mon[32078]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-16T10:50:13.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:13 smithi111 ceph-mon[36315]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:13.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:13 smithi111 ceph-mon[36315]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 -- 172.21.15.17:0/3437025220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21381011d0 msgr2=0x7f2138101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 --2- 172.21.15.17:0/3437025220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21381011d0 0x7f2138101630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f212c009990 tx=0x7f212c009ca0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 -- 172.21.15.17:0/3437025220 shutdown_connections 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 --2- 172.21.15.17:0/3437025220 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213810e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 --2- 172.21.15.17:0/3437025220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2138107210 0x7f21381075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 --2- 172.21.15.17:0/3437025220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21381011d0 0x7f2138101630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 -- 172.21.15.17:0/3437025220 >> 172.21.15.17:0/3437025220 conn(0x7f2138078100 msgr2=0x7f2138078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 -- 172.21.15.17:0/3437025220 shutdown_connections 2024-03-16T10:50:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.223+0000 7f213e37a700 1 -- 172.21.15.17:0/3437025220 wait complete. 2024-03-16T10:50:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.224+0000 7f213e37a700 1 Processor -- start 2024-03-16T10:50:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.224+0000 7f213e37a700 1 -- start start 2024-03-16T10:50:14.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.224+0000 7f213e37a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:14.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.224+0000 7f213e37a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:14.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.224+0000 7f213e37a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213e37a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2138111470 con 0x7f2138107210 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213e37a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f21381112f0 con 0x7f2138101b70 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213e37a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f21381115f0 con 0x7f21381011d0 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213c917700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21377fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213c917700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45644/0 (socket says 172.21.15.17:45644) 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21377fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:39388/0 (socket says 172.21.15.17:39388) 2024-03-16T10:50:14.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42566/0 (socket says 172.21.15.17:42566) 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213c917700 1 -- 172.21.15.17:0/3662989457 learned_addr learned my addr 172.21.15.17:0/3662989457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 -- 172.21.15.17:0/3662989457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 msgr2=0x7f213819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 -- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 msgr2=0x7f2138198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 -- 172.21.15.17:0/3662989457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138199010 con 0x7f21381011d0 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213c917700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21377fe700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f2137fff700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f212800e9f0 tx=0x7f212800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128004220 con 0x7f21381011d0 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2138199300 con 0x7f21381011d0 2024-03-16T10:50:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2128004d10 con 0x7f21381011d0 2024-03-16T10:50:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.225+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128005020 con 0x7f21381011d0 2024-03-16T10:50:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.226+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21381a5510 con 0x7f21381011d0 2024-03-16T10:50:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.226+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21381028c0 con 0x7f21381011d0 2024-03-16T10:50:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.228+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f2128004750 con 0x7f21381011d0 2024-03-16T10:50:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.228+0000 7f21357fa700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 0x7f21200a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.228+0000 7f21377fe700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 0x7f21200a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.228+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f21280ce870 con 0x7f21381011d0 2024-03-16T10:50:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.229+0000 7f21377fe700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 0x7f21200a4d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b2e0 tx=0x7f212c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:14.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.236+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f212809b910 con 0x7f21381011d0 2024-03-16T10:50:14.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:14 smithi174 ceph-mon[36202]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:14.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:14 smithi017 ceph-mon[32078]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:14.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:14 smithi111 ceph-mon[36315]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.508+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21381a57a0 con 0x7f21381011d0 2024-03-16T10:50:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.508+0000 7f21357fa700 1 -- 172.21.15.17:0/3662989457 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f212809b210 con 0x7f21381011d0 2024-03-16T10:50:14.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:14.509 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 msgr2=0x7f21200a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 0x7f21200a4d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f212c00b2e0 tx=0x7f212c005960 comp rx=0 tx=0).stop 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 msgr2=0x7f213819e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f212800e9f0 tx=0x7f212800ed00 comp rx=0 tx=0).stop 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 shutdown_connections 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f21200a2890 0x7f21200a4d50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2138107210 0x7f2138198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21381011d0 0x7f213819e6b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.510+0000 7f213e37a700 1 --2- 172.21.15.17:0/3662989457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2138101b70 0x7f213819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.511+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 >> 172.21.15.17:0/3662989457 conn(0x7f2138078100 msgr2=0x7f21381004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.511+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 shutdown_connections 2024-03-16T10:50:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:14.511+0000 7f213e37a700 1 -- 172.21.15.17:0/3662989457 wait complete. 2024-03-16T10:50:15.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:15 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3662989457' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T10:50:15.169 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-16T10:50:15.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- 172.21.15.17:0/1021995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 msgr2=0x7fc38c100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 --2- 172.21.15.17:0/1021995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c100b20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc388009900 tx=0x7fc38802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- 172.21.15.17:0/1021995427 shutdown_connections 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 --2- 172.21.15.17:0/1021995427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1022b0 0x7fc38c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 --2- 172.21.15.17:0/1021995427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1018f0 0x7fc38c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 --2- 172.21.15.17:0/1021995427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c100b20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- 172.21.15.17:0/1021995427 >> 172.21.15.17:0/1021995427 conn(0x7fc38c0fbc70 msgr2=0x7fc38c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- 172.21.15.17:0/1021995427 shutdown_connections 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- 172.21.15.17:0/1021995427 wait complete. 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 Processor -- start 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.277+0000 7fc3942b2640 1 -- start start 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1018f0 0x7fc38c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1022b0 0x7fc38c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10c370 con 0x7fc38c100700 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10c1f0 con 0x7fc38c1018f0 2024-03-16T10:50:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c10c4f0 con 0x7fc38c1022b0 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45660/0 (socket says 172.21.15.17:45660) 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 -- 172.21.15.17:0/3507634508 learned_addr learned my addr 172.21.15.17:0/3507634508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39184d640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1018f0 0x7fc38c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39284f640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1022b0 0x7fc38c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 -- 172.21.15.17:0/3507634508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1022b0 msgr2=0x7fc38c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1022b0 0x7fc38c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 -- 172.21.15.17:0/3507634508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1018f0 msgr2=0x7fc38c19c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1018f0 0x7fc38c19c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 -- 172.21.15.17:0/3507634508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c19f7a0 con 0x7fc38c100700 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc39204e640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc38802c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388041070 con 0x7fc38c100700 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc388004450 con 0x7fc38c100700 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c19fa30 con 0x7fc38c100700 2024-03-16T10:50:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388034440 con 0x7fc38c100700 2024-03-16T10:50:15.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.278+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c19ff20 con 0x7fc38c100700 2024-03-16T10:50:15.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.279+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c107a90 con 0x7fc38c100700 2024-03-16T10:50:15.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.281+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fc388044070 con 0x7fc38c100700 2024-03-16T10:50:15.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.281+0000 7fc3837fe640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 0x7fc3780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.281+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc3880f0690 con 0x7fc38c100700 2024-03-16T10:50:15.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.281+0000 7fc39184d640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 0x7fc3780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.282+0000 7fc39184d640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 0x7fc3780a4cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc38c069240 tx=0x7fc37c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.285+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fc3880bd210 con 0x7fc38c100700 2024-03-16T10:50:15.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:15 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3662989457' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T10:50:15.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:15 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3662989457' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-16T10:50:15.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.481+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc38c02d380 con 0x7fc38c100700 2024-03-16T10:50:15.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.483+0000 7fc3837fe640 1 -- 172.21.15.17:0/3507634508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fc3880c12b0 con 0x7fc38c100700 2024-03-16T10:50:15.484 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:15.484 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 msgr2=0x7fc3780a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 0x7fc3780a4cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc38c069240 tx=0x7fc37c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 msgr2=0x7fc38c0694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc388000c00 tx=0x7fc38802c640 comp rx=0 tx=0).stop 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 shutdown_connections 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc3780a2800 0x7fc3780a4cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc38c1022b0 0x7fc38c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c1018f0 0x7fc38c19c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 --2- 172.21.15.17:0/3507634508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc38c100700 0x7fc38c0694d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 >> 172.21.15.17:0/3507634508 conn(0x7fc38c0fbc70 msgr2=0x7fc38c104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:15.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 shutdown_connections 2024-03-16T10:50:15.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.485+0000 7fc3942b2640 1 -- 172.21.15.17:0/3507634508 wait complete. 2024-03-16T10:50:15.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:15.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:15.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 -- 172.21.15.17:0/540321249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341029e0 msgr2=0x7f5134102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 --2- 172.21.15.17:0/540321249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341029e0 0x7f5134102e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5124009900 tx=0x7f512402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:15.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 -- 172.21.15.17:0/540321249 shutdown_connections 2024-03-16T10:50:15.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 --2- 172.21.15.17:0/540321249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341033a0 0x7f5134109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 --2- 172.21.15.17:0/540321249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341029e0 0x7f5134102e60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 --2- 172.21.15.17:0/540321249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341017f0 0x7f5134101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 -- 172.21.15.17:0/540321249 >> 172.21.15.17:0/540321249 conn(0x7f51340fcd80 msgr2=0x7f51340ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 -- 172.21.15.17:0/540321249 shutdown_connections 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.613+0000 7f513b9c6640 1 -- 172.21.15.17:0/540321249 wait complete. 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 Processor -- start 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 -- start start 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341017f0 0x7f5134197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341029e0 0x7f5134198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d470 con 0x7f51341033a0 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d2f0 con 0x7f51341029e0 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f513b9c6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d5f0 con 0x7f51341017f0 2024-03-16T10:50:15.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45674/0 (socket says 172.21.15.17:45674) 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 -- 172.21.15.17:0/4044601968 learned_addr learned my addr 172.21.15.17:0/4044601968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5138f61640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341029e0 0x7f5134198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139762640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341017f0 0x7f5134197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 -- 172.21.15.17:0/4044601968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341017f0 msgr2=0x7f5134197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341017f0 0x7f5134197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 -- 172.21.15.17:0/4044601968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341029e0 msgr2=0x7f5134198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341029e0 0x7f5134198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 -- 172.21.15.17:0/4044601968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513419f740 con 0x7f51341033a0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f5139f63640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f512c00eb10 tx=0x7f512c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.614+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c004b20 con 0x7f51341033a0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.615+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f512c004cc0 con 0x7f51341033a0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.615+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513419fa30 con 0x7f51341033a0 2024-03-16T10:50:15.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.615+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c010760 con 0x7f51341033a0 2024-03-16T10:50:15.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.615+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513419ffa0 con 0x7f51341033a0 2024-03-16T10:50:15.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.615+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5134108b90 con 0x7f51341033a0 2024-03-16T10:50:15.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.617+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f512c005000 con 0x7f51341033a0 2024-03-16T10:50:15.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.618+0000 7f512a7fc640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 0x7f51200a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.618+0000 7f5139762640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 0x7f51200a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.618+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f512c0cf390 con 0x7f51341033a0 2024-03-16T10:50:15.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.619+0000 7f5139762640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 0x7f51200a4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51300095f0 tx=0x7f5130005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.621+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f512c09c4d0 con 0x7f51341033a0 2024-03-16T10:50:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.804+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f513402d340 con 0x7f51341033a0 2024-03-16T10:50:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.805+0000 7f512a7fc640 1 -- 172.21.15.17:0/4044601968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f512c09bdd0 con 0x7f51341033a0 2024-03-16T10:50:15.805 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 msgr2=0x7f51200a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 0x7f51200a4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51300095f0 tx=0x7f5130005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 msgr2=0x7f513419f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f512c00eb10 tx=0x7f512c00c2d0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 shutdown_connections 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f51200a2880 0x7f51200a4d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51341033a0 0x7f513419f0d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f51341029e0 0x7f5134198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 --2- 172.21.15.17:0/4044601968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51341017f0 0x7f5134197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 >> 172.21.15.17:0/4044601968 conn(0x7f51340fcd80 msgr2=0x7f5134105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 shutdown_connections 2024-03-16T10:50:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.807+0000 7f513b9c6640 1 -- 172.21.15.17:0/4044601968 wait complete. 2024-03-16T10:50:15.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 -- 172.21.15.17:0/4286731339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984100c10 msgr2=0x7f3984101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 --2- 172.21.15.17:0/4286731339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984100c10 0x7f3984101030 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3978009900 tx=0x7f397802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 -- 172.21.15.17:0/4286731339 shutdown_connections 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 --2- 172.21.15.17:0/4286731339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39841022e0 0x7f3984108b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 --2- 172.21.15.17:0/4286731339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 0x7f3984101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 --2- 172.21.15.17:0/4286731339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984100c10 0x7f3984101030 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 -- 172.21.15.17:0/4286731339 >> 172.21.15.17:0/4286731339 conn(0x7f39840fb400 msgr2=0x7f39840fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 -- 172.21.15.17:0/4286731339 shutdown_connections 2024-03-16T10:50:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.943+0000 7f3988f87640 1 -- 172.21.15.17:0/4286731339 wait complete. 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 Processor -- start 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 -- start start 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 0x7f3984196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 0x7f3984196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f398410c350 con 0x7f39841022e0 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f398410c1d0 con 0x7f3984100c10 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3988f87640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f398410c4d0 con 0x7f3984101920 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3982d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 0x7f3984196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3982d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45688/0 (socket says 172.21.15.17:45688) 2024-03-16T10:50:15.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3982d9d640 1 -- 172.21.15.17:0/2181178735 learned_addr learned my addr 172.21.15.17:0/2181178735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3981d9b640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 0x7f3984196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 -- 172.21.15.17:0/2181178735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 msgr2=0x7f3984196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 0x7f3984196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 -- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 msgr2=0x7f398419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f398259c640 1 -- 172.21.15.17:0/2181178735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398419e640 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.944+0000 7f3982d9d640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f398259c640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 0x7f3984196a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f397802c170 tx=0x7f397802c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978041070 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398419e8d0 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3978004450 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978003e50 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.945+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398419ede0 con 0x7f3984100c10 2024-03-16T10:50:15.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.946+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3984107b20 con 0x7f3984100c10 2024-03-16T10:50:15.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.948+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f3978044070 con 0x7f3984100c10 2024-03-16T10:50:15.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.948+0000 7f39737fe640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 0x7f396c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:15.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.948+0000 7f3981d9b640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 0x7f396c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:15.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.948+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f39780f0410 con 0x7f3984100c10 2024-03-16T10:50:15.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.949+0000 7f3981d9b640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 0x7f396c0a4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3984197f30 tx=0x7f3974005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:15.953+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f39780bcf00 con 0x7f3984100c10 2024-03-16T10:50:16.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:16 smithi017 ceph-mon[32078]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:50:16.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:16 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3507634508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:16.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:16 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4044601968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:16.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.136+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f398402d400 con 0x7f3984100c10 2024-03-16T10:50:16.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.136+0000 7f39737fe640 1 -- 172.21.15.17:0/2181178735 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f39780c0fa0 con 0x7f3984100c10 2024-03-16T10:50:16.137 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 msgr2=0x7f396c0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 0x7f396c0a4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3984197f30 tx=0x7f3974005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 msgr2=0x7f3984196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 0x7f3984196a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f397802c170 tx=0x7f397802c650 comp rx=0 tx=0).stop 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 shutdown_connections 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f396c0a29a0 0x7f396c0a4e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39841022e0 0x7f398419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3984101920 0x7f3984196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 --2- 172.21.15.17:0/2181178735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3984100c10 0x7f3984196a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 >> 172.21.15.17:0/2181178735 conn(0x7f39840fb400 msgr2=0x7f3984104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 shutdown_connections 2024-03-16T10:50:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.138+0000 7f3988f87640 1 -- 172.21.15.17:0/2181178735 wait complete. 2024-03-16T10:50:16.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 -- 172.21.15.17:0/2205539757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 msgr2=0x7f691c100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 --2- 172.21.15.17:0/2205539757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c100b00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6918009900 tx=0x7f691802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 -- 172.21.15.17:0/2205539757 shutdown_connections 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 --2- 172.21.15.17:0/2205539757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 --2- 172.21.15.17:0/2205539757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 0x7f691c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 --2- 172.21.15.17:0/2205539757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c100b00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 -- 172.21.15.17:0/2205539757 >> 172.21.15.17:0/2205539757 conn(0x7f691c0fbc70 msgr2=0x7f691c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 -- 172.21.15.17:0/2205539757 shutdown_connections 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.273+0000 7f69242ae640 1 -- 172.21.15.17:0/2205539757 wait complete. 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 Processor -- start 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 -- start start 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 0x7f691c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f691c10c350 con 0x7f691c1006e0 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f691c10c1d0 con 0x7f691c102290 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f69242ae640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f691c10c4d0 con 0x7f691c1018d0 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45694/0 (socket says 172.21.15.17:45694) 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 -- 172.21.15.17:0/934422371 learned_addr learned my addr 172.21.15.17:0/934422371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f6921849640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 0x7f691c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692284b640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 -- 172.21.15.17:0/934422371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 msgr2=0x7f691c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 0x7f691c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 -- 172.21.15.17:0/934422371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 msgr2=0x7f691c1a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c1a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 -- 172.21.15.17:0/934422371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c1a19b0 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692284b640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c1a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.274+0000 7f692204a640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f691802c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.275+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918041070 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.275+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6918004450 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.275+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c1a1c40 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.275+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918034440 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.275+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c1a2130 con 0x7f691c1006e0 2024-03-16T10:50:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.276+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c1a2300 con 0x7f691c1006e0 2024-03-16T10:50:16.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.277+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f6918044070 con 0x7f691c1006e0 2024-03-16T10:50:16.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.278+0000 7f69137fe640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 0x7f69080a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.278+0000 7f6921849640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 0x7f69080a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.278+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f69180f07d0 con 0x7f691c1006e0 2024-03-16T10:50:16.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.278+0000 7f6921849640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 0x7f69080a4cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f690c009bd0 tx=0x7f690c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.281+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f69180bd910 con 0x7f691c1006e0 2024-03-16T10:50:16.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:16 smithi174 ceph-mon[36202]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:50:16.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:16 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3507634508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:16.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:16 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4044601968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:16.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:16 smithi111 ceph-mon[36315]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-16T10:50:16.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:16 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3507634508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:16.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:16 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4044601968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.468+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f691c1a24d0 con 0x7f691c1006e0 2024-03-16T10:50:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.468+0000 7f69137fe640 1 -- 172.21.15.17:0/934422371 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f69180bd210 con 0x7f691c1006e0 2024-03-16T10:50:16.469 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 msgr2=0x7f69080a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 0x7f69080a4cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f690c009bd0 tx=0x7f690c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 msgr2=0x7f691c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f691802c640 comp rx=0 tx=0).stop 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 shutdown_connections 2024-03-16T10:50:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f69080a2800 0x7f69080a4cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f691c102290 0x7f691c1a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691c1018d0 0x7f691c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 --2- 172.21.15.17:0/934422371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f691c1006e0 0x7f691c199da0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 >> 172.21.15.17:0/934422371 conn(0x7f691c0fbc70 msgr2=0x7f691c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 shutdown_connections 2024-03-16T10:50:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.470+0000 7f69242ae640 1 -- 172.21.15.17:0/934422371 wait complete. 2024-03-16T10:50:16.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 -- 172.21.15.17:0/3819391155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 msgr2=0x7f80041046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 --2- 172.21.15.17:0/3819391155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f80041046d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009900 tx=0x7f7ffc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 -- 172.21.15.17:0/3819391155 shutdown_connections 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 --2- 172.21.15.17:0/3819391155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 0x7f8004109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 --2- 172.21.15.17:0/3819391155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 0x7f8004107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 --2- 172.21.15.17:0/3819391155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f80041046d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 -- 172.21.15.17:0/3819391155 >> 172.21.15.17:0/3819391155 conn(0x7f80040fbc70 msgr2=0x7f80040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 -- 172.21.15.17:0/3819391155 shutdown_connections 2024-03-16T10:50:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.588+0000 7f800c2d3640 1 -- 172.21.15.17:0/3819391155 wait complete. 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 Processor -- start 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 -- start start 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 0x7f8004198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 0x7f800419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f800410d4a0 con 0x7f80041022e0 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f800410d320 con 0x7f8004104c10 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800c2d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f800410d620 con 0x7f8004107540 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45718/0 (socket says 172.21.15.17:45718) 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 -- 172.21.15.17:0/2090355941 learned_addr learned my addr 172.21.15.17:0/2090355941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800986e640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 0x7f8004198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a870640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 0x7f800419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 -- 172.21.15.17:0/2090355941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 msgr2=0x7f800419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 0x7f800419f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 -- 172.21.15.17:0/2090355941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 msgr2=0x7f8004198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 0x7f8004198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 -- 172.21.15.17:0/2090355941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800419f760 con 0x7f80041022e0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.589+0000 7f800a06f640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009230 tx=0x7f7ffc02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.590+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc041070 con 0x7f80041022e0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.590+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ffc004450 con 0x7f80041022e0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.590+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800419f9f0 con 0x7f80041022e0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.590+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc003e20 con 0x7f80041022e0 2024-03-16T10:50:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.590+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800419ff30 con 0x7f80041022e0 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.591+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80040fd760 con 0x7f80041022e0 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.592+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f7ffc044070 con 0x7f80041022e0 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.592+0000 7f80037fe640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 0x7f7fec0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.592+0000 7f800986e640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 0x7f7fec0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.592+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7ffc0f04d0 con 0x7f80041022e0 2024-03-16T10:50:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.593+0000 7f800986e640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 0x7f7fec0a4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80099a0 tx=0x7f7ff8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.597+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f7ffc0bcfc0 con 0x7f80041022e0 2024-03-16T10:50:16.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.817+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80040623e0 con 0x7f80041022e0 2024-03-16T10:50:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.818+0000 7f80037fe640 1 -- 172.21.15.17:0/2090355941 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7f7ffc0c1060 con 0x7f80041022e0 2024-03-16T10:50:16.819 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:50:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 msgr2=0x7f7fec0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 0x7f7fec0a4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80099a0 tx=0x7f7ff8009500 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 msgr2=0x7f8004197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009230 tx=0x7f7ffc02c650 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 shutdown_connections 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7fec0a2880 0x7f7fec0a4d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8004107540 0x7f800419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8004104c10 0x7f8004198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 --2- 172.21.15.17:0/2090355941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80041022e0 0x7f8004197b40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 >> 172.21.15.17:0/2090355941 conn(0x7f80040fbc70 msgr2=0x7f8004102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 shutdown_connections 2024-03-16T10:50:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.820+0000 7f800c2d3640 1 -- 172.21.15.17:0/2090355941 wait complete. 2024-03-16T10:50:16.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 -- 172.21.15.17:0/4090307613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410c210 msgr2=0x7fe47410c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 --2- 172.21.15.17:0/4090307613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410c210 0x7fe47410c630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe464009900 tx=0x7fe46402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 -- 172.21.15.17:0/4090307613 shutdown_connections 2024-03-16T10:50:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 --2- 172.21.15.17:0/4090307613 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410ddc0 0x7fe474114650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 --2- 172.21.15.17:0/4090307613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410d400 0x7fe47410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 --2- 172.21.15.17:0/4090307613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410c210 0x7fe47410c630 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 -- 172.21.15.17:0/4090307613 >> 172.21.15.17:0/4090307613 conn(0x7fe47406c240 msgr2=0x7fe47406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 -- 172.21.15.17:0/4090307613 shutdown_connections 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.937+0000 7fe47a662640 1 -- 172.21.15.17:0/4090307613 wait complete. 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 Processor -- start 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 -- start start 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410c210 0x7fe4741a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410ddc0 0x7fe4741a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe474117ea0 con 0x7fe47410d400 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe474117d20 con 0x7fe47410c210 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe47a662640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe474118020 con 0x7fe47410ddc0 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.938+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe473fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410c210 0x7fe4741a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45730/0 (socket says 172.21.15.17:45730) 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 -- 172.21.15.17:0/3287467426 learned_addr learned my addr 172.21.15.17:0/3287467426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe478bff640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410ddc0 0x7fe4741a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 -- 172.21.15.17:0/3287467426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410ddc0 msgr2=0x7fe4741a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410ddc0 0x7fe4741a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 -- 172.21.15.17:0/3287467426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410c210 msgr2=0x7fe4741a2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410c210 0x7fe4741a2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 -- 172.21.15.17:0/3287467426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4741aa170 con 0x7fe47410d400 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4737fe640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e9f0 tx=0x7fe46800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46800cd80 con 0x7fe47410d400 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe468005500 con 0x7fe47410d400 2024-03-16T10:50:16.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4741aa460 con 0x7fe47410d400 2024-03-16T10:50:16.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468010690 con 0x7fe47410d400 2024-03-16T10:50:16.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.939+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741aa9b0 con 0x7fe47410d400 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.940+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4741135d0 con 0x7fe47410d400 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.941+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fe4680046c0 con 0x7fe47410d400 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.942+0000 7fe4717fa640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 0x7fe45c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.942+0000 7fe473fff640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 0x7fe45c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.942+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe4680ced40 con 0x7fe47410d400 2024-03-16T10:50:16.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.942+0000 7fe473fff640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 0x7fe45c0a4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe464000c00 tx=0x7fe464005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:16.946+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe46809be80 con 0x7fe47410d400 2024-03-16T10:50:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:17 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2181178735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:17 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/934422371' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:17 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2090355941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.130+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe47402d400 con 0x7fe47410d400 2024-03-16T10:50:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.132+0000 7fe4717fa640 1 -- 172.21.15.17:0/3287467426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fe46809b780 con 0x7fe47410d400 2024-03-16T10:50:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:17.133 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 msgr2=0x7fe45c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 0x7fe45c0a4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe464000c00 tx=0x7fe464005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 msgr2=0x7fe4741a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e9f0 tx=0x7fe46800edf0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 shutdown_connections 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe45c0a2880 0x7fe45c0a4d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe47410ddc0 0x7fe4741a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe47410d400 0x7fe4741a2a90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 --2- 172.21.15.17:0/3287467426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe47410c210 0x7fe4741a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 >> 172.21.15.17:0/3287467426 conn(0x7fe47406c240 msgr2=0x7fe4741107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 shutdown_connections 2024-03-16T10:50:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.134+0000 7fe47a662640 1 -- 172.21.15.17:0/3287467426 wait complete. 2024-03-16T10:50:17.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:17.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 -- 172.21.15.17:0/1267098265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8102300 msgr2=0x7f6ee81046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 --2- 172.21.15.17:0/1267098265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8102300 0x7f6ee81046f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009900 tx=0x7f6ee402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 -- 172.21.15.17:0/1267098265 shutdown_connections 2024-03-16T10:50:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 --2- 172.21.15.17:0/1267098265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8107560 0x7f6ee8109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 --2- 172.21.15.17:0/1267098265 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8104c30 0x7f6ee8107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 --2- 172.21.15.17:0/1267098265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8102300 0x7f6ee81046f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 -- 172.21.15.17:0/1267098265 >> 172.21.15.17:0/1267098265 conn(0x7f6ee80fbc70 msgr2=0x7f6ee80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 -- 172.21.15.17:0/1267098265 shutdown_connections 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 -- 172.21.15.17:0/1267098265 wait complete. 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.272+0000 7f6eef377640 1 Processor -- start 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 -- start start 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8102300 0x7f6ee8197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8104c30 0x7f6ee8198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810d470 con 0x7f6ee8107560 2024-03-16T10:50:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810d2f0 con 0x7f6ee8102300 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eef377640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810d5f0 con 0x7f6ee8104c30 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed113640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8102300 0x7f6ee8197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45754/0 (socket says 172.21.15.17:45754) 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 -- 172.21.15.17:0/3197339029 learned_addr learned my addr 172.21.15.17:0/3197339029 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eec912640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8104c30 0x7f6ee8198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 -- 172.21.15.17:0/3197339029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8104c30 msgr2=0x7f6ee8198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8104c30 0x7f6ee8198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 -- 172.21.15.17:0/3197339029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8102300 msgr2=0x7f6ee8197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8102300 0x7f6ee8197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 -- 172.21.15.17:0/3197339029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee819f760 con 0x7f6ee8107560 2024-03-16T10:50:17.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6eed914640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000eb10 tx=0x7f6ee000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.273+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004b20 con 0x7f6ee8107560 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.274+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee819fa50 con 0x7f6ee8107560 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.274+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee0004cc0 con 0x7f6ee8107560 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.274+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0010760 con 0x7f6ee8107560 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.274+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee819ffa0 con 0x7f6ee8107560 2024-03-16T10:50:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.274+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee80fd760 con 0x7f6ee8107560 2024-03-16T10:50:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.276+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f6ee0005000 con 0x7f6ee8107560 2024-03-16T10:50:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.276+0000 7f6ede7fc640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 0x7f6ed40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.276+0000 7f6eed113640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 0x7f6ed40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.276+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6ee00cf410 con 0x7f6ee8107560 2024-03-16T10:50:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.277+0000 7f6eed113640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 0x7f6ed40a4cc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee402c7b0 tx=0x7f6ee4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.280+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f6ee009c550 con 0x7f6ee8107560 2024-03-16T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:17 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2181178735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:17 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/934422371' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:17 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2090355941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:17.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:17 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2181178735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:17 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/934422371' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:17.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:17 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2090355941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.463+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ee802d400 con 0x7f6ee8107560 2024-03-16T10:50:17.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.464+0000 7f6ede7fc640 1 -- 172.21.15.17:0/3197339029 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f6ee009be50 con 0x7f6ee8107560 2024-03-16T10:50:17.465 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 msgr2=0x7f6ed40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 0x7f6ed40a4cc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee402c7b0 tx=0x7f6ee4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 msgr2=0x7f6ee819f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000eb10 tx=0x7f6ee000c2d0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 shutdown_connections 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ed40a2800 0x7f6ed40a4cc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee8107560 0x7f6ee819f0f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ee8104c30 0x7f6ee8198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 --2- 172.21.15.17:0/3197339029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee8102300 0x7f6ee8197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 >> 172.21.15.17:0/3197339029 conn(0x7f6ee80fbc70 msgr2=0x7f6ee8102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 shutdown_connections 2024-03-16T10:50:17.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.466+0000 7f6eef377640 1 -- 172.21.15.17:0/3197339029 wait complete. 2024-03-16T10:50:17.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:17.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/838210497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41006e0 msgr2=0x7fe3e4100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/838210497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41006e0 0x7fe3e4100b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009900 tx=0x7fe3d802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:17.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/838210497 shutdown_connections 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/838210497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 0x7fe3e4108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/838210497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41018d0 0x7fe3e4101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/838210497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41006e0 0x7fe3e4100b00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/838210497 >> 172.21.15.17:0/838210497 conn(0x7fe3e40fbc70 msgr2=0x7fe3e40fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/838210497 shutdown_connections 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/838210497 wait complete. 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 Processor -- start 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.583+0000 7fe3eaa4b640 1 -- start start 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41006e0 0x7fe3e4196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 0x7fe3e419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410c330 con 0x7fe3e41018d0 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410c1b0 con 0x7fe3e4102290 2024-03-16T10:50:17.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410c4b0 con 0x7fe3e41006e0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45766/0 (socket says 172.21.15.17:45766) 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 -- 172.21.15.17:0/208071225 learned_addr learned my addr 172.21.15.17:0/208071225 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e3fff640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41006e0 0x7fe3e4196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e8fe8640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 0x7fe3e419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 -- 172.21.15.17:0/208071225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41006e0 msgr2=0x7fe3e4196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41006e0 0x7fe3e4196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 -- 172.21.15.17:0/208071225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 msgr2=0x7fe3e419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 0x7fe3e419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 -- 172.21.15.17:0/208071225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e419e6a0 con 0x7fe3e41018d0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e37fe640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400e9f0 tx=0x7fe3d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400ccc0 con 0x7fe3e41018d0 2024-03-16T10:50:17.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e419e990 con 0x7fe3e41018d0 2024-03-16T10:50:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d4010910 con 0x7fe3e41018d0 2024-03-16T10:50:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.584+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40188a0 con 0x7fe3e41018d0 2024-03-16T10:50:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.585+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e419eee0 con 0x7fe3e41018d0 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.586+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e4107ac0 con 0x7fe3e41018d0 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.586+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fe3d4010ac0 con 0x7fe3e41018d0 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.587+0000 7fe3e17fa640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 0x7fe3cc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.587+0000 7fe3e3fff640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 0x7fe3cc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.587+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe3d40cee00 con 0x7fe3e41018d0 2024-03-16T10:50:17.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.588+0000 7fe3e3fff640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 0x7fe3cc0a4cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c00 tx=0x7fe3d8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.592+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe3d409bf40 con 0x7fe3e41018d0 2024-03-16T10:50:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.775+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe3e402d3b0 con 0x7fe3e41018d0 2024-03-16T10:50:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.775+0000 7fe3e17fa640 1 -- 172.21.15.17:0/208071225 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fe3d409b840 con 0x7fe3e41018d0 2024-03-16T10:50:17.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 msgr2=0x7fe3cc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 0x7fe3cc0a4cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000c00 tx=0x7fe3d8005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 msgr2=0x7fe3e4196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400e9f0 tx=0x7fe3d400edf0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 shutdown_connections 2024-03-16T10:50:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3cc0a2800 0x7fe3cc0a4cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e4102290 0x7fe3e419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e41018d0 0x7fe3e4196fc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 --2- 172.21.15.17:0/208071225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3e41006e0 0x7fe3e4196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 >> 172.21.15.17:0/208071225 conn(0x7fe3e40fbc70 msgr2=0x7fe3e4104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 shutdown_connections 2024-03-16T10:50:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.777+0000 7fe3eaa4b640 1 -- 172.21.15.17:0/208071225 wait complete. 2024-03-16T10:50:17.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:17.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 -- 172.21.15.17:0/619196745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee81006e0 msgr2=0x7faee8100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 --2- 172.21.15.17:0/619196745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee81006e0 0x7faee8100b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faee4009ca0 tx=0x7faee402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 -- 172.21.15.17:0/619196745 shutdown_connections 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 --2- 172.21.15.17:0/619196745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee8102290 0x7faee8108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 --2- 172.21.15.17:0/619196745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81018d0 0x7faee8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 --2- 172.21.15.17:0/619196745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee81006e0 0x7faee8100b00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 -- 172.21.15.17:0/619196745 >> 172.21.15.17:0/619196745 conn(0x7faee80fbc70 msgr2=0x7faee80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 -- 172.21.15.17:0/619196745 shutdown_connections 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.895+0000 7faeef3b9640 1 -- 172.21.15.17:0/619196745 wait complete. 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 Processor -- start 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 -- start start 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81006e0 0x7faee80694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 0x7faee819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faee810c350 con 0x7faee8102290 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7faee810c1d0 con 0x7faee81018d0 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeef3b9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faee810c4d0 con 0x7faee81006e0 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeed956640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeed956640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45782/0 (socket says 172.21.15.17:45782) 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeed956640 1 -- 172.21.15.17:0/3121050233 learned_addr learned my addr 172.21.15.17:0/3121050233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 0x7faee819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeed155640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81006e0 0x7faee80694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 -- 172.21.15.17:0/3121050233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81006e0 msgr2=0x7faee80694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81006e0 0x7faee80694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 -- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 msgr2=0x7faee819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:17.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeec954640 1 -- 172.21.15.17:0/3121050233 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee819f780 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.896+0000 7faeed956640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faeec954640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 0x7faee819c880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faed800e9f0 tx=0x7faed800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed800ccc0 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee819fa70 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed8005020 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80049e0 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.897+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee819ff70 con 0x7faee81018d0 2024-03-16T10:50:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.898+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee8107ad0 con 0x7faee81018d0 2024-03-16T10:50:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.900+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7faed8005560 con 0x7faee81018d0 2024-03-16T10:50:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.900+0000 7faede7fc640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 0x7faed40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.900+0000 7faeed155640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 0x7faed40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:17.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.900+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7faed80cea50 con 0x7faee81018d0 2024-03-16T10:50:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.901+0000 7faeed155640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 0x7faed40a4cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faee402c700 tx=0x7faee4032590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:17.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:17.907+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7faed80051d0 con 0x7faee81018d0 2024-03-16T10:50:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:18 smithi017 ceph-mon[32078]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:50:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3287467426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3197339029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/208071225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.147+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faee802d400 con 0x7faee81018d0 2024-03-16T10:50:18.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.147+0000 7faede7fc640 1 -- 172.21.15.17:0/3121050233 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7faed809bb80 con 0x7faee81018d0 2024-03-16T10:50:18.148 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 msgr2=0x7faed40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 0x7faed40a4cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faee402c700 tx=0x7faee4032590 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 msgr2=0x7faee819c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 0x7faee819c880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faed800e9f0 tx=0x7faed800eeb0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 shutdown_connections 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7faed40a2800 0x7faed40a4cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faee8102290 0x7faee819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faee81018d0 0x7faee819c880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 --2- 172.21.15.17:0/3121050233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faee81006e0 0x7faee80694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 >> 172.21.15.17:0/3121050233 conn(0x7faee80fbc70 msgr2=0x7faee8104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 shutdown_connections 2024-03-16T10:50:18.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.150+0000 7faeef3b9640 1 -- 172.21.15.17:0/3121050233 wait complete. 2024-03-16T10:50:18.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 -- 172.21.15.17:0/2364072772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 msgr2=0x7f3e7c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2364072772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c101d70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009900 tx=0x7f3e7002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 -- 172.21.15.17:0/2364072772 shutdown_connections 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2364072772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 0x7f3e7c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2364072772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c101d70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2364072772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 0x7f3e7c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 -- 172.21.15.17:0/2364072772 >> 172.21.15.17:0/2364072772 conn(0x7f3e7c0fbc70 msgr2=0x7f3e7c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 -- 172.21.15.17:0/2364072772 shutdown_connections 2024-03-16T10:50:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 -- 172.21.15.17:0/2364072772 wait complete. 2024-03-16T10:50:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.267+0000 7f3e811a9640 1 Processor -- start 2024-03-16T10:50:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 -- start start 2024-03-16T10:50:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 0x7f3e7c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 0x7f3e7c19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10c360 con 0x7f3e7c1018f0 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10c1e0 con 0x7f3e7c1022b0 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e811a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10c4e0 con 0x7f3e7c100700 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45802/0 (socket says 172.21.15.17:45802) 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 -- 172.21.15.17:0/2722809087 learned_addr learned my addr 172.21.15.17:0/2722809087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7b59e640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 0x7f3e7c19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7ad9d640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 0x7f3e7c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 -- 172.21.15.17:0/2722809087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 msgr2=0x7f3e7c197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 0x7f3e7c197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 -- 172.21.15.17:0/2722809087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 msgr2=0x7f3e7c19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 0x7f3e7c19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.268+0000 7f3e7a59c640 1 -- 172.21.15.17:0/2722809087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c19f750 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e7a59c640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009230 tx=0x7f3e7002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70041070 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c19f9e0 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e70004450 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70003e20 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.269+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c19fed0 con 0x7f3e7c1018f0 2024-03-16T10:50:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.270+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7c1a0100 con 0x7f3e7c1018f0 2024-03-16T10:50:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.271+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f3e70044070 con 0x7f3e7c1018f0 2024-03-16T10:50:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.271+0000 7f3e63fff640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 0x7f3e640a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.272+0000 7f3e7ad9d640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 0x7f3e640a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.272+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f3e700f05e0 con 0x7f3e7c1018f0 2024-03-16T10:50:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.272+0000 7f3e7ad9d640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 0x7f3e640a4cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c101750 tx=0x7f3e6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.280+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f3e700bd030 con 0x7f3e7c1018f0 2024-03-16T10:50:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:18 smithi174 ceph-mon[36202]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:50:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3287467426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3197339029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/208071225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:18 smithi111 ceph-mon[36315]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:50:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3287467426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3197339029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/208071225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:18.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.506+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e7c1a02d0 con 0x7f3e7c1018f0 2024-03-16T10:50:18.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.506+0000 7f3e63fff640 1 -- 172.21.15.17:0/2722809087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7f3e700c10d0 con 0x7f3e7c1018f0 2024-03-16T10:50:18.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:18.507 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:50:18.508 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 msgr2=0x7f3e640a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 0x7f3e640a4cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c101750 tx=0x7f3e6c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 msgr2=0x7f3e7c198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009230 tx=0x7f3e7002c650 comp rx=0 tx=0).stop 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 shutdown_connections 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f3e640a2800 0x7f3e640a4cc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3e7c1022b0 0x7f3e7c19f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e7c1018f0 0x7f3e7c198070 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 --2- 172.21.15.17:0/2722809087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e7c100700 0x7f3e7c197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 >> 172.21.15.17:0/2722809087 conn(0x7f3e7c0fbc70 msgr2=0x7f3e7c0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 shutdown_connections 2024-03-16T10:50:18.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.508+0000 7f3e811a9640 1 -- 172.21.15.17:0/2722809087 wait complete. 2024-03-16T10:50:18.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 -- 172.21.15.17:0/3954640109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 msgr2=0x7f05a4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 --2- 172.21.15.17:0/3954640109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4102e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0594009900 tx=0x7f059402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 -- 172.21.15.17:0/3954640109 shutdown_connections 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 --2- 172.21.15.17:0/3954640109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 0x7f05a4109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 --2- 172.21.15.17:0/3954640109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4102e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 --2- 172.21.15.17:0/3954640109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 0x7f05a4101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 -- 172.21.15.17:0/3954640109 >> 172.21.15.17:0/3954640109 conn(0x7f05a40fcd90 msgr2=0x7f05a40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 -- 172.21.15.17:0/3954640109 shutdown_connections 2024-03-16T10:50:18.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.624+0000 7f05abd97640 1 -- 172.21.15.17:0/3954640109 wait complete. 2024-03-16T10:50:18.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 Processor -- start 2024-03-16T10:50:18.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 -- start start 2024-03-16T10:50:18.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 0x7f05a4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 0x7f05a419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410d4a0 con 0x7f05a4102a10 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410d320 con 0x7f05a41033d0 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05abd97640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410d620 con 0x7f05a4101820 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45830/0 (socket says 172.21.15.17:45830) 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 -- 172.21.15.17:0/2561334650 learned_addr learned my addr 172.21.15.17:0/2561334650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9b33640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 0x7f05a4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05aa334640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 0x7f05a419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 -- 172.21.15.17:0/2561334650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 msgr2=0x7f05a4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 0x7f05a4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 -- 172.21.15.17:0/2561334650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 msgr2=0x7f05a419f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 0x7f05a419f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.625+0000 7f05a9332640 1 -- 172.21.15.17:0/2561334650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a419f770 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f05a9332640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0594009230 tx=0x7f059402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594041070 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0594004450 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a419fa00 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594003e20 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.626+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a419fef0 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.627+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a4108bc0 con 0x7f05a4102a10 2024-03-16T10:50:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.628+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f0594044070 con 0x7f05a4102a10 2024-03-16T10:50:18.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.628+0000 7f059affd640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 0x7f05900a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.629+0000 7f05a9b33640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 0x7f05900a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.629+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f05940f0930 con 0x7f05a4102a10 2024-03-16T10:50:18.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.629+0000 7f05a9b33640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 0x7f05900a4cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05a4102870 tx=0x7f05a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.632+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f05940bd380 con 0x7f05a4102a10 2024-03-16T10:50:18.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.828+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05a402d400 con 0x7f05a4102a10 2024-03-16T10:50:18.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.830+0000 7f059affd640 1 -- 172.21.15.17:0/2561334650 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7f05940c1420 con 0x7f05a4102a10 2024-03-16T10:50:18.831 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:18.831 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 msgr2=0x7f05900a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 0x7f05900a4cc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05a4102870 tx=0x7f05a0005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 msgr2=0x7f05a4198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0594009230 tx=0x7f059402c650 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 shutdown_connections 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f05900a2800 0x7f05900a4cc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f05a41033d0 0x7f05a419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05a4102a10 0x7f05a4198090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 --2- 172.21.15.17:0/2561334650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05a4101820 0x7f05a4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 >> 172.21.15.17:0/2561334650 conn(0x7f05a40fcd90 msgr2=0x7f05a4105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 shutdown_connections 2024-03-16T10:50:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.832+0000 7f05abd97640 1 -- 172.21.15.17:0/2561334650 wait complete. 2024-03-16T10:50:18.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- 172.21.15.17:0/3952512831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c107560 msgr2=0x7fb22c109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- 172.21.15.17:0/3952512831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c107560 0x7fb22c109950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb224009be0 tx=0x7fb22402bef0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- 172.21.15.17:0/3952512831 shutdown_connections 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- 172.21.15.17:0/3952512831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c107560 0x7fb22c109950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- 172.21.15.17:0/3952512831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 0x7fb22c107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- 172.21.15.17:0/3952512831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c102300 0x7fb22c1046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- 172.21.15.17:0/3952512831 >> 172.21.15.17:0/3952512831 conn(0x7fb22c0fbc70 msgr2=0x7fb22c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- 172.21.15.17:0/3952512831 shutdown_connections 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- 172.21.15.17:0/3952512831 wait complete. 2024-03-16T10:50:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 Processor -- start 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- start start 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c102300 0x7fb22c197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 0x7fb22c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c10d4a0 con 0x7fb22c107560 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c10d320 con 0x7fb22c104c30 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb231a61640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c10d620 con 0x7fb22c102300 2024-03-16T10:50:18.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.954+0000 7fb22b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45848/0 (socket says 172.21.15.17:45848) 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 -- 172.21.15.17:0/2316386293 learned_addr learned my addr 172.21.15.17:0/2316386293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22affd640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c102300 0x7fb22c197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb223fff640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 0x7fb22c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 -- 172.21.15.17:0/2316386293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c102300 msgr2=0x7fb22c197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c102300 0x7fb22c197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 -- 172.21.15.17:0/2316386293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 msgr2=0x7fb22c197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 0x7fb22c197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 -- 172.21.15.17:0/2316386293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c19f6c0 con 0x7fb22c107560 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb22b7fe640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb224036040 tx=0x7fb2240337b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224043020 con 0x7fb22c107560 2024-03-16T10:50:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c19f950 con 0x7fb22c107560 2024-03-16T10:50:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22402ca60 con 0x7fb22c107560 2024-03-16T10:50:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224034700 con 0x7fb22c107560 2024-03-16T10:50:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.955+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c19fea0 con 0x7fb22c107560 2024-03-16T10:50:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.956+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c0fd760 con 0x7fb22c107560 2024-03-16T10:50:18.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.957+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fb224046020 con 0x7fb22c107560 2024-03-16T10:50:18.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.958+0000 7fb230a5f640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 0x7fb2180a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:18.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.958+0000 7fb22affd640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 0x7fb2180a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:18.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.958+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb2240f0f80 con 0x7fb22c107560 2024-03-16T10:50:18.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.958+0000 7fb22affd640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 0x7fb2180a4cc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009530 tx=0x7fb21c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:18.962+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb22404d020 con 0x7fb22c107560 2024-03-16T10:50:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.185+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb22c0623e0 con 0x7fb22c107560 2024-03-16T10:50:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.185+0000 7fb230a5f640 1 -- 172.21.15.17:0/2316386293 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7fb2240be0c0 con 0x7fb22c107560 2024-03-16T10:50:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:50:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 msgr2=0x7fb2180a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 0x7fb2180a4cc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009530 tx=0x7fb21c009260 comp rx=0 tx=0).stop 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 msgr2=0x7fb22c19f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb224036040 tx=0x7fb2240337b0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 shutdown_connections 2024-03-16T10:50:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2180a2800 0x7fb2180a4cc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb22c107560 0x7fb22c19f050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb22c104c30 0x7fb22c197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 --2- 172.21.15.17:0/2316386293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb22c102300 0x7fb22c197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 >> 172.21.15.17:0/2316386293 conn(0x7fb22c0fbc70 msgr2=0x7fb22c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 shutdown_connections 2024-03-16T10:50:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.188+0000 7fb231a61640 1 -- 172.21.15.17:0/2316386293 wait complete. 2024-03-16T10:50:19.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3121050233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:19.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2722809087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2561334650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-16T10:48:48.817905+0000', 'modified': '2024-03-16T10:48:56.174199+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24536, 'mds_1': 24497, 'mds_2': 24493, 'mds_3': 24470, 'mds_4': 14655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14643': {'gid': 14643, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/3638042020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3638042020}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3638042020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14655': {'gid': 14655, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6841/2050511049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 2050511049}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 2050511049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6833/760873641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6832', 'nonce': 760873641}, {'type': 'v1', 'addr': '172.21.15.174:6833', 'nonce': 760873641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.111:6833/1048472977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6832', 'nonce': 1048472977}, {'type': 'v1', 'addr': '172.21.15.111:6833', 'nonce': 1048472977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/330421208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 330421208}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 330421208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/3507552570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 3507552570}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 3507552570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.111:6835/3904744326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6834', 'nonce': 3904744326}, {'type': 'v1', 'addr': '172.21.15.111:6835', 'nonce': 3904744326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.174:6839/2355684811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 2355684811}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 2355684811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.111:6837/2446703423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 2446703423}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 2446703423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24536': {'gid': 24536, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.111:6839/1155010688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6838', 'nonce': 1155010688}, {'type': 'v1', 'addr': '172.21.15.111:6839', 'nonce': 1155010688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24536, 'qdb_cluster': [24493, 24536, 24470, 24497, 14655]} 2024-03-16T10:50:19.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-16T10:50:19.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T10:50:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- 172.21.15.17:0/3467340096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768103a20 msgr2=0x7f5768103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- 172.21.15.17:0/3467340096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768103a20 0x7f5768103e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5758009900 tx=0x7f575802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- 172.21.15.17:0/3467340096 shutdown_connections 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- 172.21.15.17:0/3467340096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 0x7f576810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- 172.21.15.17:0/3467340096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768104c10 0x7f5768105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- 172.21.15.17:0/3467340096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768103a20 0x7f5768103e40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- 172.21.15.17:0/3467340096 >> 172.21.15.17:0/3467340096 conn(0x7f57680fef90 msgr2=0x7f57681013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- 172.21.15.17:0/3467340096 shutdown_connections 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- 172.21.15.17:0/3467340096 wait complete. 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 Processor -- start 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 -- start start 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768103a20 0x7f5768199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.306+0000 7f576d5f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 0x7f57681a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f576d5f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f576810f6a0 con 0x7f5768104c10 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f576d5f4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f576810f520 con 0x7f5768103a20 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f576d5f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f576810f820 con 0x7f57681055d0 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45862/0 (socket says 172.21.15.17:45862) 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 -- 172.21.15.17:0/233217123 learned_addr learned my addr 172.21.15.17:0/233217123 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f5766ffd640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768103a20 0x7f5768199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f57677fe640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 0x7f57681a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 -- 172.21.15.17:0/233217123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 msgr2=0x7f57681a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 0x7f57681a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 -- 172.21.15.17:0/233217123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768103a20 msgr2=0x7f5768199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768103a20 0x7f5768199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 -- 172.21.15.17:0/233217123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57681a1970 con 0x7f5768104c10 2024-03-16T10:50:19.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f575ffff640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f575000e9f0 tx=0x7f575000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f5764ff9640 1 -- 172.21.15.17:0/233217123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575000cd80 con 0x7f5768104c10 2024-03-16T10:50:19.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f5764ff9640 1 -- 172.21.15.17:0/233217123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5750010910 con 0x7f5768104c10 2024-03-16T10:50:19.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57681a1c60 con 0x7f5768104c10 2024-03-16T10:50:19.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f5764ff9640 1 -- 172.21.15.17:0/233217123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750018990 con 0x7f5768104c10 2024-03-16T10:50:19.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.307+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681a21b0 con 0x7f5768104c10 2024-03-16T10:50:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f5764ff9640 1 -- 172.21.15.17:0/233217123 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f5750010ac0 con 0x7f5768104c10 2024-03-16T10:50:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 Processor -- start 2024-03-16T10:50:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 -- start start 2024-03-16T10:50:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e49bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55eb17da5c80 con 0x55eb17e41bd0 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55eb17d4eaa0 con 0x55eb17e425c0 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57701e8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb17da1d20 con 0x55eb17e47730 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45864/0 (socket says 172.21.15.17:45864) 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f57677fe640 1 -- 172.21.15.17:0/810513692 learned_addr learned my addr 172.21.15.17:0/810513692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.310+0000 7f575ffff640 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e49bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f5764ff9640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 0x7f57540a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 -- 172.21.15.17:0/810513692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 msgr2=0x55eb17e49bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e49bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 -- 172.21.15.17:0/810513692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 msgr2=0x55eb17e470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 -- 172.21.15.17:0/810513692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb17d70ff0 con 0x55eb17e41bd0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f5766ffd640 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f5764ff9640 1 -- 172.21.15.17:0/233217123 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f57500cec50 con 0x7f5768104c10 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 0x7f57540a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f57677fe640 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5760011590 tx=0x7f5760011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8289d96046174731 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f575d7fa640 1 -- 172.21.15.17:0/810513692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760017050 con 0x55eb17e41bd0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f575d7fa640 1 -- 172.21.15.17:0/810513692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f576000fd20 con 0x55eb17e41bd0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.311+0000 7f575d7fa640 1 -- 172.21.15.17:0/810513692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576000e9f0 con 0x55eb17e41bd0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 -- 172.21.15.17:0/810513692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 msgr2=0x55eb17e41ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5760011590 tx=0x7f5760011a50 comp rx=0 tx=0).stop 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57677fe640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 0x7f57540a4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5760022000 tx=0x7f5760023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 -- 172.21.15.17:0/810513692 shutdown_connections 2024-03-16T10:50:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e49bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 --2- 172.21.15.17:0/810513692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e41bd0 0x55eb17e41ff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 -- 172.21.15.17:0/810513692 >> 172.21.15.17:0/810513692 conn(0x55eb17e3d140 msgr2=0x55eb17e3d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 -- 172.21.15.17:0/810513692 shutdown_connections 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.312+0000 7f57701e8740 1 -- 172.21.15.17:0/810513692 wait complete. 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 -- start start 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 Processor -- start 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e4c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e4a6e0 con 0x55eb17e47730 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55eb17d61ef0 con 0x55eb17e425c0 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e4a860 con 0x55eb17e41bd0 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57701e8740 10 client.0 _ll_register_callbacks cb 0x55eb17d5cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e4c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45878/0 (socket says 172.21.15.17:45878) 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57677fe640 1 -- 172.21.15.17:0/210257276 learned_addr learned my addr 172.21.15.17:0/210257276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 -- 172.21.15.17:0/210257276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 msgr2=0x55eb17e4bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 -- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 msgr2=0x55eb17e532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f575ffff640 1 -- 172.21.15.17:0/210257276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb17d6ea30 con 0x55eb17e425c0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.313+0000 7f57677fe640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f575ffff640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e4c290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57500cc840 tx=0x7f57500d2360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a844bfe25212d71e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575009b740 con 0x55eb17e425c0 2024-03-16T10:50:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5750018b30 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576000fd20 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f575009f7e0 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 10 client.24938 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eb17aba2d0 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f576000fd20 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f575009ab90 con 0x55eb17e425c0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 10 client.24938 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 10 client.24938 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 20 client.24938 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17e58730 0x55eb17e59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 4 client.24938 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb17db31c0 con 0x55eb17e58730 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.314+0000 7f5766ffd640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17e58730 0x55eb17e59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.315+0000 7f5766ffd640 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17e58730 0x55eb17e59ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b40e825478e5afcf server_cookie=ff16555daa279ef7 in_seq=0 out_seq=0 2024-03-16T10:50:19.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.315+0000 7f574e7fc640 10 client.24938 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.315+0000 7f574e7fc640 1 -- 172.21.15.17:0/210257276 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55eb17db31c0 con 0x55eb17e58730 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.315+0000 7f574e7fc640 10 client.24938 handle_command_reply: tid=0 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 client.24938 shutdown 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 msgr2=0x55eb17e4c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e4c290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57500cc840 tx=0x7f57500d2360 comp rx=0 tx=0).stop 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 shutdown_connections 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17e58730 0x55eb17e59ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e47730 0x55eb17e532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e425c0 0x55eb17e4c290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f574e7fc640 0 client.24938 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 --2- 172.21.15.17:0/210257276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 >> 172.21.15.17:0/210257276 conn(0x55eb17e3d140 msgr2=0x55eb17e3c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 shutdown_connections 2024-03-16T10:50:19.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 1 -- 172.21.15.17:0/210257276 wait complete. 2024-03-16T10:50:19.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.316+0000 7f57701e8740 20 client.24938 trim_cache size 0 max 16384 2024-03-16T10:50:19.324 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3121050233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:19.324 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2722809087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.324 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2561334650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 Processor -- start 2024-03-16T10:50:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 -- start start 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 0x55eb17e40ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e3baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e57ee0 con 0x55eb17e425c0 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e585b0 con 0x55eb17e41bd0 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57701e8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e58c80 con 0x55eb17e47730 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 0x55eb17e40ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45884/0 (socket says 172.21.15.17:45884) 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f575ffff640 1 -- 172.21.15.17:0/612940910 learned_addr learned my addr 172.21.15.17:0/612940910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f57677fe640 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e3baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f5766ffd640 1 -- 172.21.15.17:0/612940910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 msgr2=0x55eb17e3baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.334+0000 7f5766ffd640 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e3baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f5766ffd640 1 -- 172.21.15.17:0/612940910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 msgr2=0x55eb17e53290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f5766ffd640 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f5766ffd640 1 -- 172.21.15.17:0/612940910 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb17b846b0 con 0x55eb17e41bd0 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f575ffff640 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f5766ffd640 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 0x55eb17e40ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f575802c170 tx=0x7f575802e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d503129828163e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f575cff9640 1 -- 172.21.15.17:0/612940910 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758046ca0 con 0x55eb17e41bd0 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f575cff9640 1 -- 172.21.15.17:0/612940910 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5758004040 con 0x55eb17e41bd0 2024-03-16T10:50:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.335+0000 7f575cff9640 1 -- 172.21.15.17:0/612940910 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758005330 con 0x55eb17e41bd0 2024-03-16T10:50:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- 172.21.15.17:0/612940910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 msgr2=0x55eb17e40ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 0x55eb17e40ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f575802c170 tx=0x7f575802e040 comp rx=0 tx=0).stop 2024-03-16T10:50:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- 172.21.15.17:0/612940910 shutdown_connections 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e47730 0x55eb17e3baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- 172.21.15.17:0/612940910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e41bd0 0x55eb17e40ab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- 172.21.15.17:0/612940910 >> 172.21.15.17:0/612940910 conn(0x55eb17e3d140 msgr2=0x55eb17e403a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- 172.21.15.17:0/612940910 shutdown_connections 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- 172.21.15.17:0/612940910 wait complete. 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- start start 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 Processor -- start 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e47730 0x55eb17e517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e59a20 con 0x55eb17e425c0 2024-03-16T10:50:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e59350 con 0x55eb17e47730 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb17e5a0f0 con 0x55eb17e41bd0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57701e8740 10 client.0 _ll_register_callbacks cb 0x7f575000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f575ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45892/0 (socket says 172.21.15.17:45892) 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f575ffff640 1 -- 172.21.15.17:0/67563148 learned_addr learned my addr 172.21.15.17:0/67563148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f5766ffd640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.336+0000 7f57677fe640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e47730 0x55eb17e517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 -- 172.21.15.17:0/67563148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 msgr2=0x55eb17e4e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 -- 172.21.15.17:0/67563148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e47730 msgr2=0x55eb17e517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e47730 0x55eb17e517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 -- 172.21.15.17:0/67563148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb17e51dd0 con 0x55eb17e425c0 2024-03-16T10:50:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f575ffff640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5750098110 tx=0x7f57500d22f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0e866b28feaebe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575009b280 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f57500b4450 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5758004040 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57500a3e30 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f57701e8740 10 client.15075 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eb17e53140 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5758004040 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f575009a690 con 0x55eb17e425c0 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f57701e8740 10 client.15075 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.337+0000 7f57701e8740 10 client.15075 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 20 client.15075 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17ec2a00 0x55eb17ec1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 4 client.15075 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "status"}) -- 0x55eb17dad510 con 0x55eb17ec2a00 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f5766ffd640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17ec2a00 0x55eb17ec1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f574e7fc640 10 client.15075 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f5766ffd640 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17ec2a00 0x55eb17ec1710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=43e05d3e6e92fa24 server_cookie=d62c85c131541a9d in_seq=0 out_seq=0 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f574e7fc640 1 -- 172.21.15.17:0/67563148 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55eb17dad510 con 0x55eb17ec2a00 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f574e7fc640 10 client.15075 handle_command_reply: tid=0 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 client.15075 shutdown 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 msgr2=0x55eb17e4e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5750098110 tx=0x7f57500d22f0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 shutdown_connections 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55eb17ec2a00 0x55eb17ec1710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55eb17e47730 0x55eb17e517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb17e425c0 0x55eb17e4e860 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f574e7fc640 0 client.15075 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 --2- 172.21.15.17:0/67563148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb17e41bd0 0x55eb17e4e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 >> 172.21.15.17:0/67563148 conn(0x55eb17e3d140 msgr2=0x55eb17e40c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 shutdown_connections 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.338+0000 7f57701e8740 1 -- 172.21.15.17:0/67563148 wait complete. 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f57701e8740 20 client.15075 trim_cache size 0 max 16384 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14655, 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 84.168589159000007, 2024-03-16T10:50:19.346 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:19.347 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:19.347 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:19.347 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 97.968466065000001 2024-03-16T10:50:19.347 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 msgr2=0x7f57540a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 0x7f57540a4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5760022000 tx=0x7f5760023000 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 msgr2=0x7f576819a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f575000e9f0 tx=0x7f575000eeb0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 shutdown_connections 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57540a2880 0x7f57540a4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57681055d0 0x7f57681a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5768104c10 0x7f576819a290 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 --2- 172.21.15.17:0/233217123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5768103a20 0x7f5768199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 >> 172.21.15.17:0/233217123 conn(0x7f57680fef90 msgr2=0x7f5768107f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 shutdown_connections 2024-03-16T10:50:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.339+0000 7f576d5f4640 1 -- 172.21.15.17:0/233217123 wait complete. 2024-03-16T10:50:19.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T10:50:19.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3121050233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:19.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2722809087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2561334650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- 172.21.15.17:0/1145603988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 msgr2=0x7fb578103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1145603988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578103e40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb568009900 tx=0x7fb56802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- 172.21.15.17:0/1145603988 shutdown_connections 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1145603988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 0x7fb57810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1145603988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 0x7fb578105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1145603988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578103e40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- 172.21.15.17:0/1145603988 >> 172.21.15.17:0/1145603988 conn(0x7fb5780fef90 msgr2=0x7fb5781013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- 172.21.15.17:0/1145603988 shutdown_connections 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- 172.21.15.17:0/1145603988 wait complete. 2024-03-16T10:50:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 Processor -- start 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.454+0000 7fb57dff3640 1 -- start start 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 0x7fb57819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 0x7fb5781a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810f670 con 0x7fb578103a20 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810f4f0 con 0x7fb5781055d0 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb57810f7f0 con 0x7fb578104c10 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56074/0 (socket says 172.21.15.17:56074) 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 -- 172.21.15.17:0/1854599739 learned_addr learned my addr 172.21.15.17:0/1854599739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb576ffd640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 0x7fb57819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb577fff640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 0x7fb5781a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 -- 172.21.15.17:0/1854599739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 msgr2=0x7fb57819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 0x7fb57819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 -- 172.21.15.17:0/1854599739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 msgr2=0x7fb5781a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 0x7fb5781a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 -- 172.21.15.17:0/1854599739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5781a1990 con 0x7fb578103a20 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb568000c00 tx=0x7fb56802c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb574ff9640 1 -- 172.21.15.17:0/1854599739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568041070 con 0x7fb578103a20 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb574ff9640 1 -- 172.21.15.17:0/1854599739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb568004450 con 0x7fb578103a20 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781a1c20 con 0x7fb578103a20 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb574ff9640 1 -- 172.21.15.17:0/1854599739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568034440 con 0x7fb578103a20 2024-03-16T10:50:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.455+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781a2160 con 0x7fb578103a20 2024-03-16T10:50:19.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 Processor -- start 2024-03-16T10:50:19.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 -- start start 2024-03-16T10:50:19.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf3305c0 0x561abf3350c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf337bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561abf293c80 con 0x561abf32fbd0 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561abf23caa0 con 0x561abf3305c0 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb580bd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561abf28fd20 con 0x561abf335730 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56076/0 (socket says 172.21.15.17:56076) 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 -- 172.21.15.17:0/259139379 learned_addr learned my addr 172.21.15.17:0/259139379 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb576ffd640 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf337bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb574ff9640 1 -- 172.21.15.17:0/1854599739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fb568044070 con 0x7fb578103a20 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 -- 172.21.15.17:0/259139379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 msgr2=0x561abf337bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf337bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 -- 172.21.15.17:0/259139379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf3305c0 msgr2=0x561abf3350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf3305c0 0x561abf3350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb577fff640 1 -- 172.21.15.17:0/259139379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abf25eff0 con 0x561abf32fbd0 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.458+0000 7fb576ffd640 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf337bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb577fff640 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb570009fd0 tx=0x7fb5700118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d45173af0dc99ca server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb55dffb640 1 -- 172.21.15.17:0/259139379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570004d20 con 0x561abf32fbd0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb55dffb640 1 -- 172.21.15.17:0/259139379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb570004050 con 0x561abf32fbd0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb574ff9640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 0x7fb5600a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb55dffb640 1 -- 172.21.15.17:0/259139379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570005280 con 0x561abf32fbd0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 0x7fb5600a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.459+0000 7fb574ff9640 1 -- 172.21.15.17:0/1854599739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb5680f0420 con 0x7fb578103a20 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- 172.21.15.17:0/259139379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 msgr2=0x561abf32fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb570009fd0 tx=0x7fb5700118d0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb5777fe640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 0x7fb5600a4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x561abf3309c0 tx=0x7fb56802bc30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- 172.21.15.17:0/259139379 shutdown_connections 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf337bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf3305c0 0x561abf3350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- 172.21.15.17:0/259139379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf32fff0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- 172.21.15.17:0/259139379 >> 172.21.15.17:0/259139379 conn(0x561abf32b140 msgr2=0x561abf32b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- 172.21.15.17:0/259139379 shutdown_connections 2024-03-16T10:50:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- 172.21.15.17:0/259139379 wait complete. 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- start start 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 Processor -- start 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf339db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf33a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.460+0000 7fb580bd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561abf3386e0 con 0x561abf335730 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561abf24fef0 con 0x561abf32fbd0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561abf338860 con 0x561abf3305c0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 10 client.0 _ll_register_callbacks cb 0x561abf24adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf33a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56078/0 (socket says 172.21.15.17:56078) 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb577fff640 1 -- 172.21.15.17:0/2447802024 learned_addr learned my addr 172.21.15.17:0/2447802024 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb577fff640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf339db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 -- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 msgr2=0x561abf339db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf339db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 -- 172.21.15.17:0/2447802024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 msgr2=0x561abf341330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 -- 172.21.15.17:0/2447802024 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abf25ca30 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb577fff640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb576ffd640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf33a2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb57819b280 tx=0x7fb56c012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a1f6df2a27d22e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c004030 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb56c0041d0 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb570004050 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb56c0043d0 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 10 client.24922 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.461+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561abefa82d0 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb570004050 con 0x561abf3305c0 2024-03-16T10:50:19.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb56c003af0 con 0x561abf3305c0 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 10 client.24922 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 10 client.24922 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 20 client.24922 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf346950 0x561abf347dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 4 client.24922 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561abf2a11c0 con 0x561abf346950 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb577fff640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf346950 0x561abf347dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb556ffd640 10 client.24922 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:19.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.462+0000 7fb577fff640 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf346950 0x561abf347dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b355dc5746953cf0 server_cookie=5a3fe620c93ccbb6 in_seq=0 out_seq=0 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb556ffd640 1 -- 172.21.15.17:0/2447802024 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561abf2a11c0 con 0x561abf346950 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb556ffd640 10 client.24922 handle_command_reply: tid=0 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 client.24922 shutdown 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 msgr2=0x561abf33a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf33a2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb57819b280 tx=0x7fb56c012b60 comp rx=0 tx=0).stop 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 shutdown_connections 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf346950 0x561abf347dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf335730 0x561abf341330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf33a2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 --2- 172.21.15.17:0/2447802024 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf339db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb556ffd640 0 client.24922 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 >> 172.21.15.17:0/2447802024 conn(0x561abf32b140 msgr2=0x561abf32a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 shutdown_connections 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.463+0000 7fb580bd6740 1 -- 172.21.15.17:0/2447802024 wait complete. 2024-03-16T10:50:19.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.464+0000 7fb580bd6740 20 client.24922 trim_cache size 0 max 16384 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 Processor -- start 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 -- start start 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf329af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf32a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561abf346100 con 0x561abf3305c0 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561abf3467d0 con 0x561abf32fbd0 2024-03-16T10:50:19.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb580bd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561abf346ea0 con 0x561abf335730 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb576ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb576ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56084/0 (socket says 172.21.15.17:56084) 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb576ffd640 1 -- 172.21.15.17:0/3704274446 learned_addr learned my addr 172.21.15.17:0/3704274446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb577fff640 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf329af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.484+0000 7fb577fff640 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf32a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 -- 172.21.15.17:0/3704274446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 msgr2=0x561abf32a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf32a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 -- 172.21.15.17:0/3704274446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 msgr2=0x561abf329af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf329af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 -- 172.21.15.17:0/3704274446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abf0726b0 con 0x561abf3305c0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb576ffd640 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009f20 tx=0x7fb56c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0378ec73e21cc0e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb55d7fa640 1 -- 172.21.15.17:0/3704274446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c010720 con 0x561abf3305c0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb55d7fa640 1 -- 172.21.15.17:0/3704274446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56c003fe0 con 0x561abf3305c0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.485+0000 7fb55d7fa640 1 -- 172.21.15.17:0/3704274446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0035f0 con 0x561abf3305c0 2024-03-16T10:50:19.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- 172.21.15.17:0/3704274446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 msgr2=0x561abf3412f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009f20 tx=0x7fb56c0057f0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- 172.21.15.17:0/3704274446 shutdown_connections 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf335730 0x561abf32a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf3305c0 0x561abf3412f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 --2- 172.21.15.17:0/3704274446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf32fbd0 0x561abf329af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- 172.21.15.17:0/3704274446 >> 172.21.15.17:0/3704274446 conn(0x561abf32b140 msgr2=0x561abf345750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- 172.21.15.17:0/3704274446 shutdown_connections 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- 172.21.15.17:0/3704274446 wait complete. 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 -- start start 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.486+0000 7fb580bd6740 1 Processor -- start 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf333ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf335730 0x561abf3aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561abf347c40 con 0x561abf32fbd0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561abf347570 con 0x561abf335730 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561abf348310 con 0x561abf3305c0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 10 client.0 _ll_register_callbacks cb 0x7fb56c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56092/0 (socket says 172.21.15.17:56092) 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 -- 172.21.15.17:0/4154475443 learned_addr learned my addr 172.21.15.17:0/4154475443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb576ffd640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf333ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf335730 0x561abf3aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 -- 172.21.15.17:0/4154475443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 msgr2=0x561abf333ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf333ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 -- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf335730 msgr2=0x561abf3aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf335730 0x561abf3aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 -- 172.21.15.17:0/4154475443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abf334130 con 0x561abf32fbd0 2024-03-16T10:50:19.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb577fff640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb570004d00 tx=0x7fb5700118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ff1af54ec1d00 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570003d40 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb57000f4e0 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb56c003fe0 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb57000f6e0 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 10 client.15093 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.487+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561abf3abcf0 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb56c003fe0 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb57003d770 con 0x561abf32fbd0 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 10 client.15093 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 10 client.15093 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 20 client.15093 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf3b07c0 0x561abf3af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 4 client.15093 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "status"}) -- 0x561abf29b510 con 0x561abf3b07c0 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb576ffd640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf3b07c0 0x561abf3af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb576ffd640 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf3b07c0 0x561abf3af4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ead72840fbcea8d0 server_cookie=5600057cded1ebf2 in_seq=0 out_seq=0 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.488+0000 7fb556ffd640 10 client.15093 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb556ffd640 1 -- 172.21.15.17:0/4154475443 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561abf29b510 con 0x561abf3b07c0 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb556ffd640 10 client.15093 handle_command_reply: tid=0 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 client.15093 shutdown 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 msgr2=0x561abf333580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb570004d00 tx=0x7fb5700118d0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 shutdown_connections 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x561abf3b07c0 0x561abf3af4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561abf335730 0x561abf3aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561abf3305c0 0x561abf333ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb556ffd640 0 client.15093 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 --2- 172.21.15.17:0/4154475443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561abf32fbd0 0x561abf333580 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 >> 172.21.15.17:0/4154475443 conn(0x561abf32b140 msgr2=0x561abf32e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 shutdown_connections 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 1 -- 172.21.15.17:0/4154475443 wait complete. 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb580bd6740 20 client.15093 trim_cache size 0 max 16384 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24470, 2024-03-16T10:50:19.496 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 85.291337709999993, 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 115.31165079500001 2024-03-16T10:50:19.497 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 msgr2=0x7fb5600a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 0x7fb5600a4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x561abf3309c0 tx=0x7fb56802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 msgr2=0x7fb578199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb568000c00 tx=0x7fb56802c640 comp rx=0 tx=0).stop 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 shutdown_connections 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb5600a2880 0x7fb5600a4d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5781055d0 0x7fb5781a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb578104c10 0x7fb57819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 --2- 172.21.15.17:0/1854599739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb578103a20 0x7fb578199e10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.489+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 >> 172.21.15.17:0/1854599739 conn(0x7fb5780fef90 msgr2=0x7fb578107f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.490+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 shutdown_connections 2024-03-16T10:50:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.490+0000 7fb57dff3640 1 -- 172.21.15.17:0/1854599739 wait complete. 2024-03-16T10:50:19.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-16T10:50:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- 172.21.15.17:0/1478293016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181006f0 msgr2=0x7f7318100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 --2- 172.21.15.17:0/1478293016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181006f0 0x7f7318100b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7308009900 tx=0x7f730802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- 172.21.15.17:0/1478293016 shutdown_connections 2024-03-16T10:50:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 --2- 172.21.15.17:0/1478293016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 0x7f7318108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 --2- 172.21.15.17:0/1478293016 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181018e0 0x7f7318101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 --2- 172.21.15.17:0/1478293016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181006f0 0x7f7318100b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- 172.21.15.17:0/1478293016 >> 172.21.15.17:0/1478293016 conn(0x7f73180fbc80 msgr2=0x7f73180fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- 172.21.15.17:0/1478293016 shutdown_connections 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- 172.21.15.17:0/1478293016 wait complete. 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 Processor -- start 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.607+0000 7f731d487640 1 -- start start 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 0x7f731806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 0x7f731819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f731810c370 con 0x7f73181018e0 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f731810c1f0 con 0x7f73181006f0 2024-03-16T10:50:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f731810c4f0 con 0x7f73181022a0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56120/0 (socket says 172.21.15.17:56120) 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 -- 172.21.15.17:0/257087033 learned_addr learned my addr 172.21.15.17:0/257087033 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f7316ffd640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 0x7f731806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73177fe640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 0x7f731819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 -- 172.21.15.17:0/257087033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 msgr2=0x7f731819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 0x7f731819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 -- 172.21.15.17:0/257087033 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 msgr2=0x7f731806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 0x7f731806a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 -- 172.21.15.17:0/257087033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731819f7c0 con 0x7f73181018e0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f7316ffd640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 0x7f731806a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f73167fc640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f730c00ea60 tx=0x7f730c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f72fffff640 1 -- 172.21.15.17:0/257087033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c00cde0 con 0x7f73181018e0 2024-03-16T10:50:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f72fffff640 1 -- 172.21.15.17:0/257087033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730c0035f0 con 0x7f73181018e0 2024-03-16T10:50:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731819fa50 con 0x7f73181018e0 2024-03-16T10:50:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f72fffff640 1 -- 172.21.15.17:0/257087033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c010670 con 0x7f73181018e0 2024-03-16T10:50:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.608+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731819fff0 con 0x7f73181018e0 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 Processor -- start 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 -- start start 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c53730 0x55b718c55bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b718bb1c80 con 0x55b718c53730 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b718b5aaa0 con 0x55b718c4e5c0 2024-03-16T10:50:19.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f732006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b718badd20 con 0x55b718c4dbd0 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f73177fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f73177fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33662/0 (socket says 172.21.15.17:33662) 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f7316ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f73177fe640 1 -- 172.21.15.17:0/2116827526 learned_addr learned my addr 172.21.15.17:0/2116827526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.611+0000 7f72fffff640 1 -- 172.21.15.17:0/257087033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f730c0037a0 con 0x7f73181018e0 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 -- 172.21.15.17:0/2116827526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 msgr2=0x55b718c530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 -- 172.21.15.17:0/2116827526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c53730 msgr2=0x55b718c55bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c53730 0x55b718c55bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 -- 172.21.15.17:0/2116827526 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b718b7cff0 con 0x55b718c4dbd0 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f7316ffd640 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f73177fe640 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7310009fd0 tx=0x7f73100118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae9b77ba0764ad server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f72fd7fa640 1 -- 172.21.15.17:0/2116827526 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310004d20 con 0x55b718c4dbd0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f72fd7fa640 1 -- 172.21.15.17:0/2116827526 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7310004050 con 0x55b718c4dbd0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f72fd7fa640 1 -- 172.21.15.17:0/2116827526 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310005220 con 0x55b718c4dbd0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f72fffff640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 0x7f73000a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f7316ffd640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 0x7f73000a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.612+0000 7f72fffff640 1 -- 172.21.15.17:0/257087033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f730c0cec30 con 0x7f73181018e0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- 172.21.15.17:0/2116827526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 msgr2=0x55b718c4dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f7316ffd640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 0x7f73000a4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7308000c00 tx=0x7f7308005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7310009fd0 tx=0x7f73100118d0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- 172.21.15.17:0/2116827526 shutdown_connections 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c53730 0x55b718c55bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- 172.21.15.17:0/2116827526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c4dff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- 172.21.15.17:0/2116827526 >> 172.21.15.17:0/2116827526 conn(0x55b718c49140 msgr2=0x55b718c49540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- 172.21.15.17:0/2116827526 shutdown_connections 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- 172.21.15.17:0/2116827526 wait complete. 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- start start 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 Processor -- start 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c5f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b718c566e0 con 0x55b718c4e5c0 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b718b6def0 con 0x55b718c53730 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b718c56860 con 0x55b718c4dbd0 2024-03-16T10:50:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f732006a740 10 client.0 _ll_register_callbacks cb 0x55b718b68dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.613+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56148/0 (socket says 172.21.15.17:56148) 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f73167fc640 1 -- 172.21.15.17:0/603256393 learned_addr learned my addr 172.21.15.17:0/603256393 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f73177fe640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c5f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 -- 172.21.15.17:0/603256393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 msgr2=0x55b718c5f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c5f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 -- 172.21.15.17:0/603256393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 msgr2=0x55b718c58380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 -- 172.21.15.17:0/603256393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b718b7aa30 con 0x55b718c4dbd0 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f73167fc640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f7316ffd640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f730802c170 tx=0x7f7308009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7984a372002f61f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f72faff5640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730804c070 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7308004c50 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7310004050 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7308004e50 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f732006a740 10 client.24940 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.614+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b7188c62d0 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7310004050 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f73080346a0 con 0x55b718c4dbd0 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 10 client.24940 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 10 client.24940 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T10:50:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 20 client.24940 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718c64820 0x55b718c65c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 4 client.24940 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b718bbf1c0 con 0x55b718c64820 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f73167fc640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718c64820 0x55b718c65c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.615+0000 7f72faff5640 10 client.24940 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f73167fc640 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718c64820 0x55b718c65c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7fd9657533fba3f server_cookie=c6a12c61e45014ea in_seq=0 out_seq=0 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f72faff5640 1 -- 172.21.15.17:0/603256393 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b718bbf1c0 con 0x55b718c64820 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f72faff5640 10 client.24940 handle_command_reply: tid=0 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f732006a740 1 client.24940 shutdown 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 msgr2=0x55b718c57e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.617+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f730802c170 tx=0x7f7308009260 comp rx=0 tx=0).stop 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 shutdown_connections 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c5f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c58380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718c64820 0x55b718c65c90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 --2- 172.21.15.17:0/603256393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57e40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f72faff5640 0 client.24940 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 >> 172.21.15.17:0/603256393 conn(0x55b718c49140 msgr2=0x55b718c48380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 shutdown_connections 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 1 -- 172.21.15.17:0/603256393 wait complete. 2024-03-16T10:50:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.618+0000 7f732006a740 20 client.24940 trim_cache size 0 max 16384 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 Processor -- start 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 -- start start 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b718c63fd0 con 0x55b718c4e5c0 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b718c646a0 con 0x55b718c53730 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f732006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b718c64d70 con 0x55b718c4dbd0 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.636+0000 7f73167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56158/0 (socket says 172.21.15.17:56158) 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 -- 172.21.15.17:0/2955172445 learned_addr learned my addr 172.21.15.17:0/2955172445 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73177fe640 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f7316ffd640 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 -- 172.21.15.17:0/2955172445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 msgr2=0x55b718c57340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 -- 172.21.15.17:0/2955172445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 msgr2=0x55b718c57a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c57a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 -- 172.21.15.17:0/2955172445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7189906b0 con 0x55b718c4e5c0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f73167fc640 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f730c09b370 tx=0x7f730c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71f228b7db0bb90 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f72fcff9640 1 -- 172.21.15.17:0/2955172445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0b3070 con 0x55b718c4e5c0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f72fcff9640 1 -- 172.21.15.17:0/2955172445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730c09bd70 con 0x55b718c4e5c0 2024-03-16T10:50:19.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.637+0000 7f72fcff9640 1 -- 172.21.15.17:0/2955172445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0bb040 con 0x55b718c4e5c0 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- 172.21.15.17:0/2955172445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 msgr2=0x55b718c5f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f730c09b370 tx=0x7f730c003f30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- 172.21.15.17:0/2955172445 shutdown_connections 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c53730 0x55b718c57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4e5c0 0x55b718c5f310 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- 172.21.15.17:0/2955172445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c4dbd0 0x55b718c57340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- 172.21.15.17:0/2955172445 >> 172.21.15.17:0/2955172445 conn(0x55b718c49140 msgr2=0x55b718c56c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- 172.21.15.17:0/2955172445 shutdown_connections 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- 172.21.15.17:0/2955172445 wait complete. 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- start start 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 Processor -- start 2024-03-16T10:50:19.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c53730 0x55b718c5daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b718c65b10 con 0x55b718c4dbd0 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b718c65440 con 0x55b718c4e5c0 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b718c661e0 con 0x55b718c53730 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f732006a740 10 client.0 _ll_register_callbacks cb 0x7f7308009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f7316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f73167fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f73167fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35114/0 (socket says 172.21.15.17:35114) 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f7316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56170/0 (socket says 172.21.15.17:56170) 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f73167fc640 1 -- 172.21.15.17:0/240581039 learned_addr learned my addr 172.21.15.17:0/240581039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.638+0000 7f73177fe640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c53730 0x55b718c5daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 -- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c53730 msgr2=0x55b718c5daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c53730 0x55b718c5daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 -- 172.21.15.17:0/240581039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 msgr2=0x55b718c5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 -- 172.21.15.17:0/240581039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b718c5e090 con 0x55b718c4e5c0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f7316ffd640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f73167fc640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d010 tx=0x7f730c09f7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cbe8740ce49baed server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0b3070 con 0x55b718c4e5c0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f730c09bd70 con 0x55b718c4e5c0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f730c0b4270 con 0x55b718c4e5c0 2024-03-16T10:50:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f730c0bb070 con 0x55b718c4e5c0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f732006a740 10 client.24977 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b718c5f390 con 0x55b718c4e5c0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730c09bd70 con 0x55b718c4e5c0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f730c09aac0 con 0x55b718c4e5c0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.639+0000 7f732006a740 10 client.24977 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 10 client.24977 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 20 client.24977 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718cce7d0 0x55b718ccd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 4 client.24977 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "status"}) -- 0x55b718bb9510 con 0x55b718cce7d0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f7316ffd640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718cce7d0 0x55b718ccd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f7316ffd640 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718cce7d0 0x55b718ccd4e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58333c273698fafd server_cookie=abcee8d20af58020 in_seq=0 out_seq=0 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f72faff5640 10 client.24977 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f72faff5640 1 -- 172.21.15.17:0/240581039 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b718bb9510 con 0x55b718cce7d0 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f72faff5640 10 client.24977 handle_command_reply: tid=0 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 client.24977 shutdown 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 msgr2=0x55b718c5aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d010 tx=0x7f730c09f7c0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 shutdown_connections 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55b718cce7d0 0x55b718ccd4e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b718c53730 0x55b718c5daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b718c4e5c0 0x55b718c5aa80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f72faff5640 0 client.24977 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 --2- 172.21.15.17:0/240581039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b718c4dbd0 0x55b718c5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.640+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 >> 172.21.15.17:0/240581039 conn(0x55b718c49140 msgr2=0x55b718c4cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 shutdown_connections 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f732006a740 1 -- 172.21.15.17:0/240581039 wait complete. 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f732006a740 20 client.24977 trim_cache size 0 max 16384 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24493, 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:19.650 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 86.448928491000004, 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 103.895970908 2024-03-16T10:50:19.651 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:19.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 msgr2=0x7f73000a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 0x7f73000a4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7308000c00 tx=0x7f7308005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 msgr2=0x7f731819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f730c00ea60 tx=0x7f730c00ef20 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 shutdown_connections 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73000a2880 0x7f73000a4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73181022a0 0x7f731819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73181018e0 0x7f731819c890 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 --2- 172.21.15.17:0/257087033 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73181006f0 0x7f731806a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 >> 172.21.15.17:0/257087033 conn(0x7f73180fbc80 msgr2=0x7f7318104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 shutdown_connections 2024-03-16T10:50:19.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.641+0000 7f731d487640 1 -- 172.21.15.17:0/257087033 wait complete. 2024-03-16T10:50:19.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-16T10:50:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 -- 172.21.15.17:0/2439651391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 msgr2=0x7f74d40ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 --2- 172.21.15.17:0/2439651391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d40ffee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009890 tx=0x7f74d002bb70 comp rx=0 tx=0).stop 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 -- 172.21.15.17:0/2439651391 shutdown_connections 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 --2- 172.21.15.17:0/2439651391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 0x7f74d4109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 --2- 172.21.15.17:0/2439651391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 --2- 172.21.15.17:0/2439651391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d40ffee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.777+0000 7f74db40b640 1 -- 172.21.15.17:0/2439651391 >> 172.21.15.17:0/2439651391 conn(0x7f74d40fb3f0 msgr2=0x7f74d40fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.778+0000 7f74db40b640 1 -- 172.21.15.17:0/2439651391 shutdown_connections 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.778+0000 7f74db40b640 1 -- 172.21.15.17:0/2439651391 wait complete. 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.778+0000 7f74db40b640 1 Processor -- start 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.778+0000 7f74db40b640 1 -- start start 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.778+0000 7f74db40b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 0x7f74d419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74d410d470 con 0x7f74d4102a90 2024-03-16T10:50:19.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f74d410d2f0 con 0x7f74d4103450 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f74d410d5f0 con 0x7f74d40ffac0 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56182/0 (socket says 172.21.15.17:56182) 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d91a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 -- 172.21.15.17:0/2160446193 learned_addr learned my addr 172.21.15.17:0/2160446193 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d99a8640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 0x7f74d419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 -- 172.21.15.17:0/2160446193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 msgr2=0x7f74d4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 -- 172.21.15.17:0/2160446193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 msgr2=0x7f74d419f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 0x7f74d419f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 -- 172.21.15.17:0/2160446193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d419f770 con 0x7f74d4102a90 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e9c0 tx=0x7f74c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74ca7fc640 1 -- 172.21.15.17:0/2160446193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c400cde0 con 0x7f74d4102a90 2024-03-16T10:50:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d419fa60 con 0x7f74d4102a90 2024-03-16T10:50:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74ca7fc640 1 -- 172.21.15.17:0/2160446193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74c40035f0 con 0x7f74d4102a90 2024-03-16T10:50:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74ca7fc640 1 -- 172.21.15.17:0/2160446193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4010650 con 0x7f74d4102a90 2024-03-16T10:50:19.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.779+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d41a0000 con 0x7f74d4102a90 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 Processor -- start 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 -- start start 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a602253bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a6021afc80 con 0x55a602251730 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a602158aa0 con 0x55a60224c5c0 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74ddffc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a6021abd20 con 0x55a60224bbd0 2024-03-16T10:50:19.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74d91a7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74d99a8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74d91a7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35146/0 (socket says 172.21.15.17:35146) 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74d91a7640 1 -- 172.21.15.17:0/3883048471 learned_addr learned my addr 172.21.15.17:0/3883048471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.782+0000 7f74d99a8640 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33710/0 (socket says 172.21.15.17:33710) 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74ca7fc640 1 -- 172.21.15.17:0/2160446193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f74c40037a0 con 0x7f74d4102a90 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 -- 172.21.15.17:0/3883048471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 msgr2=0x55a6022510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 -- 172.21.15.17:0/3883048471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 msgr2=0x55a602253bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a602253bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 -- 172.21.15.17:0/3883048471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60217aff0 con 0x55a60224bbd0 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d99a8640 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009f00 tx=0x7f74cc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bee8c8b84e25de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74bf7fe640 1 -- 172.21.15.17:0/3883048471 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004d20 con 0x55a60224bbd0 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74bf7fe640 1 -- 172.21.15.17:0/3883048471 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc004030 con 0x55a60224bbd0 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74bf7fe640 1 -- 172.21.15.17:0/3883048471 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc005260 con 0x55a60224bbd0 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74ca7fc640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 0x7f74c00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74d91a7640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 0x7f74c00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.783+0000 7f74ca7fc640 1 -- 172.21.15.17:0/2160446193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f74c40ceca0 con 0x7f74d4102a90 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- 172.21.15.17:0/3883048471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 msgr2=0x55a60224bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74d91a7640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 0x7f74c00a4cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f74d0000c00 tx=0x7f74d0034ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009f00 tx=0x7f74cc011810 comp rx=0 tx=0).stop 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- 172.21.15.17:0/3883048471 shutdown_connections 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a602253bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 --2- 172.21.15.17:0/3883048471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a60224bff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- 172.21.15.17:0/3883048471 >> 172.21.15.17:0/3883048471 conn(0x55a602247140 msgr2=0x55a602247540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- 172.21.15.17:0/3883048471 shutdown_connections 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- 172.21.15.17:0/3883048471 wait complete. 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 -- start start 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.784+0000 7f74ddffc740 1 Processor -- start 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602255e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a602251730 0x55a60225d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a6022546e0 con 0x55a60224c5c0 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a60216bef0 con 0x55a602251730 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a602254860 con 0x55a60224bbd0 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74ddffc740 10 client.0 _ll_register_callbacks cb 0x55a602166dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d91a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602255e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56192/0 (socket says 172.21.15.17:56192) 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 -- 172.21.15.17:0/2520021311 learned_addr learned my addr 172.21.15.17:0/2520021311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d99a8640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a602251730 0x55a60225d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 -- 172.21.15.17:0/2520021311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 msgr2=0x55a602255e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602255e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 -- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a602251730 msgr2=0x55a60225d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a602251730 0x55a60225d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 -- 172.21.15.17:0/2520021311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a602178a30 con 0x55a60224c5c0 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d91a7640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602255e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74d89a6640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f74c40a3950 tx=0x7f74c409bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3c11249c250ce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.785+0000 7f74bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c40b4060 con 0x55a60224c5c0 2024-03-16T10:50:19.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f74c40999e0 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc004030 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74c40a3e80 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 10 client.15117 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a601ec42d0 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc004030 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f74c40b4200 con 0x55a60224c5c0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 10 client.15117 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 20 client.15117 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a602262790 0x55a602263c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 4 client.15117 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6021bd1c0 con 0x55a602262790 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.786+0000 7f74d91a7640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a602262790 0x55a602263c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.787+0000 7f74d91a7640 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a602262790 0x55a602263c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f630b12814d75c2 server_cookie=8ae6bc20b8f95cea in_seq=0 out_seq=0 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.787+0000 7f74bcff9640 10 client.15117 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.787+0000 7f74bcff9640 1 -- 172.21.15.17:0/2520021311 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a6021bd1c0 con 0x55a602262790 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.787+0000 7f74bcff9640 10 client.15117 handle_command_reply: tid=0 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.787+0000 7f74ddffc740 1 client.15117 shutdown 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 msgr2=0x55a602256350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f74c40a3950 tx=0x7f74c409bea0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 shutdown_connections 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a602262790 0x55a602263c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a602251730 0x55a60225d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a60224c5c0 0x55a602256350 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 --2- 172.21.15.17:0/2520021311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602255e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 >> 172.21.15.17:0/2520021311 conn(0x55a602247140 msgr2=0x55a602246380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74bcff9640 0 client.15117 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:19.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 shutdown_connections 2024-03-16T10:50:19.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 1 -- 172.21.15.17:0/2520021311 wait complete. 2024-03-16T10:50:19.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.788+0000 7f74ddffc740 20 client.15117 trim_cache size 0 max 16384 2024-03-16T10:50:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 Processor -- start 2024-03-16T10:50:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 -- start start 2024-03-16T10:50:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a6022550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a602255620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a602261f40 con 0x55a602251730 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a602262610 con 0x55a60224c5c0 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74ddffc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a602262ce0 con 0x55a60224bbd0 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56194/0 (socket says 172.21.15.17:56194) 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 -- 172.21.15.17:0/745751871 learned_addr learned my addr 172.21.15.17:0/745751871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d89a6640 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a602255620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d91a7640 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a6022550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 -- 172.21.15.17:0/745751871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 msgr2=0x55a6022550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a6022550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 -- 172.21.15.17:0/745751871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 msgr2=0x55a602255620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a602255620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.806+0000 7f74d99a8640 1 -- 172.21.15.17:0/745751871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a601f8e6b0 con 0x55a602251730 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74d99a8640 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009f00 tx=0x7f74cc005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80082b633092827d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74beffd640 1 -- 172.21.15.17:0/745751871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc028030 con 0x55a602251730 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74beffd640 1 -- 172.21.15.17:0/745751871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc0048e0 con 0x55a602251730 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74beffd640 1 -- 172.21.15.17:0/745751871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc01e040 con 0x55a602251730 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- 172.21.15.17:0/745751871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 msgr2=0x55a60224ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009f00 tx=0x7f74cc005c80 comp rx=0 tx=0).stop 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- 172.21.15.17:0/745751871 shutdown_connections 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a60224ce50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a602255620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 --2- 172.21.15.17:0/745751871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a6022550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- 172.21.15.17:0/745751871 >> 172.21.15.17:0/745751871 conn(0x55a602247140 msgr2=0x55a602255e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- 172.21.15.17:0/745751871 shutdown_connections 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- 172.21.15.17:0/745751871 wait complete. 2024-03-16T10:50:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.807+0000 7f74ddffc740 1 -- start start 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 Processor -- start 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602250190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a6022caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a602263a80 con 0x55a602251730 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a6022633b0 con 0x55a60224c5c0 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a602264150 con 0x55a60224bbd0 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74ddffc740 10 client.0 _ll_register_callbacks cb 0x7f74c409b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a6022caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d89a6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35172/0 (socket says 172.21.15.17:35172) 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d89a6640 1 -- 172.21.15.17:0/543943039 learned_addr learned my addr 172.21.15.17:0/543943039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d91a7640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602250190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 -- 172.21.15.17:0/543943039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 msgr2=0x55a602250190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602250190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 -- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 msgr2=0x55a6022c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.808+0000 7f74d99a8640 1 -- 172.21.15.17:0/543943039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6022cb2c0 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74d99a8640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a6022caa90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006010 tx=0x7f74cc004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c6d5c3e2e07e53 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc031070 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f74cc003970 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc0048e0 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74cc028040 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 10 client.15123 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a6022cc5c0 con 0x55a602251730 2024-03-16T10:50:19.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc0048e0 con 0x55a602251730 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f74cc034020 con 0x55a602251730 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 10 client.15123 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 20 client.15123 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a6022d0a90 0x55a6022cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 4 client.15123 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.809+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "status"}) -- 0x55a6021b7510 con 0x55a6022d0a90 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74d91a7640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a6022d0a90 0x55a6022cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74d91a7640 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a6022d0a90 0x55a6022cf7a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db0b73922d76d106 server_cookie=aaae090ce4f30106 in_seq=0 out_seq=0 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74bcff9640 10 client.15123 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74bcff9640 1 -- 172.21.15.17:0/543943039 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a6021b7510 con 0x55a6022d0a90 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74bcff9640 10 client.15123 handle_command_reply: tid=0 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 client.15123 shutdown 2024-03-16T10:50:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 msgr2=0x55a6022caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a6022caa90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006010 tx=0x7f74cc004a90 comp rx=0 tx=0).stop 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 shutdown_connections 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a602251730 0x55a6022caa90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a6022d0a90 0x55a6022cf7a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a60224c5c0 0x55a6022c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 --2- 172.21.15.17:0/543943039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a60224bbd0 0x55a602250190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74bcff9640 0 client.15123 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 >> 172.21.15.17:0/543943039 conn(0x55a602247140 msgr2=0x55a602255e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 shutdown_connections 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 1 -- 172.21.15.17:0/543943039 wait complete. 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.810+0000 7f74ddffc740 20 client.15123 trim_cache size 0 max 16384 2024-03-16T10:50:19.817 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24497, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 87.629716207000001, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 107.001515571 2024-03-16T10:50:19.818 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 msgr2=0x7f74c00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 0x7f74c00a4cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f74d0000c00 tx=0x7f74d0034ad0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 msgr2=0x7f74d4198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e9c0 tx=0x7f74c400ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 shutdown_connections 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74c00a2800 0x7f74c00a4cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74d4103450 0x7f74d419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4102a90 0x7f74d4198090 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 --2- 172.21.15.17:0/2160446193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74d40ffac0 0x7f74d4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 >> 172.21.15.17:0/2160446193 conn(0x7f74d40fb3f0 msgr2=0x7f74d4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 shutdown_connections 2024-03-16T10:50:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.811+0000 7f74db40b640 1 -- 172.21.15.17:0/2160446193 wait complete. 2024-03-16T10:50:19.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 -- 172.21.15.17:0/3387311417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1033a0 msgr2=0x7fb94c109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 --2- 172.21.15.17:0/3387311417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1033a0 0x7fb94c109c30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb944009be0 tx=0x7fb94402bef0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 -- 172.21.15.17:0/3387311417 shutdown_connections 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 --2- 172.21.15.17:0/3387311417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1033a0 0x7fb94c109c30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 --2- 172.21.15.17:0/3387311417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1029e0 0x7fb94c102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 --2- 172.21.15.17:0/3387311417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1017f0 0x7fb94c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 -- 172.21.15.17:0/3387311417 >> 172.21.15.17:0/3387311417 conn(0x7fb94c0fcd80 msgr2=0x7fb94c0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 -- 172.21.15.17:0/3387311417 shutdown_connections 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.925+0000 7fb953b90640 1 -- 172.21.15.17:0/3387311417 wait complete. 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 Processor -- start 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 -- start start 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1033a0 0x7fb94c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c10d470 con 0x7fb94c1029e0 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c10d2f0 con 0x7fb94c1017f0 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb953b90640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb94c10d5f0 con 0x7fb94c1033a0 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95192c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56226/0 (socket says 172.21.15.17:56226) 2024-03-16T10:50:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 -- 172.21.15.17:0/656144329 learned_addr learned my addr 172.21.15.17:0/656144329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95192c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35192/0 (socket says 172.21.15.17:35192) 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95212d640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1033a0 0x7fb94c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 -- 172.21.15.17:0/656144329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1033a0 msgr2=0x7fb94c074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1033a0 0x7fb94c074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 -- 172.21.15.17:0/656144329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 msgr2=0x7fb94c075590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 -- 172.21.15.17:0/656144329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94c0749a0 con 0x7fb94c1029e0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95192c640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb95112b640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00e9f0 tx=0x7fb93c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.926+0000 7fb942ffd640 1 -- 172.21.15.17:0/656144329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00cd80 con 0x7fb94c1029e0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.927+0000 7fb942ffd640 1 -- 172.21.15.17:0/656144329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb93c005500 con 0x7fb94c1029e0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.927+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94c1a1c00 con 0x7fb94c1029e0 2024-03-16T10:50:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.927+0000 7fb942ffd640 1 -- 172.21.15.17:0/656144329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c010690 con 0x7fb94c1029e0 2024-03-16T10:50:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.927+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb94c1a2100 con 0x7fb94c1029e0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb942ffd640 1 -- 172.21.15.17:0/656144329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fb93c0046c0 con 0x7fb94c1029e0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb956777740 1 Processor -- start 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb956777740 1 -- start start 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb942ffd640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 0x7fb9380a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb956777740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.929+0000 7fb956777740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092ddb5c0 0x55e092de00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb956777740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092de0730 0x55e092de2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb956777740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e092d3ec80 con 0x55e092ddb5c0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb956777740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e092ce7aa0 con 0x55e092ddabd0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb956777740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e092d3ad20 con 0x55e092de0730 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95192c640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 0x7fb9380a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95112b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092ddb5c0 0x55e092de00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35204/0 (socket says 172.21.15.17:35204) 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 -- 172.21.15.17:0/852648998 learned_addr learned my addr 172.21.15.17:0/852648998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb942ffd640 1 -- 172.21.15.17:0/656144329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb93c0cee40 con 0x7fb94c1029e0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092de0730 0x55e092de2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 -- 172.21.15.17:0/852648998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092de0730 msgr2=0x55e092de2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092de0730 0x55e092de2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 -- 172.21.15.17:0/852648998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092ddb5c0 msgr2=0x55e092de00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092ddb5c0 0x55e092de00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 -- 172.21.15.17:0/852648998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e092d09ff0 con 0x55e092ddabd0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95192c640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 0x7fb9380a4cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9480096c0 tx=0x7fb948009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb95212d640 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb944004ab0 tx=0x7fb944005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7ae57872f4c850 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb937fff640 1 -- 172.21.15.17:0/852648998 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944033630 con 0x55e092ddabd0 2024-03-16T10:50:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb937fff640 1 -- 172.21.15.17:0/852648998 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944003e50 con 0x55e092ddabd0 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.930+0000 7fb937fff640 1 -- 172.21.15.17:0/852648998 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944004030 con 0x55e092ddabd0 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- 172.21.15.17:0/852648998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 msgr2=0x55e092ddaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb944004ab0 tx=0x7fb944005e30 comp rx=0 tx=0).stop 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- 172.21.15.17:0/852648998 shutdown_connections 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092de0730 0x55e092de2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092ddb5c0 0x55e092de00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 --2- 172.21.15.17:0/852648998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092ddaff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- 172.21.15.17:0/852648998 >> 172.21.15.17:0/852648998 conn(0x55e092dd6140 msgr2=0x55e092dd6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- 172.21.15.17:0/852648998 shutdown_connections 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- 172.21.15.17:0/852648998 wait complete. 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.931+0000 7fb956777740 1 -- start start 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 Processor -- start 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092de4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddb5c0 0x55e092de5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e092de3680 con 0x55e092de0730 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e092cfaef0 con 0x55e092ddabd0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e092de3800 con 0x55e092ddb5c0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb956777740 10 client.0 _ll_register_callbacks cb 0x55e092cf5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56240/0 (socket says 172.21.15.17:56240) 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 -- 172.21.15.17:0/734120726 learned_addr learned my addr 172.21.15.17:0/734120726 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95192c640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092de4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95112b640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddb5c0 0x55e092de5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 -- 172.21.15.17:0/734120726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddb5c0 msgr2=0x55e092de5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddb5c0 0x55e092de5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 -- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 msgr2=0x55e092de4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092de4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.932+0000 7fb95212d640 1 -- 172.21.15.17:0/734120726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e092d07a30 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb95212d640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb944036040 tx=0x7fb944004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee4e6f5d05b68ec server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944051060 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb944004b40 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb944003e50 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb944004d40 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 10 client.15135 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e092a532d0 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944003e50 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb944034430 con 0x55e092de0730 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T10:50:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 20 client.15135 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092df1210 0x55e092df2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 4 client.15135 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e092d4c1c0 con 0x55e092df1210 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.933+0000 7fb95192c640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092df1210 0x55e092df2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.934+0000 7fb9357fa640 10 client.15135 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.934+0000 7fb95192c640 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092df1210 0x55e092df2680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e69b7c9439d58b9 server_cookie=13eaf3227c55458e in_seq=0 out_seq=0 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.934+0000 7fb9357fa640 1 -- 172.21.15.17:0/734120726 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e092d4c1c0 con 0x55e092df1210 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.934+0000 7fb9357fa640 10 client.15135 handle_command_reply: tid=0 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.934+0000 7fb956777740 1 client.15135 shutdown 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 msgr2=0x55e092dec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb944036040 tx=0x7fb944004a40 comp rx=0 tx=0).stop 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 shutdown_connections 2024-03-16T10:50:19.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092df1210 0x55e092df2680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092dec2b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddb5c0 0x55e092de5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb9357fa640 0 client.15135 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 --2- 172.21.15.17:0/734120726 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddabd0 0x55e092de4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 >> 172.21.15.17:0/734120726 conn(0x55e092dd6140 msgr2=0x55e092dd5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 shutdown_connections 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 1 -- 172.21.15.17:0/734120726 wait complete. 2024-03-16T10:50:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.935+0000 7fb956777740 20 client.15135 trim_cache size 0 max 16384 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 Processor -- start 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 -- start start 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092dec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e092df09c0 con 0x55e092de0730 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e092df1090 con 0x55e092ddb5c0 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb956777740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e092df1760 con 0x55e092ddabd0 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56254/0 (socket says 172.21.15.17:56254) 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 -- 172.21.15.17:0/2979898064 learned_addr learned my addr 172.21.15.17:0/2979898064 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95192c640 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95112b640 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092dec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 -- 172.21.15.17:0/2979898064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 msgr2=0x55e092de4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 -- 172.21.15.17:0/2979898064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 msgr2=0x55e092dec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092dec270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.953+0000 7fb95212d640 1 -- 172.21.15.17:0/2979898064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e092b1d6b0 con 0x55e092de0730 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb95212d640 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb944005e70 tx=0x7fb94402c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1237b885c7d1d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb9377fe640 1 -- 172.21.15.17:0/2979898064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94405b070 con 0x55e092de0730 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb9377fe640 1 -- 172.21.15.17:0/2979898064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944003e50 con 0x55e092de0730 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb9377fe640 1 -- 172.21.15.17:0/2979898064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94402c950 con 0x55e092de0730 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 -- 172.21.15.17:0/2979898064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 msgr2=0x55e092de4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb944005e70 tx=0x7fb94402c570 comp rx=0 tx=0).stop 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 -- 172.21.15.17:0/2979898064 shutdown_connections 2024-03-16T10:50:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092de4560 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092dec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 --2- 172.21.15.17:0/2979898064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 -- 172.21.15.17:0/2979898064 >> 172.21.15.17:0/2979898064 conn(0x55e092dd6140 msgr2=0x55e092ddfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 -- 172.21.15.17:0/2979898064 shutdown_connections 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.954+0000 7fb956777740 1 -- 172.21.15.17:0/2979898064 wait complete. 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 -- start start 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 Processor -- start 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092de7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e092df2500 con 0x55e092de0730 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e092df1e30 con 0x55e092ddb5c0 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e092df2bd0 con 0x55e092ddabd0 2024-03-16T10:50:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb956777740 10 client.0 _ll_register_callbacks cb 0x7fb93c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95192c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56256/0 (socket says 172.21.15.17:56256) 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 -- 172.21.15.17:0/908376803 learned_addr learned my addr 172.21.15.17:0/908376803 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95112b640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092de7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 -- 172.21.15.17:0/908376803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 msgr2=0x55e092de7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 -- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 msgr2=0x55e092de7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092de7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.955+0000 7fb95212d640 1 -- 172.21.15.17:0/908376803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e092deb3a0 con 0x55e092de0730 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb95212d640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb94402c430 tx=0x7fb944033b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a609d76e0818474d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94405b070 con 0x55e092de0730 2024-03-16T10:50:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb944003970 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb944003e50 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb944003b70 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 10 client.15141 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e092dec6a0 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb944003e50 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb9440043a0 con 0x55e092de0730 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 20 client.15141 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092e5b3c0 0x55e092e57800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 4 client.15141 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.956+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "status"}) -- 0x55e092d46510 con 0x55e092e5b3c0 2024-03-16T10:50:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb95192c640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092e5b3c0 0x55e092e57800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb9357fa640 10 client.15141 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb95192c640 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092e5b3c0 0x55e092e57800 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3944beca3b818414 server_cookie=fa9567cae350b4da in_seq=0 out_seq=0 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb9357fa640 1 -- 172.21.15.17:0/908376803 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e092d46510 con 0x55e092e5b3c0 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb9357fa640 10 client.15141 handle_command_reply: tid=0 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 client.15141 shutdown 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 msgr2=0x55e092deadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb94402c430 tx=0x7fb944033b90 comp rx=0 tx=0).stop 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 shutdown_connections 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e092e5b3c0 0x55e092e57800 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e092de0730 0x55e092deadb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e092ddb5c0 0x55e092de7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb9357fa640 0 client.15141 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 --2- 172.21.15.17:0/908376803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e092ddabd0 0x55e092de7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 >> 172.21.15.17:0/908376803 conn(0x55e092dd6140 msgr2=0x55e092ddf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 shutdown_connections 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 1 -- 172.21.15.17:0/908376803 wait complete. 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.957+0000 7fb956777740 20 client.15141 trim_cache size 0 max 16384 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24536, 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:19.965 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 90.314028562000004, 2024-03-16T10:50:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:19.966 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 95.651743303000003 2024-03-16T10:50:19.966 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 msgr2=0x7fb9380a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 0x7fb9380a4cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9480096c0 tx=0x7fb948009260 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 msgr2=0x7fb94c073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00e9f0 tx=0x7fb93c00edf0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 shutdown_connections 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9380a2800 0x7fb9380a4cc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb94c1033a0 0x7fb94c074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb94c1029e0 0x7fb94c073bd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 --2- 172.21.15.17:0/656144329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb94c1017f0 0x7fb94c075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 >> 172.21.15.17:0/656144329 conn(0x7fb94c0fcd80 msgr2=0x7fb94c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 shutdown_connections 2024-03-16T10:50:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:19.958+0000 7fb953b90640 1 -- 172.21.15.17:0/656144329 wait complete. 2024-03-16T10:50:19.970 INFO:tasks.cephadm:Setup complete, yielding 2024-03-16T10:50:19.970 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-16T10:50:19.980 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:50:19.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph orch status' 2024-03-16T10:50:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:20 smithi017 ceph-mon[32078]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:50:20.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:20 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2316386293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:20 smithi174 ceph-mon[36202]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:50:20.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:20 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2316386293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:20.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:20 smithi111 ceph-mon[36315]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:50:20.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:20 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2316386293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- 172.21.15.17:0/3141990191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04101200 msgr2=0x7f8a04101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/3141990191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04101200 0x7f8a04101620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89f40099c0 tx=0x7f89f4009cd0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- 172.21.15.17:0/3141990191 shutdown_connections 2024-03-16T10:50:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/3141990191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04102da0 0x7f8a04109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/3141990191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04101200 0x7f8a04101620 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/3141990191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a04102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- 172.21.15.17:0/3141990191 >> 172.21.15.17:0/3141990191 conn(0x7f8a040fc7a0 msgr2=0x7f8a040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- 172.21.15.17:0/3141990191 shutdown_connections 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- 172.21.15.17:0/3141990191 wait complete. 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 Processor -- start 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.036+0000 7f8a09ff1700 1 -- start start 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 0x7f8a0406aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04102da0 0x7f8a041a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0410cde0 con 0x7f8a04102da0 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0410cc60 con 0x7f8a04102400 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a09ff1700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0410cf60 con 0x7f8a04101200 2024-03-16T10:50:22.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a037fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 0x7f8a0406aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:35234/0 (socket says 172.21.15.17:35234) 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 -- 172.21.15.17:0/1104888580 learned_addr learned my addr 172.21.15.17:0/1104888580 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a03fff700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04102da0 0x7f8a041a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 -- 172.21.15.17:0/1104888580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 msgr2=0x7f8a0406aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 0x7f8a0406aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 -- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04102da0 msgr2=0x7f8a041a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04102da0 0x7f8a041a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 -- 172.21.15.17:0/1104888580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a041a2470 con 0x7f8a04102400 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a037fe700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 0x7f8a0406aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.037+0000 7f8a02ffd700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f89f800e9a0 tx=0x7f89f800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.038+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800c9c0 con 0x7f8a04102400 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.038+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f800cb60 con 0x7f8a04102400 2024-03-16T10:50:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.038+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a041a2760 con 0x7f8a04102400 2024-03-16T10:50:22.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.038+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8018660 con 0x7f8a04102400 2024-03-16T10:50:22.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.038+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a041a2cf0 con 0x7f8a04102400 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.039+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04068f90 con 0x7f8a04102400 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.040+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f89f800cd10 con 0x7f8a04102400 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.040+0000 7f8a00ff9700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 0x7f89ec0a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.040+0000 7f8a037fe700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 0x7f89ec0a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.041+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f89f80ceaf0 con 0x7f8a04102400 2024-03-16T10:50:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.041+0000 7f8a037fe700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 0x7f89ec0a4cb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.045+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f89f809bc30 con 0x7f8a04102400 2024-03-16T10:50:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.267+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8a0402df90 con 0x7f89ec0a27f0 2024-03-16T10:50:22.268 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:22 smithi017 ceph-mon[32078]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:22.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.268+0000 7f8a00ff9700 1 -- 172.21.15.17:0/1104888580 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8a0402df90 con 0x7f89ec0a27f0 2024-03-16T10:50:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-03-16T10:50:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-03-16T10:50:22.269 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 msgr2=0x7f89ec0a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 0x7f89ec0a4cb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f4005fb0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 msgr2=0x7f8a0419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f89f800e9a0 tx=0x7f89f800ecb0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 shutdown_connections 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f89ec0a27f0 0x7f89ec0a4cb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a04102da0 0x7f8a041a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a04101200 0x7f8a0406aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 --2- 172.21.15.17:0/1104888580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a04102400 0x7f8a0419f740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 >> 172.21.15.17:0/1104888580 conn(0x7f8a040fc7a0 msgr2=0x7f8a04105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 shutdown_connections 2024-03-16T10:50:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:22.271+0000 7f8a09ff1700 1 -- 172.21.15.17:0/1104888580 wait complete. 2024-03-16T10:50:22.314 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:22 smithi174 ceph-mon[36202]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:22.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:22 smithi111 ceph-mon[36315]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:22.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-16T10:50:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:23.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:23 smithi174 ceph-mon[36202]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:23.316 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:23 smithi017 ceph-mon[32078]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:23.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:23 smithi111 ceph-mon[36315]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:24.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:24 smithi174 ceph-mon[36202]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:24.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:24 smithi017 ceph-mon[32078]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:24.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:24 smithi111 ceph-mon[36315]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 -- 172.21.15.17:0/1096276936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04105760 msgr2=0x7f8c04107b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1096276936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04105760 0x7f8c04107b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009990 tx=0x7f8bec009ca0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 -- 172.21.15.17:0/1096276936 shutdown_connections 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1096276936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04108090 0x7f8c0410a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1096276936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04102e30 0x7f8c04105220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1096276936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04105760 0x7f8c04107b50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 -- 172.21.15.17:0/1096276936 >> 172.21.15.17:0/1096276936 conn(0x7f8c040fc7a0 msgr2=0x7f8c040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 -- 172.21.15.17:0/1096276936 shutdown_connections 2024-03-16T10:50:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 -- 172.21.15.17:0/1096276936 wait complete. 2024-03-16T10:50:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.096+0000 7f8c096fe700 1 Processor -- start 2024-03-16T10:50:25.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 -- start start 2024-03-16T10:50:25.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04105760 0x7f8c04198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04108090 0x7f8c0419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410ded0 con 0x7f8c04102e30 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410dd50 con 0x7f8c04105760 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c096fe700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410e050 con 0x7f8c04108090 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56288/0 (socket says 172.21.15.17:56288) 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 -- 172.21.15.17:0/1949124651 learned_addr learned my addr 172.21.15.17:0/1949124651 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c027fc700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04105760 0x7f8c04198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c037fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04108090 0x7f8c0419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 -- 172.21.15.17:0/1949124651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04108090 msgr2=0x7f8c0419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:25.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04108090 0x7f8c0419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 -- 172.21.15.17:0/1949124651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04105760 msgr2=0x7f8c04198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04105760 0x7f8c04198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 -- 172.21.15.17:0/1949124651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c041a01e0 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.097+0000 7f8c02ffd700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400e9d0 tx=0x7f8bf400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.098+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400cbd0 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.098+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c041a04d0 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.098+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf400ee70 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.098+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4018680 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.098+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c041a0a60 con 0x7f8c04102e30 2024-03-16T10:50:25.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.099+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04068f90 con 0x7f8c04102e30 2024-03-16T10:50:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.100+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f8bf40188e0 con 0x7f8c04102e30 2024-03-16T10:50:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.101+0000 7f8bfbfff700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 0x7f8bf00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.101+0000 7f8c027fc700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 0x7f8bf00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.101+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8bf40cebb0 con 0x7f8c04102e30 2024-03-16T10:50:25.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.101+0000 7f8c027fc700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 0x7f8bf00a4d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b7b0 tx=0x7f8bec00b880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:25.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.105+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8bf409bcf0 con 0x7f8c04102e30 2024-03-16T10:50:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.320+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8c04062710 con 0x7f8bf00a2890 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.334+0000 7f8bfbfff700 1 -- 172.21.15.17:0/1949124651 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f8c04062710 con 0x7f8bf00a2890 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (104s) 18s ago 103s 17.4M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 0b95be7646ab 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi111 running (101s) 34s ago 100s 25.5M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 1e259e6c336d 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi174 running (115s) 34s ago 115s 19.3M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 9b54497e9522 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (2m) 18s ago 2m 13.8M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 68d2d9d0c98b 2024-03-16T10:50:25.335 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi111 running (2m) 34s ago 2m 17.6M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 27bfb38bbbb0 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi174 running (118s) 34s ago 118s 18.4M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 947abf66148c 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (107s) 18s ago 106s 19.1M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 5dad0ff0304c 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi111 running (112s) 34s ago 112s 18.0M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 12094577a144 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi174 running (110s) 34s ago 109s 19.2M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 736267ec3201 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (2m) 18s ago 2m 16.4M - 19.0.0-2162-g3d78f5ba be86dc8cb22b db13e56010fc 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi111 running (2m) 34s ago 2m 17.0M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 5b199dc513b0 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi174 running (2m) 34s ago 2m 17.1M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 429a37357321 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (9m) 18s ago 9m 513M - 19.0.0-2162-g3d78f5ba be86dc8cb22b a2ef02fdce56 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi111 *:8443,8765 running (7m) 34s ago 7m 452M - 19.0.0-2162-g3d78f5ba be86dc8cb22b 9e1f123d317c 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi174 *:8443,8765 running (7m) 34s ago 7m 454M - 19.0.0-2162-g3d78f5ba be86dc8cb22b c88940e1f103 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (9m) 18s ago 9m 50.9M 2048M 19.0.0-2162-g3d78f5ba be86dc8cb22b c900f929f10a 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi111 running (7m) 34s ago 7m 39.1M 2048M 19.0.0-2162-g3d78f5ba be86dc8cb22b e2255074d989 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi174 running (8m) 34s ago 7m 39.9M 2048M 19.0.0-2162-g3d78f5ba be86dc8cb22b 97d7f40e9445 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 18s ago 7m 56.2M 4273M 19.0.0-2162-g3d78f5ba be86dc8cb22b 25141f8c59e7 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi111 running (6m) 34s ago 6m 57.1M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b 5a037479d5e2 2024-03-16T10:50:25.336 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi174 running (6m) 34s ago 6m 55.5M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b f852b9826594 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (6m) 18s ago 6m 43.0M 4273M 19.0.0-2162-g3d78f5ba be86dc8cb22b 06a64a2104d8 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi111 running (5m) 34s ago 5m 42.3M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b 53071e135c83 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi174 running (5m) 34s ago 5m 57.4M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b d120606af1a5 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (4m) 18s ago 4m 53.5M 4273M 19.0.0-2162-g3d78f5ba be86dc8cb22b 203a5149ac2c 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi111 running (4m) 34s ago 4m 54.0M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b c2154d251f83 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi174 running (3m) 34s ago 3m 42.7M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b 16f8c34547bc 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 18s ago 3m 41.3M 4273M 19.0.0-2162-g3d78f5ba be86dc8cb22b c26de8170746 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi111 running (3m) 34s ago 3m 52.0M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b dab26ef0a8e4 2024-03-16T10:50:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi174 running (2m) 34s ago 2m 40.7M 4270M 19.0.0-2162-g3d78f5ba be86dc8cb22b da516dc2e8d3 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 msgr2=0x7f8bf00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 0x7f8bf00a4d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b7b0 tx=0x7f8bec00b880 comp rx=0 tx=0).stop 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 msgr2=0x7f8c04198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400e9d0 tx=0x7f8bf400ece0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 shutdown_connections 2024-03-16T10:50:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bf00a2890 0x7f8bf00a4d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c04108090 0x7f8c0419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c04102e30 0x7f8c04198580 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 --2- 172.21.15.17:0/1949124651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c04105760 0x7f8c04198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.336+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 >> 172.21.15.17:0/1949124651 conn(0x7f8c040fc7a0 msgr2=0x7f8c041038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.337+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 shutdown_connections 2024-03-16T10:50:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:25.337+0000 7f8c096fe700 1 -- 172.21.15.17:0/1949124651 wait complete. 2024-03-16T10:50:26.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-16T10:50:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:26 smithi174 ceph-mon[36202]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:50:26.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:26 smithi174 ceph-mon[36202]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:26.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:26 smithi017 ceph-mon[32078]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:50:26.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:26 smithi017 ceph-mon[32078]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:26.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:26 smithi111 ceph-mon[36315]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-16T10:50:26.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:26 smithi111 ceph-mon[36315]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:28.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- 172.21.15.17:0/1783049757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4102400 msgr2=0x7f95f4102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:28.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 --2- 172.21.15.17:0/1783049757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4102400 0x7f95f4102860 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95e80099c0 tx=0x7f95e8009cd0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- 172.21.15.17:0/1783049757 shutdown_connections 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 --2- 172.21.15.17:0/1783049757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4101200 0x7f95f4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 --2- 172.21.15.17:0/1783049757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 0x7f95f4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 --2- 172.21.15.17:0/1783049757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4102400 0x7f95f4102860 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- 172.21.15.17:0/1783049757 >> 172.21.15.17:0/1783049757 conn(0x7f95f40fc7a0 msgr2=0x7f95f40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- 172.21.15.17:0/1783049757 shutdown_connections 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- 172.21.15.17:0/1783049757 wait complete. 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 Processor -- start 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.028+0000 7f95f96c7700 1 -- start start 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 0x7f95f41037e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 0x7f95f4103d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95f410cdc0 con 0x7f95f4101200 2024-03-16T10:50:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f95f410cc40 con 0x7f95f4102400 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f96c7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95f410cf40 con 0x7f95f4102da0 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56302/0 (socket says 172.21.15.17:56302) 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 -- 172.21.15.17:0/740645705 learned_addr learned my addr 172.21.15.17:0/740645705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f27fc700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 0x7f95f41037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f37fe700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 0x7f95f4103d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 -- 172.21.15.17:0/740645705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 msgr2=0x7f95f4103d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 0x7f95f4103d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 -- 172.21.15.17:0/740645705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 msgr2=0x7f95f41037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 0x7f95f41037e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 -- 172.21.15.17:0/740645705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f4104560 con 0x7f95f4101200 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f27fc700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 0x7f95f41037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:28.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95f2ffd700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95e400e970 tx=0x7f95e400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.029+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4004220 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.030+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f41a2650 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.030+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e40043c0 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.030+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4003dc0 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.030+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f41a2b90 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.031+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f4068f90 con 0x7f95f4101200 2024-03-16T10:50:28.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.033+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f95e400c7e0 con 0x7f95f4101200 2024-03-16T10:50:28.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.033+0000 7f95dbfff700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 0x7f95dc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:28.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.033+0000 7f95f27fc700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 0x7f95dc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:28.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.033+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f95e40cec90 con 0x7f95f4101200 2024-03-16T10:50:28.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.034+0000 7f95f27fc700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 0x7f95dc0a4d50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:28.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.039+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f95e409be60 con 0x7f95f4101200 2024-03-16T10:50:28.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:28 smithi017 ceph-mon[32078]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-16T10:50:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.312+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f95f40fe980 con 0x7f95dc0a2890 2024-03-16T10:50:28.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:28 smithi174 ceph-mon[36202]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-16T10:50:28.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.318+0000 7f95dbfff700 1 -- 172.21.15.17:0/740645705 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f95f40fe980 con 0x7f95dc0a2890 2024-03-16T10:50:28.318 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-16T10:50:28.319 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 37s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi111=b;smithi111=e;smithi111=h;smithi111=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-03-16T10:50:28.319 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 37s ago 7m smithi017=x;smithi111=y;smithi174=z;count:3 2024-03-16T10:50:28.319 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 37s ago 8m smithi017:172.21.15.17=a;smithi111:172.21.15.111=b;smithi174:172.21.15.174=c;count:3 2024-03-16T10:50:28.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 37s ago - 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 msgr2=0x7f95dc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 0x7f95dc0a4d50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f95e8000c00 tx=0x7f95e8005fb0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 msgr2=0x7f95f4105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95e400e970 tx=0x7f95e400ec80 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 shutdown_connections 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f95dc0a2890 0x7f95dc0a4d50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95f4102da0 0x7f95f4103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95f4101200 0x7f95f4105120 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 --2- 172.21.15.17:0/740645705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95f4102400 0x7f95f41037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 >> 172.21.15.17:0/740645705 conn(0x7f95f40fc7a0 msgr2=0x7f95f40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 shutdown_connections 2024-03-16T10:50:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:28.320+0000 7f95f96c7700 1 -- 172.21.15.17:0/740645705 wait complete. 2024-03-16T10:50:28.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:28 smithi111 ceph-mon[36315]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-16T10:50:28.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-16T10:50:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:29.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:29 smithi174 ceph-mon[36202]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:29.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:29 smithi017 ceph-mon[32078]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:29.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:29 smithi111 ceph-mon[36315]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:30.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:30 smithi174 ceph-mon[36202]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:30.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:30 smithi017 ceph-mon[32078]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:30.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:30 smithi111 ceph-mon[36315]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- 172.21.15.17:0/1247844489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420103ed0 msgr2=0x7f742010a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 --2- 172.21.15.17:0/1247844489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420103ed0 0x7f742010a780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f741800b0d0 tx=0x7f741800b3e0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- 172.21.15.17:0/1247844489 shutdown_connections 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 --2- 172.21.15.17:0/1247844489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420103ed0 0x7f742010a780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 --2- 172.21.15.17:0/1247844489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420102330 0x7f7420102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 --2- 172.21.15.17:0/1247844489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103530 0x7f7420103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- 172.21.15.17:0/1247844489 >> 172.21.15.17:0/1247844489 conn(0x7f74200fd8d0 msgr2=0x7f74200ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- 172.21.15.17:0/1247844489 shutdown_connections 2024-03-16T10:50:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- 172.21.15.17:0/1247844489 wait complete. 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 Processor -- start 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.124+0000 7f74248f7700 1 -- start start 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 0x7f7420076070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 0x7f74200746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103ed0 0x7f7420074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f742010df20 con 0x7f7420102330 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f742010dda0 con 0x7f7420103ed0 2024-03-16T10:50:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f74248f7700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f742010e0a0 con 0x7f7420103530 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 0x7f7420076070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 0x7f7420076070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60770/0 (socket says 172.21.15.17:60770) 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741e59c700 1 -- 172.21.15.17:0/1249120567 learned_addr learned my addr 172.21.15.17:0/1249120567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741ed9d700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103ed0 0x7f7420074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 0x7f74200746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 -- 172.21.15.17:0/1249120567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103ed0 msgr2=0x7f7420074c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103ed0 0x7f7420074c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 -- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 msgr2=0x7f7420076070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 0x7f7420076070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 -- 172.21.15.17:0/1249120567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200754b0 con 0x7f7420103530 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f741dd9b700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 0x7f74200746c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f741400e9f0 tx=0x7f741400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.125+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741400c9c0 con 0x7f7420103530 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.126+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74201a2600 con 0x7f7420103530 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.126+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f741400cb60 con 0x7f7420103530 2024-03-16T10:50:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.126+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414018680 con 0x7f7420103530 2024-03-16T10:50:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.126+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74201a2b10 con 0x7f7420103530 2024-03-16T10:50:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.126+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420068f90 con 0x7f7420103530 2024-03-16T10:50:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.127+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f7414010430 con 0x7f7420103530 2024-03-16T10:50:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.128+0000 7f740f7fe700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 0x7f74080a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.128+0000 7f741e59c700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 0x7f74080a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.128+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f74140ceaa0 con 0x7f7420103530 2024-03-16T10:50:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.128+0000 7f741e59c700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 0x7f74080a4d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7410005950 tx=0x7f7410009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.132+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f741409bbe0 con 0x7f7420103530 2024-03-16T10:50:31.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.350+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f7420062710 con 0x7f74080a2890 2024-03-16T10:50:31.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.351+0000 7f740f7fe700 1 -- 172.21.15.17:0/1249120567 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f7420062710 con 0x7f74080a2890 2024-03-16T10:50:31.352 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-03-16T10:50:31.352 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-03-16T10:50:31.352 INFO:teuthology.orchestra.run.smithi017.stdout:smithi111 172.21.15.111 2024-03-16T10:50:31.352 INFO:teuthology.orchestra.run.smithi017.stdout:smithi174 172.21.15.174 2024-03-16T10:50:31.353 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2024-03-16T10:50:31.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 msgr2=0x7f74080a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:31.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 0x7f74080a4d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7410005950 tx=0x7f7410009260 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 msgr2=0x7f74200746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 0x7f74200746c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f741400e9f0 tx=0x7f741400ed00 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 shutdown_connections 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f74080a2890 0x7f74080a4d50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7420103ed0 0x7f7420074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7420102330 0x7f7420076070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 --2- 172.21.15.17:0/1249120567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7420103530 0x7f74200746c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 >> 172.21.15.17:0/1249120567 conn(0x7f74200fd8d0 msgr2=0x7f74201067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 shutdown_connections 2024-03-16T10:50:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:31.354+0000 7f74248f7700 1 -- 172.21.15.17:0/1249120567 wait complete. 2024-03-16T10:50:32.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-16T10:50:32.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:32 smithi174 ceph-mon[36202]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:32.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:32 smithi174 ceph-mon[36202]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:32 smithi017 ceph-mon[32078]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:32 smithi017 ceph-mon[32078]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:32.340 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:32.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:32 smithi111 ceph-mon[36315]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:32.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:32 smithi111 ceph-mon[36315]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 -- 172.21.15.17:0/479214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 msgr2=0x7efe60101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 --2- 172.21.15.17:0/479214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60101620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe5000b0d0 tx=0x7efe5000b3e0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 -- 172.21.15.17:0/479214749 shutdown_connections 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 --2- 172.21.15.17:0/479214749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 0x7efe60109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 --2- 172.21.15.17:0/479214749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60101620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 --2- 172.21.15.17:0/479214749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe60102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 -- 172.21.15.17:0/479214749 >> 172.21.15.17:0/479214749 conn(0x7efe600fc7a0 msgr2=0x7efe600febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 -- 172.21.15.17:0/479214749 shutdown_connections 2024-03-16T10:50:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.125+0000 7efe65743700 1 -- 172.21.15.17:0/479214749 wait complete. 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 Processor -- start 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 -- start start 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe601979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 0x7efe6019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe6010ce00 con 0x7efe60101200 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efe6010cc80 con 0x7efe60102da0 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe65743700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe6010cf80 con 0x7efe60102400 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe5effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe5effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60796/0 (socket says 172.21.15.17:60796) 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe5effd700 1 -- 172.21.15.17:0/2234951448 learned_addr learned my addr 172.21.15.17:0/2234951448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.126+0000 7efe5e7fc700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe601979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5f7fe700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 0x7efe6019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 -- 172.21.15.17:0/2234951448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 msgr2=0x7efe601979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe601979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 -- 172.21.15.17:0/2234951448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 msgr2=0x7efe6019ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 0x7efe6019ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 -- 172.21.15.17:0/2234951448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6019f0f0 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5e7fc700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe601979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe5effd700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe50007a50 tx=0x7efe50007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004c50 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe50004df0 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe60069f80 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500259c0 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.127+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6006a4c0 con 0x7efe60101200 2024-03-16T10:50:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.128+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe60068f90 con 0x7efe60101200 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.129+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7efe5001ac30 con 0x7efe60101200 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.130+0000 7efe57fff700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 0x7efe4c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.130+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7efe5000f030 con 0x7efe60101200 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.130+0000 7efe5e7fc700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 0x7efe4c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.131+0000 7efe5e7fc700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 0x7efe4c0a4d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe48011490 tx=0x7efe48009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.134+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7efe5002a060 con 0x7efe60101200 2024-03-16T10:50:34.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:34 smithi174 ceph-mon[36202]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:34.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:34 smithi017 ceph-mon[32078]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:34.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.350+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7efe6006a720 con 0x7efe4c0a2890 2024-03-16T10:50:34.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.352+0000 7efe57fff700 1 -- 172.21.15.17:0/2234951448 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7efe6006a720 con 0x7efe4c0a2890 2024-03-16T10:50:34.354 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-16T10:50:34.354 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-16T10:50:34.354 INFO:teuthology.orchestra.run.smithi017.stdout:smithi111 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-16T10:50:34.354 INFO:teuthology.orchestra.run.smithi017.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-16T10:50:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 msgr2=0x7efe4c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 0x7efe4c0a4d50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe48011490 tx=0x7efe48009260 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 msgr2=0x7efe60197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe50007a50 tx=0x7efe50007a80 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 shutdown_connections 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7efe4c0a2890 0x7efe4c0a4d50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe60102da0 0x7efe6019ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe60101200 0x7efe60197490 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 --2- 172.21.15.17:0/2234951448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe60102400 0x7efe601979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 >> 172.21.15.17:0/2234951448 conn(0x7efe600fc7a0 msgr2=0x7efe601057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 shutdown_connections 2024-03-16T10:50:34.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:34.354+0000 7efe65743700 1 -- 172.21.15.17:0/2234951448 wait complete. 2024-03-16T10:50:34.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:34 smithi111 ceph-mon[36315]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:35.035 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-16T10:50:35.043 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:50:35.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-16T10:50:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:35.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:35 smithi174 ceph-mon[36202]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:35.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:35 smithi017 ceph-mon[32078]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:35.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:35 smithi111 ceph-mon[36315]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:36.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:36 smithi017 ceph-mon[32078]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:36.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:36 smithi174 ceph-mon[36202]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:36 smithi111 ceph-mon[36315]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 -- 172.21.15.17:0/2529612233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 msgr2=0x7f1978101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 --2- 172.21.15.17:0/2529612233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f1978101610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19680099c0 tx=0x7f1968009cd0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 -- 172.21.15.17:0/2529612233 shutdown_connections 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 --2- 172.21.15.17:0/2529612233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f1978101610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 --2- 172.21.15.17:0/2529612233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f1978109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 --2- 172.21.15.17:0/2529612233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f1978102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 -- 172.21.15.17:0/2529612233 >> 172.21.15.17:0/2529612233 conn(0x7f19780fc790 msgr2=0x7f19780febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 -- 172.21.15.17:0/2529612233 shutdown_connections 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.117+0000 7f197c815700 1 -- 172.21.15.17:0/2529612233 wait complete. 2024-03-16T10:50:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 Processor -- start 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 -- start start 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f197819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f197810cdd0 con 0x7f19781023f0 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f197810cc50 con 0x7f19781011f0 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197c815700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f197810cf50 con 0x7f1978102d90 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f1975d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f1975d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60820/0 (socket says 172.21.15.17:60820) 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f197659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:40216/0 (socket says 172.21.15.17:40216) 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.118+0000 7f1975d9b700 1 -- 172.21.15.17:0/3888728959 learned_addr learned my addr 172.21.15.17:0/3888728959 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f1976d9d700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f197819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 -- 172.21.15.17:0/3888728959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 msgr2=0x7f197819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f197819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 -- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 msgr2=0x7f197819d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 -- 172.21.15.17:0/3888728959 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19781a0170 con 0x7f19781011f0 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f1976d9d700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f197819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f1975d9b700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197659c700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1968003790 tx=0x7f1968009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1968009e60 con 0x7f19781011f0 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19781a0400 con 0x7f19781011f0 2024-03-16T10:50:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.119+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1968003e40 con 0x7f19781011f0 2024-03-16T10:50:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.120+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1968005620 con 0x7f19781011f0 2024-03-16T10:50:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.120+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19781a08e0 con 0x7f19781011f0 2024-03-16T10:50:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.121+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1978068f90 con 0x7f19781011f0 2024-03-16T10:50:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.121+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f196800fc50 con 0x7f19781011f0 2024-03-16T10:50:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.122+0000 7f19677fe700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 0x7f19600a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.122+0000 7f1975d9b700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 0x7f19600a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.122+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f19680cee20 con 0x7f19781011f0 2024-03-16T10:50:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.123+0000 7f1975d9b700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 0x7f19600a4c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f197806b8f0 tx=0x7f196c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:37.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.131+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f1968013070 con 0x7f19781011f0 2024-03-16T10:50:37.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.400+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f197802df60 con 0x7f19781011f0 2024-03-16T10:50:37.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.400+0000 7f19677fe700 1 -- 172.21.15.17:0/3888728959 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3092 (secure 0 0 0) 0x7f196809bf50 con 0x7f19781011f0 2024-03-16T10:50:37.401 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-03-16T10:50:37.401 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 26 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-03-16T10:48:48.817905+0000 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-03-16T10:48:56.174199+0000 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-03-16T10:50:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 5 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2,3,4 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24536,1=24497,2=24493,3=24470,4=14655} 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-03-16T10:50:37.403 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 24536 members: 24493,24536,24470,24497,14655 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24536} state up:active seq 3 addr [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.174:6836/3507552570,v1:172.21.15.174:6837/3507552570] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{1:24497} state up:active seq 6 addr [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{1:24454} state up:standby-replay seq 1 addr [v2:172.21.15.174:6834/330421208,v1:172.21.15.174:6835/330421208] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{2:24493} state up:active seq 6 addr [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.111:6832/1048472977,v1:172.21.15.111:6833/1048472977] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{3:24470} state up:active seq 9 addr [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{3:24412} state up:standby-replay seq 1 addr [v2:172.21.15.174:6832/760873641,v1:172.21.15.174:6833/760873641] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{4:14655} state up:active seq 5 addr [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{4:14643} state up:standby-replay seq 1 addr [v2:172.21.15.17:6838/3638042020,v1:172.21.15.17:6839/3638042020] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:37.405 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-03-16T10:50:37.405 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.17:6834/234575221,v1:172.21.15.17:6835/234575221] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14574} state up:standby seq 1 addr [v2:172.21.15.17:6836/3386509633,v1:172.21.15.17:6837/3386509633] compat {c=[1],r=[1],i=[1fff]}] 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 msgr2=0x7f19600a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 0x7f19600a4c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f197806b8f0 tx=0x7f196c009260 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 msgr2=0x7f197806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1968003790 tx=0x7f1968009580 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 shutdown_connections 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f19600a2770 0x7f19600a4c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19781011f0 0x7f197806b390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1978102d90 0x7f197819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 --2- 172.21.15.17:0/3888728959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19781023f0 0x7f197819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.403+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 >> 172.21.15.17:0/3888728959 conn(0x7f19780fc790 msgr2=0x7f1978105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.404+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 shutdown_connections 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:37.404+0000 7f197c815700 1 -- 172.21.15.17:0/3888728959 wait complete. 2024-03-16T10:50:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:38.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-16T10:50:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:38.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:38 smithi174 ceph-mon[36202]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:38.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:38 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3888728959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T10:50:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:38 smithi017 ceph-mon[32078]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:38 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3888728959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T10:50:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:38 smithi111 ceph-mon[36315]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:38 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3888728959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-16T10:50:40.275 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:40 smithi017 ceph-mon[32078]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:40.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 -- 172.21.15.17:0/2382821579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4102880 msgr2=0x7fdfb4102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 --2- 172.21.15.17:0/2382821579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4102880 0x7fdfb4102ca0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b0a0 tx=0x7fdfa400b3b0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 -- 172.21.15.17:0/2382821579 shutdown_connections 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 --2- 172.21.15.17:0/2382821579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb41096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 --2- 172.21.15.17:0/2382821579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4102880 0x7fdfb4102ca0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 --2- 172.21.15.17:0/2382821579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4101450 0x7fdfb41018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 -- 172.21.15.17:0/2382821579 >> 172.21.15.17:0/2382821579 conn(0x7fdfb40fbf40 msgr2=0x7fdfb40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 -- 172.21.15.17:0/2382821579 shutdown_connections 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.279+0000 7fdfbb684700 1 -- 172.21.15.17:0/2382821579 wait complete. 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 Processor -- start 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 -- start start 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb4103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4102880 0x7fdfb4103d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb410cdd0 con 0x7fdfb4101450 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb410cc50 con 0x7fdfb4101e10 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfbb684700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb410cf50 con 0x7fdfb4102880 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb9420700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb9420700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53016/0 (socket says 172.21.15.17:53016) 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb9420700 1 -- 172.21.15.17:0/858866521 learned_addr learned my addr 172.21.15.17:0/858866521 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb4103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb9c21700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4102880 0x7fdfb4103d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 -- 172.21.15.17:0/858866521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4102880 msgr2=0x7fdfb4103d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4102880 0x7fdfb4103d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 -- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 msgr2=0x7fdfb41051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb8c1f700 1 -- 172.21.15.17:0/858866521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb4104650 con 0x7fdfb4101e10 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.280+0000 7fdfb9420700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfb8c1f700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb4103840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e9f0 tx=0x7fdfa800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800c9c0 con 0x7fdfb4101e10 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb41a2740 con 0x7fdfb4101e10 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfa800cb60 con 0x7fdfb4101e10 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8018680 con 0x7fdfb4101e10 2024-03-16T10:50:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.281+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb41a2ca0 con 0x7fdfb4101e10 2024-03-16T10:50:40.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.282+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb4068f90 con 0x7fdfb4101e10 2024-03-16T10:50:40.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.283+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fdfa8047a60 con 0x7fdfb4101e10 2024-03-16T10:50:40.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.283+0000 7fdfb27fc700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 0x7fdf9c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:40.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.284+0000 7fdfb9420700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 0x7fdf9c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:40.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.284+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fdfa80cea90 con 0x7fdfb4101e10 2024-03-16T10:50:40.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.284+0000 7fdfb9420700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 0x7fdf9c0a4dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400d010 tx=0x7fdfa400b700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.289+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fdfa809bb30 con 0x7fdfb4101e10 2024-03-16T10:50:40.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.497+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fdfb41a30d0 con 0x7fdfb4101e10 2024-03-16T10:50:40.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.497+0000 7fdfb27fc700 1 -- 172.21.15.17:0/858866521 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5237 (secure 0 0 0) 0x7fdfa809b430 con 0x7fdfb4101e10 2024-03-16T10:50:40.498 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 87 2024-03-16T10:50:40.499 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:50:40.499 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-03-16T10:40:45.482093+0000 2024-03-16T10:50:40.499 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-03-16T10:49:42.268666+0000 2024-03-16T10:50:40.499 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 26 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-03-16T10:50:40.501 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/1731197906,v1:172.21.15.17:6803/1731197906] [v2:172.21.15.17:6804/1731197906,v1:172.21.15.17:6805/1731197906] exists,up e80ee777-191c-4297-a64a-666a31e8fb28 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/135053879,v1:172.21.15.111:6801/135053879] [v2:172.21.15.111:6802/135053879,v1:172.21.15.111:6803/135053879] exists,up 779bf596-8e58-42dc-bf10-e0ef94c86c9c 2024-03-16T10:50:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/1400344146,v1:172.21.15.174:6801/1400344146] [v2:172.21.15.174:6802/1400344146,v1:172.21.15.174:6803/1400344146] exists,up 5448fc77-cae4-481f-a7e0-fe2af1de6d52 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/3346256775,v1:172.21.15.17:6811/3346256775] [v2:172.21.15.17:6812/3346256775,v1:172.21.15.17:6813/3346256775] exists,up 1b2b5e3b-24b9-4122-aa88-fbfad12dc540 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6808/4209940365,v1:172.21.15.111:6809/4209940365] [v2:172.21.15.111:6810/4209940365,v1:172.21.15.111:6811/4209940365] exists,up 378c14d6-4057-4205-96df-afbe86d97234 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6808/3274269229,v1:172.21.15.174:6809/3274269229] [v2:172.21.15.174:6810/3274269229,v1:172.21.15.174:6811/3274269229] exists,up 250babd9-c57e-4a5a-b6e8-61da501066a8 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/3796077791,v1:172.21.15.17:6819/3796077791] [v2:172.21.15.17:6820/3796077791,v1:172.21.15.17:6821/3796077791] exists,up fbed0a5f-2a68-41e2-a105-431f47433d7b 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 51 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6816/2270288694,v1:172.21.15.111:6817/2270288694] [v2:172.21.15.111:6818/2270288694,v1:172.21.15.111:6819/2270288694] exists,up 9926c51c-4954-470c-a6d2-cd4ec79d50bb 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 59 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6816/3711712891,v1:172.21.15.174:6817/3711712891] [v2:172.21.15.174:6818/3711712891,v1:172.21.15.174:6819/3711712891] exists,up c482b95a-bcfd-4b86-806e-e5e11694b585 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 67 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/4098561509,v1:172.21.15.17:6827/4098561509] [v2:172.21.15.17:6828/4098561509,v1:172.21.15.17:6829/4098561509] exists,up 126cff44-91f0-49a3-8ff3-762baa059349 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6824/3614977703,v1:172.21.15.111:6825/3614977703] [v2:172.21.15.111:6826/3614977703,v1:172.21.15.111:6827/3614977703] exists,up 1209c41f-8100-49bf-9d4b-f422fd725d71 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6824/850467808,v1:172.21.15.174:6825/850467808] [v2:172.21.15.174:6826/850467808,v1:172.21.15.174:6827/850467808] exists,up bb52cfa5-7b9d-4008-bbff-17225492bb2a 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.8 [2,11] 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.1c [8,11] 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.13 [4,9] 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.20 [5,9] 2024-03-16T10:50:40.503 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.24 [4,9] 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.3a [4,8] 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/1123613371 expires 2024-03-17T10:41:40.391994+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/1123613371 expires 2024-03-17T10:41:40.391994+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/4191018145 expires 2024-03-17T10:41:40.391994+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2689612240 expires 2024-03-17T10:41:40.391994+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1267658658 expires 2024-03-17T10:41:12.324893+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/3497137081 expires 2024-03-17T10:41:12.324893+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2804979263 expires 2024-03-17T10:41:12.324893+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/3497137081 expires 2024-03-17T10:41:12.324893+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/435172589 expires 2024-03-17T10:41:12.324893+0000 2024-03-16T10:50:40.504 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/520901211 expires 2024-03-17T10:41:40.391994+0000 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 msgr2=0x7fdf9c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 0x7fdf9c0a4dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400d010 tx=0x7fdfa400b700 comp rx=0 tx=0).stop 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 msgr2=0x7fdfb4103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb4103840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e9f0 tx=0x7fdfa800ed00 comp rx=0 tx=0).stop 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 shutdown_connections 2024-03-16T10:50:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdf9c0a2910 0x7fdf9c0a4dd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb4102880 0x7fdfb4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb4101450 0x7fdfb41051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 --2- 172.21.15.17:0/858866521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfb4101e10 0x7fdfb4103840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 >> 172.21.15.17:0/858866521 conn(0x7fdfb40fbf40 msgr2=0x7fdfb40fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 shutdown_connections 2024-03-16T10:50:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:40.500+0000 7fdfbb684700 1 -- 172.21.15.17:0/858866521 wait complete. 2024-03-16T10:50:40.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:40 smithi174 ceph-mon[36202]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:40.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:40 smithi111 ceph-mon[36315]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:41.194 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-16T10:50:41.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3485062909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f4100700 msgr2=0x7ff3f4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3485062909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f4100700 0x7ff3f4100b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009860 tx=0x7ff3e402bb70 comp rx=0 tx=0).stop 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3485062909 shutdown_connections 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3485062909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f41022b0 0x7ff3f4108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3485062909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3485062909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f4100700 0x7ff3f4100b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3485062909 >> 172.21.15.17:0/3485062909 conn(0x7ff3f40fbc70 msgr2=0x7ff3f40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3485062909 shutdown_connections 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.313+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3485062909 wait complete. 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 Processor -- start 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 -- start start 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f4100700 0x7ff3f4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f41022b0 0x7ff3f419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f410c380 con 0x7ff3f41018f0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f410c200 con 0x7ff3f41022b0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.314+0000 7ff3fa8b2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f410c500 con 0x7ff3f4100700 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53026/0 (socket says 172.21.15.17:53026) 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f4100700 0x7ff3f4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 -- 172.21.15.17:0/3631980754 learned_addr learned my addr 172.21.15.17:0/3631980754 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f8e4f640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f41022b0 0x7ff3f419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 -- 172.21.15.17:0/3631980754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f4100700 msgr2=0x7ff3f4196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f4100700 0x7ff3f4196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 -- 172.21.15.17:0/3631980754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f41022b0 msgr2=0x7ff3f419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f41022b0 0x7ff3f419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 -- 172.21.15.17:0/3631980754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f419e640 con 0x7ff3f41018f0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f37fe640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800e9c0 tx=0x7ff3e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800cde0 con 0x7ff3f41018f0 2024-03-16T10:50:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f419e930 con 0x7ff3f41018f0 2024-03-16T10:50:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e80035f0 con 0x7ff3f41018f0 2024-03-16T10:50:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8010650 con 0x7ff3f41018f0 2024-03-16T10:50:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.315+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f419eed0 con 0x7ff3f41018f0 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.316+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f4107a20 con 0x7ff3f41018f0 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.317+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7ff3e80037a0 con 0x7ff3f41018f0 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.318+0000 7ff3f17fa640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 0x7ff3dc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.318+0000 7ff3f3fff640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 0x7ff3dc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.318+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff3e80ceca0 con 0x7ff3f41018f0 2024-03-16T10:50:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.318+0000 7ff3f3fff640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 0x7ff3dc0a4cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009830 tx=0x7ff3e4034ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:41.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.322+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff3e809bde0 con 0x7ff3f41018f0 2024-03-16T10:50:41.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.533+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3f402d400 con 0x7ff3f41018f0 2024-03-16T10:50:41.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.535+0000 7ff3f17fa640 1 -- 172.21.15.17:0/3631980754 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7ff3e809b6e0 con 0x7ff3f41018f0 2024-03-16T10:50:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:41.536 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 msgr2=0x7ff3dc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 0x7ff3dc0a4cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009830 tx=0x7ff3e4034ad0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 msgr2=0x7ff3f4196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800e9c0 tx=0x7ff3e800ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 shutdown_connections 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff3dc0a2800 0x7ff3dc0a4cc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff3f41022b0 0x7ff3f419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3f41018f0 0x7ff3f4196f60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 --2- 172.21.15.17:0/3631980754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3f4100700 0x7ff3f4196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 >> 172.21.15.17:0/3631980754 conn(0x7ff3f40fbc70 msgr2=0x7ff3f4104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 shutdown_connections 2024-03-16T10:50:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.537+0000 7ff3fa8b2640 1 -- 172.21.15.17:0/3631980754 wait complete. 2024-03-16T10:50:41.548 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:41 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/858866521' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T10:50:41.549 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:41.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:41.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:41 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/858866521' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T10:50:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 -- 172.21.15.17:0/1326995353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 msgr2=0x7fa94c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 --2- 172.21.15.17:0/1326995353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c101d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa934009900 tx=0x7fa93402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 -- 172.21.15.17:0/1326995353 shutdown_connections 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 --2- 172.21.15.17:0/1326995353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1022a0 0x7fa94c108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 --2- 172.21.15.17:0/1326995353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c101d60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 --2- 172.21.15.17:0/1326995353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1006f0 0x7fa94c100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 -- 172.21.15.17:0/1326995353 >> 172.21.15.17:0/1326995353 conn(0x7fa94c0fbc80 msgr2=0x7fa94c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 -- 172.21.15.17:0/1326995353 shutdown_connections 2024-03-16T10:50:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 -- 172.21.15.17:0/1326995353 wait complete. 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.655+0000 7fa951322640 1 Processor -- start 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 -- start start 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1006f0 0x7fa94c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1022a0 0x7fa94c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10c370 con 0x7fa94c1018e0 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10c1f0 con 0x7fa94c1022a0 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa951322640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c10c4f0 con 0x7fa94c1006f0 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53046/0 (socket says 172.21.15.17:53046) 2024-03-16T10:50:41.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 -- 172.21.15.17:0/2121844604 learned_addr learned my addr 172.21.15.17:0/2121844604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94b7fe640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1022a0 0x7fa94c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94affd640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1006f0 0x7fa94c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 -- 172.21.15.17:0/2121844604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1006f0 msgr2=0x7fa94c197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1006f0 0x7fa94c197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 -- 172.21.15.17:0/2121844604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1022a0 msgr2=0x7fa94c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1022a0 0x7fa94c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 -- 172.21.15.17:0/2121844604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c19f740 con 0x7fa94c1018e0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa94a7fc640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa934009230 tx=0x7fa93402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.656+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934041070 con 0x7fa94c1018e0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.657+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa934004450 con 0x7fa94c1018e0 2024-03-16T10:50:41.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.657+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c19f9d0 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.657+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934003e20 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.657+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c19fec0 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.658+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c1a00f0 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.659+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fa934044070 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.659+0000 7fa943fff640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 0x7fa9380a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.659+0000 7fa94affd640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 0x7fa9380a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.659+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa9340f0540 con 0x7fa94c1018e0 2024-03-16T10:50:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.660+0000 7fa94affd640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 0x7fa9380a4cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa94c101740 tx=0x7fa93c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.664+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fa9340bd030 con 0x7fa94c1018e0 2024-03-16T10:50:41.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:41 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/858866521' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-16T10:50:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.849+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa94c1a02c0 con 0x7fa94c1018e0 2024-03-16T10:50:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.849+0000 7fa943fff640 1 -- 172.21.15.17:0/2121844604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fa9340c10d0 con 0x7fa94c1018e0 2024-03-16T10:50:41.850 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 msgr2=0x7fa9380a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 0x7fa9380a4cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa94c101740 tx=0x7fa93c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 msgr2=0x7fa94c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa934009230 tx=0x7fa93402c650 comp rx=0 tx=0).stop 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 shutdown_connections 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa9380a2800 0x7fa9380a4cc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa94c1022a0 0x7fa94c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1018e0 0x7fa94c1980b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 --2- 172.21.15.17:0/2121844604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa94c1006f0 0x7fa94c197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 >> 172.21.15.17:0/2121844604 conn(0x7fa94c0fbc80 msgr2=0x7fa94c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 shutdown_connections 2024-03-16T10:50:41.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:41.851+0000 7fa951322640 1 -- 172.21.15.17:0/2121844604 wait complete. 2024-03-16T10:50:41.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 -- 172.21.15.17:0/834584368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec104bf0 msgr2=0x7fd1ec106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/834584368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec106fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009900 tx=0x7fd1e002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 -- 172.21.15.17:0/834584368 shutdown_connections 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/834584368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec107520 0x7fd1ec109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/834584368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec106fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/834584368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec1046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 -- 172.21.15.17:0/834584368 >> 172.21.15.17:0/834584368 conn(0x7fd1ec0fbc70 msgr2=0x7fd1ec0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 -- 172.21.15.17:0/834584368 shutdown_connections 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.001+0000 7fd1f20c6640 1 -- 172.21.15.17:0/834584368 wait complete. 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 Processor -- start 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 -- start start 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec107520 0x7fd1ec19f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec10d450 con 0x7fd1ec104bf0 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec10d2d0 con 0x7fd1ec1022c0 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1f20c6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec10d5d0 con 0x7fd1ec107520 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1eb7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53064/0 (socket says 172.21.15.17:53064) 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.002+0000 7fd1eaffd640 1 -- 172.21.15.17:0/3657387291 learned_addr learned my addr 172.21.15.17:0/3657387291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1ebfff640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec107520 0x7fd1ec19f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 -- 172.21.15.17:0/3657387291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec107520 msgr2=0x7fd1ec19f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec107520 0x7fd1ec19f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 -- 172.21.15.17:0/3657387291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 msgr2=0x7fd1ec197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 -- 172.21.15.17:0/3657387291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec19f770 con 0x7fd1ec104bf0 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eb7fe640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1eaffd640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0041070 con 0x7fd1ec104bf0 2024-03-16T10:50:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec19fa00 con 0x7fd1ec104bf0 2024-03-16T10:50:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1e0004450 con 0x7fd1ec104bf0 2024-03-16T10:50:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec19ff40 con 0x7fd1ec104bf0 2024-03-16T10:50:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.003+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0034440 con 0x7fd1ec104bf0 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.004+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec0fd760 con 0x7fd1ec104bf0 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.005+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fd1e0044070 con 0x7fd1ec104bf0 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.006+0000 7fd1e8ff9640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 0x7fd1d40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.006+0000 7fd1eb7fe640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 0x7fd1d40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.006+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd1e00f0750 con 0x7fd1ec104bf0 2024-03-16T10:50:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.006+0000 7fd1eb7fe640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 0x7fd1d40a4cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009fc0 tx=0x7fd1dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.009+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd1e00bd230 con 0x7fd1ec104bf0 2024-03-16T10:50:42.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.237+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd1ec02d1b0 con 0x7fd1ec104bf0 2024-03-16T10:50:42.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.237+0000 7fd1e8ff9640 1 -- 172.21.15.17:0/3657387291 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fd1e00c12d0 con 0x7fd1ec104bf0 2024-03-16T10:50:42.238 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:42.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 msgr2=0x7fd1d40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 0x7fd1d40a4cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009fc0 tx=0x7fd1dc005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:42.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 msgr2=0x7fd1ec198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e002c640 comp rx=0 tx=0).stop 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 shutdown_connections 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd1d40a2800 0x7fd1d40a4cc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1ec107520 0x7fd1ec19f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1ec104bf0 0x7fd1ec198090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 --2- 172.21.15.17:0/3657387291 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1022c0 0x7fd1ec197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 >> 172.21.15.17:0/3657387291 conn(0x7fd1ec0fbc70 msgr2=0x7fd1ec102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.239+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 shutdown_connections 2024-03-16T10:50:42.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.240+0000 7fd1f20c6640 1 -- 172.21.15.17:0/3657387291 wait complete. 2024-03-16T10:50:42.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 -- 172.21.15.17:0/2588396397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01018d0 msgr2=0x7fbcc0101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 --2- 172.21.15.17:0/2588396397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01018d0 0x7fbcc0101d50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009900 tx=0x7fbcb402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 -- 172.21.15.17:0/2588396397 shutdown_connections 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 --2- 172.21.15.17:0/2588396397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 0x7fbcc0108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 --2- 172.21.15.17:0/2588396397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01018d0 0x7fbcc0101d50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 --2- 172.21.15.17:0/2588396397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01006e0 0x7fbcc0100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 -- 172.21.15.17:0/2588396397 >> 172.21.15.17:0/2588396397 conn(0x7fbcc00fbc70 msgr2=0x7fbcc00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 -- 172.21.15.17:0/2588396397 shutdown_connections 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.357+0000 7fbcc6759640 1 -- 172.21.15.17:0/2588396397 wait complete. 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 Processor -- start 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 -- start start 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01018d0 0x7fbcc019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 0x7fbcc019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc010c360 con 0x7fbcc01006e0 2024-03-16T10:50:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc010c1e0 con 0x7fbcc01018d0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc6759640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc010c4e0 con 0x7fbcc0102290 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53084/0 (socket says 172.21.15.17:53084) 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 -- 172.21.15.17:0/4273527257 learned_addr learned my addr 172.21.15.17:0/4273527257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbf7fe640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01018d0 0x7fbcc019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcc4cf6640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 0x7fbcc019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 -- 172.21.15.17:0/4273527257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 msgr2=0x7fbcc019ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 0x7fbcc019ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 -- 172.21.15.17:0/4273527257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01018d0 msgr2=0x7fbcc019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01018d0 0x7fbcc019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.358+0000 7fbcbffff640 1 -- 172.21.15.17:0/4273527257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc019f780 con 0x7fbcc01006e0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcbffff640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9c0 tx=0x7fbcb000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000cd80 con 0x7fbcc01006e0 2024-03-16T10:50:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc019fa10 con 0x7fbcc01006e0 2024-03-16T10:50:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcb00035f0 con 0x7fbcc01006e0 2024-03-16T10:50:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0010690 con 0x7fbcc01006e0 2024-03-16T10:50:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.359+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc019ff30 con 0x7fbcc01006e0 2024-03-16T10:50:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.360+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc0107a20 con 0x7fbcc01006e0 2024-03-16T10:50:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.361+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fbcb00037a0 con 0x7fbcc01006e0 2024-03-16T10:50:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.362+0000 7fbcbd7fa640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 0x7fbca80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.362+0000 7fbcbf7fe640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 0x7fbca80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.362+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbcb00ced70 con 0x7fbcc01006e0 2024-03-16T10:50:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.362+0000 7fbcbf7fe640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 0x7fbca80a4cc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402c7b0 tx=0x7fbcb4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.366+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbcb009beb0 con 0x7fbcc01006e0 2024-03-16T10:50:42.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.549+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbcc002d250 con 0x7fbcc01006e0 2024-03-16T10:50:42.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.550+0000 7fbcbd7fa640 1 -- 172.21.15.17:0/4273527257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fbcb009b7b0 con 0x7fbcc01006e0 2024-03-16T10:50:42.551 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:42.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 msgr2=0x7fbca80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 0x7fbca80a4cc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402c7b0 tx=0x7fbcb4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 msgr2=0x7fbcc00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000e9c0 tx=0x7fbcb000ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 shutdown_connections 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbca80a2800 0x7fbca80a4cc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcc0102290 0x7fbcc019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcc01018d0 0x7fbcc019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 --2- 172.21.15.17:0/4273527257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcc01006e0 0x7fbcc00694b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 >> 172.21.15.17:0/4273527257 conn(0x7fbcc00fbc70 msgr2=0x7fbcc0104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 shutdown_connections 2024-03-16T10:50:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.552+0000 7fbcc6759640 1 -- 172.21.15.17:0/4273527257 wait complete. 2024-03-16T10:50:42.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:42 smithi174 ceph-mon[36202]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:42 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3631980754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:42 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2121844604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:42.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:42 smithi017 ceph-mon[32078]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:42.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:42 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3631980754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:42.563 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:42 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2121844604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:42.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:42 smithi111 ceph-mon[36315]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:42 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3631980754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:42.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:42 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2121844604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:42.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.668+0000 7f0310a31640 1 -- 172.21.15.17:0/1805209792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c100070 msgr2=0x7f030c100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.668+0000 7f0310a31640 1 --2- 172.21.15.17:0/1805209792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c100070 0x7f030c100490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009900 tx=0x7f02fc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 -- 172.21.15.17:0/1805209792 shutdown_connections 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 --2- 172.21.15.17:0/1805209792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c101370 0x7f030c1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 --2- 172.21.15.17:0/1805209792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c1009d0 0x7f030c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 --2- 172.21.15.17:0/1805209792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c100070 0x7f030c100490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 -- 172.21.15.17:0/1805209792 >> 172.21.15.17:0/1805209792 conn(0x7f030c0fbc70 msgr2=0x7f030c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 -- 172.21.15.17:0/1805209792 shutdown_connections 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 -- 172.21.15.17:0/1805209792 wait complete. 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 Processor -- start 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 -- start start 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.669+0000 7f0310a31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c1009d0 0x7f030c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c101370 0x7f030c1a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10f640 con 0x7f030c100070 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10f4c0 con 0x7f030c101370 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f030c10f7c0 con 0x7f030c1009d0 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53108/0 (socket says 172.21.15.17:53108) 2024-03-16T10:50:42.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 -- 172.21.15.17:0/530370382 learned_addr learned my addr 172.21.15.17:0/530370382 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0309d9b640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c1009d0 0x7f030c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030ad9d640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c101370 0x7f030c1a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 -- 172.21.15.17:0/530370382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c1009d0 msgr2=0x7f030c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c1009d0 0x7f030c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 -- 172.21.15.17:0/530370382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c101370 msgr2=0x7f030c1a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c101370 0x7f030c1a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 -- 172.21.15.17:0/530370382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c1a1910 con 0x7f030c100070 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f030a59c640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009230 tx=0x7f02fc02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc041070 con 0x7f030c100070 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c1a1ba0 con 0x7f030c100070 2024-03-16T10:50:42.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02fc004450 con 0x7f030c100070 2024-03-16T10:50:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc003e20 con 0x7f030c100070 2024-03-16T10:50:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.670+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c1a20e0 con 0x7f030c100070 2024-03-16T10:50:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.671+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030c10af80 con 0x7f030c100070 2024-03-16T10:50:42.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.672+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f02fc044070 con 0x7f030c100070 2024-03-16T10:50:42.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.673+0000 7f02fb7fe640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 0x7f02f40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:42.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.673+0000 7f0309d9b640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 0x7f02f40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:42.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.673+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f02fc0f05e0 con 0x7f030c100070 2024-03-16T10:50:42.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.673+0000 7f0309d9b640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 0x7f02f40a4cc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0300009bd0 tx=0x7f0300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:42.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.677+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f02fc0bd0d0 con 0x7f030c100070 2024-03-16T10:50:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.934+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f030c02d1b0 con 0x7f030c100070 2024-03-16T10:50:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.934+0000 7f02fb7fe640 1 -- 172.21.15.17:0/530370382 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7f02fc0c1170 con 0x7f030c100070 2024-03-16T10:50:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:42.935 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:50:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 msgr2=0x7f02f40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 0x7f02f40a4cc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0300009bd0 tx=0x7f0300005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 msgr2=0x7f030c199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009230 tx=0x7f02fc02c650 comp rx=0 tx=0).stop 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 shutdown_connections 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f02f40a2800 0x7f02f40a4cc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f030c101370 0x7f030c1a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f030c1009d0 0x7f030c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 --2- 172.21.15.17:0/530370382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f030c100070 0x7f030c199d00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.936+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 >> 172.21.15.17:0/530370382 conn(0x7f030c0fbc70 msgr2=0x7f030c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.937+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 shutdown_connections 2024-03-16T10:50:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:42.937+0000 7f0310a31640 1 -- 172.21.15.17:0/530370382 wait complete. 2024-03-16T10:50:42.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 -- 172.21.15.17:0/2969137990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 msgr2=0x7f8bf0109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 --2- 172.21.15.17:0/2969137990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf0109930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009ca0 tx=0x7f8be802c100 comp rx=0 tx=0).stop 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 -- 172.21.15.17:0/2969137990 shutdown_connections 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 --2- 172.21.15.17:0/2969137990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf0109930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 --2- 172.21.15.17:0/2969137990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 --2- 172.21.15.17:0/2969137990 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf01046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.050+0000 7f8bf8634640 1 -- 172.21.15.17:0/2969137990 >> 172.21.15.17:0/2969137990 conn(0x7f8bf00fbc70 msgr2=0x7f8bf00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- 172.21.15.17:0/2969137990 shutdown_connections 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- 172.21.15.17:0/2969137990 wait complete. 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 Processor -- start 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- start start 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf0199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010d4a0 con 0x7f8bf0107540 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010d320 con 0x7f8bf01022e0 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf8634640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010d620 con 0x7f8bf0104c10 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf6bd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf5bcf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf63d0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf0199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf6bd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53132/0 (socket says 172.21.15.17:53132) 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf6bd1640 1 -- 172.21.15.17:0/4087832025 learned_addr learned my addr 172.21.15.17:0/4087832025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.051+0000 7f8bf5bcf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42436/0 (socket says 172.21.15.17:42436) 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 -- 172.21.15.17:0/4087832025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 msgr2=0x7f8bf019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 -- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 msgr2=0x7f8bf01a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 -- 172.21.15.17:0/4087832025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a1940 con 0x7f8bf01022e0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf6bd1640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf63d0640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf0199d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e9f0 tx=0x7f8bec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00ccc0 con 0x7f8bf01022e0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a1c30 con 0x7f8bf01022e0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec010910 con 0x7f8bf01022e0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec018960 con 0x7f8bf01022e0 2024-03-16T10:50:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.052+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a2180 con 0x7f8bf01022e0 2024-03-16T10:50:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.053+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0109030 con 0x7f8bf01022e0 2024-03-16T10:50:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.054+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f8bec010ac0 con 0x7f8bf01022e0 2024-03-16T10:50:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.055+0000 7f8be77fe640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 0x7f8bdc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.055+0000 7f8bf5bcf640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 0x7f8bdc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.055+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8bec0cee00 con 0x7f8bf01022e0 2024-03-16T10:50:43.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.055+0000 7f8bf5bcf640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 0x7f8bdc0a4cc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0069440 tx=0x7f8be0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.063+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8bec09b8f0 con 0x7f8bf01022e0 2024-03-16T10:50:43.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.249+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bf002d3d0 con 0x7f8bf01022e0 2024-03-16T10:50:43.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.250+0000 7f8be77fe640 1 -- 172.21.15.17:0/4087832025 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7f8bec09f990 con 0x7f8bf01022e0 2024-03-16T10:50:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:43.251 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 msgr2=0x7f8bdc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 0x7f8bdc0a4cc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0069440 tx=0x7f8be0005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 msgr2=0x7f8bf0199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf0199d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e9f0 tx=0x7f8bec00eeb0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 shutdown_connections 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8bdc0a2800 0x7f8bdc0a4cc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0107540 0x7f8bf01a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bf0104c10 0x7f8bf019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 --2- 172.21.15.17:0/4087832025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bf01022e0 0x7f8bf0199d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 >> 172.21.15.17:0/4087832025 conn(0x7f8bf00fbc70 msgr2=0x7f8bf01019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 shutdown_connections 2024-03-16T10:50:43.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.252+0000 7f8bf8634640 1 -- 172.21.15.17:0/4087832025 wait complete. 2024-03-16T10:50:43.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:43.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 -- 172.21.15.17:0/3758239000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d601018d0 msgr2=0x7f8d60101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 --2- 172.21.15.17:0/3758239000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d601018d0 0x7f8d60101d50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009900 tx=0x7f8d5002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 -- 172.21.15.17:0/3758239000 shutdown_connections 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 --2- 172.21.15.17:0/3758239000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60102290 0x7f8d60108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 --2- 172.21.15.17:0/3758239000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d601018d0 0x7f8d60101d50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 --2- 172.21.15.17:0/3758239000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601006e0 0x7f8d60100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.374+0000 7f8d678ea640 1 -- 172.21.15.17:0/3758239000 >> 172.21.15.17:0/3758239000 conn(0x7f8d600fbc70 msgr2=0x7f8d600fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- 172.21.15.17:0/3758239000 shutdown_connections 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- 172.21.15.17:0/3758239000 wait complete. 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 Processor -- start 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- start start 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601018d0 0x7f8d60196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6010c3b0 con 0x7f8d60102290 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6010c230 con 0x7f8d601018d0 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.375+0000 7f8d678ea640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6010c530 con 0x7f8d601006e0 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65686640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53154/0 (socket says 172.21.15.17:53154) 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65686640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42448/0 (socket says 172.21.15.17:42448) 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 -- 172.21.15.17:0/1938028768 learned_addr learned my addr 172.21.15.17:0/1938028768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d64e85640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601018d0 0x7f8d60196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 -- 172.21.15.17:0/1938028768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 msgr2=0x7f8d601969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 -- 172.21.15.17:0/1938028768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601018d0 msgr2=0x7f8d60196f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601018d0 0x7f8d60196f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 -- 172.21.15.17:0/1938028768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6019e610 con 0x7f8d60102290 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65686640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d65e87640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800eca0 tx=0x7f8d5800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58004b20 con 0x7f8d60102290 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d58004cc0 con 0x7f8d60102290 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d600689a0 con 0x7f8d60102290 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58017650 con 0x7f8d60102290 2024-03-16T10:50:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.376+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d60068f10 con 0x7f8d60102290 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.377+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d600685d0 con 0x7f8d60102290 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.378+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f8d58005020 con 0x7f8d60102290 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.379+0000 7f8d567fc640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 0x7f8d4c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.379+0000 7f8d65686640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 0x7f8d4c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.379+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8d580d0bf0 con 0x7f8d60102290 2024-03-16T10:50:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.379+0000 7f8d65686640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 0x7f8d4c0a4d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d60101730 tx=0x7f8d5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.384+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8d5809d640 con 0x7f8d60102290 2024-03-16T10:50:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:43 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3657387291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:43 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4273527257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:43 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/530370382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:43 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3657387291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:43 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4273527257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:43 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/530370382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.619+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d6019e8a0 con 0x7f8d60102290 2024-03-16T10:50:43.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.619+0000 7f8d567fc640 1 -- 172.21.15.17:0/1938028768 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f8d58099020 con 0x7f8d60102290 2024-03-16T10:50:43.620 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 msgr2=0x7f8d4c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 0x7f8d4c0a4d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d60101730 tx=0x7f8d5c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 msgr2=0x7f8d6019dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800eca0 tx=0x7f8d5800b690 comp rx=0 tx=0).stop 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 shutdown_connections 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d4c0a2880 0x7f8d4c0a4d40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d60102290 0x7f8d6019dfa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d601018d0 0x7f8d60196f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 --2- 172.21.15.17:0/1938028768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d601006e0 0x7f8d601969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 >> 172.21.15.17:0/1938028768 conn(0x7f8d600fbc70 msgr2=0x7f8d60104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 shutdown_connections 2024-03-16T10:50:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.621+0000 7f8d678ea640 1 -- 172.21.15.17:0/1938028768 wait complete. 2024-03-16T10:50:43.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:43.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:43 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3657387291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:43 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4273527257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:43.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:43 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/530370382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 -- 172.21.15.17:0/1438968813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1022b0 msgr2=0x7f34ac108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 --2- 172.21.15.17:0/1438968813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1022b0 0x7f34ac108b40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009ca0 tx=0x7f34a402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 -- 172.21.15.17:0/1438968813 shutdown_connections 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 --2- 172.21.15.17:0/1438968813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1022b0 0x7f34ac108b40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 --2- 172.21.15.17:0/1438968813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 0x7f34ac101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 --2- 172.21.15.17:0/1438968813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac100700 0x7f34ac100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 -- 172.21.15.17:0/1438968813 >> 172.21.15.17:0/1438968813 conn(0x7f34ac0fbc90 msgr2=0x7f34ac0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 -- 172.21.15.17:0/1438968813 shutdown_connections 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.763+0000 7f34b0937640 1 -- 172.21.15.17:0/1438968813 wait complete. 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 Processor -- start 2024-03-16T10:50:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 -- start start 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 0x7f34ac19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac1022b0 0x7f34ac19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac10c380 con 0x7f34ac100700 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac10c200 con 0x7f34ac1022b0 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34b0937640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f34ac10c500 con 0x7f34ac1018f0 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53168/0 (socket says 172.21.15.17:53168) 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 -- 172.21.15.17:0/2810312111 learned_addr learned my addr 172.21.15.17:0/2810312111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34a9d9b640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 0x7f34ac19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aad9d640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac1022b0 0x7f34ac19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 -- 172.21.15.17:0/2810312111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 msgr2=0x7f34ac19c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 0x7f34ac19c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 -- 172.21.15.17:0/2810312111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac1022b0 msgr2=0x7f34ac19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac1022b0 0x7f34ac19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.764+0000 7f34aa59c640 1 -- 172.21.15.17:0/2810312111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ac19f770 con 0x7f34ac100700 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34aa59c640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e9c0 tx=0x7f349c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cd80 con 0x7f34ac100700 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c0035f0 con 0x7f34ac100700 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ac19fa00 con 0x7f34ac100700 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c010690 con 0x7f34ac100700 2024-03-16T10:50:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.765+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ac19ff50 con 0x7f34ac100700 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.766+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ac107a20 con 0x7f34ac100700 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.767+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f349c0037a0 con 0x7f34ac100700 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.767+0000 7f34a37fe640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 0x7f34980a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.768+0000 7f34a9d9b640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 0x7f34980a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.768+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f349c0ced70 con 0x7f34ac100700 2024-03-16T10:50:43.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.768+0000 7f34a9d9b640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 0x7f34980a4cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06a6d0 tx=0x7f3494005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.772+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f349c09beb0 con 0x7f34ac100700 2024-03-16T10:50:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.955+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f34ac02d1b0 con 0x7f34ac100700 2024-03-16T10:50:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.956+0000 7f34a37fe640 1 -- 172.21.15.17:0/2810312111 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f34ac02d1b0 con 0x7f34ac100700 2024-03-16T10:50:43.956 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.957+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 msgr2=0x7f34980a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.957+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 0x7f34980a4cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06a6d0 tx=0x7f3494005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.957+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 msgr2=0x7f34ac06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.957+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e9c0 tx=0x7f349c00ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 shutdown_connections 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f34980a2800 0x7f34980a4cc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34ac1022b0 0x7f34ac19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34ac1018f0 0x7f34ac19c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 --2- 172.21.15.17:0/2810312111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac100700 0x7f34ac06a960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 >> 172.21.15.17:0/2810312111 conn(0x7f34ac0fbc90 msgr2=0x7f34ac104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 shutdown_connections 2024-03-16T10:50:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:43.958+0000 7f34b0937640 1 -- 172.21.15.17:0/2810312111 wait complete. 2024-03-16T10:50:43.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.077+0000 7f7134e19640 1 -- 172.21.15.17:0/3665464115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 msgr2=0x7f71301046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.077+0000 7f7134e19640 1 --2- 172.21.15.17:0/3665464115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f71301046b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7124009900 tx=0x7f712402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 -- 172.21.15.17:0/3665464115 shutdown_connections 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 --2- 172.21.15.17:0/3665464115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130107520 0x7f7130109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 --2- 172.21.15.17:0/3665464115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130104bf0 0x7f7130106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 --2- 172.21.15.17:0/3665464115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f71301046b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 -- 172.21.15.17:0/3665464115 >> 172.21.15.17:0/3665464115 conn(0x7f71300fbc70 msgr2=0x7f71300fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 -- 172.21.15.17:0/3665464115 shutdown_connections 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 -- 172.21.15.17:0/3665464115 wait complete. 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 Processor -- start 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.078+0000 7f7134e19640 1 -- start start 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130104bf0 0x7f71301980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130107520 0x7f713019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f713010d450 con 0x7f71301022c0 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f713010d2d0 con 0x7f7130104bf0 2024-03-16T10:50:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f713010d5d0 con 0x7f7130107520 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53190/0 (socket says 172.21.15.17:53190) 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 -- 172.21.15.17:0/686486262 learned_addr learned my addr 172.21.15.17:0/686486262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712ed9d640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130107520 0x7f713019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712dd9b640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130104bf0 0x7f71301980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 -- 172.21.15.17:0/686486262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130107520 msgr2=0x7f713019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130107520 0x7f713019f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 -- 172.21.15.17:0/686486262 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130104bf0 msgr2=0x7f71301980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130104bf0 0x7f71301980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 -- 172.21.15.17:0/686486262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713019f7a0 con 0x7f71301022c0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f712e59c640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7124009230 tx=0x7f712402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124041070 con 0x7f71301022c0 2024-03-16T10:50:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713019fa30 con 0x7f71301022c0 2024-03-16T10:50:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7124004450 con 0x7f71301022c0 2024-03-16T10:50:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124003db0 con 0x7f71301022c0 2024-03-16T10:50:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.079+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713019ff20 con 0x7f71301022c0 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.080+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71300fd760 con 0x7f71301022c0 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.081+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f7124044070 con 0x7f71301022c0 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.082+0000 7f711f7fe640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 0x7f71180a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.082+0000 7f712dd9b640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 0x7f71180a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.082+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f71240f0900 con 0x7f71301022c0 2024-03-16T10:50:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.083+0000 7f712dd9b640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 0x7f71180a4cc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7130199090 tx=0x7f7120005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.086+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f71240bda40 con 0x7f71301022c0 2024-03-16T10:50:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.269+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f713002d340 con 0x7f71301022c0 2024-03-16T10:50:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.269+0000 7f711f7fe640 1 -- 172.21.15.17:0/686486262 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f71240bd340 con 0x7f71301022c0 2024-03-16T10:50:44.270 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:44.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 msgr2=0x7f71180a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 0x7f71180a4cc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7130199090 tx=0x7f7120005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 msgr2=0x7f7130197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7124009230 tx=0x7f712402c650 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 shutdown_connections 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f71180a2800 0x7f71180a4cc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130107520 0x7f713019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7130104bf0 0x7f71301980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 --2- 172.21.15.17:0/686486262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71301022c0 0x7f7130197b80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.271+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 >> 172.21.15.17:0/686486262 conn(0x7f71300fbc70 msgr2=0x7f7130102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.272+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 shutdown_connections 2024-03-16T10:50:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.272+0000 7f7134e19640 1 -- 172.21.15.17:0/686486262 wait complete. 2024-03-16T10:50:44.282 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:44 smithi017 ceph-mon[32078]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:44.282 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4087832025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:44.282 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1938028768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.282 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:44 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2810312111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:44.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 -- 172.21.15.17:0/3776471605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff44100700 msgr2=0x7eff44100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 --2- 172.21.15.17:0/3776471605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff44100700 0x7eff44100b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7eff40009900 tx=0x7eff4002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 -- 172.21.15.17:0/3776471605 shutdown_connections 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 --2- 172.21.15.17:0/3776471605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441022b0 0x7eff44108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 --2- 172.21.15.17:0/3776471605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff441018f0 0x7eff44101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 --2- 172.21.15.17:0/3776471605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff44100700 0x7eff44100b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 -- 172.21.15.17:0/3776471605 >> 172.21.15.17:0/3776471605 conn(0x7eff440fbc70 msgr2=0x7eff440fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 -- 172.21.15.17:0/3776471605 shutdown_connections 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.387+0000 7eff4c43f640 1 -- 172.21.15.17:0/3776471605 wait complete. 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 Processor -- start 2024-03-16T10:50:44.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 -- start start 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 0x7eff44197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 0x7eff44198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff440694d0 con 0x7eff441022b0 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7eff44069350 con 0x7eff44100700 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4c43f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff44069650 con 0x7eff441018f0 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a9dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a9dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53212/0 (socket says 172.21.15.17:53212) 2024-03-16T10:50:44.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 0x7eff44197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a9dc640 1 -- 172.21.15.17:0/1790996998 learned_addr learned my addr 172.21.15.17:0/1790996998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff499da640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 0x7eff44198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 -- 172.21.15.17:0/1790996998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 msgr2=0x7eff44198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 0x7eff44198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 -- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 msgr2=0x7eff4419f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a1db640 1 -- 172.21.15.17:0/1790996998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4419f740 con 0x7eff44100700 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff4a9dc640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.388+0000 7eff499da640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 0x7eff44198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:44.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff4a1db640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 0x7eff44197b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff4002c170 tx=0x7eff4002c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40041070 con 0x7eff44100700 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4419f9d0 con 0x7eff44100700 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff40004450 con 0x7eff44100700 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40003e50 con 0x7eff44100700 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.389+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4419fee0 con 0x7eff44100700 2024-03-16T10:50:44.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.390+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44107a20 con 0x7eff44100700 2024-03-16T10:50:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.392+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7eff40044070 con 0x7eff44100700 2024-03-16T10:50:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.392+0000 7eff3b7fe640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 0x7eff300a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.392+0000 7eff499da640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 0x7eff300a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.392+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7eff400f0660 con 0x7eff44100700 2024-03-16T10:50:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.393+0000 7eff499da640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 0x7eff300a4e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff44199030 tx=0x7eff34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.400+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7eff400bd150 con 0x7eff44100700 2024-03-16T10:50:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:44 smithi174 ceph-mon[36202]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4087832025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1938028768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:44 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2810312111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.621+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff4402d1b0 con 0x7eff44100700 2024-03-16T10:50:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.622+0000 7eff3b7fe640 1 -- 172.21.15.17:0/1790996998 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11935 (secure 0 0 0) 0x7eff400c11f0 con 0x7eff44100700 2024-03-16T10:50:44.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:44.623 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:48:56.174199+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:50:44.623 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 msgr2=0x7eff300a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 0x7eff300a4e60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7eff44199030 tx=0x7eff34005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 msgr2=0x7eff44197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 0x7eff44197b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff4002c170 tx=0x7eff4002c650 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 shutdown_connections 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff300a29a0 0x7eff300a4e60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff441022b0 0x7eff4419f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff441018f0 0x7eff44198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 --2- 172.21.15.17:0/1790996998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff44100700 0x7eff44197b20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 >> 172.21.15.17:0/1790996998 conn(0x7eff440fbc70 msgr2=0x7eff44104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 shutdown_connections 2024-03-16T10:50:44.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.624+0000 7eff4c43f640 1 -- 172.21.15.17:0/1790996998 wait complete. 2024-03-16T10:50:44.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:44 smithi111 ceph-mon[36315]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-03-16T10:50:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4087832025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1938028768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:44 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2810312111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 -- 172.21.15.17:0/2044427062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 msgr2=0x7fb2d4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 --2- 172.21.15.17:0/2044427062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4100b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009860 tx=0x7fb2d002bb70 comp rx=0 tx=0).stop 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 -- 172.21.15.17:0/2044427062 shutdown_connections 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 --2- 172.21.15.17:0/2044427062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41022b0 0x7fb2d4108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 --2- 172.21.15.17:0/2044427062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41018f0 0x7fb2d4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 --2- 172.21.15.17:0/2044427062 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4100b20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 -- 172.21.15.17:0/2044427062 >> 172.21.15.17:0/2044427062 conn(0x7fb2d40fbc70 msgr2=0x7fb2d40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 -- 172.21.15.17:0/2044427062 shutdown_connections 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.738+0000 7fb2db587640 1 -- 172.21.15.17:0/2044427062 wait complete. 2024-03-16T10:50:44.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 Processor -- start 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 -- start start 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 0x7fb2d41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41022b0 0x7fb2d419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410c350 con 0x7fb2d41022b0 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410c1d0 con 0x7fb2d4100700 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2db587640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410c4d0 con 0x7fb2d41018f0 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9b24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41022b0 0x7fb2d419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d8b22640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 0x7fb2d41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:50098/0 (socket says 172.21.15.17:50098) 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 -- 172.21.15.17:0/1186861263 learned_addr learned my addr 172.21.15.17:0/1186861263 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:44.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 -- 172.21.15.17:0/1186861263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 msgr2=0x7fb2d41980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 0x7fb2d41980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 -- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41022b0 msgr2=0x7fb2d419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41022b0 0x7fb2d419f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 -- 172.21.15.17:0/1186861263 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d419f790 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d8b22640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 0x7fb2d41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2d9323640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2d002c0b0 tx=0x7fb2d0032430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.739+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0041020 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.740+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2d002c9f0 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.740+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d419fa20 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.740+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0039040 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.740+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d419ff60 con 0x7fb2d4100700 2024-03-16T10:50:44.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.740+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d41a0130 con 0x7fb2d4100700 2024-03-16T10:50:44.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.742+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7fb2d0044020 con 0x7fb2d4100700 2024-03-16T10:50:44.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.742+0000 7fb2ca7fc640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 0x7fb2c00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:44.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.742+0000 7fb2d8b22640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 0x7fb2c00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:44.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.743+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb2d00f0620 con 0x7fb2d4100700 2024-03-16T10:50:44.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.743+0000 7fb2d8b22640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 0x7fb2c00a4d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4199080 tx=0x7fb2c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:44.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.746+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb2d004b020 con 0x7fb2d4100700 2024-03-16T10:50:44.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.928+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2d41a0300 con 0x7fb2d4100700 2024-03-16T10:50:44.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.930+0000 7fb2ca7fc640 1 -- 172.21.15.17:0/1186861263 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fb2d00bd740 con 0x7fb2d4100700 2024-03-16T10:50:44.930 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:44.931 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:44.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.931+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 msgr2=0x7fb2c00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.931+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 0x7fb2c00a4d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4199080 tx=0x7fb2c4009260 comp rx=0 tx=0).stop 2024-03-16T10:50:44.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.931+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 msgr2=0x7fb2d4197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.931+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2d002c0b0 tx=0x7fb2d0032430 comp rx=0 tx=0).stop 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 shutdown_connections 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb2c00a2880 0x7fb2c00a4d40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2d41022b0 0x7fb2d419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2d41018f0 0x7fb2d41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 --2- 172.21.15.17:0/1186861263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2d4100700 0x7fb2d4197b70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 >> 172.21.15.17:0/1186861263 conn(0x7fb2d40fbc70 msgr2=0x7fb2d40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 shutdown_connections 2024-03-16T10:50:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:44.932+0000 7fb2db587640 1 -- 172.21.15.17:0/1186861263 wait complete. 2024-03-16T10:50:44.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-16T10:48:48.817905+0000', 'modified': '2024-03-16T10:48:56.174199+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24536, 'mds_1': 24497, 'mds_2': 24493, 'mds_3': 24470, 'mds_4': 14655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14643': {'gid': 14643, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6839/3638042020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3638042020}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3638042020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14655': {'gid': 14655, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6841/2050511049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6840', 'nonce': 2050511049}, {'type': 'v1', 'addr': '172.21.15.17:6841', 'nonce': 2050511049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6833/760873641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6832', 'nonce': 760873641}, {'type': 'v1', 'addr': '172.21.15.174:6833', 'nonce': 760873641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.111:6833/1048472977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6832', 'nonce': 1048472977}, {'type': 'v1', 'addr': '172.21.15.111:6833', 'nonce': 1048472977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/330421208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 330421208}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 330421208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/3507552570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 3507552570}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 3507552570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.111:6835/3904744326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6834', 'nonce': 3904744326}, {'type': 'v1', 'addr': '172.21.15.111:6835', 'nonce': 3904744326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.174:6839/2355684811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 2355684811}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 2355684811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.111:6837/2446703423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 2446703423}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 2446703423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24536': {'gid': 24536, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.111:6839/1155010688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6838', 'nonce': 1155010688}, {'type': 'v1', 'addr': '172.21.15.111:6839', 'nonce': 1155010688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24536, 'qdb_cluster': [24493, 24536, 24470, 24497, 14655]} 2024-03-16T10:50:44.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-16T10:50:44.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 -- 172.21.15.17:0/2082035404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 msgr2=0x7f4cc4108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/2082035404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc4108b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009be0 tx=0x7f4cb402bef0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 -- 172.21.15.17:0/2082035404 shutdown_connections 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/2082035404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc4108b40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/2082035404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc41018f0 0x7f4cc4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/2082035404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc4100700 0x7f4cc4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 -- 172.21.15.17:0/2082035404 >> 172.21.15.17:0/2082035404 conn(0x7f4cc40fbc90 msgr2=0x7f4cc40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 -- 172.21.15.17:0/2082035404 shutdown_connections 2024-03-16T10:50:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.050+0000 7f4cc8c97640 1 -- 172.21.15.17:0/2082035404 wait complete. 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 Processor -- start 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 -- start start 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 0x7f4cc4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410c360 con 0x7f4cc41018f0 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410c1e0 con 0x7f4cc41022b0 2024-03-16T10:50:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc8c97640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc410c4e0 con 0x7f4cc4100700 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53234/0 (socket says 172.21.15.17:53234) 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/4185934471 learned_addr learned my addr 172.21.15.17:0/4185934471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc259c640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 0x7f4cc4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.051+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/4185934471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 msgr2=0x7f4cc4197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 0x7f4cc4197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/4185934471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 msgr2=0x7f4cc419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/4185934471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc419f750 con 0x7f4cc41018f0 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc259c640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 0x7f4cc4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800ea60 tx=0x7f4cb800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cb37fe640 1 -- 172.21.15.17:0/4185934471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cd20 con 0x7f4cc41018f0 2024-03-16T10:50:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc419fa40 con 0x7f4cc41018f0 2024-03-16T10:50:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cb37fe640 1 -- 172.21.15.17:0/4185934471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb80035f0 con 0x7f4cc41018f0 2024-03-16T10:50:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cb37fe640 1 -- 172.21.15.17:0/4185934471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8010690 con 0x7f4cc41018f0 2024-03-16T10:50:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.052+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc419ffe0 con 0x7f4cc41018f0 2024-03-16T10:50:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.054+0000 7f4ccb882740 1 Processor -- start 2024-03-16T10:50:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 -- start start 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cd2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab56c2ec80 con 0x55ab56cd0730 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab56bd7aa0 con 0x55ab56ccb5c0 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4ccb882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab56c2ad20 con 0x55ab56ccabd0 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42536/0 (socket says 172.21.15.17:42536) 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/4071698223 learned_addr learned my addr 172.21.15.17:0/4071698223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc259c640 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cb37fe640 1 -- 172.21.15.17:0/4185934471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f4cb80037a0 con 0x7f4cc41018f0 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/4071698223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccb5c0 msgr2=0x55ab56cd00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/4071698223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 msgr2=0x55ab56cd2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cd2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.055+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/4071698223 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab56bf9ff0 con 0x55ab56ccabd0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb4005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99589fc0ad99894 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cb0ff9640 1 -- 172.21.15.17:0/4071698223 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4043030 con 0x55ab56ccabd0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cb37fe640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 0x7f4cac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cb0ff9640 1 -- 172.21.15.17:0/4071698223 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb4003970 con 0x55ab56ccabd0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cb0ff9640 1 -- 172.21.15.17:0/4071698223 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb402cc90 con 0x55ab56ccabd0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cc259c640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 0x7f4cac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.056+0000 7f4cb37fe640 1 -- 172.21.15.17:0/4185934471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4cb80cecc0 con 0x7f4cc41018f0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4cc259c640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 0x7f4cac0a4cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55ab56ccb9c0 tx=0x7f4cbc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- 172.21.15.17:0/4071698223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 msgr2=0x55ab56ccaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb4005c70 comp rx=0 tx=0).stop 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- 172.21.15.17:0/4071698223 shutdown_connections 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cd2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 --2- 172.21.15.17:0/4071698223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56ccaff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- 172.21.15.17:0/4071698223 >> 172.21.15.17:0/4071698223 conn(0x55ab56cc6140 msgr2=0x55ab56cc6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- 172.21.15.17:0/4071698223 shutdown_connections 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- 172.21.15.17:0/4071698223 wait complete. 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 -- start start 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.057+0000 7f4ccb882740 1 Processor -- start 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 0x55ab56cdc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab56cd3680 con 0x55ab56ccb5c0 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab56beaef0 con 0x55ab56cd0730 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab56cd3800 con 0x55ab56ccabd0 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 10 client.0 _ll_register_callbacks cb 0x55ab56be5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42542/0 (socket says 172.21.15.17:42542) 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53252/0 (socket says 172.21.15.17:53252) 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc259c640 1 -- 172.21.15.17:0/2967010644 learned_addr learned my addr 172.21.15.17:0/2967010644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 0x55ab56cdc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/2967010644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 msgr2=0x55ab56cd4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/2967010644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 msgr2=0x55ab56cdc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 0x55ab56cdc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 -- 172.21.15.17:0/2967010644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab56bf7a30 con 0x55ab56ccb5c0 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc259c640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 0x55ab56cdc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80cc8b0 tx=0x7f4cb809b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87edb4e5ee4a5375 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80b4060 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4cb8003b30 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.058+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb4003970 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4cb80d0070 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 10 client.15258 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab569432d0 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb4003970 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4cb8097d70 con 0x55ab56ccb5c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 10 client.15258 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 10 client.15258 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 20 client.15258 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56ce17c0 0x55ab56ce2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 4 client.15258 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab56c3c1c0 con 0x55ab56ce17c0 2024-03-16T10:50:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.059+0000 7f4cc259c640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56ce17c0 0x55ab56ce2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ca9ffb640 10 client.15258 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4cc259c640 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56ce17c0 0x55ab56ce2c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a73a0683881de53c server_cookie=6858fc73b2e9c72a in_seq=0 out_seq=0 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/2967010644 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ab56c3c1c0 con 0x55ab56ce17c0 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ca9ffb640 10 client.15258 handle_command_reply: tid=0 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 client.15258 shutdown 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 msgr2=0x55ab56cd5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80cc8b0 tx=0x7f4cb809b4d0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 shutdown_connections 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56ce17c0 0x55ab56ce2c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56cd0730 0x55ab56cdc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56ccb5c0 0x55ab56cd5300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ca9ffb640 0 client.15258 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2967010644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccabd0 0x55ab56cd4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 >> 172.21.15.17:0/2967010644 conn(0x55ab56cc6140 msgr2=0x55ab56cc5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.060+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 shutdown_connections 2024-03-16T10:50:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.061+0000 7f4ccb882740 1 -- 172.21.15.17:0/2967010644 wait complete. 2024-03-16T10:50:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.061+0000 7f4ccb882740 20 client.15258 trim_cache size 0 max 16384 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 Processor -- start 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 -- start start 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56ccfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56cdc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce0f70 con 0x55ab56cd0730 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce1640 con 0x55ab56ccabd0 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4ccb882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce1d10 con 0x55ab56ccb5c0 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53260/0 (socket says 172.21.15.17:53260) 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/2896734395 learned_addr learned my addr 172.21.15.17:0/2896734395 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56cdc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc259c640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56ccfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/2896734395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 msgr2=0x55ab56cdc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56cdc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/2896734395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 msgr2=0x55ab56ccfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56ccfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/2896734395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab56a0d6b0 con 0x55ab56cd0730 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.079+0000 7f4cc259c640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56ccfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4004af0 tx=0x7f4cb4004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759225be45912569 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4cabfff640 1 -- 172.21.15.17:0/2896734395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4043040 con 0x55ab56cd0730 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4cabfff640 1 -- 172.21.15.17:0/2896734395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb4003e50 con 0x55ab56cd0730 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4cabfff640 1 -- 172.21.15.17:0/2896734395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40047c0 con 0x55ab56cd0730 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 -- 172.21.15.17:0/2896734395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 msgr2=0x55ab56cc6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4004af0 tx=0x7f4cb4004a80 comp rx=0 tx=0).stop 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 -- 172.21.15.17:0/2896734395 shutdown_connections 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56cc6520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56cdc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 --2- 172.21.15.17:0/2896734395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56ccfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 -- 172.21.15.17:0/2896734395 >> 172.21.15.17:0/2896734395 conn(0x55ab56cc6140 msgr2=0x55ab56cc9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 -- 172.21.15.17:0/2896734395 shutdown_connections 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.080+0000 7f4ccb882740 1 -- 172.21.15.17:0/2896734395 wait complete. 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 -- start start 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 Processor -- start 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56cce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56ccec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce2ab0 con 0x55ab56cd0730 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce23e0 con 0x55ab56ccabd0 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab56ce3180 con 0x55ab56ccb5c0 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ccb882740 10 client.0 _ll_register_callbacks cb 0x7f4cb800ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53264/0 (socket says 172.21.15.17:53264) 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/1675350318 learned_addr learned my addr 172.21.15.17:0/1675350318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc1d9b640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56ccec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc259c640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56cce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/1675350318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 msgr2=0x55ab56ccec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56ccec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/1675350318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 msgr2=0x55ab56cce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56cce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 -- 172.21.15.17:0/1675350318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab56d45a60 con 0x55ab56cd0730 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc259c640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56cce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4cc2d9d640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4033420 tx=0x7f4cb402c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cad07fd5527f7a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.081+0000 7f4ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4043030 con 0x55ab56cd0730 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4cb4004740 con 0x55ab56cd0730 2024-03-16T10:50:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb4003e50 con 0x55ab56cd0730 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4cb4009800 con 0x55ab56cd0730 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 10 client.15264 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab56d46d30 con 0x55ab56cd0730 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb4003e50 con 0x55ab56cd0730 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4cb4034730 con 0x55ab56cd0730 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 10 client.15264 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 10 client.15264 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 20 client.15264 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56d4b2e0 0x55ab56d49ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 4 client.15264 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "status"}) -- 0x55ab56c36510 con 0x55ab56d4b2e0 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4cc259c640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56d4b2e0 0x55ab56d49ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.082+0000 7f4cc259c640 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56d4b2e0 0x55ab56d49ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75ca8e85337d4429 server_cookie=843fc17c5a72b50a in_seq=0 out_seq=0 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ca9ffb640 10 client.15264 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ca9ffb640 1 -- 172.21.15.17:0/1675350318 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55ab56c36510 con 0x55ab56d4b2e0 2024-03-16T10:50:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ca9ffb640 10 client.15264 handle_command_reply: tid=0 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 client.15264 shutdown 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 msgr2=0x55ab56d45520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4033420 tx=0x7f4cb402c690 comp rx=0 tx=0).stop 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 shutdown_connections 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55ab56d4b2e0 0x55ab56d49ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab56cd0730 0x55ab56d45520 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab56ccb5c0 0x55ab56ccec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ca9ffb640 0 client.15264 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 --2- 172.21.15.17:0/1675350318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab56ccabd0 0x55ab56cce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 >> 172.21.15.17:0/1675350318 conn(0x55ab56cc6140 msgr2=0x55ab56cc4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 shutdown_connections 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 1 -- 172.21.15.17:0/1675350318 wait complete. 2024-03-16T10:50:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4ccb882740 20 client.15264 trim_cache size 0 max 16384 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14655, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 109.913136849, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 123.713013437 2024-03-16T10:50:45.091 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 msgr2=0x7f4cac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 0x7f4cac0a4cc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55ab56ccb9c0 tx=0x7f4cbc009260 comp rx=0 tx=0).stop 2024-03-16T10:50:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 msgr2=0x7f4cc4198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.083+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800ea60 tx=0x7f4cb800ee60 comp rx=0 tx=0).stop 2024-03-16T10:50:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 shutdown_connections 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4cac0a2800 0x7f4cac0a4cc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4cc41022b0 0x7f4cc419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cc41018f0 0x7f4cc4198070 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 --2- 172.21.15.17:0/4185934471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cc4100700 0x7f4cc4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 >> 172.21.15.17:0/4185934471 conn(0x7f4cc40fbc90 msgr2=0x7f4cc40fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 shutdown_connections 2024-03-16T10:50:45.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.084+0000 7f4cc8c97640 1 -- 172.21.15.17:0/4185934471 wait complete. 2024-03-16T10:50:45.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T10:50:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 -- 172.21.15.17:0/736630563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 msgr2=0x7f6ffc102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 --2- 172.21.15.17:0/736630563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc102e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009900 tx=0x7f6fec02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 -- 172.21.15.17:0/736630563 shutdown_connections 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 --2- 172.21.15.17:0/736630563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1033a0 0x7f6ffc109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 --2- 172.21.15.17:0/736630563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc102e60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 --2- 172.21.15.17:0/736630563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1017f0 0x7f6ffc101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 -- 172.21.15.17:0/736630563 >> 172.21.15.17:0/736630563 conn(0x7f6ffc0fcd80 msgr2=0x7f6ffc0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 -- 172.21.15.17:0/736630563 shutdown_connections 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.216+0000 7f7003e6e640 1 -- 172.21.15.17:0/736630563 wait complete. 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 Processor -- start 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 -- start start 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1017f0 0x7f6ffc075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1033a0 0x7f6ffc074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc10d470 con 0x7f6ffc1029e0 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc10d2f0 con 0x7f6ffc1033a0 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7003e6e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc10d5f0 con 0x7f6ffc1017f0 2024-03-16T10:50:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53282/0 (socket says 172.21.15.17:53282) 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 -- 172.21.15.17:0/678281025 learned_addr learned my addr 172.21.15.17:0/678281025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001c0a640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1017f0 0x7f6ffc075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f700240b640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1033a0 0x7f6ffc074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 -- 172.21.15.17:0/678281025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1017f0 msgr2=0x7f6ffc075590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1017f0 0x7f6ffc075590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 -- 172.21.15.17:0/678281025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1033a0 msgr2=0x7f6ffc074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1033a0 0x7f6ffc074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 -- 172.21.15.17:0/678281025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc0749a0 con 0x7f6ffc1029e0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.217+0000 7f7001409640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009230 tx=0x7f6fec02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.218+0000 7f6ff2ffd640 1 -- 172.21.15.17:0/678281025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec041070 con 0x7f6ffc1029e0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.218+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc1a1bd0 con 0x7f6ffc1029e0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.218+0000 7f6ff2ffd640 1 -- 172.21.15.17:0/678281025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec004450 con 0x7f6ffc1029e0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.218+0000 7f6ff2ffd640 1 -- 172.21.15.17:0/678281025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec003e20 con 0x7f6ffc1029e0 2024-03-16T10:50:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.218+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc1a2120 con 0x7f6ffc1029e0 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.220+0000 7f7006a56740 1 Processor -- start 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.220+0000 7f6ff2ffd640 1 -- 172.21.15.17:0/678281025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f6fec044070 con 0x7f6ffc1029e0 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.220+0000 7f7006a56740 1 -- start start 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b2abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab29a86c80 con 0x55ab29b28730 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab29a2faa0 con 0x55ab29b22bd0 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7006a56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab29a82d20 con 0x55ab29b235c0 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f700240b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b2abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f700240b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:50186/0 (socket says 172.21.15.17:50186) 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f700240b640 1 -- 172.21.15.17:0/355644352 learned_addr learned my addr 172.21.15.17:0/355644352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001c0a640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f6ff2ffd640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 0x7f6fe80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 -- 172.21.15.17:0/355644352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 msgr2=0x55ab29b280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b280c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 -- 172.21.15.17:0/355644352 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 msgr2=0x55ab29b22ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 -- 172.21.15.17:0/355644352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab29a51ff0 con 0x55ab29b28730 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001c0a640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f700240b640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f700240b640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 0x7f6fe80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f6ff2ffd640 1 -- 172.21.15.17:0/678281025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6fec0f0540 con 0x7f6ffc1029e0 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.221+0000 7f7001409640 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b2abc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ee0b0 tx=0x7f6fec04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae01cb4937c6cbc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f6fe7fff640 1 -- 172.21.15.17:0/355644352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0bcb70 con 0x55ab29b28730 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f6fe7fff640 1 -- 172.21.15.17:0/355644352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec004c60 con 0x55ab29b28730 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f6fe7fff640 1 -- 172.21.15.17:0/355644352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec09feb0 con 0x55ab29b28730 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f700240b640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 0x7f6fe80a4cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55ab29b23e20 tx=0x7f6ff4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 -- 172.21.15.17:0/355644352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 msgr2=0x55ab29b2abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b2abc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ee0b0 tx=0x7f6fec04d000 comp rx=0 tx=0).stop 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 -- 172.21.15.17:0/355644352 shutdown_connections 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b2abc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 --2- 172.21.15.17:0/355644352 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.222+0000 7f7006a56740 1 -- 172.21.15.17:0/355644352 >> 172.21.15.17:0/355644352 conn(0x55ab29b1e140 msgr2=0x55ab29b1e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- 172.21.15.17:0/355644352 shutdown_connections 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- 172.21.15.17:0/355644352 wait complete. 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- start start 2024-03-16T10:50:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 Processor -- start 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b22bd0 0x55ab29b2ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b28730 0x55ab29b33f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab29a86c80 con 0x55ab29b235c0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab29a42ef0 con 0x55ab29b28730 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b2b4a0 con 0x55ab29b22bd0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7006a56740 10 client.0 _ll_register_callbacks cb 0x55ab29a3ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7001409640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7001409640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53300/0 (socket says 172.21.15.17:53300) 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7001409640 1 -- 172.21.15.17:0/1912477122 learned_addr learned my addr 172.21.15.17:0/1912477122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f7001c0a640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b22bd0 0x55ab29b2ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.223+0000 7f700240b640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b28730 0x55ab29b33f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 -- 172.21.15.17:0/1912477122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b22bd0 msgr2=0x55ab29b2ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b22bd0 0x55ab29b2ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 -- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b28730 msgr2=0x55ab29b33f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b28730 0x55ab29b33f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 -- 172.21.15.17:0/1912477122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab29a4fa30 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7001409640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ee130 tx=0x7f6fec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f566f8aaa127c1b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f6fe57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0bc990 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6fec0d1020 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec004c60 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6fec0bcb70 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7006a56740 10 client.15276 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab2979b2d0 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.224+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec004c60 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6fec0c5290 con 0x55ab29b235c0 2024-03-16T10:50:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 10 client.15276 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 10 client.15276 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 20 client.15276 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29b39270 0x55ab29b3a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 4 client.15276 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab29a941c0 con 0x55ab29b39270 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7001c0a640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29b39270 0x55ab29b3a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f6fe57fa640 10 client.15276 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.225+0000 7f7001c0a640 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29b39270 0x55ab29b3a6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ec171f3613cf946 server_cookie=387a68eef7155f51 in_seq=0 out_seq=0 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f6fe57fa640 1 -- 172.21.15.17:0/1912477122 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ab29a941c0 con 0x55ab29b39270 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f6fe57fa640 10 client.15276 handle_command_reply: tid=0 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 client.15276 shutdown 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 msgr2=0x55ab29b2cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ee130 tx=0x7f6fec009260 comp rx=0 tx=0).stop 2024-03-16T10:50:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 shutdown_connections 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29b39270 0x55ab29b3a6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b28730 0x55ab29b33f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f6fe57fa640 0 client.15276 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b235c0 0x55ab29b2cf40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 --2- 172.21.15.17:0/1912477122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b22bd0 0x55ab29b2ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 >> 172.21.15.17:0/1912477122 conn(0x55ab29b1e140 msgr2=0x55ab29b1d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 shutdown_connections 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 1 -- 172.21.15.17:0/1912477122 wait complete. 2024-03-16T10:50:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.226+0000 7f7006a56740 20 client.15276 trim_cache size 0 max 16384 2024-03-16T10:50:45.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 Processor -- start 2024-03-16T10:50:45.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 -- start start 2024-03-16T10:50:45.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b2cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b33f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b38a20 con 0x55ab29b28730 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b390f0 con 0x55ab29b22bd0 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.244+0000 7f7006a56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b397c0 con 0x55ab29b235c0 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f700240b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f700240b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53316/0 (socket says 172.21.15.17:53316) 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f700240b640 1 -- 172.21.15.17:0/866266229 learned_addr learned my addr 172.21.15.17:0/866266229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b2cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001409640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b33f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 -- 172.21.15.17:0/866266229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 msgr2=0x55ab29b33f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b33f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 -- 172.21.15.17:0/866266229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 msgr2=0x55ab29b1caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 -- 172.21.15.17:0/866266229 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab298656b0 con 0x55ab29b22bd0 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f700240b640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f7001c0a640 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b2cd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ab29b3b070 tx=0x7f6ff8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ba304a448b7fbb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f6fe77fe640 1 -- 172.21.15.17:0/866266229 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8003de0 con 0x55ab29b22bd0 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f6fe77fe640 1 -- 172.21.15.17:0/866266229 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff80205d0 con 0x55ab29b22bd0 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.245+0000 7f6fe77fe640 1 -- 172.21.15.17:0/866266229 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8010cc0 con 0x55ab29b22bd0 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- 172.21.15.17:0/866266229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 msgr2=0x55ab29b2cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b2cd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ab29b3b070 tx=0x7f6ff8005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- 172.21.15.17:0/866266229 shutdown_connections 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b28730 0x55ab29b1caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b235c0 0x55ab29b33f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 --2- 172.21.15.17:0/866266229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b22bd0 0x55ab29b2cd20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- 172.21.15.17:0/866266229 >> 172.21.15.17:0/866266229 conn(0x55ab29b1e140 msgr2=0x55ab29b2c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- 172.21.15.17:0/866266229 shutdown_connections 2024-03-16T10:50:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- 172.21.15.17:0/866266229 wait complete. 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 -- start start 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.246+0000 7f7006a56740 1 Processor -- start 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 0x55ab29b9afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b28730 0x55ab29b9d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b3a560 con 0x55ab29b22bd0 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b39e90 con 0x55ab29b235c0 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ab29b3ac30 con 0x55ab29b28730 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 10 client.0 _ll_register_callbacks cb 0x7f6ff4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53326/0 (socket says 172.21.15.17:53326) 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 -- 172.21.15.17:0/2823116623 learned_addr learned my addr 172.21.15.17:0/2823116623 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001409640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 0x55ab29b9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f700240b640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b28730 0x55ab29b9d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 -- 172.21.15.17:0/2823116623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b28730 msgr2=0x55ab29b9d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b28730 0x55ab29b9d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 -- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 msgr2=0x55ab29b9afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 0x55ab29b9afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 -- 172.21.15.17:0/2823116623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab29b9da50 con 0x55ab29b22bd0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001409640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 0x55ab29b9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7001c0a640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004650 tx=0x7f6ff8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10a8ffb34be660e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f6fe57fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8010630 con 0x55ab29b22bd0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6ff80200f0 con 0x55ab29b22bd0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff80205d0 con 0x55ab29b22bd0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ff80202f0 con 0x55ab29b22bd0 2024-03-16T10:50:45.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 10 client.15282 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.247+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab29b9eca0 con 0x55ab29b22bd0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff80205d0 con 0x55ab29b22bd0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6ff802c8e0 con 0x55ab29b22bd0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 10 client.15282 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 10 client.15282 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 20 client.15282 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29ba35f0 0x55ab29b9fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 4 client.15282 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "status"}) -- 0x55ab29a8e510 con 0x55ab29ba35f0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7001409640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29ba35f0 0x55ab29b9fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f7001409640 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29ba35f0 0x55ab29b9fa30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cecb9c0df7f193 server_cookie=cc810d64272b6d2a in_seq=0 out_seq=0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.248+0000 7f6fe57fa640 10 client.15282 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f6fe57fa640 1 -- 172.21.15.17:0/2823116623 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55ab29a8e510 con 0x55ab29ba35f0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f6fe57fa640 10 client.15282 handle_command_reply: tid=0 2024-03-16T10:50:45.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 client.15282 shutdown 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 msgr2=0x55ab29b31f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004650 tx=0x7f6ff8009b90 comp rx=0 tx=0).stop 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 shutdown_connections 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55ab29ba35f0 0x55ab29b9fa30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ab29b28730 0x55ab29b9d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ab29b235c0 0x55ab29b9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 --2- 172.21.15.17:0/2823116623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ab29b22bd0 0x55ab29b31f30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f6fe57fa640 0 client.15282 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 >> 172.21.15.17:0/2823116623 conn(0x55ab29b1e140 msgr2=0x55ab29b1caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 shutdown_connections 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 1 -- 172.21.15.17:0/2823116623 wait complete. 2024-03-16T10:50:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7006a56740 20 client.15282 trim_cache size 0 max 16384 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24470, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 111.051329151, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 141.071638122 2024-03-16T10:50:45.257 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 msgr2=0x7f6fe80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 0x7f6fe80a4cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55ab29b23e20 tx=0x7f6ff4004a40 comp rx=0 tx=0).stop 2024-03-16T10:50:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 msgr2=0x7f6ffc073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009230 tx=0x7f6fec02c650 comp rx=0 tx=0).stop 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 shutdown_connections 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6fe80a2800 0x7f6fe80a4cc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ffc1033a0 0x7f6ffc074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ffc1029e0 0x7f6ffc073bd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 --2- 172.21.15.17:0/678281025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ffc1017f0 0x7f6ffc075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.249+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 >> 172.21.15.17:0/678281025 conn(0x7f6ffc0fcd80 msgr2=0x7f6ffc105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.250+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 shutdown_connections 2024-03-16T10:50:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.250+0000 7f7003e6e640 1 -- 172.21.15.17:0/678281025 wait complete. 2024-03-16T10:50:45.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 -- 172.21.15.17:0/2668290188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581018d0 msgr2=0x7f7258101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 --2- 172.21.15.17:0/2668290188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581018d0 0x7f7258101d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7248009900 tx=0x7f724802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 -- 172.21.15.17:0/2668290188 shutdown_connections 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 --2- 172.21.15.17:0/2668290188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 0x7f7258108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 --2- 172.21.15.17:0/2668290188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581018d0 0x7f7258101d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 --2- 172.21.15.17:0/2668290188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581006e0 0x7f7258100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 -- 172.21.15.17:0/2668290188 >> 172.21.15.17:0/2668290188 conn(0x7f72580fbc70 msgr2=0x7f72580fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 -- 172.21.15.17:0/2668290188 shutdown_connections 2024-03-16T10:50:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.372+0000 7f725f48a640 1 -- 172.21.15.17:0/2668290188 wait complete. 2024-03-16T10:50:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 Processor -- start 2024-03-16T10:50:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 -- start start 2024-03-16T10:50:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581006e0 0x7f7258196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 0x7f725819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f725810c340 con 0x7f72581018d0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f725810c1c0 con 0x7f72581006e0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725f48a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f725810c4c0 con 0x7f7258102290 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725ca25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725ca25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53330/0 (socket says 172.21.15.17:53330) 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.373+0000 7f725ca25640 1 -- 172.21.15.17:0/1412040430 learned_addr learned my addr 172.21.15.17:0/1412040430 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725d226640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581006e0 0x7f7258196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725da27640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 0x7f725819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 -- 172.21.15.17:0/1412040430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 msgr2=0x7f725819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 0x7f725819dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 -- 172.21.15.17:0/1412040430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581006e0 msgr2=0x7f7258196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581006e0 0x7f7258196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 -- 172.21.15.17:0/1412040430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725819e620 con 0x7f72581018d0 2024-03-16T10:50:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725ca25640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7248009230 tx=0x7f724802c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f724e7fc640 1 -- 172.21.15.17:0/1412040430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248041070 con 0x7f72581018d0 2024-03-16T10:50:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725819e8b0 con 0x7f72581018d0 2024-03-16T10:50:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f724e7fc640 1 -- 172.21.15.17:0/1412040430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7248004450 con 0x7f72581018d0 2024-03-16T10:50:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f724e7fc640 1 -- 172.21.15.17:0/1412040430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248003e20 con 0x7f72581018d0 2024-03-16T10:50:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.374+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725819edf0 con 0x7f72581018d0 2024-03-16T10:50:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 Processor -- start 2024-03-16T10:50:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 -- start start 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561669331c80 con 0x5616693cdbd0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5616692daaa0 con 0x5616693d3730 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f7262070740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56166932dd20 con 0x5616693ce5c0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f724e7fc640 1 -- 172.21.15.17:0/1412040430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f7248044070 con 0x7f72581018d0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53346/0 (socket says 172.21.15.17:53346) 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 -- 172.21.15.17:0/3993479549 learned_addr learned my addr 172.21.15.17:0/3993479549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725d226640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725ca25640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 -- 172.21.15.17:0/3993479549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 msgr2=0x5616693d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 -- 172.21.15.17:0/3993479549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 msgr2=0x5616693d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693d5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725da27640 1 -- 172.21.15.17:0/3993479549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616692fcff0 con 0x5616693cdbd0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725d226640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.377+0000 7f725ca25640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f725da27640 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7250009fd0 tx=0x7f72500118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d3745ea1ae04a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f724e7fc640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 0x7f72440a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f72437fe640 1 -- 172.21.15.17:0/3993479549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725001b070 con 0x5616693cdbd0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f725d226640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 0x7f72440a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f724e7fc640 1 -- 172.21.15.17:0/1412040430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f72480f0550 con 0x7f72581018d0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f72437fe640 1 -- 172.21.15.17:0/3993479549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7250004d20 con 0x5616693cdbd0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.378+0000 7f72437fe640 1 -- 172.21.15.17:0/3993479549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250005020 con 0x5616693cdbd0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- 172.21.15.17:0/3993479549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 msgr2=0x5616693cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f725d226640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 0x7f72440a4cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5616693ce9c0 tx=0x7f7254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7250009fd0 tx=0x7f72500118d0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- 172.21.15.17:0/3993479549 shutdown_connections 2024-03-16T10:50:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 --2- 172.21.15.17:0/3993479549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693cdff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- 172.21.15.17:0/3993479549 >> 172.21.15.17:0/3993479549 conn(0x5616693c9140 msgr2=0x5616693c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- 172.21.15.17:0/3993479549 shutdown_connections 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- 172.21.15.17:0/3993479549 wait complete. 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 -- start start 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 Processor -- start 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.379+0000 7f7262070740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5616693d66e0 con 0x5616693cdbd0 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5616692edef0 con 0x5616693d3730 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5616693d6860 con 0x5616693ce5c0 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 10 client.0 _ll_register_callbacks cb 0x5616692e8dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53354/0 (socket says 172.21.15.17:53354) 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 -- 172.21.15.17:0/74313710 learned_addr learned my addr 172.21.15.17:0/74313710 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725ca25640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725da27640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 -- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 msgr2=0x5616693d8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 -- 172.21.15.17:0/74313710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 msgr2=0x5616693df3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693df3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 -- 172.21.15.17:0/74313710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616692faa30 con 0x5616693cdbd0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725ca25640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f725d226640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f725401e9d0 tx=0x7f7254004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4847d49aa68fd4e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7240ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725402e060 con 0x5616693cdbd0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7254018030 con 0x5616693cdbd0 2024-03-16T10:50:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.380+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7250004d20 con 0x5616693cdbd0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7254009850 con 0x5616693cdbd0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 10 client.15294 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5616690462d0 con 0x5616693cdbd0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7250004d20 con 0x5616693cdbd0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7254033070 con 0x5616693cdbd0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 10 client.15294 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 10 client.15294 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 20 client.15294 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5616693e4910 0x5616693e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 4 client.15294 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56166933f1c0 con 0x5616693e4910 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.381+0000 7f725ca25640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5616693e4910 0x5616693e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7240ff9640 10 client.15294 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f725ca25640 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5616693e4910 0x5616693e5d80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a2cc7defb3a468e server_cookie=6c01dde0ad15bb6d in_seq=0 out_seq=0 2024-03-16T10:50:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7240ff9640 1 -- 172.21.15.17:0/74313710 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56166933f1c0 con 0x5616693e4910 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7240ff9640 10 client.15294 handle_command_reply: tid=0 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 client.15294 shutdown 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 msgr2=0x5616693d7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f725401e9d0 tx=0x7f7254004730 comp rx=0 tx=0).stop 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 shutdown_connections 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.382+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5616693e4910 0x5616693e5d80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693d8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 1 --2- 172.21.15.17:0/74313710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693d7e40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 >> 172.21.15.17:0/74313710 conn(0x5616693c9140 msgr2=0x5616693c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7240ff9640 0 client.15294 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 shutdown_connections 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 1 -- 172.21.15.17:0/74313710 wait complete. 2024-03-16T10:50:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.383+0000 7f7262070740 20 client.15294 trim_cache size 0 max 16384 2024-03-16T10:50:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 Processor -- start 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 -- start start 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693ce5c0 0x5616693df380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693d3730 0x5616693d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5616693e40c0 con 0x5616693ce5c0 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5616693e4790 con 0x5616693cdbd0 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f7262070740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5616693e4e60 con 0x5616693d3730 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f725ca25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693ce5c0 0x5616693df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f725d226640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f725d226640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:50244/0 (socket says 172.21.15.17:50244) 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f725d226640 1 -- 172.21.15.17:0/2169026458 learned_addr learned my addr 172.21.15.17:0/2169026458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.401+0000 7f725da27640 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693d3730 0x5616693d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 -- 172.21.15.17:0/2169026458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693d3730 msgr2=0x5616693d7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693d3730 0x5616693d7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 -- 172.21.15.17:0/2169026458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693ce5c0 msgr2=0x5616693df380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693ce5c0 0x5616693df380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 -- 172.21.15.17:0/2169026458 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616691106b0 con 0x5616693cdbd0 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f725d226640 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f725400f930 tx=0x7f7254009d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ce8cc017beb9ab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f7242ffd640 1 -- 172.21.15.17:0/2169026458 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254039070 con 0x5616693cdbd0 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f7242ffd640 1 -- 172.21.15.17:0/2169026458 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7254005500 con 0x5616693cdbd0 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.402+0000 7f7242ffd640 1 -- 172.21.15.17:0/2169026458 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254004a00 con 0x5616693cdbd0 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- 172.21.15.17:0/2169026458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 msgr2=0x5616693d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f725400f930 tx=0x7f7254009d30 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- 172.21.15.17:0/2169026458 shutdown_connections 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693d3730 0x5616693d7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693ce5c0 0x5616693df380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- 172.21.15.17:0/2169026458 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693cdbd0 0x5616693d5b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- 172.21.15.17:0/2169026458 >> 172.21.15.17:0/2169026458 conn(0x5616693c9140 msgr2=0x5616693c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- 172.21.15.17:0/2169026458 shutdown_connections 2024-03-16T10:50:45.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- 172.21.15.17:0/2169026458 wait complete. 2024-03-16T10:50:45.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 -- start start 2024-03-16T10:50:45.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 Processor -- start 2024-03-16T10:50:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.403+0000 7f7262070740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5616693e5c00 con 0x5616693cdbd0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5616693e5530 con 0x5616693d3730 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5616693e62d0 con 0x5616693ce5c0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 10 client.0 _ll_register_callbacks cb 0x7f7254009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53374/0 (socket says 172.21.15.17:53374) 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 -- 172.21.15.17:0/815669574 learned_addr learned my addr 172.21.15.17:0/815669574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725ca25640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725da27640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 -- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 msgr2=0x5616693da9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693da9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 -- 172.21.15.17:0/815669574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 msgr2=0x5616693dd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693dd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 -- 172.21.15.17:0/815669574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616693ddfb0 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725ca25640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693da9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f725d226640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f725401e9d0 tx=0x7f72540052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d14b0e65ead80c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7240ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725404a060 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f725400fe00 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.404+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7254005500 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f725402e050 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 10 client.15300 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5616693df2b0 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7254005500 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f725404f070 con 0x5616693cdbd0 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 10 client.15300 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 10 client.15300 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 20 client.15300 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x56166944e820 0x56166944d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 4 client.15300 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "status"}) -- 0x561669339510 con 0x56166944e820 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.405+0000 7f725ca25640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x56166944e820 0x56166944d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7240ff9640 10 client.15300 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f725ca25640 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x56166944e820 0x56166944d530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22f554eda561815 server_cookie=5d8afc57a94f5ffd in_seq=0 out_seq=0 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7240ff9640 1 -- 172.21.15.17:0/815669574 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561669339510 con 0x56166944e820 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7240ff9640 10 client.15300 handle_command_reply: tid=0 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 client.15300 shutdown 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 msgr2=0x5616693da460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f725401e9d0 tx=0x7f72540052d0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 shutdown_connections 2024-03-16T10:50:45.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5616693d3730 0x5616693dd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x56166944e820 0x56166944d530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5616693ce5c0 0x5616693da9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 --2- 172.21.15.17:0/815669574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616693cdbd0 0x5616693da460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 >> 172.21.15.17:0/815669574 conn(0x5616693c9140 msgr2=0x5616693cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7240ff9640 0 client.15300 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 shutdown_connections 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 1 -- 172.21.15.17:0/815669574 wait complete. 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.406+0000 7f7262070740 20 client.15300 trim_cache size 0 max 16384 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:45.413 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24493, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 112.214366115, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 129.66140822099999 2024-03-16T10:50:45.414 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 msgr2=0x7f72440a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 0x7f72440a4cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5616693ce9c0 tx=0x7f7254005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 msgr2=0x7f7258196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7248009230 tx=0x7f724802c650 comp rx=0 tx=0).stop 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 shutdown_connections 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f72440a2800 0x7f72440a4cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7258102290 0x7f725819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72581018d0 0x7f7258196f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 --2- 172.21.15.17:0/1412040430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72581006e0 0x7f7258196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 >> 172.21.15.17:0/1412040430 conn(0x7f72580fbc70 msgr2=0x7f7258104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 shutdown_connections 2024-03-16T10:50:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.407+0000 7f725f48a640 1 -- 172.21.15.17:0/1412040430 wait complete. 2024-03-16T10:50:45.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-16T10:50:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.525+0000 7f13c54a7640 1 -- 172.21.15.17:0/4051020981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 msgr2=0x7f13c0101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.525+0000 7f13c54a7640 1 --2- 172.21.15.17:0/4051020981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0101c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009900 tx=0x7f13b002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- 172.21.15.17:0/4051020981 shutdown_connections 2024-03-16T10:50:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- 172.21.15.17:0/4051020981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c01033c0 0x7f13c0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- 172.21.15.17:0/4051020981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c0102a00 0x7f13c0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- 172.21.15.17:0/4051020981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0101c30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- 172.21.15.17:0/4051020981 >> 172.21.15.17:0/4051020981 conn(0x7f13c00fcd80 msgr2=0x7f13c00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- 172.21.15.17:0/4051020981 shutdown_connections 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- 172.21.15.17:0/4051020981 wait complete. 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 Processor -- start 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- start start 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 0x7f13c01980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c01033c0 0x7f13c019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010d460 con 0x7f13c0101810 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010d2e0 con 0x7f13c01033c0 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.526+0000 7f13c54a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010d5e0 con 0x7f13c0102a00 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53386/0 (socket says 172.21.15.17:53386) 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 -- 172.21.15.17:0/2464890204 learned_addr learned my addr 172.21.15.17:0/2464890204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 0x7f13c01980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c01033c0 0x7f13c019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 -- 172.21.15.17:0/2464890204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 msgr2=0x7f13c01980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 0x7f13c01980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 -- 172.21.15.17:0/2464890204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c01033c0 msgr2=0x7f13c019f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c01033c0 0x7f13c019f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 -- 172.21.15.17:0/2464890204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c019f7b0 con 0x7f13c0101810 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 0x7f13c01980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13beffd640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13a7fff640 1 -- 172.21.15.17:0/2464890204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0041070 con 0x7f13c0101810 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13a7fff640 1 -- 172.21.15.17:0/2464890204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b0004450 con 0x7f13c0101810 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13a7fff640 1 -- 172.21.15.17:0/2464890204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0003df0 con 0x7f13c0101810 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c019fa40 con 0x7f13c0101810 2024-03-16T10:50:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.527+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c019ff30 con 0x7f13c0101810 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 Processor -- start 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13a7fff640 1 -- 172.21.15.17:0/2464890204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f13b0044070 con 0x7f13c0101810 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 -- start start 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 0x5644359370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 0x564435939bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564435895c80 con 0x564435937730 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56443583eaa0 con 0x5644359325c0 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13c8168740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564435891d20 con 0x564435931bd0 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 0x564435939bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13beffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 0x5644359370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42700/0 (socket says 172.21.15.17:42700) 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13bf7fe640 1 -- 172.21.15.17:0/149549796 learned_addr learned my addr 172.21.15.17:0/149549796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13a7fff640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 0x7f13a80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.530+0000 7f13beffd640 1 -- 172.21.15.17:0/149549796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 msgr2=0x564435931ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13beffd640 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13beffd640 1 -- 172.21.15.17:0/149549796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 msgr2=0x564435939bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13beffd640 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 0x564435939bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13beffd640 1 -- 172.21.15.17:0/149549796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564435860ff0 con 0x5644359325c0 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13be7fc640 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 0x564435939bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 0x7f13a80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13a7fff640 1 -- 172.21.15.17:0/2464890204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f13b00f04b0 con 0x7f13c0101810 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13beffd640 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 0x5644359370c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ee0a0 tx=0x7f13b0005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a57b9e46194527 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13a57fa640 1 -- 172.21.15.17:0/149549796 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b00bcd50 con 0x5644359325c0 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 0x7f13a80a4cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x564435932e20 tx=0x7f13b8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13a57fa640 1 -- 172.21.15.17:0/149549796 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b00bd680 con 0x5644359325c0 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.531+0000 7f13a57fa640 1 -- 172.21.15.17:0/149549796 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b009f140 con 0x5644359325c0 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- 172.21.15.17:0/149549796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 msgr2=0x5644359370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 0x5644359370c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ee0a0 tx=0x7f13b0005e50 comp rx=0 tx=0).stop 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- 172.21.15.17:0/149549796 shutdown_connections 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435937730 0x564435939bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5644359325c0 0x5644359370c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- 172.21.15.17:0/149549796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x564435931ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- 172.21.15.17:0/149549796 >> 172.21.15.17:0/149549796 conn(0x56443592d140 msgr2=0x56443592d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- 172.21.15.17:0/149549796 shutdown_connections 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- 172.21.15.17:0/149549796 wait complete. 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- start start 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 Processor -- start 2024-03-16T10:50:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x56443593bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435942fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56443593a4a0 con 0x564435931bd0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x564435851ef0 con 0x564435937730 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56443593a620 con 0x5644359325c0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.532+0000 7f13c8168740 10 client.0 _ll_register_callbacks cb 0x56443584cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53402/0 (socket says 172.21.15.17:53402) 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 -- 172.21.15.17:0/2223023910 learned_addr learned my addr 172.21.15.17:0/2223023910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435942fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x56443593bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 -- 172.21.15.17:0/2223023910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 msgr2=0x56443593bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x56443593bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 -- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 msgr2=0x564435942fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435942fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 -- 172.21.15.17:0/2223023910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443585ea30 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435942fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13beffd640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f13b00bcf10 tx=0x7f13b00c1250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65bd93176b4892d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b00bc8e0 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f13b00bb280 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b00bd680 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f13b00bcac0 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13c8168740 10 client.15312 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.533+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644355aa2d0 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b00bd680 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f13b00b95f0 con 0x564435931bd0 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 10 client.15312 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 10 client.15312 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 20 client.15312 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x564435948230 0x5644359496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 4 client.15312 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644358a31c0 con 0x564435948230 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x564435948230 0x5644359496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x564435948230 0x5644359496a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6cfe8519bfe9af3 server_cookie=77bb8d7f95a0e86a in_seq=0 out_seq=0 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.534+0000 7f13a2ff5640 10 client.15312 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2223023910 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5644358a31c0 con 0x564435948230 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13a2ff5640 10 client.15312 handle_command_reply: tid=0 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 client.15312 shutdown 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 msgr2=0x56443593ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f13b00bcf10 tx=0x7f13b00c1250 comp rx=0 tx=0).stop 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 shutdown_connections 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x564435948230 0x5644359496a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435942fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13a2ff5640 0 client.15312 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x56443593bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 --2- 172.21.15.17:0/2223023910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593ba20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 >> 172.21.15.17:0/2223023910 conn(0x56443592d140 msgr2=0x56443592c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 shutdown_connections 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 1 -- 172.21.15.17:0/2223023910 wait complete. 2024-03-16T10:50:45.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.535+0000 7f13c8168740 20 client.15312 trim_cache size 0 max 16384 2024-03-16T10:50:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 Processor -- start 2024-03-16T10:50:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 -- start start 2024-03-16T10:50:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644359479e0 con 0x564435931bd0 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5644359480b0 con 0x564435937730 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13c8168740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564435948780 con 0x5644359325c0 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53408/0 (socket says 172.21.15.17:53408) 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:50314/0 (socket says 172.21.15.17:50314) 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42720/0 (socket says 172.21.15.17:42720) 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 -- 172.21.15.17:0/920696507 learned_addr learned my addr 172.21.15.17:0/920696507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 -- 172.21.15.17:0/920696507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 msgr2=0x564435942f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 -- 172.21.15.17:0/920696507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 msgr2=0x56443593b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13bf7fe640 1 -- 172.21.15.17:0/920696507 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644356746b0 con 0x564435937730 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.555+0000 7f13be7fc640 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.556+0000 7f13bf7fe640 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13b8010a80 tx=0x7f13b8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81760108cea5f64b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.556+0000 7f13a4ff9640 1 -- 172.21.15.17:0/920696507 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b802e070 con 0x564435937730 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.556+0000 7f13a4ff9640 1 -- 172.21.15.17:0/920696507 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b801c450 con 0x564435937730 2024-03-16T10:50:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.556+0000 7f13a4ff9640 1 -- 172.21.15.17:0/920696507 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8029630 con 0x564435937730 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- 172.21.15.17:0/920696507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 msgr2=0x56443593bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13b8010a80 tx=0x7f13b8019000 comp rx=0 tx=0).stop 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- 172.21.15.17:0/920696507 shutdown_connections 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x56443593bb70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5644359325c0 0x564435942f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 --2- 172.21.15.17:0/920696507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564435931bd0 0x56443593b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- 172.21.15.17:0/920696507 >> 172.21.15.17:0/920696507 conn(0x56443592d140 msgr2=0x564435928210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- 172.21.15.17:0/920696507 shutdown_connections 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- 172.21.15.17:0/920696507 wait complete. 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 -- start start 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.557+0000 7f13c8168740 1 Processor -- start 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x56443593e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435941980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564435949520 con 0x5644359325c0 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x564435948e50 con 0x564435937730 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564435949bf0 con 0x564435931bd0 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13c8168740 10 client.0 _ll_register_callbacks cb 0x7f13b4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53424/0 (socket says 172.21.15.17:53424) 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435941980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 -- 172.21.15.17:0/2656656649 learned_addr learned my addr 172.21.15.17:0/2656656649 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13beffd640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x56443593e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 -- 172.21.15.17:0/2656656649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 msgr2=0x56443593e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x56443593e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 -- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 msgr2=0x564435941980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435941980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 -- 172.21.15.17:0/2656656649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564435941f70 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13be7fc640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f13b4005d00 tx=0x7f13b4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3463f17d4977bfd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.558+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011ca0 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b801c450 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f13b4011e40 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f13b4005020 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 10 client.15318 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644359adfa0 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b801c450 con 0x5644359325c0 2024-03-16T10:50:45.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f13b4020070 con 0x5644359325c0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 10 client.15318 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 10 client.15318 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 20 client.15318 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5644359b2ad0 0x5644359b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 4 client.15318 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "status"}) -- 0x56443589d510 con 0x5644359b2ad0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.559+0000 7f13beffd640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5644359b2ad0 0x5644359b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13a2ff5640 10 client.15318 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13beffd640 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5644359b2ad0 0x5644359b17e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fae554d0e0b54ae8 server_cookie=c374c52140a43784 in_seq=0 out_seq=0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13a2ff5640 1 -- 172.21.15.17:0/2656656649 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56443589d510 con 0x5644359b2ad0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13a2ff5640 10 client.15318 handle_command_reply: tid=0 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 client.15318 shutdown 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 msgr2=0x56443593e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f13b4005d00 tx=0x7f13b4012bc0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 shutdown_connections 2024-03-16T10:50:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5644359b2ad0 0x5644359b17e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564435937730 0x564435941980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644359325c0 0x56443593e960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13a2ff5640 0 client.15318 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 --2- 172.21.15.17:0/2656656649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564435931bd0 0x56443593e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 >> 172.21.15.17:0/2656656649 conn(0x56443592d140 msgr2=0x56443593b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 shutdown_connections 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 1 -- 172.21.15.17:0/2656656649 wait complete. 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.560+0000 7f13c8168740 20 client.15318 trim_cache size 0 max 16384 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:45.566 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24497, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 113.37966292500001, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 132.75146497599999 2024-03-16T10:50:45.567 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 msgr2=0x7f13a80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 0x7f13a80a4cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x564435932e20 tx=0x7f13b8004a40 comp rx=0 tx=0).stop 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 msgr2=0x7f13c0197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b002c640 comp rx=0 tx=0).stop 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 shutdown_connections 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f13a80a2800 0x7f13a80a4cc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13c01033c0 0x7f13c019f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c0102a00 0x7f13c01980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 --2- 172.21.15.17:0/2464890204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0101810 0x7f13c0197b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 >> 172.21.15.17:0/2464890204 conn(0x7f13c00fcd80 msgr2=0x7f13c0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 shutdown_connections 2024-03-16T10:50:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.561+0000 7f13c54a7640 1 -- 172.21.15.17:0/2464890204 wait complete. 2024-03-16T10:50:45.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/686486262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:45.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1790996998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:45 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1186861263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/686486262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:45.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1790996998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:45 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1186861263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-16T10:50:45.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/686486262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:45.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1790996998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:45 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1186861263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 -- 172.21.15.17:0/3392347390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70081000b0 msgr2=0x7f70081004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 --2- 172.21.15.17:0/3392347390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70081000b0 0x7f70081004d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009860 tx=0x7f6ff802bb70 comp rx=0 tx=0).stop 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 -- 172.21.15.17:0/3392347390 shutdown_connections 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 --2- 172.21.15.17:0/3392347390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f7008101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 --2- 172.21.15.17:0/3392347390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7008100a10 0x7f7008100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 --2- 172.21.15.17:0/3392347390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70081000b0 0x7f70081004d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 -- 172.21.15.17:0/3392347390 >> 172.21.15.17:0/3392347390 conn(0x7f70080fbc70 msgr2=0x7f70080fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 -- 172.21.15.17:0/3392347390 shutdown_connections 2024-03-16T10:50:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.677+0000 7f700ceb2640 1 -- 172.21.15.17:0/3392347390 wait complete. 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 Processor -- start 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 -- start start 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 0x7f700819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f70081a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f700810f640 con 0x7f70081000b0 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f700810f4c0 con 0x7f70081013b0 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700ceb2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f700810f7c0 con 0x7f7008100a10 2024-03-16T10:50:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53434/0 (socket says 172.21.15.17:53434) 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f700659c640 1 -- 172.21.15.17:0/706936126 learned_addr learned my addr 172.21.15.17:0/706936126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f7005d9b640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 0x7f700819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.678+0000 7f7006d9d640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f70081a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 -- 172.21.15.17:0/706936126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 msgr2=0x7f700819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 0x7f700819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 -- 172.21.15.17:0/706936126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 msgr2=0x7f70081a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f70081a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 -- 172.21.15.17:0/706936126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70081a1920 con 0x7f70081000b0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f7005d9b640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 0x7f700819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f7006d9d640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f70081a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700659c640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005940 tx=0x7f6ff8032470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f6ff77fe640 1 -- 172.21.15.17:0/706936126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8041020 con 0x7f70081000b0 2024-03-16T10:50:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f6ff77fe640 1 -- 172.21.15.17:0/706936126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff802c9f0 con 0x7f70081000b0 2024-03-16T10:50:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70081a1bb0 con 0x7f70081000b0 2024-03-16T10:50:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f6ff77fe640 1 -- 172.21.15.17:0/706936126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8039040 con 0x7f70081000b0 2024-03-16T10:50:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.679+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081a20f0 con 0x7f70081000b0 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 Processor -- start 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 -- start start 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c7fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0c850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0be3c80 con 0x55e7a0c805c0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0b8caa0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f700fb7d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0bdfd20 con 0x55e7a0c85730 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f6ff77fe640 1 -- 172.21.15.17:0/706936126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f6ff8044020 con 0x7f70081000b0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f7005d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f7005d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:42756/0 (socket says 172.21.15.17:42756) 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f7006d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c7fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.682+0000 7f7005d9b640 1 -- 172.21.15.17:0/1948621374 learned_addr learned my addr 172.21.15.17:0/1948621374 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f700659c640 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0c850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 -- 172.21.15.17:0/1948621374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 msgr2=0x55e7a0c7fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c7fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 -- 172.21.15.17:0/1948621374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 msgr2=0x55e7a0c850c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0c850c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 -- 172.21.15.17:0/1948621374 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a0baeff0 con 0x55e7a0c85730 2024-03-16T10:50:45.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f700659c640 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0c850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0114f0 tx=0x7f6ffc0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74aa121bc06f5002 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f6ff4ff9640 1 -- 172.21.15.17:0/1948621374 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005020 con 0x55e7a0c85730 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f6ff4ff9640 1 -- 172.21.15.17:0/1948621374 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc0047a0 con 0x55e7a0c85730 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f6ff4ff9640 1 -- 172.21.15.17:0/1948621374 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00f9c0 con 0x55e7a0c85730 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f6ff77fe640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 0x7f6ff00a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f7006d9d640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 0x7f6ff00a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.683+0000 7f6ff77fe640 1 -- 172.21.15.17:0/706936126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6ff80f03c0 con 0x7f70081000b0 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- 172.21.15.17:0/1948621374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 msgr2=0x55e7a0c87bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f7006d9d640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 0x7f6ff00a4dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55e7a0c80e20 tx=0x7f7000009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0114f0 tx=0x7f6ffc0119b0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- 172.21.15.17:0/1948621374 shutdown_connections 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c87bc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0c850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1948621374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c7fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- 172.21.15.17:0/1948621374 >> 172.21.15.17:0/1948621374 conn(0x55e7a0c7b140 msgr2=0x55e7a0c7b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- 172.21.15.17:0/1948621374 shutdown_connections 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- 172.21.15.17:0/1948621374 wait complete. 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.684+0000 7f700fb7d740 1 -- start start 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 Processor -- start 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 0x55e7a0c8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c91300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c886e0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0b9fef0 con 0x55e7a0c805c0 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c88860 con 0x55e7a0c85730 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700fb7d740 10 client.0 _ll_register_callbacks cb 0x55e7a0b9adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53456/0 (socket says 172.21.15.17:53456) 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 -- 172.21.15.17:0/1248429150 learned_addr learned my addr 172.21.15.17:0/1248429150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 0x55e7a0c8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f7006d9d640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c91300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 -- 172.21.15.17:0/1248429150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 msgr2=0x55e7a0c91300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c91300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 -- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 msgr2=0x55e7a0c8a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 0x55e7a0c8a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 -- 172.21.15.17:0/1248429150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a0baca30 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 0x55e7a0c8a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f700659c640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80bccf0 tx=0x7f6ff80095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f83be34e66c7913 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.685+0000 7f6fedffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80bc8a0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6ff80f3c60 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ffc0047a0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ff80baea0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 10 client.15330 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7a08f82d0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc0047a0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6ff803c030 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 10 client.15330 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 10 client.15330 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 20 client.15330 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0c967f0 0x55e7a0c97c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 4 client.15330 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7a0bf11c0 con 0x55e7a0c967f0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.686+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0c967f0 0x55e7a0c97c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.687+0000 7f7005d9b640 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0c967f0 0x55e7a0c97c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bedc924a0aa13a01 server_cookie=edc8378f30520260 in_seq=0 out_seq=0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.687+0000 7f6fedffb640 10 client.15330 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f6fedffb640 1 -- 172.21.15.17:0/1248429150 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e7a0bf11c0 con 0x55e7a0c967f0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f6fedffb640 10 client.15330 handle_command_reply: tid=0 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 client.15330 shutdown 2024-03-16T10:50:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 msgr2=0x55e7a0c89d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80bccf0 tx=0x7f6ff80095b0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 shutdown_connections 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0c967f0 0x55e7a0c97c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0c91300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c805c0 0x55e7a0c8a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f6fedffb640 0 client.15330 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 --2- 172.21.15.17:0/1248429150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89d80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 >> 172.21.15.17:0/1248429150 conn(0x55e7a0c7b140 msgr2=0x55e7a0c7a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 shutdown_connections 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 1 -- 172.21.15.17:0/1248429150 wait complete. 2024-03-16T10:50:45.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.688+0000 7f700fb7d740 20 client.15330 trim_cache size 0 max 16384 2024-03-16T10:50:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.721+0000 7f700fb7d740 1 Processor -- start 2024-03-16T10:50:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 -- start start 2024-03-16T10:50:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c805c0 0x55e7a0c91290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 0x55e7a0c89ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c95fa0 con 0x55e7a0c85730 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c96670 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700fb7d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c96d40 con 0x55e7a0c805c0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f7006d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 0x55e7a0c89ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f7006d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 0x55e7a0c89ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53470/0 (socket says 172.21.15.17:53470) 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f7006d9d640 1 -- 172.21.15.17:0/693580463 learned_addr learned my addr 172.21.15.17:0/693580463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f7005d9b640 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c805c0 0x55e7a0c91290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 -- 172.21.15.17:0/693580463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c805c0 msgr2=0x55e7a0c91290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c805c0 0x55e7a0c91290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 -- 172.21.15.17:0/693580463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 msgr2=0x55e7a0c89ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 0x55e7a0c89ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 -- 172.21.15.17:0/693580463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a09c26b0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.722+0000 7f700659c640 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b9650 tx=0x7f6ff8034ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a83a39b06c94e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f6feffff640 1 -- 172.21.15.17:0/693580463 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80bc6c0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f6feffff640 1 -- 172.21.15.17:0/693580463 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff80f38c0 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f6feffff640 1 -- 172.21.15.17:0/693580463 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80bc410 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 -- 172.21.15.17:0/693580463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 msgr2=0x55e7a0c89990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b9650 tx=0x7f6ff8034ad0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 -- 172.21.15.17:0/693580463 shutdown_connections 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c85730 0x55e7a0c89ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c805c0 0x55e7a0c91290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 --2- 172.21.15.17:0/693580463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c89990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 -- 172.21.15.17:0/693580463 >> 172.21.15.17:0/693580463 conn(0x55e7a0c7b140 msgr2=0x55e7a0c84de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 -- 172.21.15.17:0/693580463 shutdown_connections 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.723+0000 7f700fb7d740 1 -- 172.21.15.17:0/693580463 wait complete. 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 -- start start 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 Processor -- start 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c8f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0cfaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c97ae0 con 0x55e7a0c805c0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c97410 con 0x55e7a0c7fbd0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7a0c981b0 con 0x55e7a0c85730 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700fb7d740 10 client.0 _ll_register_callbacks cb 0x7f6ff80097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53472/0 (socket says 172.21.15.17:53472) 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 -- 172.21.15.17:0/4083733890 learned_addr learned my addr 172.21.15.17:0/4083733890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f700659c640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c8f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7006d9d640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0cfaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 -- 172.21.15.17:0/4083733890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 msgr2=0x55e7a0cfaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0cfaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 -- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 msgr2=0x55e7a0c8f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c8f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.724+0000 7f7005d9b640 1 -- 172.21.15.17:0/4083733890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a0cfafd0 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f7005d9b640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009cd0 tx=0x7f6ffc009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de84f95e5e0ee58e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f6fedffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005d10 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6ffc016040 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff80f38c0 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ffc011040 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f700fb7d740 10 client.15336 fetch_fsmap learned FSMap version 26 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7a0cfc1e0 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.725+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff80f38c0 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6ffc00f890 con 0x55e7a0c805c0 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 10 client.15336 fetch_fsmap finished waiting for FSMap version 26 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 10 client.15336 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 20 client.15336 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:45.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0d00c40 0x55e7a0cff950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 4 client.15336 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "status"}) -- 0x55e7a0c88040 con 0x55e7a0d00c40 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700659c640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0d00c40 0x55e7a0cff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700659c640 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0d00c40 0x55e7a0cff950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463ca01b53756772 server_cookie=72e1c1e53b7c3aed in_seq=0 out_seq=0 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f6fedffb640 10 client.15336 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f6fedffb640 1 -- 172.21.15.17:0/4083733890 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e7a0c88040 con 0x55e7a0d00c40 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f6fedffb640 10 client.15336 handle_command_reply: tid=0 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.726+0000 7f700fb7d740 1 client.15336 shutdown 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 msgr2=0x55e7a0cf8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009cd0 tx=0x7f6ffc009670 comp rx=0 tx=0).stop 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 shutdown_connections 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e7a0d00c40 0x55e7a0cff950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7a0c85730 0x55e7a0cfaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7a0c805c0 0x55e7a0cf8540 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 --2- 172.21.15.17:0/4083733890 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e7a0c7fbd0 0x55e7a0c8f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f6fedffb640 0 client.15336 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 >> 172.21.15.17:0/4083733890 conn(0x55e7a0c7b140 msgr2=0x55e7a0c89970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 shutdown_connections 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 1 -- 172.21.15.17:0/4083733890 wait complete. 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700fb7d740 20 client.15336 trim_cache size 0 max 16384 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "811ebd0c-e381-11ee-95c9-87774f69a715", 2024-03-16T10:50:45.734 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24536, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 116.08342711500001, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 85, 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 121.421138527 2024-03-16T10:50:45.735 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 msgr2=0x7f6ff00a4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 0x7f6ff00a4dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55e7a0c80e20 tx=0x7f7000009500 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 msgr2=0x7f7008199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005940 tx=0x7f6ff8032470 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.727+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 shutdown_connections 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6ff00a2900 0x7f6ff00a4dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f70081013b0 0x7f70081a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7008100a10 0x7f700819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 --2- 172.21.15.17:0/706936126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70081000b0 0x7f7008199d10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 >> 172.21.15.17:0/706936126 conn(0x7f70080fbc70 msgr2=0x7f70080fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 shutdown_connections 2024-03-16T10:50:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:45.728+0000 7f700ceb2640 1 -- 172.21.15.17:0/706936126 wait complete. 2024-03-16T10:50:45.739 INFO:teuthology.run_tasks:Running task kclient... 2024-03-16T10:50:45.761 INFO:tasks.kclient:Mounting kernel clients... 2024-03-16T10:50:45.761 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-16T10:50:45.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:45.761 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-16T10:50:45.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:45.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-16T10:50:45.848 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-03-16T10:50:45.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:50:45.850 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-03-16T10:50:45.851 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T10:50:45.851 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:45.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph fs ls 2024-03-16T10:50:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:50:46.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:46 smithi174 ceph-mon[36202]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:46.569 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:46 smithi017 ceph-mon[32078]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:46 smithi111 ceph-mon[36315]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 -- 172.21.15.17:0/2155163376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e006a920 msgr2=0x7f40e010f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 --2- 172.21.15.17:0/2155163376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e006a920 0x7f40e010f160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40d80099c0 tx=0x7f40d8009cd0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 -- 172.21.15.17:0/2155163376 shutdown_connections 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 --2- 172.21.15.17:0/2155163376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e006a920 0x7f40e010f160 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 --2- 172.21.15.17:0/2155163376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e0108320 0x7f40e0108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 --2- 172.21.15.17:0/2155163376 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0069f80 0x7f40e006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 -- 172.21.15.17:0/2155163376 >> 172.21.15.17:0/2155163376 conn(0x7f40e0078100 msgr2=0x7f40e0078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 -- 172.21.15.17:0/2155163376 shutdown_connections 2024-03-16T10:50:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.905+0000 7f40e5168700 1 -- 172.21.15.17:0/2155163376 wait complete. 2024-03-16T10:50:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.906+0000 7f40e5168700 1 Processor -- start 2024-03-16T10:50:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.906+0000 7f40e5168700 1 -- start start 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 0x7f40e019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 0x7f40e0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01125a0 con 0x7f40e0069f80 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0112420 con 0x7f40e0108320 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40e5168700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0112720 con 0x7f40e006a920 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40ded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40ded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53494/0 (socket says 172.21.15.17:53494) 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40ded9d700 1 -- 172.21.15.17:0/1276045307 learned_addr learned my addr 172.21.15.17:0/1276045307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 0x7f40e0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40de59c700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 0x7f40e019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 -- 172.21.15.17:0/1276045307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 msgr2=0x7f40e019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 0x7f40e019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 -- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 msgr2=0x7f40e019e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 -- 172.21.15.17:0/1276045307 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e0199000 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40ded9d700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40de59c700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 0x7f40e019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.907+0000 7f40df59e700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 0x7f40e0198820 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40d80098e0 tx=0x7f40d800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.908+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8027070 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.908+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e0199290 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.908+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d8003680 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.908+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8022e20 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.908+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e01a5500 con 0x7f40e0108320 2024-03-16T10:50:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.909+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e01039d0 con 0x7f40e0108320 2024-03-16T10:50:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.910+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f40d802a070 con 0x7f40e0108320 2024-03-16T10:50:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.910+0000 7f40c7fff700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 0x7f40c80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.910+0000 7f40ded9d700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 0x7f40c80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.910+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f40d80cf2f0 con 0x7f40e0108320 2024-03-16T10:50:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.911+0000 7f40ded9d700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 0x7f40c80a4d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009c10 tx=0x7f40d000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:47.914+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f40d8013070 con 0x7f40e0108320 2024-03-16T10:50:48.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.177+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f40e0199d50 con 0x7f40e0108320 2024-03-16T10:50:48.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.178+0000 7f40c7fff700 1 -- 172.21.15.17:0/1276045307 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f40d809c4c0 con 0x7f40e0108320 2024-03-16T10:50:48.178 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 msgr2=0x7f40c80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 0x7f40c80a4d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009c10 tx=0x7f40d000b040 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 msgr2=0x7f40e0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 0x7f40e0198820 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f40d80098e0 tx=0x7f40d800f690 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 shutdown_connections 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f40c80a2890 0x7f40c80a4d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40e0108320 0x7f40e0198820 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e0069f80 0x7f40e019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 --2- 172.21.15.17:0/1276045307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e006a920 0x7f40e019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 >> 172.21.15.17:0/1276045307 conn(0x7f40e0078100 msgr2=0x7f40e00ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 shutdown_connections 2024-03-16T10:50:48.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48.180+0000 7f40e5168700 1 -- 172.21.15.17:0/1276045307 wait complete. 2024-03-16T10:50:48.533 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:48 smithi017 ceph-mon[32078]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:48.533 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:48 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1276045307' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T10:50:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:48 smithi174 ceph-mon[36202]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:48 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1276045307' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T10:50:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:48 smithi111 ceph-mon[36315]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-16T10:50:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:48 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1276045307' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T10:50:48.864 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T10:50:48.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:48.865 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T10:50:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42107sec preferred_lft 42107sec 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-16T10:50:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-16T10:50:48.882 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-16T10:50:48.882 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-16T10:50:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:49.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:49.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:49.078 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T10:50:49.106 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-16T10:50:49.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:49.108 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-16T10:50:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-16T10:50:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T10:50:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T10:50:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T10:50:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T10:50:49.180 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T10:50:49.180 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-16T10:50:49.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T10:50:49.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T10:50:49.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T10:50:49.181 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-16T10:50:49.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:49.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:49.481 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-16T10:50:49.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:49.495 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-03-16T10:50:49.557 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T10:50:49.557 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-16T10:50:49.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T10:50:49.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-16T10:50:49.559 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-16T10:50:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:49.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:49.697 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-16T10:50:49.697 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T10:50:49.697 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-16T10:50:49.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-16T10:50:49.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-16T10:50:49.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-16T10:50:49.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-16T10:50:49.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-16T10:50:49.698 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-16T10:50:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:49.840 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T10:50:49.840 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-16T10:50:49.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-16T10:50:49.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-03-16T10:50:49.841 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-16T10:50:49.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:49.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T10:50:49.923 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:49.937 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T10:50:49.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T10:50:49.937 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:49.991 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-03-16T10:50:49.991 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-03-16T10:50:49.991 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28 2024-03-16T10:50:49.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:49.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-03-16T10:50:50.075 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-03-16T10:50:50.075 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-03-16T10:50:50.202 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-03-16T10:50:50.202 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-03-16T10:50:50.202 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.111:6789,172.21.15.174:6789" 2024-03-16T10:50:50.202 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 0@811ebd0c-e381-11ee-95c9-87774f69a715.cephfs=/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28 2024-03-16T10:50:50.202 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.17:6789/172.21.15.111:6789/172.21.15.174:6789" will pass to kernel 2024-03-16T10:50:50.203 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-16T10:50:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-03-16T10:50:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T10:50:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T10:50:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T10:50:50.205 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T10:50:50.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:50.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:50.277 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T10:50:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:50 smithi017 ceph-mon[32078]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:50.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-16T10:50:50.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:50.389 INFO:teuthology.orchestra.run.smithi017.stdout:client25189 2024-03-16T10:50:50.389 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:50:50.390 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T10:50:50.445 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T10:50:50.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-16T10:50:50.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:50.541 INFO:teuthology.orchestra.run.smithi017.stdout:client25189 2024-03-16T10:50:50.541 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T10:50:50.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:50 smithi174 ceph-mon[36202]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:50.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-16T10:50:50.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:50.615 INFO:teuthology.orchestra.run.smithi017.stdout:client25189 2024-03-16T10:50:50.615 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/811ebd0c-e381-11ee-95c9-87774f69a715.client25189/status') 2024-03-16T10:50:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:50 smithi111 ceph-mon[36315]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-16T10:50:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T10:50:50.683 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.25189 (3)172.21.15.17:0/3500064734 2024-03-16T10:50:50.683 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2024-03-16T10:50:50.683 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2024-03-16T10:50:50.683 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2024-03-16T10:50:50.683 INFO:teuthology.orchestra.run.smithi017.stderr:71 bytes copied, 2.5395e-05 s, 2.8 MB/s 2024-03-16T10:50:50.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T10:50:50.691 INFO:teuthology.run_tasks:Running task exec... 2024-03-16T10:50:50.702 INFO:teuthology.task.exec:Executing custom commands... 2024-03-16T10:50:50.702 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:50:50.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- 172.21.15.17:0/4127460640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba4100700 msgr2=0x7f4ba4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 --2- 172.21.15.17:0/4127460640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba4100700 0x7f4ba4100b20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009900 tx=0x7f4b9802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- 172.21.15.17:0/4127460640 shutdown_connections 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 --2- 172.21.15.17:0/4127460640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba41022b0 0x7f4ba4108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 --2- 172.21.15.17:0/4127460640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 0x7f4ba4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 --2- 172.21.15.17:0/4127460640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba4100700 0x7f4ba4100b20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- 172.21.15.17:0/4127460640 >> 172.21.15.17:0/4127460640 conn(0x7f4ba40fbc70 msgr2=0x7f4ba40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- 172.21.15.17:0/4127460640 shutdown_connections 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- 172.21.15.17:0/4127460640 wait complete. 2024-03-16T10:50:50.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 Processor -- start 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.823+0000 7f4baae44640 1 -- start start 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 0x7f4ba4198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 0x7f4ba419f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba410c370 con 0x7f4ba41022b0 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba410c1f0 con 0x7f4ba4100700 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba410c4f0 con 0x7f4ba41018f0 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba8be0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 0x7f4ba419f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba8be0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:47582/0 (socket says 172.21.15.17:47582) 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba8be0640 1 -- 172.21.15.17:0/1432917448 learned_addr learned my addr 172.21.15.17:0/1432917448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba3fff640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 0x7f4ba4198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:50.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 -- 172.21.15.17:0/1432917448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 msgr2=0x7f4ba4198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 0x7f4ba4198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 -- 172.21.15.17:0/1432917448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 msgr2=0x7f4ba4197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 -- 172.21.15.17:0/1432917448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba419f6f0 con 0x7f4ba41022b0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba8be0640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba93e1640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 0x7f4ba419f080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009fd0 tx=0x7f4b9c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00ce20 con 0x7f4ba41022b0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b9c005020 con 0x7f4ba41022b0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.824+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba419f9e0 con 0x7f4ba41022b0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.825+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c010720 con 0x7f4ba41022b0 2024-03-16T10:50:50.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.825+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba419fee0 con 0x7f4ba41022b0 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.826+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba41a0170 con 0x7f4ba41022b0 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.827+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f4b9c005540 con 0x7f4ba41022b0 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.827+0000 7f4ba1ffb640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 0x7f4b940a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.827+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4b9c0cf0a0 con 0x7f4ba41022b0 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.827+0000 7f4ba8be0640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 0x7f4b940a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.828+0000 7f4ba8be0640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 0x7f4b940a4d60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802c8e0 tx=0x7f4b98005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:50.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:50.833+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4b9c09c1e0 con 0x7f4ba41022b0 2024-03-16T10:50:51.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.055+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f4ba41a03a0 con 0x7f4ba41022b0 2024-03-16T10:50:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.214+0000 7f4ba1ffb640 1 -- 172.21.15.17:0/1432917448 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f4b9c09bae0 con 0x7f4ba41022b0 2024-03-16T10:50:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 msgr2=0x7f4b940a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 0x7f4b940a4d60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802c8e0 tx=0x7f4b98005b50 comp rx=0 tx=0).stop 2024-03-16T10:50:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 msgr2=0x7f4ba419f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 0x7f4ba419f080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009fd0 tx=0x7f4b9c00ef10 comp rx=0 tx=0).stop 2024-03-16T10:50:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 shutdown_connections 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4b940a28a0 0x7f4b940a4d60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ba41022b0 0x7f4ba419f080 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ba41018f0 0x7f4ba4198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 --2- 172.21.15.17:0/1432917448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ba4100700 0x7f4ba4197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.216+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 >> 172.21.15.17:0/1432917448 conn(0x7f4ba40fbc70 msgr2=0x7f4ba40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.217+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 shutdown_connections 2024-03-16T10:50:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.217+0000 7f4baae44640 1 -- 172.21.15.17:0/1432917448 wait complete. 2024-03-16T10:50:51.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-03-16T10:50:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 -- 172.21.15.17:0/1904620254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c102350 msgr2=0x7f446c104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 --2- 172.21.15.17:0/1904620254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c102350 0x7f446c104740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4468009ca0 tx=0x7f446802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 -- 172.21.15.17:0/1904620254 shutdown_connections 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 --2- 172.21.15.17:0/1904620254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c1075b0 0x7f446c1099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 --2- 172.21.15.17:0/1904620254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c104c80 0x7f446c107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 --2- 172.21.15.17:0/1904620254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c102350 0x7f446c104740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 -- 172.21.15.17:0/1904620254 >> 172.21.15.17:0/1904620254 conn(0x7f446c0fbca0 msgr2=0x7f446c0fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 -- 172.21.15.17:0/1904620254 shutdown_connections 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 -- 172.21.15.17:0/1904620254 wait complete. 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.333+0000 7f447417e640 1 Processor -- start 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 -- start start 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c104c80 0x7f446c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c1075b0 0x7f446c19f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10d4c0 con 0x7f446c1075b0 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10d340 con 0x7f446c102350 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447417e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10d640 con 0x7f446c104c80 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f447271b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c1075b0 0x7f446c19f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:47596/0 (socket says 172.21.15.17:47596) 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 -- 172.21.15.17:0/272306943 learned_addr learned my addr 172.21.15.17:0/272306943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471719640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c104c80 0x7f446c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 -- 172.21.15.17:0/272306943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c104c80 msgr2=0x7f446c197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c104c80 0x7f446c197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 -- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c1075b0 msgr2=0x7f446c19f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c1075b0 0x7f446c19f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 -- 172.21.15.17:0/272306943 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c19f6b0 con 0x7f446c102350 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4471f1a640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4468009dc0 tx=0x7f4468032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.334+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468041020 con 0x7f446c102350 2024-03-16T10:50:51.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.335+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4468034cd0 con 0x7f446c102350 2024-03-16T10:50:51.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.335+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c19f940 con 0x7f446c102350 2024-03-16T10:50:51.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.335+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468039040 con 0x7f446c102350 2024-03-16T10:50:51.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.335+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c19fe80 con 0x7f446c102350 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.336+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c0fd790 con 0x7f446c102350 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.337+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f4468044020 con 0x7f446c102350 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.337+0000 7f4462ffd640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 0x7f44580a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.337+0000 7f4471719640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 0x7f44580a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.337+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f44680f0810 con 0x7f446c102350 2024-03-16T10:50:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.338+0000 7f4471719640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 0x7f44580a4de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f446c198fa0 tx=0x7f445c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:51.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.342+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f446804b020 con 0x7f446c102350 2024-03-16T10:50:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.553+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f446c061d80 con 0x7f44580a2920 2024-03-16T10:50:51.560 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-16T10:50:51.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:51 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-16T10:50:51.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.571+0000 7f4462ffd640 1 -- 172.21.15.17:0/272306943 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f446c061d80 con 0x7f44580a2920 2024-03-16T10:50:51.571 INFO:teuthology.orchestra.run.smithi017.stdout:{} 2024-03-16T10:50:51.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.572+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 msgr2=0x7f44580a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.572+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 0x7f44580a4de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f446c198fa0 tx=0x7f445c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 msgr2=0x7f446c197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4468009dc0 tx=0x7f4468032f20 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 shutdown_connections 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f44580a2920 0x7f44580a4de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c1075b0 0x7f446c19f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f446c104c80 0x7f446c197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 --2- 172.21.15.17:0/272306943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f446c102350 0x7f446c197a90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 >> 172.21.15.17:0/272306943 conn(0x7f446c0fbca0 msgr2=0x7f446c102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 shutdown_connections 2024-03-16T10:50:51.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.573+0000 7f447417e640 1 -- 172.21.15.17:0/272306943 wait complete. 2024-03-16T10:50:51.584 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-16T10:50:51.595 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-16T10:50:51.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:51.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:51 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3216928843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781018f0 msgr2=0x7f6d78101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3216928843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781018f0 0x7f6d78101d70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009900 tx=0x7f6d6802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3216928843 shutdown_connections 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3216928843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d781022b0 0x7f6d78108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3216928843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781018f0 0x7f6d78101d70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3216928843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d78100700 0x7f6d78100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3216928843 >> 172.21.15.17:0/3216928843 conn(0x7f6d780fbc70 msgr2=0x7f6d780fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3216928843 shutdown_connections 2024-03-16T10:50:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.734+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3216928843 wait complete. 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 Processor -- start 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 -- start start 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 0x7f6d7810b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d781018f0 0x7f6d781096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7810d4a0 con 0x7f6d781022b0 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7810d320 con 0x7f6d781018f0 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7fe4b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7810d620 con 0x7f6d78100700 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42310/0 (socket says 172.21.15.17:42310) 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 -- 172.21.15.17:0/3814352368 learned_addr learned my addr 172.21.15.17:0/3814352368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7d3e6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d781018f0 0x7f6d781096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7dbe7640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 0x7f6d7810b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 -- 172.21.15.17:0/3814352368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 msgr2=0x7f6d7810b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 0x7f6d7810b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 -- 172.21.15.17:0/3814352368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d781018f0 msgr2=0x7f6d781096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d781018f0 0x7f6d781096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 -- 172.21.15.17:0/3814352368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7810a490 con 0x7f6d781022b0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7dbe7640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 0x7f6d7810b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.735+0000 7f6d7e3e8640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000eb10 tx=0x7f6d7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.736+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70004b20 con 0x7f6d781022b0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.736+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d70004cc0 con 0x7f6d781022b0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.736+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d781a1bf0 con 0x7f6d781022b0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.736+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70010760 con 0x7f6d781022b0 2024-03-16T10:50:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.736+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d781a20c0 con 0x7f6d781022b0 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.737+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d780685d0 con 0x7f6d781022b0 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.738+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f6d70010900 con 0x7f6d781022b0 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.738+0000 7f6d6effd640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 0x7f6d640a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.739+0000 7f6d7dbe7640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 0x7f6d640a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.739+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6d700cf220 con 0x7f6d781022b0 2024-03-16T10:50:51.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.739+0000 7f6d7dbe7640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 0x7f6d640a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d78101750 tx=0x7f6d74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:51.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.742+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f6d70053740 con 0x7f6d781022b0 2024-03-16T10:50:51.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:50:51.558+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:50:51.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:50:51.558+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:50:51.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:50:51.558+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:50:51.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:50:51.558+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:50:51.840 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:50:51 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:50:51.558+0000 7f00a23d9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T10:50:51.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.928+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d780623e0 con 0x7f6d781022b0 2024-03-16T10:50:51.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.930+0000 7f6d6effd640 1 -- 172.21.15.17:0/3814352368 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7f6d7009c2c0 con 0x7f6d781022b0 2024-03-16T10:50:51.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:51.931 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 msgr2=0x7f6d640a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 0x7f6d640a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6d78101750 tx=0x7f6d74005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 msgr2=0x7f6d78109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000eb10 tx=0x7f6d7000c2d0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 shutdown_connections 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6d640a2800 0x7f6d640a4cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d781022b0 0x7f6d78109c00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d781018f0 0x7f6d781096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 --2- 172.21.15.17:0/3814352368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d78100700 0x7f6d7810b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 >> 172.21.15.17:0/3814352368 conn(0x7f6d780fbc70 msgr2=0x7f6d78104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 shutdown_connections 2024-03-16T10:50:51.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:51.932+0000 7f6d7fe4b640 1 -- 172.21.15.17:0/3814352368 wait complete. 2024-03-16T10:50:51.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:51.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- 172.21.15.17:0/343036438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 msgr2=0x7f5160100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 --2- 172.21.15.17:0/343036438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160100b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5158009ca0 tx=0x7f515802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- 172.21.15.17:0/343036438 shutdown_connections 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 --2- 172.21.15.17:0/343036438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 0x7f5160108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 --2- 172.21.15.17:0/343036438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 0x7f5160101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 --2- 172.21.15.17:0/343036438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160100b00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- 172.21.15.17:0/343036438 >> 172.21.15.17:0/343036438 conn(0x7f51600fbc70 msgr2=0x7f51600fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- 172.21.15.17:0/343036438 shutdown_connections 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- 172.21.15.17:0/343036438 wait complete. 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 Processor -- start 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.049+0000 7f5166ade640 1 -- start start 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 0x7f5160198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 0x7f516019f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f516010c330 con 0x7f51601006e0 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f516010c1b0 con 0x7f5160102290 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f516010c4b0 con 0x7f51601018d0 2024-03-16T10:50:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42328/0 (socket says 172.21.15.17:42328) 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 -- 172.21.15.17:0/3706545204 learned_addr learned my addr 172.21.15.17:0/3706545204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516507b640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 0x7f516019f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f515ffff640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 0x7f5160198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 -- 172.21.15.17:0/3706545204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 msgr2=0x7f5160198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 0x7f5160198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 -- 172.21.15.17:0/3706545204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 msgr2=0x7f516019f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 0x7f516019f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 -- 172.21.15.17:0/3706545204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516019f750 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f516487a640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f51580324c0 tx=0x7f5158032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158041020 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5158034cd0 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516019f9e0 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.050+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158039040 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.051+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516019fed0 con 0x7f51601006e0 2024-03-16T10:50:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.052+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51601a00a0 con 0x7f51601006e0 2024-03-16T10:50:52.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.053+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 137290+0+0 (secure 0 0 0) 0x7f5158044020 con 0x7f51601006e0 2024-03-16T10:50:52.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.053+0000 7f515dffb640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 0x7f514c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.054+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f51580f0c30 con 0x7f51601006e0 2024-03-16T10:50:52.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.054+0000 7f515ffff640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 0x7f514c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.054+0000 7f515ffff640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 0x7f514c0a4cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5160199040 tx=0x7f5150005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.058+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f515804b020 con 0x7f51601006e0 2024-03-16T10:50:52.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.228+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f5158003970 con 0x7f51601006e0 2024-03-16T10:50:52.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.254+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51601a0270 con 0x7f51601006e0 2024-03-16T10:50:52.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.255+0000 7f515dffb640 1 -- 172.21.15.17:0/3706545204 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f51580bde00 con 0x7f51601006e0 2024-03-16T10:50:52.255 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:52.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 msgr2=0x7f514c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 0x7f514c0a4cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5160199040 tx=0x7f5150005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 msgr2=0x7f5160197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f51580324c0 tx=0x7f5158032f40 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 shutdown_connections 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f514c0a2800 0x7f514c0a4cc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5160102290 0x7f516019f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51601018d0 0x7f5160198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 --2- 172.21.15.17:0/3706545204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51601006e0 0x7f5160197b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 >> 172.21.15.17:0/3706545204 conn(0x7f51600fbc70 msgr2=0x7f51600fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 shutdown_connections 2024-03-16T10:50:52.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.257+0000 7f5166ade640 1 -- 172.21.15.17:0/3706545204 wait complete. 2024-03-16T10:50:52.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 -- 172.21.15.17:0/1011100269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44102290 msgr2=0x7f8d44108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 --2- 172.21.15.17:0/1011100269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44102290 0x7f8d44108b20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009ca0 tx=0x7f8d3c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 -- 172.21.15.17:0/1011100269 shutdown_connections 2024-03-16T10:50:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 --2- 172.21.15.17:0/1011100269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d44102290 0x7f8d44108b20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 --2- 172.21.15.17:0/1011100269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441018d0 0x7f8d44101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 --2- 172.21.15.17:0/1011100269 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d441006e0 0x7f8d44100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 -- 172.21.15.17:0/1011100269 >> 172.21.15.17:0/1011100269 conn(0x7f8d440fbc70 msgr2=0x7f8d440fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 -- 172.21.15.17:0/1011100269 shutdown_connections 2024-03-16T10:50:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.375+0000 7f8d4953b640 1 -- 172.21.15.17:0/1011100269 wait complete. 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 Processor -- start 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 -- start start 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 0x7f8d44197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 0x7f8d4419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4410c360 con 0x7f8d441018d0 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4410c1e0 con 0x7f8d44102290 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d4953b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4410c4e0 con 0x7f8d441006e0 2024-03-16T10:50:52.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d437fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 0x7f8d4419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42344/0 (socket says 172.21.15.17:42344) 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d427fc640 1 -- 172.21.15.17:0/3207337475 learned_addr learned my addr 172.21.15.17:0/3207337475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.376+0000 7f8d42ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 0x7f8d44197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 -- 172.21.15.17:0/3207337475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 msgr2=0x7f8d44197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 0x7f8d44197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 -- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 msgr2=0x7f8d441980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 -- 172.21.15.17:0/3207337475 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4419f730 con 0x7f8d44102290 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d42ffd640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 0x7f8d44197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d427fc640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d437fe640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 0x7f8d4419f0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c02c630 tx=0x7f8d3c032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c041020 con 0x7f8d44102290 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4419f9c0 con 0x7f8d44102290 2024-03-16T10:50:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3c034cd0 con 0x7f8d44102290 2024-03-16T10:50:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c039040 con 0x7f8d44102290 2024-03-16T10:50:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.377+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4419fed0 con 0x7f8d44102290 2024-03-16T10:50:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.378+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d441a0100 con 0x7f8d44102290 2024-03-16T10:50:52.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.379+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f8d3c044020 con 0x7f8d44102290 2024-03-16T10:50:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.380+0000 7f8d2bfff640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 0x7f8d2c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.380+0000 7f8d42ffd640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 0x7f8d2c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.380+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8d3c0f0bd0 con 0x7f8d44102290 2024-03-16T10:50:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.380+0000 7f8d42ffd640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 0x7f8d2c0a4d50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8d44101730 tx=0x7f8d34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.388+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8d3c04b020 con 0x7f8d44102290 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:52 smithi111 ceph-mon[36315]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:52 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:52 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:52 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3814352368' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:52 smithi174 ceph-mon[36202]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:52 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:52 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:50:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:52 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3814352368' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:52.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.571+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d441a03f0 con 0x7f8d44102290 2024-03-16T10:50:52.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.572+0000 7f8d2bfff640 1 -- 172.21.15.17:0/3207337475 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f8d3c0bdcb0 con 0x7f8d44102290 2024-03-16T10:50:52.573 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 msgr2=0x7f8d2c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 0x7f8d2c0a4d50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8d44101730 tx=0x7f8d34005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 msgr2=0x7f8d4419f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 0x7f8d4419f0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c02c630 tx=0x7f8d3c032f20 comp rx=0 tx=0).stop 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 shutdown_connections 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8d2c0a2890 0x7f8d2c0a4d50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d44102290 0x7f8d4419f0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d441018d0 0x7f8d441980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 --2- 172.21.15.17:0/3207337475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d441006e0 0x7f8d44197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 >> 172.21.15.17:0/3207337475 conn(0x7f8d440fbc70 msgr2=0x7f8d440fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 shutdown_connections 2024-03-16T10:50:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.575+0000 7f8d4953b640 1 -- 172.21.15.17:0/3207337475 wait complete. 2024-03-16T10:50:52.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:52 smithi017 ceph-mon[32078]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-03-16T10:50:52.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1432917448' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-16T10:50:52.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:52 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:50:52.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:52 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3814352368' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:52.590 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:52.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.696+0000 7f15fa663640 1 -- 172.21.15.17:0/1619034569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 msgr2=0x7f15f4108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.696+0000 7f15fa663640 1 --2- 172.21.15.17:0/1619034569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f4108b20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009ca0 tx=0x7f15ec02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.696+0000 7f15fa663640 1 -- 172.21.15.17:0/1619034569 shutdown_connections 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- 172.21.15.17:0/1619034569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f4108b20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- 172.21.15.17:0/1619034569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- 172.21.15.17:0/1619034569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f4100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- 172.21.15.17:0/1619034569 >> 172.21.15.17:0/1619034569 conn(0x7f15f40fbc70 msgr2=0x7f15f40fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- 172.21.15.17:0/1619034569 shutdown_connections 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- 172.21.15.17:0/1619034569 wait complete. 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 Processor -- start 2024-03-16T10:50:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- start start 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15f410c360 con 0x7f15f4102290 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f15f410c1e0 con 0x7f15f41018d0 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.697+0000 7f15fa663640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f15f410c4e0 con 0x7f15f41006e0 2024-03-16T10:50:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:39684/0 (socket says 172.21.15.17:39684) 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 -- 172.21.15.17:0/3383719650 learned_addr learned my addr 172.21.15.17:0/3383719650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42360/0 (socket says 172.21.15.17:42360) 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 -- 172.21.15.17:0/3383719650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 msgr2=0x7f15f4196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 -- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 msgr2=0x7f15f419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 -- 172.21.15.17:0/3383719650 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f419e5f0 con 0x7f15f41006e0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f37fe640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f8c00640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f3fff640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15e400e9c0 tx=0x7f15e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e400cd80 con 0x7f15f41006e0 2024-03-16T10:50:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f419e8e0 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e40035f0 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4010690 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.698+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f419ede0 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.699+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f4107a00 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.701+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f15e40037a0 con 0x7f15f41006e0 2024-03-16T10:50:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.701+0000 7f15f17fa640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 0x7f15e00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:52.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.701+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f15e40cef20 con 0x7f15f41006e0 2024-03-16T10:50:52.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.701+0000 7f15f37fe640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 0x7f15e00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:52.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.702+0000 7f15f37fe640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 0x7f15e00a4d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0095f0 tx=0x7f15dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:52.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.705+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f15e409bf60 con 0x7f15f41006e0 2024-03-16T10:50:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.886+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f15f402d340 con 0x7f15f41006e0 2024-03-16T10:50:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.886+0000 7f15f17fa640 1 -- 172.21.15.17:0/3383719650 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f15e409b860 con 0x7f15f41006e0 2024-03-16T10:50:52.887 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 msgr2=0x7f15e00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 0x7f15e00a4d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0095f0 tx=0x7f15dc005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 msgr2=0x7f15f41969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15e400e9c0 tx=0x7f15e400ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 shutdown_connections 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f15e00a2890 0x7f15e00a4d50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f4102290 0x7f15f419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15f41018d0 0x7f15f4196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 --2- 172.21.15.17:0/3383719650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15f41006e0 0x7f15f41969d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 >> 172.21.15.17:0/3383719650 conn(0x7f15f40fbc70 msgr2=0x7f15f4104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.888+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 shutdown_connections 2024-03-16T10:50:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:52.889+0000 7f15fa663640 1 -- 172.21.15.17:0/3383719650 wait complete. 2024-03-16T10:50:52.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:53.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2442235909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100720 msgr2=0x7fc6c8100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2442235909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100720 0x7fc6c8100b40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009900 tx=0x7fc6c002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:53.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2442235909 shutdown_connections 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2442235909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c81022d0 0x7fc6c8108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2442235909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 0x7fc6c8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2442235909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100720 0x7fc6c8100b40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2442235909 >> 172.21.15.17:0/2442235909 conn(0x7fc6c80fbc90 msgr2=0x7fc6c80fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2442235909 shutdown_connections 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.022+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2442235909 wait complete. 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 Processor -- start 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 -- start start 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 0x7fc6c81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 0x7fc6c819f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810d4c0 con 0x7fc6c81022d0 2024-03-16T10:50:53.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810d340 con 0x7fc6c8100720 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cf89a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810d640 con 0x7fc6c8101910 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cd636640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cde37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 0x7fc6c819f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cd636640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:47700/0 (socket says 172.21.15.17:47700) 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cd636640 1 -- 172.21.15.17:0/2469873519 learned_addr learned my addr 172.21.15.17:0/2469873519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.023+0000 7fc6cce35640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 0x7fc6c81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 -- 172.21.15.17:0/2469873519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 msgr2=0x7fc6c81980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 0x7fc6c81980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 -- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 msgr2=0x7fc6c819f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 0x7fc6c819f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 -- 172.21.15.17:0/2469873519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c819f7a0 con 0x7fc6c8100720 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cde37640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 0x7fc6c819f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cd636640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c002c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0041070 con 0x7fc6c8100720 2024-03-16T10:50:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c819fa30 con 0x7fc6c8100720 2024-03-16T10:50:53.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c0004450 con 0x7fc6c8100720 2024-03-16T10:50:53.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0003df0 con 0x7fc6c8100720 2024-03-16T10:50:53.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.024+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c819ff70 con 0x7fc6c8100720 2024-03-16T10:50:53.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.025+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c8107a60 con 0x7fc6c8100720 2024-03-16T10:50:53.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.027+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fc6c0044070 con 0x7fc6c8100720 2024-03-16T10:50:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.027+0000 7fc6be7fc640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 0x7fc6b40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.028+0000 7fc6cce35640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 0x7fc6b40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.028+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc6c00f07c0 con 0x7fc6c8100720 2024-03-16T10:50:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.028+0000 7fc6cce35640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 0x7fc6b40a4d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8199090 tx=0x7fc6b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.035+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fc6c00bd8a0 con 0x7fc6c8100720 2024-03-16T10:50:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.231+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6c802d360 con 0x7fc6c8100720 2024-03-16T10:50:53.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.239+0000 7fc6be7fc640 1 -- 172.21.15.17:0/2469873519 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fc6c00bd1a0 con 0x7fc6c8100720 2024-03-16T10:50:53.240 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:53.240 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 msgr2=0x7fc6b40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 0x7fc6b40a4d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8199090 tx=0x7fc6b8005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 msgr2=0x7fc6c8197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000c00 tx=0x7fc6c002c640 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 shutdown_connections 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc6b40a2890 0x7fc6b40a4d50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c81022d0 0x7fc6c819f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc6c8101910 0x7fc6c81980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 --2- 172.21.15.17:0/2469873519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6c8100720 0x7fc6c8197b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 >> 172.21.15.17:0/2469873519 conn(0x7fc6c80fbc90 msgr2=0x7fc6c8104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 shutdown_connections 2024-03-16T10:50:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.242+0000 7fc6cf89a640 1 -- 172.21.15.17:0/2469873519 wait complete. 2024-03-16T10:50:53.257 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:53.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 -- 172.21.15.17:0/935177126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 msgr2=0x7f1ed81046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 --2- 172.21.15.17:0/935177126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed81046f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009860 tx=0x7f1ec802bb70 comp rx=0 tx=0).stop 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 -- 172.21.15.17:0/935177126 shutdown_connections 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 --2- 172.21.15.17:0/935177126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8107560 0x7f1ed8109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 --2- 172.21.15.17:0/935177126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8104c30 0x7f1ed8107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 --2- 172.21.15.17:0/935177126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed81046f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 -- 172.21.15.17:0/935177126 >> 172.21.15.17:0/935177126 conn(0x7f1ed80fbc70 msgr2=0x7f1ed80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 -- 172.21.15.17:0/935177126 shutdown_connections 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 -- 172.21.15.17:0/935177126 wait complete. 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.364+0000 7f1eddc59640 1 Processor -- start 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 -- start start 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed8101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8104c30 0x7f1ed81002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed810d450 con 0x7f1ed8107560 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed810d2d0 con 0x7f1ed8102300 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1eddc59640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed810d5d0 con 0x7f1ed8104c30 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed8101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42388/0 (socket says 172.21.15.17:42388) 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed7fff640 1 -- 172.21.15.17:0/2243265640 learned_addr learned my addr 172.21.15.17:0/2243265640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed6ffd640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8104c30 0x7f1ed81002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 -- 172.21.15.17:0/2243265640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8104c30 msgr2=0x7f1ed81002b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8104c30 0x7f1ed81002b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 -- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 msgr2=0x7f1ed81007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 -- 172.21.15.17:0/2243265640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8101080 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed7fff640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.365+0000 7f1ed77fe640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed8101c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802c0b0 tx=0x7f1ec8032430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.366+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8041020 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.366+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec802c9f0 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.366+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81a1c20 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.366+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8039040 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.366+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81a21c0 con 0x7f1ed8102300 2024-03-16T10:50:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.367+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed80fd760 con 0x7f1ed8102300 2024-03-16T10:50:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.368+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f1ec8044020 con 0x7f1ed8102300 2024-03-16T10:50:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.369+0000 7f1ed4ff9640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 0x7f1ec00a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.369+0000 7f1ed6ffd640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 0x7f1ec00a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.369+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f1ec80f0590 con 0x7f1ed8102300 2024-03-16T10:50:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.369+0000 7f1ed6ffd640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 0x7f1ec00a4dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ed81019e0 tx=0x7f1ecc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.376+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f1ec804b020 con 0x7f1ed8102300 2024-03-16T10:50:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:53 smithi174 ceph-mon[36202]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:53 smithi174 ceph-mon[36202]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-16T10:50:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:53 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3706545204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:53 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3207337475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:53 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3383719650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.588+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ed802d340 con 0x7f1ed8102300 2024-03-16T10:50:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.589+0000 7f1ed4ff9640 1 -- 172.21.15.17:0/2243265640 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f1ec80bd760 con 0x7f1ed8102300 2024-03-16T10:50:53.589 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:53.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:53 smithi017 ceph-mon[32078]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:53 smithi017 ceph-mon[32078]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-16T10:50:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:53 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3706545204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:53 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3207337475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:53 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3383719650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.591+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 msgr2=0x7f1ec00a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.591+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 0x7f1ec00a4dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ed81019e0 tx=0x7f1ecc009260 comp rx=0 tx=0).stop 2024-03-16T10:50:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.591+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 msgr2=0x7f1ed8101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.591+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed8101c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802c0b0 tx=0x7f1ec8032430 comp rx=0 tx=0).stop 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 shutdown_connections 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1ec00a2910 0x7f1ec00a4dd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ed8107560 0x7f1ed81007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ed8104c30 0x7f1ed81002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 --2- 172.21.15.17:0/2243265640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ed8102300 0x7f1ed8101c70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 >> 172.21.15.17:0/2243265640 conn(0x7f1ed80fbc70 msgr2=0x7f1ed8102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 shutdown_connections 2024-03-16T10:50:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.592+0000 7f1eddc59640 1 -- 172.21.15.17:0/2243265640 wait complete. 2024-03-16T10:50:53.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:53 smithi111 ceph-mon[36315]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-03-16T10:50:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:53 smithi111 ceph-mon[36315]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-16T10:50:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:53 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3706545204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:53 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3207337475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:53 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3383719650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3522343019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1018d0 msgr2=0x7f87cc101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3522343019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1018d0 0x7f87cc101d50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009900 tx=0x7f87bc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3522343019 shutdown_connections 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3522343019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 0x7f87cc108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3522343019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1018d0 0x7f87cc101d50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3522343019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1006e0 0x7f87cc100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3522343019 >> 172.21.15.17:0/3522343019 conn(0x7f87cc0fbc70 msgr2=0x7f87cc0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3522343019 shutdown_connections 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3522343019 wait complete. 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.710+0000 7f87d1f5b640 1 Processor -- start 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 -- start start 2024-03-16T10:50:53.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1018d0 0x7f87cc198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 0x7f87cc19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc10d480 con 0x7f87cc1006e0 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc10d300 con 0x7f87cc102290 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87d1f5b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc10d600 con 0x7f87cc1018d0 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42396/0 (socket says 172.21.15.17:42396) 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 -- 172.21.15.17:0/3143237008 learned_addr learned my addr 172.21.15.17:0/3143237008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87caffd640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1018d0 0x7f87cc198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cbfff640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 0x7f87cc19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 -- 172.21.15.17:0/3143237008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1018d0 msgr2=0x7f87cc198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1018d0 0x7f87cc198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 -- 172.21.15.17:0/3143237008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 msgr2=0x7f87cc19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 0x7f87cc19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 -- 172.21.15.17:0/3143237008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc19f740 con 0x7f87cc1006e0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.711+0000 7f87cb7fe640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e9c0 tx=0x7f87b400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.712+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400cd80 con 0x7f87cc1006e0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.712+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b4010910 con 0x7f87cc1006e0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.712+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc19fa30 con 0x7f87cc1006e0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.712+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4018950 con 0x7f87cc1006e0 2024-03-16T10:50:53.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.712+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc19ff50 con 0x7f87cc1006e0 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.713+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc107a20 con 0x7f87cc1006e0 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.714+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f87b401f020 con 0x7f87cc1006e0 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.714+0000 7f87c8ff9640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 0x7f87b80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.714+0000 7f87caffd640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 0x7f87b80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.714+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f87b40cebb0 con 0x7f87cc1006e0 2024-03-16T10:50:53.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.715+0000 7f87caffd640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 0x7f87b80a4d50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87bc02c7b0 tx=0x7f87bc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:53.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.720+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f87b40d5080 con 0x7f87cc1006e0 2024-03-16T10:50:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.932+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f87cc02d430 con 0x7f87cc1006e0 2024-03-16T10:50:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.933+0000 7f87c8ff9640 1 -- 172.21.15.17:0/3143237008 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f87b409bbf0 con 0x7f87cc1006e0 2024-03-16T10:50:53.933 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 msgr2=0x7f87b80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 0x7f87b80a4d50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87bc02c7b0 tx=0x7f87bc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 msgr2=0x7f87cc197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e9c0 tx=0x7f87b400edc0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 shutdown_connections 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87b80a2890 0x7f87b80a4d50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87cc102290 0x7f87cc19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87cc1018d0 0x7f87cc198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 --2- 172.21.15.17:0/3143237008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87cc1006e0 0x7f87cc197b20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 >> 172.21.15.17:0/3143237008 conn(0x7f87cc0fbc70 msgr2=0x7f87cc104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 shutdown_connections 2024-03-16T10:50:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:53.935+0000 7f87d1f5b640 1 -- 172.21.15.17:0/3143237008 wait complete. 2024-03-16T10:50:53.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:54.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.056+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3695778314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 msgr2=0x7f1abc101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.056+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3695778314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc101d50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009900 tx=0x7f1ab002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3695778314 shutdown_connections 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3695778314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3695778314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc101d50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3695778314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 0x7f1abc100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3695778314 >> 172.21.15.17:0/3695778314 conn(0x7f1abc0fbc70 msgr2=0x7f1abc0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3695778314 shutdown_connections 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3695778314 wait complete. 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 Processor -- start 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- start start 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 0x7f1abc197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10c340 con 0x7f1abc1018d0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10c1c0 con 0x7f1abc102290 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.057+0000 7f1ac1bb9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10c4c0 con 0x7f1abc1006e0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42410/0 (socket says 172.21.15.17:42410) 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 -- 172.21.15.17:0/3005893289 learned_addr learned my addr 172.21.15.17:0/3005893289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abb7fe640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 0x7f1abc197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abbfff640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 -- 172.21.15.17:0/3005893289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 msgr2=0x7f1abc197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 0x7f1abc197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 -- 172.21.15.17:0/3005893289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 msgr2=0x7f1abc19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 -- 172.21.15.17:0/3005893289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc19f780 con 0x7f1abc1018d0 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abbfff640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:54.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1abaffd640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0041070 con 0x7f1abc1018d0 2024-03-16T10:50:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc19fa10 con 0x7f1abc1018d0 2024-03-16T10:50:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ab0004450 con 0x7f1abc1018d0 2024-03-16T10:50:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0003e20 con 0x7f1abc1018d0 2024-03-16T10:50:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.058+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc19ff00 con 0x7f1abc1018d0 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.059+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc1a0130 con 0x7f1abc1018d0 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.060+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f1ab0044070 con 0x7f1abc1018d0 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.061+0000 7f1ab8ff9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 0x7f1aa40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.061+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f1ab00f0560 con 0x7f1abc1018d0 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.061+0000 7f1abb7fe640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 0x7f1aa40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.061+0000 7f1abb7fe640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 0x7f1aa40a4d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0099a0 tx=0x7f1aac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.065+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f1ab00bd060 con 0x7f1abc1018d0 2024-03-16T10:50:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.248+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1abc1a0300 con 0x7f1abc1018d0 2024-03-16T10:50:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.248+0000 7f1ab8ff9640 1 -- 172.21.15.17:0/3005893289 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f1ab00c1100 con 0x7f1abc1018d0 2024-03-16T10:50:54.249 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 msgr2=0x7f1aa40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 0x7f1aa40a4d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0099a0 tx=0x7f1aac009500 comp rx=0 tx=0).stop 2024-03-16T10:50:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 msgr2=0x7f1abc1980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab002c650 comp rx=0 tx=0).stop 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 shutdown_connections 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f1aa40a2890 0x7f1aa40a4d50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1abc102290 0x7f1abc19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1abc1018d0 0x7f1abc1980a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 --2- 172.21.15.17:0/3005893289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1abc1006e0 0x7f1abc197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.250+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 >> 172.21.15.17:0/3005893289 conn(0x7f1abc0fbc70 msgr2=0x7f1abc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.251+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 shutdown_connections 2024-03-16T10:50:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.251+0000 7f1ac1bb9640 1 -- 172.21.15.17:0/3005893289 wait complete. 2024-03-16T10:50:54.262 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-16T10:50:54.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:54.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 -- 172.21.15.17:0/1925771683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf4102a20 msgr2=0x7f2bf4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/1925771683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf4102a20 0x7f2bf4102ea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009ca0 tx=0x7f2be802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 -- 172.21.15.17:0/1925771683 shutdown_connections 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/1925771683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf41033e0 0x7f2bf4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/1925771683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf4102a20 0x7f2bf4102ea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/1925771683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4101830 0x7f2bf4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 -- 172.21.15.17:0/1925771683 >> 172.21.15.17:0/1925771683 conn(0x7f2bf40fcd80 msgr2=0x7f2bf40ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.365+0000 7f2bf95f3640 1 -- 172.21.15.17:0/1925771683 shutdown_connections 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 -- 172.21.15.17:0/1925771683 wait complete. 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 Processor -- start 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 -- start start 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf4101830 0x7f2bf4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4102a20 0x7f2bf4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410d4b0 con 0x7f2bf41033e0 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410d330 con 0x7f2bf4101830 2024-03-16T10:50:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf95f3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410d630 con 0x7f2bf4102a20 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.366+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42424/0 (socket says 172.21.15.17:42424) 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 -- 172.21.15.17:0/969015864 learned_addr learned my addr 172.21.15.17:0/969015864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf2ffd640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf4101830 0x7f2bf4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf27fc640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4102a20 0x7f2bf4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 -- 172.21.15.17:0/969015864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4102a20 msgr2=0x7f2bf4198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4102a20 0x7f2bf4198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 -- 172.21.15.17:0/969015864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf4101830 msgr2=0x7f2bf4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf4101830 0x7f2bf4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 -- 172.21.15.17:0/969015864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf419f770 con 0x7f2bf41033e0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf37fe640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e970 tx=0x7f2be400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be400ccc0 con 0x7f2bf41033e0 2024-03-16T10:50:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be400ce60 con 0x7f2bf41033e0 2024-03-16T10:50:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf419fa60 con 0x7f2bf41033e0 2024-03-16T10:50:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4010490 con 0x7f2bf41033e0 2024-03-16T10:50:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.367+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf419ff80 con 0x7f2bf41033e0 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.368+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf4108b50 con 0x7f2bf41033e0 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.369+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f2be4005020 con 0x7f2bf41033e0 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.370+0000 7f2bdbfff640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 0x7f2bdc0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.370+0000 7f2bf2ffd640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 0x7f2bdc0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.370+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f2be40ceef0 con 0x7f2bf41033e0 2024-03-16T10:50:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.371+0000 7f2bf2ffd640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 0x7f2bdc0a4dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4102880 tx=0x7f2bec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.375+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f2be409bf30 con 0x7f2bf41033e0 2024-03-16T10:50:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:54 smithi174 ceph-mon[36202]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2469873519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2243265640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:54 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3143237008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:54 smithi017 ceph-mon[32078]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2469873519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2243265640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:54 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3143237008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.604+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bf402d1b0 con 0x7f2bf41033e0 2024-03-16T10:50:54.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.605+0000 7f2bdbfff640 1 -- 172.21.15.17:0/969015864 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11935 (secure 0 0 0) 0x7f2be409b830 con 0x7f2bf41033e0 2024-03-16T10:50:54.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:54.606 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:50:51.056785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[14655,24497,24470,24493,24536]},"id":1}]} 2024-03-16T10:50:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 msgr2=0x7f2bdc0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 0x7f2bdc0a4dd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4102880 tx=0x7f2bec005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 msgr2=0x7f2bf419f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e970 tx=0x7f2be400ed70 comp rx=0 tx=0).stop 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 shutdown_connections 2024-03-16T10:50:54.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2bdc0a2910 0x7f2bdc0a4dd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bf41033e0 0x7f2bf419f100 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf4102a20 0x7f2bf4198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 --2- 172.21.15.17:0/969015864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2bf4101830 0x7f2bf4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.607+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 >> 172.21.15.17:0/969015864 conn(0x7f2bf40fcd80 msgr2=0x7f2bf4105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.608+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 shutdown_connections 2024-03-16T10:50:54.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.608+0000 7f2bf95f3640 1 -- 172.21.15.17:0/969015864 wait complete. 2024-03-16T10:50:54.622 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-16T10:50:54.622 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-16T10:50:54.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T10:50:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:54 smithi111 ceph-mon[36315]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-16T10:50:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2469873519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2243265640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:54 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3143237008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:54.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 -- 172.21.15.17:0/1976213290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 msgr2=0x7fe3d4109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/1976213290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d4109c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009ca0 tx=0x7fe3cc02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 -- 172.21.15.17:0/1976213290 shutdown_connections 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/1976213290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d4109c40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/1976213290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d41029f0 0x7fe3d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/1976213290 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d4101800 0x7fe3d4101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.728+0000 7fe3d94ff640 1 -- 172.21.15.17:0/1976213290 >> 172.21.15.17:0/1976213290 conn(0x7fe3d40fcd90 msgr2=0x7fe3d40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- 172.21.15.17:0/1976213290 shutdown_connections 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- 172.21.15.17:0/1976213290 wait complete. 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 Processor -- start 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- start start 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d4101800 0x7fe3d4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 0x7fe3d4198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d410d480 con 0x7fe3d41033b0 2024-03-16T10:50:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d410d300 con 0x7fe3d41029f0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d94ff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d410d600 con 0x7fe3d4101800 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 0x7fe3d4198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42446/0 (socket says 172.21.15.17:42446) 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d37fe640 1 -- 172.21.15.17:0/917661388 learned_addr learned my addr 172.21.15.17:0/917661388 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.729+0000 7fe3d2ffd640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d4101800 0x7fe3d4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 -- 172.21.15.17:0/917661388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d4101800 msgr2=0x7fe3d4197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d4101800 0x7fe3d4197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 -- 172.21.15.17:0/917661388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 msgr2=0x7fe3d4198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 0x7fe3d4198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 -- 172.21.15.17:0/917661388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d419f750 con 0x7fe3d41033b0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3cbfff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 0x7fe3d4198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d37fe640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc032530 tx=0x7fe3cc032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc041020 con 0x7fe3d41033b0 2024-03-16T10:50:54.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3cc034cd0 con 0x7fe3d41033b0 2024-03-16T10:50:54.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d419f9e0 con 0x7fe3d41033b0 2024-03-16T10:50:54.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc039040 con 0x7fe3d41033b0 2024-03-16T10:50:54.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.730+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d419fef0 con 0x7fe3d41033b0 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.731+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4108ac0 con 0x7fe3d41033b0 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.732+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fe3cc044020 con 0x7fe3d41033b0 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.733+0000 7fe3d0ff9640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 0x7fe3c00a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.733+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe3cc0f0730 con 0x7fe3d41033b0 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.733+0000 7fe3d2ffd640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 0x7fe3c00a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:54.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.733+0000 7fe3d2ffd640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 0x7fe3c00a4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4102850 tx=0x7fe3c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:54.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.737+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe3cc04b020 con 0x7fe3d41033b0 2024-03-16T10:50:54.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.930+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3d4061c20 con 0x7fe3c00a2910 2024-03-16T10:50:54.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.937+0000 7fe3d0ff9640 1 -- 172.21.15.17:0/917661388 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259107 (secure 0 0 0) 0x7fe3d4061c20 con 0x7fe3c00a2910 2024-03-16T10:50:54.941 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:54.942 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:50:54.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 msgr2=0x7fe3c00a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 0x7fe3c00a4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4102850 tx=0x7fe3c4005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 msgr2=0x7fe3d419f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc032530 tx=0x7fe3cc032f20 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 shutdown_connections 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe3c00a2910 0x7fe3c00a4dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d41033b0 0x7fe3d419f0e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3d41029f0 0x7fe3d4198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 --2- 172.21.15.17:0/917661388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3d4101800 0x7fe3d4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 >> 172.21.15.17:0/917661388 conn(0x7fe3d40fcd90 msgr2=0x7fe3d4105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 shutdown_connections 2024-03-16T10:50:54.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:54.940+0000 7fe3d94ff640 1 -- 172.21.15.17:0/917661388 wait complete. 2024-03-16T10:50:54.952 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-03-16T10:50:54.511188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659691,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":781,"num_write":435,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373332,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568492,"statfs":{"total":1151940427776,"available":1151558135808,"internally_reserved":0,"allocated":11980800,"data_stored":7444673,"data_compressed":113883,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002827"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516969+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:50:10.516969+0000","last_peered":"2024-03-16T10:50:10.516969+0000","last_clean":"2024-03-16T10:50:10.516969+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:50:10.516969+0000","last_undegraded":"2024-03-16T10:50:10.516969+0000","last_fullsized":"2024-03-16T10:50:10.516969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511591+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:50:10.511591+0000","last_peered":"2024-03-16T10:50:10.511591+0000","last_clean":"2024-03-16T10:50:10.511591+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:50:10.511591+0000","last_undegraded":"2024-03-16T10:50:10.511591+0000","last_fullsized":"2024-03-16T10:50:10.511591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509559+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:50:10.509559+0000","last_peered":"2024-03-16T10:50:10.509559+0000","last_clean":"2024-03-16T10:50:10.509559+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:50:10.509559+0000","last_undegraded":"2024-03-16T10:50:10.509559+0000","last_fullsized":"2024-03-16T10:50:10.509559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.493922+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:50:10.493922+0000","last_peered":"2024-03-16T10:50:10.493922+0000","last_clean":"2024-03-16T10:50:10.493922+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:50:10.493922+0000","last_undegraded":"2024-03-16T10:50:10.493922+0000","last_fullsized":"2024-03-16T10:50:10.493922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490292+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:50:10.490292+0000","last_peered":"2024-03-16T10:50:10.490292+0000","last_clean":"2024-03-16T10:50:10.490292+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:50:10.490292+0000","last_undegraded":"2024-03-16T10:50:10.490292+0000","last_fullsized":"2024-03-16T10:50:10.490292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495543+0000","last_change":"2024-03-16T10:49:42.791331+0000","last_active":"2024-03-16T10:50:10.495543+0000","last_peered":"2024-03-16T10:50:10.495543+0000","last_clean":"2024-03-16T10:50:10.495543+0000","last_became_active":"2024-03-16T10:49:42.791066+0000","last_became_peered":"2024-03-16T10:49:42.791066+0000","last_unstale":"2024-03-16T10:50:10.495543+0000","last_undegraded":"2024-03-16T10:50:10.495543+0000","last_fullsized":"2024-03-16T10:50:10.495543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:01.493249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510080+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:50:10.510080+0000","last_peered":"2024-03-16T10:50:10.510080+0000","last_clean":"2024-03-16T10:50:10.510080+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:50:10.510080+0000","last_undegraded":"2024-03-16T10:50:10.510080+0000","last_fullsized":"2024-03-16T10:50:10.510080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509893+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:50:10.509893+0000","last_peered":"2024-03-16T10:50:10.509893+0000","last_clean":"2024-03-16T10:50:10.509893+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:50:10.509893+0000","last_undegraded":"2024-03-16T10:50:10.509893+0000","last_fullsized":"2024-03-16T10:50:10.509893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521146+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:50:10.521146+0000","last_peered":"2024-03-16T10:50:10.521146+0000","last_clean":"2024-03-16T10:50:10.521146+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:50:10.521146+0000","last_undegraded":"2024-03-16T10:50:10.521146+0000","last_fullsized":"2024-03-16T10:50:10.521146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506780+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:50:10.506780+0000","last_peered":"2024-03-16T10:50:10.506780+0000","last_clean":"2024-03-16T10:50:10.506780+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:50:10.506780+0000","last_undegraded":"2024-03-16T10:50:10.506780+0000","last_fullsized":"2024-03-16T10:50:10.506780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521048+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:50:10.521048+0000","last_peered":"2024-03-16T10:50:10.521048+0000","last_clean":"2024-03-16T10:50:10.521048+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:50:10.521048+0000","last_undegraded":"2024-03-16T10:50:10.521048+0000","last_fullsized":"2024-03-16T10:50:10.521048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510658+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:50:10.510658+0000","last_peered":"2024-03-16T10:50:10.510658+0000","last_clean":"2024-03-16T10:50:10.510658+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:50:10.510658+0000","last_undegraded":"2024-03-16T10:50:10.510658+0000","last_fullsized":"2024-03-16T10:50:10.510658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495010+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:50:10.495010+0000","last_peered":"2024-03-16T10:50:10.495010+0000","last_clean":"2024-03-16T10:50:10.495010+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:50:10.495010+0000","last_undegraded":"2024-03-16T10:50:10.495010+0000","last_fullsized":"2024-03-16T10:50:10.495010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509792+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:50:10.509792+0000","last_peered":"2024-03-16T10:50:10.509792+0000","last_clean":"2024-03-16T10:50:10.509792+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:50:10.509792+0000","last_undegraded":"2024-03-16T10:50:10.509792+0000","last_fullsized":"2024-03-16T10:50:10.509792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509076+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:50:10.509076+0000","last_peered":"2024-03-16T10:50:10.509076+0000","last_clean":"2024-03-16T10:50:10.509076+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:50:10.509076+0000","last_undegraded":"2024-03-16T10:50:10.509076+0000","last_fullsized":"2024-03-16T10:50:10.509076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521982+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:50:10.521982+0000","last_peered":"2024-03-16T10:50:10.521982+0000","last_clean":"2024-03-16T10:50:10.521982+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:50:10.521982+0000","last_undegraded":"2024-03-16T10:50:10.521982+0000","last_fullsized":"2024-03-16T10:50:10.521982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.517221+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:50:10.517221+0000","last_peered":"2024-03-16T10:50:10.517221+0000","last_clean":"2024-03-16T10:50:10.517221+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:50:10.517221+0000","last_undegraded":"2024-03-16T10:50:10.517221+0000","last_fullsized":"2024-03-16T10:50:10.517221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.512884+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:50:10.512884+0000","last_peered":"2024-03-16T10:50:10.512884+0000","last_clean":"2024-03-16T10:50:10.512884+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:50:10.512884+0000","last_undegraded":"2024-03-16T10:50:10.512884+0000","last_fullsized":"2024-03-16T10:50:10.512884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.497510+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:50:10.497510+0000","last_peered":"2024-03-16T10:50:10.497510+0000","last_clean":"2024-03-16T10:50:10.497510+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:50:10.497510+0000","last_undegraded":"2024-03-16T10:50:10.497510+0000","last_fullsized":"2024-03-16T10:50:10.497510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.200945+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:50:50.200945+0000","last_peered":"2024-03-16T10:50:50.200945+0000","last_clean":"2024-03-16T10:50:50.200945+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:50:50.200945+0000","last_undegraded":"2024-03-16T10:50:50.200945+0000","last_fullsized":"2024-03-16T10:50:50.200945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508015+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:50:10.508015+0000","last_peered":"2024-03-16T10:50:10.508015+0000","last_clean":"2024-03-16T10:50:10.508015+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:50:10.508015+0000","last_undegraded":"2024-03-16T10:50:10.508015+0000","last_fullsized":"2024-03-16T10:50:10.508015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272187+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:49:42.272187+0000","last_peered":"2024-03-16T10:49:42.272187+0000","last_clean":"2024-03-16T10:49:42.272187+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:49:42.272187+0000","last_undegraded":"2024-03-16T10:49:42.272187+0000","last_fullsized":"2024-03-16T10:49:42.272187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509461+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:50:10.509461+0000","last_peered":"2024-03-16T10:50:10.509461+0000","last_clean":"2024-03-16T10:50:10.509461+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:50:10.509461+0000","last_undegraded":"2024-03-16T10:50:10.509461+0000","last_fullsized":"2024-03-16T10:50:10.509461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"87'13","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275821+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:49:42.275821+0000","last_peered":"2024-03-16T10:49:42.275821+0000","last_clean":"2024-03-16T10:49:42.275821+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:49:42.275821+0000","last_undegraded":"2024-03-16T10:49:42.275821+0000","last_fullsized":"2024-03-16T10:49:42.275821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522168+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:50:10.522168+0000","last_peered":"2024-03-16T10:50:10.522168+0000","last_clean":"2024-03-16T10:50:10.522168+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:50:10.522168+0000","last_undegraded":"2024-03-16T10:50:10.522168+0000","last_fullsized":"2024-03-16T10:50:10.522168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.282326+0000","last_change":"2024-03-16T10:49:42.282326+0000","last_active":"2024-03-16T10:49:42.282326+0000","last_peered":"2024-03-16T10:49:42.282326+0000","last_clean":"2024-03-16T10:49:42.282326+0000","last_became_active":"2024-03-16T10:49:42.277256+0000","last_became_peered":"2024-03-16T10:49:42.277256+0000","last_unstale":"2024-03-16T10:49:42.282326+0000","last_undegraded":"2024-03-16T10:49:42.282326+0000","last_fullsized":"2024-03-16T10:49:42.282326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:18.193268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516615+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:50:10.516615+0000","last_peered":"2024-03-16T10:50:10.516615+0000","last_clean":"2024-03-16T10:50:10.516615+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:50:10.516615+0000","last_undegraded":"2024-03-16T10:50:10.516615+0000","last_fullsized":"2024-03-16T10:50:10.516615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:48.295938+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:50:48.295938+0000","last_peered":"2024-03-16T10:50:48.295938+0000","last_clean":"2024-03-16T10:50:48.295938+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:50:48.295938+0000","last_undegraded":"2024-03-16T10:50:48.295938+0000","last_fullsized":"2024-03-16T10:50:48.295938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490396+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:50:10.490396+0000","last_peered":"2024-03-16T10:50:10.490396+0000","last_clean":"2024-03-16T10:50:10.490396+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:50:10.490396+0000","last_undegraded":"2024-03-16T10:50:10.490396+0000","last_fullsized":"2024-03-16T10:50:10.490396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274044+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:49:42.274044+0000","last_peered":"2024-03-16T10:49:42.274044+0000","last_clean":"2024-03-16T10:49:42.274044+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:49:42.274044+0000","last_undegraded":"2024-03-16T10:49:42.274044+0000","last_fullsized":"2024-03-16T10:49:42.274044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502515+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:50:10.502515+0000","last_peered":"2024-03-16T10:50:10.502515+0000","last_clean":"2024-03-16T10:50:10.502515+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:50:10.502515+0000","last_undegraded":"2024-03-16T10:50:10.502515+0000","last_fullsized":"2024-03-16T10:50:10.502515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274332+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:49:42.274332+0000","last_peered":"2024-03-16T10:49:42.274332+0000","last_clean":"2024-03-16T10:49:42.274332+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:49:42.274332+0000","last_undegraded":"2024-03-16T10:49:42.274332+0000","last_fullsized":"2024-03-16T10:49:42.274332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503068+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:50:10.503068+0000","last_peered":"2024-03-16T10:50:10.503068+0000","last_clean":"2024-03-16T10:50:10.503068+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:50:10.503068+0000","last_undegraded":"2024-03-16T10:50:10.503068+0000","last_fullsized":"2024-03-16T10:50:10.503068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275292+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:49:42.275292+0000","last_peered":"2024-03-16T10:49:42.275292+0000","last_clean":"2024-03-16T10:49:42.275292+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:49:42.275292+0000","last_undegraded":"2024-03-16T10:49:42.275292+0000","last_fullsized":"2024-03-16T10:49:42.275292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.498981+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:50:10.498981+0000","last_peered":"2024-03-16T10:50:10.498981+0000","last_clean":"2024-03-16T10:50:10.498981+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:50:10.498981+0000","last_undegraded":"2024-03-16T10:50:10.498981+0000","last_fullsized":"2024-03-16T10:50:10.498981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":254,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296384+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:50:49.296384+0000","last_peered":"2024-03-16T10:50:49.296384+0000","last_clean":"2024-03-16T10:50:49.296384+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:50:49.296384+0000","last_undegraded":"2024-03-16T10:50:49.296384+0000","last_fullsized":"2024-03-16T10:50:49.296384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522515+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:50:10.522515+0000","last_peered":"2024-03-16T10:50:10.522515+0000","last_clean":"2024-03-16T10:50:10.522515+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:50:10.522515+0000","last_undegraded":"2024-03-16T10:50:10.522515+0000","last_fullsized":"2024-03-16T10:50:10.522515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275650+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:49:42.275650+0000","last_peered":"2024-03-16T10:49:42.275650+0000","last_clean":"2024-03-16T10:49:42.275650+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:49:42.275650+0000","last_undegraded":"2024-03-16T10:49:42.275650+0000","last_fullsized":"2024-03-16T10:49:42.275650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508883+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:50:10.508883+0000","last_peered":"2024-03-16T10:50:10.508883+0000","last_clean":"2024-03-16T10:50:10.508883+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:50:10.508883+0000","last_undegraded":"2024-03-16T10:50:10.508883+0000","last_fullsized":"2024-03-16T10:50:10.508883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275492+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:49:42.275492+0000","last_peered":"2024-03-16T10:49:42.275492+0000","last_clean":"2024-03-16T10:49:42.275492+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:49:42.275492+0000","last_undegraded":"2024-03-16T10:49:42.275492+0000","last_fullsized":"2024-03-16T10:49:42.275492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.519219+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:50:10.519219+0000","last_peered":"2024-03-16T10:50:10.519219+0000","last_clean":"2024-03-16T10:50:10.519219+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:50:10.519219+0000","last_undegraded":"2024-03-16T10:50:10.519219+0000","last_fullsized":"2024-03-16T10:50:10.519219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'33","reported_seq":290,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296382+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:50:49.296382+0000","last_peered":"2024-03-16T10:50:49.296382+0000","last_clean":"2024-03-16T10:50:49.296382+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:50:49.296382+0000","last_undegraded":"2024-03-16T10:50:49.296382+0000","last_fullsized":"2024-03-16T10:50:49.296382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":179,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513536+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:50:10.513536+0000","last_peered":"2024-03-16T10:50:10.513536+0000","last_clean":"2024-03-16T10:50:10.513536+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:50:10.513536+0000","last_undegraded":"2024-03-16T10:50:10.513536+0000","last_fullsized":"2024-03-16T10:50:10.513536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271826+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:49:42.271826+0000","last_peered":"2024-03-16T10:49:42.271826+0000","last_clean":"2024-03-16T10:49:42.271826+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:49:42.271826+0000","last_undegraded":"2024-03-16T10:49:42.271826+0000","last_fullsized":"2024-03-16T10:49:42.271826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514034+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:50:10.514034+0000","last_peered":"2024-03-16T10:50:10.514034+0000","last_clean":"2024-03-16T10:50:10.514034+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:50:10.514034+0000","last_undegraded":"2024-03-16T10:50:10.514034+0000","last_fullsized":"2024-03-16T10:50:10.514034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275782+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:49:42.275782+0000","last_peered":"2024-03-16T10:49:42.275782+0000","last_clean":"2024-03-16T10:49:42.275782+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:49:42.275782+0000","last_undegraded":"2024-03-16T10:49:42.275782+0000","last_fullsized":"2024-03-16T10:49:42.275782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.520279+0000","last_change":"2024-03-16T10:49:42.792180+0000","last_active":"2024-03-16T10:50:10.520279+0000","last_peered":"2024-03-16T10:50:10.520279+0000","last_clean":"2024-03-16T10:50:10.520279+0000","last_became_active":"2024-03-16T10:49:42.791813+0000","last_became_peered":"2024-03-16T10:49:42.791813+0000","last_unstale":"2024-03-16T10:50:10.520279+0000","last_undegraded":"2024-03-16T10:50:10.520279+0000","last_fullsized":"2024-03-16T10:50:10.520279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:48.571823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'7","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.297161+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:50:49.297161+0000","last_peered":"2024-03-16T10:50:49.297161+0000","last_clean":"2024-03-16T10:50:49.297161+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:50:49.297161+0000","last_undegraded":"2024-03-16T10:50:49.297161+0000","last_fullsized":"2024-03-16T10:50:49.297161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511547+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:50:10.511547+0000","last_peered":"2024-03-16T10:50:10.511547+0000","last_clean":"2024-03-16T10:50:10.511547+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:50:10.511547+0000","last_undegraded":"2024-03-16T10:50:10.511547+0000","last_fullsized":"2024-03-16T10:50:10.511547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275173+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:49:42.275173+0000","last_peered":"2024-03-16T10:49:42.275173+0000","last_clean":"2024-03-16T10:49:42.275173+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:49:42.275173+0000","last_undegraded":"2024-03-16T10:49:42.275173+0000","last_fullsized":"2024-03-16T10:49:42.275173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.515883+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:50:10.515883+0000","last_peered":"2024-03-16T10:50:10.515883+0000","last_clean":"2024-03-16T10:50:10.515883+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:50:10.515883+0000","last_undegraded":"2024-03-16T10:50:10.515883+0000","last_fullsized":"2024-03-16T10:50:10.515883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275702+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:49:42.275702+0000","last_peered":"2024-03-16T10:49:42.275702+0000","last_clean":"2024-03-16T10:49:42.275702+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:49:42.275702+0000","last_undegraded":"2024-03-16T10:49:42.275702+0000","last_fullsized":"2024-03-16T10:49:42.275702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503929+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:50:10.503929+0000","last_peered":"2024-03-16T10:50:10.503929+0000","last_clean":"2024-03-16T10:50:10.503929+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:50:10.503929+0000","last_undegraded":"2024-03-16T10:50:10.503929+0000","last_fullsized":"2024-03-16T10:50:10.503929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791042+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:49:42.791042+0000","last_peered":"2024-03-16T10:49:42.791042+0000","last_clean":"2024-03-16T10:49:42.791042+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:49:42.791042+0000","last_undegraded":"2024-03-16T10:49:42.791042+0000","last_fullsized":"2024-03-16T10:49:42.791042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509779+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:50:10.509779+0000","last_peered":"2024-03-16T10:50:10.509779+0000","last_clean":"2024-03-16T10:50:10.509779+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:50:10.509779+0000","last_undegraded":"2024-03-16T10:50:10.509779+0000","last_fullsized":"2024-03-16T10:50:10.509779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.301086+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:50:50.301086+0000","last_peered":"2024-03-16T10:50:50.301086+0000","last_clean":"2024-03-16T10:50:50.301086+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:50:50.301086+0000","last_undegraded":"2024-03-16T10:50:50.301086+0000","last_fullsized":"2024-03-16T10:50:50.301086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510526+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:50:10.510526+0000","last_peered":"2024-03-16T10:50:10.510526+0000","last_clean":"2024-03-16T10:50:10.510526+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:50:10.510526+0000","last_undegraded":"2024-03-16T10:50:10.510526+0000","last_fullsized":"2024-03-16T10:50:10.510526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502799+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:50:10.502799+0000","last_peered":"2024-03-16T10:50:10.502799+0000","last_clean":"2024-03-16T10:50:10.502799+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:50:10.502799+0000","last_undegraded":"2024-03-16T10:50:10.502799+0000","last_fullsized":"2024-03-16T10:50:10.502799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296858+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:50:49.296858+0000","last_peered":"2024-03-16T10:50:49.296858+0000","last_clean":"2024-03-16T10:50:49.296858+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:50:49.296858+0000","last_undegraded":"2024-03-16T10:50:49.296858+0000","last_fullsized":"2024-03-16T10:50:49.296858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513394+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:50:10.513394+0000","last_peered":"2024-03-16T10:50:10.513394+0000","last_clean":"2024-03-16T10:50:10.513394+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:50:10.513394+0000","last_undegraded":"2024-03-16T10:50:10.513394+0000","last_fullsized":"2024-03-16T10:50:10.513394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272073+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:49:42.272073+0000","last_peered":"2024-03-16T10:49:42.272073+0000","last_clean":"2024-03-16T10:49:42.272073+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:49:42.272073+0000","last_undegraded":"2024-03-16T10:49:42.272073+0000","last_fullsized":"2024-03-16T10:49:42.272073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274675+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:49:42.274675+0000","last_peered":"2024-03-16T10:49:42.274675+0000","last_clean":"2024-03-16T10:49:42.274675+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:49:42.274675+0000","last_undegraded":"2024-03-16T10:49:42.274675+0000","last_fullsized":"2024-03-16T10:49:42.274675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507559+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:50:10.507559+0000","last_peered":"2024-03-16T10:50:10.507559+0000","last_clean":"2024-03-16T10:50:10.507559+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:50:10.507559+0000","last_undegraded":"2024-03-16T10:50:10.507559+0000","last_fullsized":"2024-03-16T10:50:10.507559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274875+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:49:42.274875+0000","last_peered":"2024-03-16T10:49:42.274875+0000","last_clean":"2024-03-16T10:49:42.274875+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:49:42.274875+0000","last_undegraded":"2024-03-16T10:49:42.274875+0000","last_fullsized":"2024-03-16T10:49:42.274875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275632+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:49:42.275632+0000","last_peered":"2024-03-16T10:49:42.275632+0000","last_clean":"2024-03-16T10:49:42.275632+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:49:42.275632+0000","last_undegraded":"2024-03-16T10:49:42.275632+0000","last_fullsized":"2024-03-16T10:49:42.275632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508631+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:50:10.508631+0000","last_peered":"2024-03-16T10:50:10.508631+0000","last_clean":"2024-03-16T10:50:10.508631+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:50:10.508631+0000","last_undegraded":"2024-03-16T10:50:10.508631+0000","last_fullsized":"2024-03-16T10:50:10.508631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'14","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791283+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:49:42.791283+0000","last_peered":"2024-03-16T10:49:42.791283+0000","last_clean":"2024-03-16T10:49:42.791283+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:49:42.791283+0000","last_undegraded":"2024-03-16T10:49:42.791283+0000","last_fullsized":"2024-03-16T10:49:42.791283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509871+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:50:10.509871+0000","last_peered":"2024-03-16T10:50:10.509871+0000","last_clean":"2024-03-16T10:50:10.509871+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:50:10.509871+0000","last_undegraded":"2024-03-16T10:50:10.509871+0000","last_fullsized":"2024-03-16T10:50:10.509871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272671+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:49:42.272671+0000","last_peered":"2024-03-16T10:49:42.272671+0000","last_clean":"2024-03-16T10:49:42.272671+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:49:42.272671+0000","last_undegraded":"2024-03-16T10:49:42.272671+0000","last_fullsized":"2024-03-16T10:49:42.272671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511731+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:50:10.511731+0000","last_peered":"2024-03-16T10:50:10.511731+0000","last_clean":"2024-03-16T10:50:10.511731+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:50:10.511731+0000","last_undegraded":"2024-03-16T10:50:10.511731+0000","last_fullsized":"2024-03-16T10:50:10.511731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.280047+0000","last_change":"2024-03-16T10:49:42.280047+0000","last_active":"2024-03-16T10:49:42.280047+0000","last_peered":"2024-03-16T10:49:42.280047+0000","last_clean":"2024-03-16T10:49:42.280047+0000","last_became_active":"2024-03-16T10:49:42.277477+0000","last_became_peered":"2024-03-16T10:49:42.277477+0000","last_unstale":"2024-03-16T10:49:42.280047+0000","last_undegraded":"2024-03-16T10:49:42.280047+0000","last_fullsized":"2024-03-16T10:49:42.280047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:04.299467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.468905+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:50:10.468905+0000","last_peered":"2024-03-16T10:50:10.468905+0000","last_clean":"2024-03-16T10:50:10.468905+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:50:10.468905+0000","last_undegraded":"2024-03-16T10:50:10.468905+0000","last_fullsized":"2024-03-16T10:50:10.468905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271623+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:49:42.271623+0000","last_peered":"2024-03-16T10:49:42.271623+0000","last_clean":"2024-03-16T10:49:42.271623+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:49:42.271623+0000","last_undegraded":"2024-03-16T10:49:42.271623+0000","last_fullsized":"2024-03-16T10:49:42.271623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505065+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:50:10.505065+0000","last_peered":"2024-03-16T10:50:10.505065+0000","last_clean":"2024-03-16T10:50:10.505065+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:50:10.505065+0000","last_undegraded":"2024-03-16T10:50:10.505065+0000","last_fullsized":"2024-03-16T10:50:10.505065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272057+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:49:42.272057+0000","last_peered":"2024-03-16T10:49:42.272057+0000","last_clean":"2024-03-16T10:49:42.272057+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:49:42.272057+0000","last_undegraded":"2024-03-16T10:49:42.272057+0000","last_fullsized":"2024-03-16T10:49:42.272057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503887+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:50:10.503887+0000","last_peered":"2024-03-16T10:50:10.503887+0000","last_clean":"2024-03-16T10:50:10.503887+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:50:10.503887+0000","last_undegraded":"2024-03-16T10:50:10.503887+0000","last_fullsized":"2024-03-16T10:50:10.503887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275122+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:49:42.275122+0000","last_peered":"2024-03-16T10:49:42.275122+0000","last_clean":"2024-03-16T10:49:42.275122+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:49:42.275122+0000","last_undegraded":"2024-03-16T10:49:42.275122+0000","last_fullsized":"2024-03-16T10:49:42.275122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521695+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:50:10.521695+0000","last_peered":"2024-03-16T10:50:10.521695+0000","last_clean":"2024-03-16T10:50:10.521695+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:50:10.521695+0000","last_undegraded":"2024-03-16T10:50:10.521695+0000","last_fullsized":"2024-03-16T10:50:10.521695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296839+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:50:49.296839+0000","last_peered":"2024-03-16T10:50:49.296839+0000","last_clean":"2024-03-16T10:50:49.296839+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:50:49.296839+0000","last_undegraded":"2024-03-16T10:50:49.296839+0000","last_fullsized":"2024-03-16T10:50:49.296839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521009+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:50:10.521009+0000","last_peered":"2024-03-16T10:50:10.521009+0000","last_clean":"2024-03-16T10:50:10.521009+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:50:10.521009+0000","last_undegraded":"2024-03-16T10:50:10.521009+0000","last_fullsized":"2024-03-16T10:50:10.521009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275274+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:49:42.275274+0000","last_peered":"2024-03-16T10:49:42.275274+0000","last_clean":"2024-03-16T10:49:42.275274+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:49:42.275274+0000","last_undegraded":"2024-03-16T10:49:42.275274+0000","last_fullsized":"2024-03-16T10:49:42.275274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508093+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:50:10.508093+0000","last_peered":"2024-03-16T10:50:10.508093+0000","last_clean":"2024-03-16T10:50:10.508093+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:50:10.508093+0000","last_undegraded":"2024-03-16T10:50:10.508093+0000","last_fullsized":"2024-03-16T10:50:10.508093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274672+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:49:42.274672+0000","last_peered":"2024-03-16T10:49:42.274672+0000","last_clean":"2024-03-16T10:49:42.274672+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:49:42.274672+0000","last_undegraded":"2024-03-16T10:49:42.274672+0000","last_fullsized":"2024-03-16T10:49:42.274672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516795+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:50:10.516795+0000","last_peered":"2024-03-16T10:50:10.516795+0000","last_clean":"2024-03-16T10:50:10.516795+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:50:10.516795+0000","last_undegraded":"2024-03-16T10:50:10.516795+0000","last_fullsized":"2024-03-16T10:50:10.516795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505205+0000","last_change":"2024-03-16T10:49:42.792025+0000","last_active":"2024-03-16T10:50:10.505205+0000","last_peered":"2024-03-16T10:50:10.505205+0000","last_clean":"2024-03-16T10:50:10.505205+0000","last_became_active":"2024-03-16T10:49:42.791745+0000","last_became_peered":"2024-03-16T10:49:42.791745+0000","last_unstale":"2024-03-16T10:50:10.505205+0000","last_undegraded":"2024-03-16T10:50:10.505205+0000","last_fullsized":"2024-03-16T10:50:10.505205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:50:32.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495402+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:50:10.495402+0000","last_peered":"2024-03-16T10:50:10.495402+0000","last_clean":"2024-03-16T10:50:10.495402+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:50:10.495402+0000","last_undegraded":"2024-03-16T10:50:10.495402+0000","last_fullsized":"2024-03-16T10:50:10.495402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.500502+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:50:10.500502+0000","last_peered":"2024-03-16T10:50:10.500502+0000","last_clean":"2024-03-16T10:50:10.500502+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:50:10.500502+0000","last_undegraded":"2024-03-16T10:50:10.500502+0000","last_fullsized":"2024-03-16T10:50:10.500502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509363+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:50:10.509363+0000","last_peered":"2024-03-16T10:50:10.509363+0000","last_clean":"2024-03-16T10:50:10.509363+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:50:10.509363+0000","last_undegraded":"2024-03-16T10:50:10.509363+0000","last_fullsized":"2024-03-16T10:50:10.509363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505148+0000","last_change":"2024-03-16T10:49:42.792395+0000","last_active":"2024-03-16T10:50:10.505148+0000","last_peered":"2024-03-16T10:50:10.505148+0000","last_clean":"2024-03-16T10:50:10.505148+0000","last_became_active":"2024-03-16T10:49:42.791992+0000","last_became_peered":"2024-03-16T10:49:42.791992+0000","last_unstale":"2024-03-16T10:50:10.505148+0000","last_undegraded":"2024-03-16T10:50:10.505148+0000","last_fullsized":"2024-03-16T10:50:10.505148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:15:16.825389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503402+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:50:10.503402+0000","last_peered":"2024-03-16T10:50:10.503402+0000","last_clean":"2024-03-16T10:50:10.503402+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:50:10.503402+0000","last_undegraded":"2024-03-16T10:50:10.503402+0000","last_fullsized":"2024-03-16T10:50:10.503402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508503+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:50:10.508503+0000","last_peered":"2024-03-16T10:50:10.508503+0000","last_clean":"2024-03-16T10:50:10.508503+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:50:10.508503+0000","last_undegraded":"2024-03-16T10:50:10.508503+0000","last_fullsized":"2024-03-16T10:50:10.508503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506446+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:50:10.506446+0000","last_peered":"2024-03-16T10:50:10.506446+0000","last_clean":"2024-03-16T10:50:10.506446+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:50:10.506446+0000","last_undegraded":"2024-03-16T10:50:10.506446+0000","last_fullsized":"2024-03-16T10:50:10.506446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.501919+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:50:10.501919+0000","last_peered":"2024-03-16T10:50:10.501919+0000","last_clean":"2024-03-16T10:50:10.501919+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:50:10.501919+0000","last_undegraded":"2024-03-16T10:50:10.501919+0000","last_fullsized":"2024-03-16T10:50:10.501919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507838+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:50:10.507838+0000","last_peered":"2024-03-16T10:50:10.507838+0000","last_clean":"2024-03-16T10:50:10.507838+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:50:10.507838+0000","last_undegraded":"2024-03-16T10:50:10.507838+0000","last_fullsized":"2024-03-16T10:50:10.507838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522414+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:50:10.522414+0000","last_peered":"2024-03-16T10:50:10.522414+0000","last_clean":"2024-03-16T10:50:10.522414+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:50:10.522414+0000","last_undegraded":"2024-03-16T10:50:10.522414+0000","last_fullsized":"2024-03-16T10:50:10.522414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514335+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:50:10.514335+0000","last_peered":"2024-03-16T10:50:10.514335+0000","last_clean":"2024-03-16T10:50:10.514335+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:50:10.514335+0000","last_undegraded":"2024-03-16T10:50:10.514335+0000","last_fullsized":"2024-03-16T10:50:10.514335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503699+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:50:10.503699+0000","last_peered":"2024-03-16T10:50:10.503699+0000","last_clean":"2024-03-16T10:50:10.503699+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:50:10.503699+0000","last_undegraded":"2024-03-16T10:50:10.503699+0000","last_fullsized":"2024-03-16T10:50:10.503699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69089,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1194,"num_read_kb":672,"num_write":252,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":212979,"data_compressed":5628,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":457215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":1109489,"data_compressed":37961,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":456359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":1050440,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":958464,"data_stored":456588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":519104,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":457619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":519240,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":1049278,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68368,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64107,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63563,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:50:54.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T10:50:55.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 -- 172.21.15.17:0/1209358945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41018f0 msgr2=0x7fccf4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1209358945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41018f0 0x7fccf4101d70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009900 tx=0x7fccdc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 -- 172.21.15.17:0/1209358945 shutdown_connections 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1209358945 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf41022b0 0x7fccf4108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1209358945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41018f0 0x7fccf4101d70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1209358945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf4100700 0x7fccf4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 -- 172.21.15.17:0/1209358945 >> 172.21.15.17:0/1209358945 conn(0x7fccf40fbc70 msgr2=0x7fccf40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 -- 172.21.15.17:0/1209358945 shutdown_connections 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.098+0000 7fccf8dab640 1 -- 172.21.15.17:0/1209358945 wait complete. 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 Processor -- start 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 -- start start 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 0x7fccf41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410c380 con 0x7fccf41022b0 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410c200 con 0x7fccf4100700 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf8dab640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410c500 con 0x7fccf41018f0 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42462/0 (socket says 172.21.15.17:42462) 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 -- 172.21.15.17:0/1616064211 learned_addr learned my addr 172.21.15.17:0/1616064211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:47816/0 (socket says 172.21.15.17:47816) 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccebfff640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 0x7fccf41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 -- 172.21.15.17:0/1616064211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 msgr2=0x7fccf41980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 0x7fccf41980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 -- 172.21.15.17:0/1616064211 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 msgr2=0x7fccf4197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf2d9d640 1 -- 172.21.15.17:0/1616064211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf419f750 con 0x7fccf41022b0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.099+0000 7fccf259c640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fccebfff640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 0x7fccf41980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fccf2d9d640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fccec00eb10 tx=0x7fccec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec004b20 con 0x7fccf41022b0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccec004cc0 con 0x7fccf41022b0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf4102b70 con 0x7fccf41022b0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec010790 con 0x7fccf41022b0 2024-03-16T10:50:55.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.100+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf4103040 con 0x7fccf41022b0 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.101+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf4103300 con 0x7fccf41022b0 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.102+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fccec005020 con 0x7fccf41022b0 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.103+0000 7fcceb7fe640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 0x7fcce00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.103+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fccec0cf070 con 0x7fccf41022b0 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.103+0000 7fccf259c640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 0x7fcce00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.103+0000 7fccf259c640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 0x7fcce00a4d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fccf4101750 tx=0x7fcce4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.107+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fccec09c0b0 con 0x7fccf41022b0 2024-03-16T10:50:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.292+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccf40fde50 con 0x7fcce00a2890 2024-03-16T10:50:55.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.299+0000 7fcceb7fe640 1 -- 172.21.15.17:0/1616064211 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259107 (secure 0 0 0) 0x7fccf40fde50 con 0x7fcce00a2890 2024-03-16T10:50:55.303 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:55.304 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:50:55.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 msgr2=0x7fcce00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 0x7fcce00a4d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fccf4101750 tx=0x7fcce4005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 msgr2=0x7fccf419f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fccec00eb10 tx=0x7fccec00c2d0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 shutdown_connections 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcce00a2890 0x7fcce00a4d50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccf41022b0 0x7fccf419f0e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf41018f0 0x7fccf41980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 --2- 172.21.15.17:0/1616064211 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf4100700 0x7fccf4197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 >> 172.21.15.17:0/1616064211 conn(0x7fccf40fbc70 msgr2=0x7fccf40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 shutdown_connections 2024-03-16T10:50:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.303+0000 7fccf8dab640 1 -- 172.21.15.17:0/1616064211 wait complete. 2024-03-16T10:50:55.314 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-03-16T10:50:54.511188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659691,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":781,"num_write":435,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373332,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568492,"statfs":{"total":1151940427776,"available":1151558135808,"internally_reserved":0,"allocated":11980800,"data_stored":7444673,"data_compressed":113883,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002827"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516969+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:50:10.516969+0000","last_peered":"2024-03-16T10:50:10.516969+0000","last_clean":"2024-03-16T10:50:10.516969+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:50:10.516969+0000","last_undegraded":"2024-03-16T10:50:10.516969+0000","last_fullsized":"2024-03-16T10:50:10.516969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511591+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:50:10.511591+0000","last_peered":"2024-03-16T10:50:10.511591+0000","last_clean":"2024-03-16T10:50:10.511591+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:50:10.511591+0000","last_undegraded":"2024-03-16T10:50:10.511591+0000","last_fullsized":"2024-03-16T10:50:10.511591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509559+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:50:10.509559+0000","last_peered":"2024-03-16T10:50:10.509559+0000","last_clean":"2024-03-16T10:50:10.509559+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:50:10.509559+0000","last_undegraded":"2024-03-16T10:50:10.509559+0000","last_fullsized":"2024-03-16T10:50:10.509559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.493922+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:50:10.493922+0000","last_peered":"2024-03-16T10:50:10.493922+0000","last_clean":"2024-03-16T10:50:10.493922+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:50:10.493922+0000","last_undegraded":"2024-03-16T10:50:10.493922+0000","last_fullsized":"2024-03-16T10:50:10.493922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490292+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:50:10.490292+0000","last_peered":"2024-03-16T10:50:10.490292+0000","last_clean":"2024-03-16T10:50:10.490292+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:50:10.490292+0000","last_undegraded":"2024-03-16T10:50:10.490292+0000","last_fullsized":"2024-03-16T10:50:10.490292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495543+0000","last_change":"2024-03-16T10:49:42.791331+0000","last_active":"2024-03-16T10:50:10.495543+0000","last_peered":"2024-03-16T10:50:10.495543+0000","last_clean":"2024-03-16T10:50:10.495543+0000","last_became_active":"2024-03-16T10:49:42.791066+0000","last_became_peered":"2024-03-16T10:49:42.791066+0000","last_unstale":"2024-03-16T10:50:10.495543+0000","last_undegraded":"2024-03-16T10:50:10.495543+0000","last_fullsized":"2024-03-16T10:50:10.495543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:01.493249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510080+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:50:10.510080+0000","last_peered":"2024-03-16T10:50:10.510080+0000","last_clean":"2024-03-16T10:50:10.510080+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:50:10.510080+0000","last_undegraded":"2024-03-16T10:50:10.510080+0000","last_fullsized":"2024-03-16T10:50:10.510080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509893+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:50:10.509893+0000","last_peered":"2024-03-16T10:50:10.509893+0000","last_clean":"2024-03-16T10:50:10.509893+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:50:10.509893+0000","last_undegraded":"2024-03-16T10:50:10.509893+0000","last_fullsized":"2024-03-16T10:50:10.509893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521146+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:50:10.521146+0000","last_peered":"2024-03-16T10:50:10.521146+0000","last_clean":"2024-03-16T10:50:10.521146+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:50:10.521146+0000","last_undegraded":"2024-03-16T10:50:10.521146+0000","last_fullsized":"2024-03-16T10:50:10.521146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506780+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:50:10.506780+0000","last_peered":"2024-03-16T10:50:10.506780+0000","last_clean":"2024-03-16T10:50:10.506780+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:50:10.506780+0000","last_undegraded":"2024-03-16T10:50:10.506780+0000","last_fullsized":"2024-03-16T10:50:10.506780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521048+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:50:10.521048+0000","last_peered":"2024-03-16T10:50:10.521048+0000","last_clean":"2024-03-16T10:50:10.521048+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:50:10.521048+0000","last_undegraded":"2024-03-16T10:50:10.521048+0000","last_fullsized":"2024-03-16T10:50:10.521048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510658+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:50:10.510658+0000","last_peered":"2024-03-16T10:50:10.510658+0000","last_clean":"2024-03-16T10:50:10.510658+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:50:10.510658+0000","last_undegraded":"2024-03-16T10:50:10.510658+0000","last_fullsized":"2024-03-16T10:50:10.510658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495010+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:50:10.495010+0000","last_peered":"2024-03-16T10:50:10.495010+0000","last_clean":"2024-03-16T10:50:10.495010+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:50:10.495010+0000","last_undegraded":"2024-03-16T10:50:10.495010+0000","last_fullsized":"2024-03-16T10:50:10.495010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509792+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:50:10.509792+0000","last_peered":"2024-03-16T10:50:10.509792+0000","last_clean":"2024-03-16T10:50:10.509792+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:50:10.509792+0000","last_undegraded":"2024-03-16T10:50:10.509792+0000","last_fullsized":"2024-03-16T10:50:10.509792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509076+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:50:10.509076+0000","last_peered":"2024-03-16T10:50:10.509076+0000","last_clean":"2024-03-16T10:50:10.509076+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:50:10.509076+0000","last_undegraded":"2024-03-16T10:50:10.509076+0000","last_fullsized":"2024-03-16T10:50:10.509076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521982+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:50:10.521982+0000","last_peered":"2024-03-16T10:50:10.521982+0000","last_clean":"2024-03-16T10:50:10.521982+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:50:10.521982+0000","last_undegraded":"2024-03-16T10:50:10.521982+0000","last_fullsized":"2024-03-16T10:50:10.521982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.517221+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:50:10.517221+0000","last_peered":"2024-03-16T10:50:10.517221+0000","last_clean":"2024-03-16T10:50:10.517221+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:50:10.517221+0000","last_undegraded":"2024-03-16T10:50:10.517221+0000","last_fullsized":"2024-03-16T10:50:10.517221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.512884+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:50:10.512884+0000","last_peered":"2024-03-16T10:50:10.512884+0000","last_clean":"2024-03-16T10:50:10.512884+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:50:10.512884+0000","last_undegraded":"2024-03-16T10:50:10.512884+0000","last_fullsized":"2024-03-16T10:50:10.512884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.497510+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:50:10.497510+0000","last_peered":"2024-03-16T10:50:10.497510+0000","last_clean":"2024-03-16T10:50:10.497510+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:50:10.497510+0000","last_undegraded":"2024-03-16T10:50:10.497510+0000","last_fullsized":"2024-03-16T10:50:10.497510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.200945+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:50:50.200945+0000","last_peered":"2024-03-16T10:50:50.200945+0000","last_clean":"2024-03-16T10:50:50.200945+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:50:50.200945+0000","last_undegraded":"2024-03-16T10:50:50.200945+0000","last_fullsized":"2024-03-16T10:50:50.200945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508015+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:50:10.508015+0000","last_peered":"2024-03-16T10:50:10.508015+0000","last_clean":"2024-03-16T10:50:10.508015+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:50:10.508015+0000","last_undegraded":"2024-03-16T10:50:10.508015+0000","last_fullsized":"2024-03-16T10:50:10.508015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272187+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:49:42.272187+0000","last_peered":"2024-03-16T10:49:42.272187+0000","last_clean":"2024-03-16T10:49:42.272187+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:49:42.272187+0000","last_undegraded":"2024-03-16T10:49:42.272187+0000","last_fullsized":"2024-03-16T10:49:42.272187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509461+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:50:10.509461+0000","last_peered":"2024-03-16T10:50:10.509461+0000","last_clean":"2024-03-16T10:50:10.509461+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:50:10.509461+0000","last_undegraded":"2024-03-16T10:50:10.509461+0000","last_fullsized":"2024-03-16T10:50:10.509461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"87'13","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275821+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:49:42.275821+0000","last_peered":"2024-03-16T10:49:42.275821+0000","last_clean":"2024-03-16T10:49:42.275821+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:49:42.275821+0000","last_undegraded":"2024-03-16T10:49:42.275821+0000","last_fullsized":"2024-03-16T10:49:42.275821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522168+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:50:10.522168+0000","last_peered":"2024-03-16T10:50:10.522168+0000","last_clean":"2024-03-16T10:50:10.522168+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:50:10.522168+0000","last_undegraded":"2024-03-16T10:50:10.522168+0000","last_fullsized":"2024-03-16T10:50:10.522168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.282326+0000","last_change":"2024-03-16T10:49:42.282326+0000","last_active":"2024-03-16T10:49:42.282326+0000","last_peered":"2024-03-16T10:49:42.282326+0000","last_clean":"2024-03-16T10:49:42.282326+0000","last_became_active":"2024-03-16T10:49:42.277256+0000","last_became_peered":"2024-03-16T10:49:42.277256+0000","last_unstale":"2024-03-16T10:49:42.282326+0000","last_undegraded":"2024-03-16T10:49:42.282326+0000","last_fullsized":"2024-03-16T10:49:42.282326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:18.193268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516615+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:50:10.516615+0000","last_peered":"2024-03-16T10:50:10.516615+0000","last_clean":"2024-03-16T10:50:10.516615+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:50:10.516615+0000","last_undegraded":"2024-03-16T10:50:10.516615+0000","last_fullsized":"2024-03-16T10:50:10.516615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:48.295938+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:50:48.295938+0000","last_peered":"2024-03-16T10:50:48.295938+0000","last_clean":"2024-03-16T10:50:48.295938+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:50:48.295938+0000","last_undegraded":"2024-03-16T10:50:48.295938+0000","last_fullsized":"2024-03-16T10:50:48.295938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490396+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:50:10.490396+0000","last_peered":"2024-03-16T10:50:10.490396+0000","last_clean":"2024-03-16T10:50:10.490396+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:50:10.490396+0000","last_undegraded":"2024-03-16T10:50:10.490396+0000","last_fullsized":"2024-03-16T10:50:10.490396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274044+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:49:42.274044+0000","last_peered":"2024-03-16T10:49:42.274044+0000","last_clean":"2024-03-16T10:49:42.274044+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:49:42.274044+0000","last_undegraded":"2024-03-16T10:49:42.274044+0000","last_fullsized":"2024-03-16T10:49:42.274044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502515+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:50:10.502515+0000","last_peered":"2024-03-16T10:50:10.502515+0000","last_clean":"2024-03-16T10:50:10.502515+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:50:10.502515+0000","last_undegraded":"2024-03-16T10:50:10.502515+0000","last_fullsized":"2024-03-16T10:50:10.502515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274332+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:49:42.274332+0000","last_peered":"2024-03-16T10:49:42.274332+0000","last_clean":"2024-03-16T10:49:42.274332+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:49:42.274332+0000","last_undegraded":"2024-03-16T10:49:42.274332+0000","last_fullsized":"2024-03-16T10:49:42.274332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503068+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:50:10.503068+0000","last_peered":"2024-03-16T10:50:10.503068+0000","last_clean":"2024-03-16T10:50:10.503068+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:50:10.503068+0000","last_undegraded":"2024-03-16T10:50:10.503068+0000","last_fullsized":"2024-03-16T10:50:10.503068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275292+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:49:42.275292+0000","last_peered":"2024-03-16T10:49:42.275292+0000","last_clean":"2024-03-16T10:49:42.275292+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:49:42.275292+0000","last_undegraded":"2024-03-16T10:49:42.275292+0000","last_fullsized":"2024-03-16T10:49:42.275292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.498981+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:50:10.498981+0000","last_peered":"2024-03-16T10:50:10.498981+0000","last_clean":"2024-03-16T10:50:10.498981+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:50:10.498981+0000","last_undegraded":"2024-03-16T10:50:10.498981+0000","last_fullsized":"2024-03-16T10:50:10.498981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":254,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296384+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:50:49.296384+0000","last_peered":"2024-03-16T10:50:49.296384+0000","last_clean":"2024-03-16T10:50:49.296384+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:50:49.296384+0000","last_undegraded":"2024-03-16T10:50:49.296384+0000","last_fullsized":"2024-03-16T10:50:49.296384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522515+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:50:10.522515+0000","last_peered":"2024-03-16T10:50:10.522515+0000","last_clean":"2024-03-16T10:50:10.522515+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:50:10.522515+0000","last_undegraded":"2024-03-16T10:50:10.522515+0000","last_fullsized":"2024-03-16T10:50:10.522515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275650+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:49:42.275650+0000","last_peered":"2024-03-16T10:49:42.275650+0000","last_clean":"2024-03-16T10:49:42.275650+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:49:42.275650+0000","last_undegraded":"2024-03-16T10:49:42.275650+0000","last_fullsized":"2024-03-16T10:49:42.275650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508883+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:50:10.508883+0000","last_peered":"2024-03-16T10:50:10.508883+0000","last_clean":"2024-03-16T10:50:10.508883+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:50:10.508883+0000","last_undegraded":"2024-03-16T10:50:10.508883+0000","last_fullsized":"2024-03-16T10:50:10.508883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275492+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:49:42.275492+0000","last_peered":"2024-03-16T10:49:42.275492+0000","last_clean":"2024-03-16T10:49:42.275492+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:49:42.275492+0000","last_undegraded":"2024-03-16T10:49:42.275492+0000","last_fullsized":"2024-03-16T10:49:42.275492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.519219+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:50:10.519219+0000","last_peered":"2024-03-16T10:50:10.519219+0000","last_clean":"2024-03-16T10:50:10.519219+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:50:10.519219+0000","last_undegraded":"2024-03-16T10:50:10.519219+0000","last_fullsized":"2024-03-16T10:50:10.519219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'33","reported_seq":290,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296382+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:50:49.296382+0000","last_peered":"2024-03-16T10:50:49.296382+0000","last_clean":"2024-03-16T10:50:49.296382+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:50:49.296382+0000","last_undegraded":"2024-03-16T10:50:49.296382+0000","last_fullsized":"2024-03-16T10:50:49.296382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":179,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513536+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:50:10.513536+0000","last_peered":"2024-03-16T10:50:10.513536+0000","last_clean":"2024-03-16T10:50:10.513536+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:50:10.513536+0000","last_undegraded":"2024-03-16T10:50:10.513536+0000","last_fullsized":"2024-03-16T10:50:10.513536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271826+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:49:42.271826+0000","last_peered":"2024-03-16T10:49:42.271826+0000","last_clean":"2024-03-16T10:49:42.271826+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:49:42.271826+0000","last_undegraded":"2024-03-16T10:49:42.271826+0000","last_fullsized":"2024-03-16T10:49:42.271826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514034+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:50:10.514034+0000","last_peered":"2024-03-16T10:50:10.514034+0000","last_clean":"2024-03-16T10:50:10.514034+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:50:10.514034+0000","last_undegraded":"2024-03-16T10:50:10.514034+0000","last_fullsized":"2024-03-16T10:50:10.514034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275782+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:49:42.275782+0000","last_peered":"2024-03-16T10:49:42.275782+0000","last_clean":"2024-03-16T10:49:42.275782+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:49:42.275782+0000","last_undegraded":"2024-03-16T10:49:42.275782+0000","last_fullsized":"2024-03-16T10:49:42.275782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.520279+0000","last_change":"2024-03-16T10:49:42.792180+0000","last_active":"2024-03-16T10:50:10.520279+0000","last_peered":"2024-03-16T10:50:10.520279+0000","last_clean":"2024-03-16T10:50:10.520279+0000","last_became_active":"2024-03-16T10:49:42.791813+0000","last_became_peered":"2024-03-16T10:49:42.791813+0000","last_unstale":"2024-03-16T10:50:10.520279+0000","last_undegraded":"2024-03-16T10:50:10.520279+0000","last_fullsized":"2024-03-16T10:50:10.520279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:48.571823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'7","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.297161+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:50:49.297161+0000","last_peered":"2024-03-16T10:50:49.297161+0000","last_clean":"2024-03-16T10:50:49.297161+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:50:49.297161+0000","last_undegraded":"2024-03-16T10:50:49.297161+0000","last_fullsized":"2024-03-16T10:50:49.297161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511547+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:50:10.511547+0000","last_peered":"2024-03-16T10:50:10.511547+0000","last_clean":"2024-03-16T10:50:10.511547+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:50:10.511547+0000","last_undegraded":"2024-03-16T10:50:10.511547+0000","last_fullsized":"2024-03-16T10:50:10.511547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275173+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:49:42.275173+0000","last_peered":"2024-03-16T10:49:42.275173+0000","last_clean":"2024-03-16T10:49:42.275173+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:49:42.275173+0000","last_undegraded":"2024-03-16T10:49:42.275173+0000","last_fullsized":"2024-03-16T10:49:42.275173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.515883+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:50:10.515883+0000","last_peered":"2024-03-16T10:50:10.515883+0000","last_clean":"2024-03-16T10:50:10.515883+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:50:10.515883+0000","last_undegraded":"2024-03-16T10:50:10.515883+0000","last_fullsized":"2024-03-16T10:50:10.515883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275702+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:49:42.275702+0000","last_peered":"2024-03-16T10:49:42.275702+0000","last_clean":"2024-03-16T10:49:42.275702+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:49:42.275702+0000","last_undegraded":"2024-03-16T10:49:42.275702+0000","last_fullsized":"2024-03-16T10:49:42.275702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503929+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:50:10.503929+0000","last_peered":"2024-03-16T10:50:10.503929+0000","last_clean":"2024-03-16T10:50:10.503929+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:50:10.503929+0000","last_undegraded":"2024-03-16T10:50:10.503929+0000","last_fullsized":"2024-03-16T10:50:10.503929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791042+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:49:42.791042+0000","last_peered":"2024-03-16T10:49:42.791042+0000","last_clean":"2024-03-16T10:49:42.791042+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:49:42.791042+0000","last_undegraded":"2024-03-16T10:49:42.791042+0000","last_fullsized":"2024-03-16T10:49:42.791042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509779+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:50:10.509779+0000","last_peered":"2024-03-16T10:50:10.509779+0000","last_clean":"2024-03-16T10:50:10.509779+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:50:10.509779+0000","last_undegraded":"2024-03-16T10:50:10.509779+0000","last_fullsized":"2024-03-16T10:50:10.509779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.301086+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:50:50.301086+0000","last_peered":"2024-03-16T10:50:50.301086+0000","last_clean":"2024-03-16T10:50:50.301086+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:50:50.301086+0000","last_undegraded":"2024-03-16T10:50:50.301086+0000","last_fullsized":"2024-03-16T10:50:50.301086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510526+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:50:10.510526+0000","last_peered":"2024-03-16T10:50:10.510526+0000","last_clean":"2024-03-16T10:50:10.510526+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:50:10.510526+0000","last_undegraded":"2024-03-16T10:50:10.510526+0000","last_fullsized":"2024-03-16T10:50:10.510526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502799+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:50:10.502799+0000","last_peered":"2024-03-16T10:50:10.502799+0000","last_clean":"2024-03-16T10:50:10.502799+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:50:10.502799+0000","last_undegraded":"2024-03-16T10:50:10.502799+0000","last_fullsized":"2024-03-16T10:50:10.502799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296858+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:50:49.296858+0000","last_peered":"2024-03-16T10:50:49.296858+0000","last_clean":"2024-03-16T10:50:49.296858+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:50:49.296858+0000","last_undegraded":"2024-03-16T10:50:49.296858+0000","last_fullsized":"2024-03-16T10:50:49.296858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513394+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:50:10.513394+0000","last_peered":"2024-03-16T10:50:10.513394+0000","last_clean":"2024-03-16T10:50:10.513394+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:50:10.513394+0000","last_undegraded":"2024-03-16T10:50:10.513394+0000","last_fullsized":"2024-03-16T10:50:10.513394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272073+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:49:42.272073+0000","last_peered":"2024-03-16T10:49:42.272073+0000","last_clean":"2024-03-16T10:49:42.272073+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:49:42.272073+0000","last_undegraded":"2024-03-16T10:49:42.272073+0000","last_fullsized":"2024-03-16T10:49:42.272073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274675+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:49:42.274675+0000","last_peered":"2024-03-16T10:49:42.274675+0000","last_clean":"2024-03-16T10:49:42.274675+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:49:42.274675+0000","last_undegraded":"2024-03-16T10:49:42.274675+0000","last_fullsized":"2024-03-16T10:49:42.274675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507559+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:50:10.507559+0000","last_peered":"2024-03-16T10:50:10.507559+0000","last_clean":"2024-03-16T10:50:10.507559+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:50:10.507559+0000","last_undegraded":"2024-03-16T10:50:10.507559+0000","last_fullsized":"2024-03-16T10:50:10.507559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274875+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:49:42.274875+0000","last_peered":"2024-03-16T10:49:42.274875+0000","last_clean":"2024-03-16T10:49:42.274875+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:49:42.274875+0000","last_undegraded":"2024-03-16T10:49:42.274875+0000","last_fullsized":"2024-03-16T10:49:42.274875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275632+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:49:42.275632+0000","last_peered":"2024-03-16T10:49:42.275632+0000","last_clean":"2024-03-16T10:49:42.275632+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:49:42.275632+0000","last_undegraded":"2024-03-16T10:49:42.275632+0000","last_fullsized":"2024-03-16T10:49:42.275632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508631+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:50:10.508631+0000","last_peered":"2024-03-16T10:50:10.508631+0000","last_clean":"2024-03-16T10:50:10.508631+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:50:10.508631+0000","last_undegraded":"2024-03-16T10:50:10.508631+0000","last_fullsized":"2024-03-16T10:50:10.508631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'14","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791283+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:49:42.791283+0000","last_peered":"2024-03-16T10:49:42.791283+0000","last_clean":"2024-03-16T10:49:42.791283+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:49:42.791283+0000","last_undegraded":"2024-03-16T10:49:42.791283+0000","last_fullsized":"2024-03-16T10:49:42.791283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509871+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:50:10.509871+0000","last_peered":"2024-03-16T10:50:10.509871+0000","last_clean":"2024-03-16T10:50:10.509871+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:50:10.509871+0000","last_undegraded":"2024-03-16T10:50:10.509871+0000","last_fullsized":"2024-03-16T10:50:10.509871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272671+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:49:42.272671+0000","last_peered":"2024-03-16T10:49:42.272671+0000","last_clean":"2024-03-16T10:49:42.272671+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:49:42.272671+0000","last_undegraded":"2024-03-16T10:49:42.272671+0000","last_fullsized":"2024-03-16T10:49:42.272671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511731+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:50:10.511731+0000","last_peered":"2024-03-16T10:50:10.511731+0000","last_clean":"2024-03-16T10:50:10.511731+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:50:10.511731+0000","last_undegraded":"2024-03-16T10:50:10.511731+0000","last_fullsized":"2024-03-16T10:50:10.511731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.280047+0000","last_change":"2024-03-16T10:49:42.280047+0000","last_active":"2024-03-16T10:49:42.280047+0000","last_peered":"2024-03-16T10:49:42.280047+0000","last_clean":"2024-03-16T10:49:42.280047+0000","last_became_active":"2024-03-16T10:49:42.277477+0000","last_became_peered":"2024-03-16T10:49:42.277477+0000","last_unstale":"2024-03-16T10:49:42.280047+0000","last_undegraded":"2024-03-16T10:49:42.280047+0000","last_fullsized":"2024-03-16T10:49:42.280047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:04.299467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.468905+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:50:10.468905+0000","last_peered":"2024-03-16T10:50:10.468905+0000","last_clean":"2024-03-16T10:50:10.468905+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:50:10.468905+0000","last_undegraded":"2024-03-16T10:50:10.468905+0000","last_fullsized":"2024-03-16T10:50:10.468905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271623+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:49:42.271623+0000","last_peered":"2024-03-16T10:49:42.271623+0000","last_clean":"2024-03-16T10:49:42.271623+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:49:42.271623+0000","last_undegraded":"2024-03-16T10:49:42.271623+0000","last_fullsized":"2024-03-16T10:49:42.271623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505065+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:50:10.505065+0000","last_peered":"2024-03-16T10:50:10.505065+0000","last_clean":"2024-03-16T10:50:10.505065+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:50:10.505065+0000","last_undegraded":"2024-03-16T10:50:10.505065+0000","last_fullsized":"2024-03-16T10:50:10.505065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272057+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:49:42.272057+0000","last_peered":"2024-03-16T10:49:42.272057+0000","last_clean":"2024-03-16T10:49:42.272057+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:49:42.272057+0000","last_undegraded":"2024-03-16T10:49:42.272057+0000","last_fullsized":"2024-03-16T10:49:42.272057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503887+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:50:10.503887+0000","last_peered":"2024-03-16T10:50:10.503887+0000","last_clean":"2024-03-16T10:50:10.503887+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:50:10.503887+0000","last_undegraded":"2024-03-16T10:50:10.503887+0000","last_fullsized":"2024-03-16T10:50:10.503887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275122+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:49:42.275122+0000","last_peered":"2024-03-16T10:49:42.275122+0000","last_clean":"2024-03-16T10:49:42.275122+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:49:42.275122+0000","last_undegraded":"2024-03-16T10:49:42.275122+0000","last_fullsized":"2024-03-16T10:49:42.275122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521695+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:50:10.521695+0000","last_peered":"2024-03-16T10:50:10.521695+0000","last_clean":"2024-03-16T10:50:10.521695+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:50:10.521695+0000","last_undegraded":"2024-03-16T10:50:10.521695+0000","last_fullsized":"2024-03-16T10:50:10.521695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296839+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:50:49.296839+0000","last_peered":"2024-03-16T10:50:49.296839+0000","last_clean":"2024-03-16T10:50:49.296839+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:50:49.296839+0000","last_undegraded":"2024-03-16T10:50:49.296839+0000","last_fullsized":"2024-03-16T10:50:49.296839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521009+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:50:10.521009+0000","last_peered":"2024-03-16T10:50:10.521009+0000","last_clean":"2024-03-16T10:50:10.521009+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:50:10.521009+0000","last_undegraded":"2024-03-16T10:50:10.521009+0000","last_fullsized":"2024-03-16T10:50:10.521009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275274+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:49:42.275274+0000","last_peered":"2024-03-16T10:49:42.275274+0000","last_clean":"2024-03-16T10:49:42.275274+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:49:42.275274+0000","last_undegraded":"2024-03-16T10:49:42.275274+0000","last_fullsized":"2024-03-16T10:49:42.275274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508093+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:50:10.508093+0000","last_peered":"2024-03-16T10:50:10.508093+0000","last_clean":"2024-03-16T10:50:10.508093+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:50:10.508093+0000","last_undegraded":"2024-03-16T10:50:10.508093+0000","last_fullsized":"2024-03-16T10:50:10.508093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274672+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:49:42.274672+0000","last_peered":"2024-03-16T10:49:42.274672+0000","last_clean":"2024-03-16T10:49:42.274672+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:49:42.274672+0000","last_undegraded":"2024-03-16T10:49:42.274672+0000","last_fullsized":"2024-03-16T10:49:42.274672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516795+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:50:10.516795+0000","last_peered":"2024-03-16T10:50:10.516795+0000","last_clean":"2024-03-16T10:50:10.516795+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:50:10.516795+0000","last_undegraded":"2024-03-16T10:50:10.516795+0000","last_fullsized":"2024-03-16T10:50:10.516795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505205+0000","last_change":"2024-03-16T10:49:42.792025+0000","last_active":"2024-03-16T10:50:10.505205+0000","last_peered":"2024-03-16T10:50:10.505205+0000","last_clean":"2024-03-16T10:50:10.505205+0000","last_became_active":"2024-03-16T10:49:42.791745+0000","last_became_peered":"2024-03-16T10:49:42.791745+0000","last_unstale":"2024-03-16T10:50:10.505205+0000","last_undegraded":"2024-03-16T10:50:10.505205+0000","last_fullsized":"2024-03-16T10:50:10.505205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:50:32.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495402+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:50:10.495402+0000","last_peered":"2024-03-16T10:50:10.495402+0000","last_clean":"2024-03-16T10:50:10.495402+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:50:10.495402+0000","last_undegraded":"2024-03-16T10:50:10.495402+0000","last_fullsized":"2024-03-16T10:50:10.495402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.500502+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:50:10.500502+0000","last_peered":"2024-03-16T10:50:10.500502+0000","last_clean":"2024-03-16T10:50:10.500502+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:50:10.500502+0000","last_undegraded":"2024-03-16T10:50:10.500502+0000","last_fullsized":"2024-03-16T10:50:10.500502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509363+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:50:10.509363+0000","last_peered":"2024-03-16T10:50:10.509363+0000","last_clean":"2024-03-16T10:50:10.509363+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:50:10.509363+0000","last_undegraded":"2024-03-16T10:50:10.509363+0000","last_fullsized":"2024-03-16T10:50:10.509363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505148+0000","last_change":"2024-03-16T10:49:42.792395+0000","last_active":"2024-03-16T10:50:10.505148+0000","last_peered":"2024-03-16T10:50:10.505148+0000","last_clean":"2024-03-16T10:50:10.505148+0000","last_became_active":"2024-03-16T10:49:42.791992+0000","last_became_peered":"2024-03-16T10:49:42.791992+0000","last_unstale":"2024-03-16T10:50:10.505148+0000","last_undegraded":"2024-03-16T10:50:10.505148+0000","last_fullsized":"2024-03-16T10:50:10.505148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:15:16.825389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503402+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:50:10.503402+0000","last_peered":"2024-03-16T10:50:10.503402+0000","last_clean":"2024-03-16T10:50:10.503402+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:50:10.503402+0000","last_undegraded":"2024-03-16T10:50:10.503402+0000","last_fullsized":"2024-03-16T10:50:10.503402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508503+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:50:10.508503+0000","last_peered":"2024-03-16T10:50:10.508503+0000","last_clean":"2024-03-16T10:50:10.508503+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:50:10.508503+0000","last_undegraded":"2024-03-16T10:50:10.508503+0000","last_fullsized":"2024-03-16T10:50:10.508503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506446+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:50:10.506446+0000","last_peered":"2024-03-16T10:50:10.506446+0000","last_clean":"2024-03-16T10:50:10.506446+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:50:10.506446+0000","last_undegraded":"2024-03-16T10:50:10.506446+0000","last_fullsized":"2024-03-16T10:50:10.506446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.501919+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:50:10.501919+0000","last_peered":"2024-03-16T10:50:10.501919+0000","last_clean":"2024-03-16T10:50:10.501919+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:50:10.501919+0000","last_undegraded":"2024-03-16T10:50:10.501919+0000","last_fullsized":"2024-03-16T10:50:10.501919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507838+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:50:10.507838+0000","last_peered":"2024-03-16T10:50:10.507838+0000","last_clean":"2024-03-16T10:50:10.507838+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:50:10.507838+0000","last_undegraded":"2024-03-16T10:50:10.507838+0000","last_fullsized":"2024-03-16T10:50:10.507838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522414+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:50:10.522414+0000","last_peered":"2024-03-16T10:50:10.522414+0000","last_clean":"2024-03-16T10:50:10.522414+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:50:10.522414+0000","last_undegraded":"2024-03-16T10:50:10.522414+0000","last_fullsized":"2024-03-16T10:50:10.522414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514335+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:50:10.514335+0000","last_peered":"2024-03-16T10:50:10.514335+0000","last_clean":"2024-03-16T10:50:10.514335+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:50:10.514335+0000","last_undegraded":"2024-03-16T10:50:10.514335+0000","last_fullsized":"2024-03-16T10:50:10.514335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503699+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:50:10.503699+0000","last_peered":"2024-03-16T10:50:10.503699+0000","last_clean":"2024-03-16T10:50:10.503699+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:50:10.503699+0000","last_undegraded":"2024-03-16T10:50:10.503699+0000","last_fullsized":"2024-03-16T10:50:10.503699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69089,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1194,"num_read_kb":672,"num_write":252,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":212979,"data_compressed":5628,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":457215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":1109489,"data_compressed":37961,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":456359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":1050440,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":958464,"data_stored":456588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":519104,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":457619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":519240,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":1049278,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68368,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64107,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63563,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:50:55.318 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-16T10:50:55.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 -- 172.21.15.17:0/2959363202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0081018f0 msgr2=0x7ff008101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 --2- 172.21.15.17:0/2959363202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0081018f0 0x7ff008101d70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feffc009900 tx=0x7feffc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 -- 172.21.15.17:0/2959363202 shutdown_connections 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 --2- 172.21.15.17:0/2959363202 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff008108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 --2- 172.21.15.17:0/2959363202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0081018f0 0x7ff008101d70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 --2- 172.21.15.17:0/2959363202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff008100700 0x7ff008100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 -- 172.21.15.17:0/2959363202 >> 172.21.15.17:0/2959363202 conn(0x7ff0080fbc70 msgr2=0x7ff0080fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 -- 172.21.15.17:0/2959363202 shutdown_connections 2024-03-16T10:50:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.485+0000 7ff00d109640 1 -- 172.21.15.17:0/2959363202 wait complete. 2024-03-16T10:50:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 Processor -- start 2024-03-16T10:50:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 -- start start 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 0x7ff008198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff00819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff00810d4a0 con 0x7ff008100700 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff00810d320 con 0x7ff0081018f0 2024-03-16T10:50:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00d109640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff00810d620 con 0x7ff0081022b0 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42472/0 (socket says 172.21.15.17:42472) 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 -- 172.21.15.17:0/3114061624 learned_addr learned my addr 172.21.15.17:0/3114061624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00759e640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff00819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00659c640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 0x7ff008198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 -- 172.21.15.17:0/3114061624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 msgr2=0x7ff00819f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff00819f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 -- 172.21.15.17:0/3114061624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 msgr2=0x7ff008198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 0x7ff008198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff006d9d640 1 -- 172.21.15.17:0/3114061624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00819f720 con 0x7ff008100700 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00759e640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff00819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.486+0000 7ff00659c640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 0x7ff008198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7ff006d9d640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feff800e9c0 tx=0x7feff800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff800cd80 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feff80035f0 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00819fa10 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8010690 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.487+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00819ff30 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.488+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff008107a20 con 0x7ff008100700 2024-03-16T10:50:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.489+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7feff80037a0 con 0x7ff008100700 2024-03-16T10:50:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.489+0000 7fefeffff640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 0x7feff00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.490+0000 7ff00659c640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 0x7feff00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.490+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7feff80cefa0 con 0x7ff008100700 2024-03-16T10:50:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.490+0000 7ff00659c640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 0x7feff00a4d50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feffc02c7b0 tx=0x7feffc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.494+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7feff809bee0 con 0x7ff008100700 2024-03-16T10:50:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:55 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3005893289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:55.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:55 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/969015864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:55.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:55 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3005893289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:55.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:55 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/969015864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:55.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:55 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3005893289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:55.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:55 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/969015864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.673+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 --> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff008061c20 con 0x7feff00a2890 2024-03-16T10:50:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.681+0000 7fefeffff640 1 -- 172.21.15.17:0/3114061624 <== mgr.14150 v2:172.21.15.17:6800/3813203524 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259107 (secure 0 0 0) 0x7ff008061c20 con 0x7feff00a2890 2024-03-16T10:50:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-16T10:50:55.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 msgr2=0x7feff00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 0x7feff00a4d50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feffc02c7b0 tx=0x7feffc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 msgr2=0x7ff008197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feff800e9c0 tx=0x7feff800ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 shutdown_connections 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feff00a2890 0x7feff00a4d50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0081022b0 0x7ff00819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0081018f0 0x7ff008198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 --2- 172.21.15.17:0/3114061624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff008100700 0x7ff008197b00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 >> 172.21.15.17:0/3114061624 conn(0x7ff0080fbc70 msgr2=0x7ff008104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 shutdown_connections 2024-03-16T10:50:55.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.685+0000 7ff00d109640 1 -- 172.21.15.17:0/3114061624 wait complete. 2024-03-16T10:50:55.697 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-03-16T10:50:54.511188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659691,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":781,"num_write":435,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":857,"ondisk_log_size":857,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373332,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568492,"statfs":{"total":1151940427776,"available":1151558135808,"internally_reserved":0,"allocated":11980800,"data_stored":7444673,"data_compressed":113883,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002827"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516969+0000","last_change":"2024-03-16T10:48:48.848963+0000","last_active":"2024-03-16T10:50:10.516969+0000","last_peered":"2024-03-16T10:50:10.516969+0000","last_clean":"2024-03-16T10:50:10.516969+0000","last_became_active":"2024-03-16T10:48:48.848607+0000","last_became_peered":"2024-03-16T10:48:48.848607+0000","last_unstale":"2024-03-16T10:50:10.516969+0000","last_undegraded":"2024-03-16T10:50:10.516969+0000","last_fullsized":"2024-03-16T10:50:10.516969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:09:44.821758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511591+0000","last_change":"2024-03-16T10:48:48.845402+0000","last_active":"2024-03-16T10:50:10.511591+0000","last_peered":"2024-03-16T10:50:10.511591+0000","last_clean":"2024-03-16T10:50:10.511591+0000","last_became_active":"2024-03-16T10:48:48.845083+0000","last_became_peered":"2024-03-16T10:48:48.845083+0000","last_unstale":"2024-03-16T10:50:10.511591+0000","last_undegraded":"2024-03-16T10:50:10.511591+0000","last_fullsized":"2024-03-16T10:50:10.511591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:55.033422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509559+0000","last_change":"2024-03-16T10:48:48.842889+0000","last_active":"2024-03-16T10:50:10.509559+0000","last_peered":"2024-03-16T10:50:10.509559+0000","last_clean":"2024-03-16T10:50:10.509559+0000","last_became_active":"2024-03-16T10:48:48.842610+0000","last_became_peered":"2024-03-16T10:48:48.842610+0000","last_unstale":"2024-03-16T10:50:10.509559+0000","last_undegraded":"2024-03-16T10:50:10.509559+0000","last_fullsized":"2024-03-16T10:50:10.509559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:39:06.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.493922+0000","last_change":"2024-03-16T10:48:48.843225+0000","last_active":"2024-03-16T10:50:10.493922+0000","last_peered":"2024-03-16T10:50:10.493922+0000","last_clean":"2024-03-16T10:50:10.493922+0000","last_became_active":"2024-03-16T10:48:48.842831+0000","last_became_peered":"2024-03-16T10:48:48.842831+0000","last_unstale":"2024-03-16T10:50:10.493922+0000","last_undegraded":"2024-03-16T10:50:10.493922+0000","last_fullsized":"2024-03-16T10:50:10.493922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:38.546281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490292+0000","last_change":"2024-03-16T10:48:48.842759+0000","last_active":"2024-03-16T10:50:10.490292+0000","last_peered":"2024-03-16T10:50:10.490292+0000","last_clean":"2024-03-16T10:50:10.490292+0000","last_became_active":"2024-03-16T10:48:48.842438+0000","last_became_peered":"2024-03-16T10:48:48.842438+0000","last_unstale":"2024-03-16T10:50:10.490292+0000","last_undegraded":"2024-03-16T10:50:10.490292+0000","last_fullsized":"2024-03-16T10:50:10.490292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:11.809411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495543+0000","last_change":"2024-03-16T10:49:42.791331+0000","last_active":"2024-03-16T10:50:10.495543+0000","last_peered":"2024-03-16T10:50:10.495543+0000","last_clean":"2024-03-16T10:50:10.495543+0000","last_became_active":"2024-03-16T10:49:42.791066+0000","last_became_peered":"2024-03-16T10:49:42.791066+0000","last_unstale":"2024-03-16T10:50:10.495543+0000","last_undegraded":"2024-03-16T10:50:10.495543+0000","last_fullsized":"2024-03-16T10:50:10.495543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:01.493249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510080+0000","last_change":"2024-03-16T10:48:48.842130+0000","last_active":"2024-03-16T10:50:10.510080+0000","last_peered":"2024-03-16T10:50:10.510080+0000","last_clean":"2024-03-16T10:50:10.510080+0000","last_became_active":"2024-03-16T10:48:48.841796+0000","last_became_peered":"2024-03-16T10:48:48.841796+0000","last_unstale":"2024-03-16T10:50:10.510080+0000","last_undegraded":"2024-03-16T10:50:10.510080+0000","last_fullsized":"2024-03-16T10:50:10.510080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:50.898156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509893+0000","last_change":"2024-03-16T10:48:48.845251+0000","last_active":"2024-03-16T10:50:10.509893+0000","last_peered":"2024-03-16T10:50:10.509893+0000","last_clean":"2024-03-16T10:50:10.509893+0000","last_became_active":"2024-03-16T10:48:48.844922+0000","last_became_peered":"2024-03-16T10:48:48.844922+0000","last_unstale":"2024-03-16T10:50:10.509893+0000","last_undegraded":"2024-03-16T10:50:10.509893+0000","last_fullsized":"2024-03-16T10:50:10.509893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:22.075647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521146+0000","last_change":"2024-03-16T10:48:48.838304+0000","last_active":"2024-03-16T10:50:10.521146+0000","last_peered":"2024-03-16T10:50:10.521146+0000","last_clean":"2024-03-16T10:50:10.521146+0000","last_became_active":"2024-03-16T10:48:48.837899+0000","last_became_peered":"2024-03-16T10:48:48.837899+0000","last_unstale":"2024-03-16T10:50:10.521146+0000","last_undegraded":"2024-03-16T10:50:10.521146+0000","last_fullsized":"2024-03-16T10:50:10.521146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:06:10.999418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506780+0000","last_change":"2024-03-16T10:48:48.852240+0000","last_active":"2024-03-16T10:50:10.506780+0000","last_peered":"2024-03-16T10:50:10.506780+0000","last_clean":"2024-03-16T10:50:10.506780+0000","last_became_active":"2024-03-16T10:48:48.851940+0000","last_became_peered":"2024-03-16T10:48:48.851940+0000","last_unstale":"2024-03-16T10:50:10.506780+0000","last_undegraded":"2024-03-16T10:50:10.506780+0000","last_fullsized":"2024-03-16T10:50:10.506780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:19.585559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521048+0000","last_change":"2024-03-16T10:48:48.856519+0000","last_active":"2024-03-16T10:50:10.521048+0000","last_peered":"2024-03-16T10:50:10.521048+0000","last_clean":"2024-03-16T10:50:10.521048+0000","last_became_active":"2024-03-16T10:48:48.855917+0000","last_became_peered":"2024-03-16T10:48:48.855917+0000","last_unstale":"2024-03-16T10:50:10.521048+0000","last_undegraded":"2024-03-16T10:50:10.521048+0000","last_fullsized":"2024-03-16T10:50:10.521048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:27:28.633105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510658+0000","last_change":"2024-03-16T10:48:48.852005+0000","last_active":"2024-03-16T10:50:10.510658+0000","last_peered":"2024-03-16T10:50:10.510658+0000","last_clean":"2024-03-16T10:50:10.510658+0000","last_became_active":"2024-03-16T10:48:48.851706+0000","last_became_peered":"2024-03-16T10:48:48.851706+0000","last_unstale":"2024-03-16T10:50:10.510658+0000","last_undegraded":"2024-03-16T10:50:10.510658+0000","last_fullsized":"2024-03-16T10:50:10.510658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:09.313823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495010+0000","last_change":"2024-03-16T10:48:48.844716+0000","last_active":"2024-03-16T10:50:10.495010+0000","last_peered":"2024-03-16T10:50:10.495010+0000","last_clean":"2024-03-16T10:50:10.495010+0000","last_became_active":"2024-03-16T10:48:48.844415+0000","last_became_peered":"2024-03-16T10:48:48.844415+0000","last_unstale":"2024-03-16T10:50:10.495010+0000","last_undegraded":"2024-03-16T10:50:10.495010+0000","last_fullsized":"2024-03-16T10:50:10.495010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:42.634785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509792+0000","last_change":"2024-03-16T10:48:48.845467+0000","last_active":"2024-03-16T10:50:10.509792+0000","last_peered":"2024-03-16T10:50:10.509792+0000","last_clean":"2024-03-16T10:50:10.509792+0000","last_became_active":"2024-03-16T10:48:48.845119+0000","last_became_peered":"2024-03-16T10:48:48.845119+0000","last_unstale":"2024-03-16T10:50:10.509792+0000","last_undegraded":"2024-03-16T10:50:10.509792+0000","last_fullsized":"2024-03-16T10:50:10.509792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:52.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509076+0000","last_change":"2024-03-16T10:48:48.841555+0000","last_active":"2024-03-16T10:50:10.509076+0000","last_peered":"2024-03-16T10:50:10.509076+0000","last_clean":"2024-03-16T10:50:10.509076+0000","last_became_active":"2024-03-16T10:48:48.840327+0000","last_became_peered":"2024-03-16T10:48:48.840327+0000","last_unstale":"2024-03-16T10:50:10.509076+0000","last_undegraded":"2024-03-16T10:50:10.509076+0000","last_fullsized":"2024-03-16T10:50:10.509076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:09.205838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521982+0000","last_change":"2024-03-16T10:48:48.847534+0000","last_active":"2024-03-16T10:50:10.521982+0000","last_peered":"2024-03-16T10:50:10.521982+0000","last_clean":"2024-03-16T10:50:10.521982+0000","last_became_active":"2024-03-16T10:48:48.847231+0000","last_became_peered":"2024-03-16T10:48:48.847231+0000","last_unstale":"2024-03-16T10:50:10.521982+0000","last_undegraded":"2024-03-16T10:50:10.521982+0000","last_fullsized":"2024-03-16T10:50:10.521982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:57.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.517221+0000","last_change":"2024-03-16T10:48:48.849208+0000","last_active":"2024-03-16T10:50:10.517221+0000","last_peered":"2024-03-16T10:50:10.517221+0000","last_clean":"2024-03-16T10:50:10.517221+0000","last_became_active":"2024-03-16T10:48:48.848933+0000","last_became_peered":"2024-03-16T10:48:48.848933+0000","last_unstale":"2024-03-16T10:50:10.517221+0000","last_undegraded":"2024-03-16T10:50:10.517221+0000","last_fullsized":"2024-03-16T10:50:10.517221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:46.776263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.512884+0000","last_change":"2024-03-16T10:48:48.844399+0000","last_active":"2024-03-16T10:50:10.512884+0000","last_peered":"2024-03-16T10:50:10.512884+0000","last_clean":"2024-03-16T10:50:10.512884+0000","last_became_active":"2024-03-16T10:48:48.844094+0000","last_became_peered":"2024-03-16T10:48:48.844094+0000","last_unstale":"2024-03-16T10:50:10.512884+0000","last_undegraded":"2024-03-16T10:50:10.512884+0000","last_fullsized":"2024-03-16T10:50:10.512884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:47.602864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.497510+0000","last_change":"2024-03-16T10:48:48.838484+0000","last_active":"2024-03-16T10:50:10.497510+0000","last_peered":"2024-03-16T10:50:10.497510+0000","last_clean":"2024-03-16T10:50:10.497510+0000","last_became_active":"2024-03-16T10:48:48.838176+0000","last_became_peered":"2024-03-16T10:48:48.838176+0000","last_unstale":"2024-03-16T10:50:10.497510+0000","last_undegraded":"2024-03-16T10:50:10.497510+0000","last_fullsized":"2024-03-16T10:50:10.497510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:27.726811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.200945+0000","last_change":"2024-03-16T10:48:48.388605+0000","last_active":"2024-03-16T10:50:50.200945+0000","last_peered":"2024-03-16T10:50:50.200945+0000","last_clean":"2024-03-16T10:50:50.200945+0000","last_became_active":"2024-03-16T10:48:48.385503+0000","last_became_peered":"2024-03-16T10:48:48.385503+0000","last_unstale":"2024-03-16T10:50:50.200945+0000","last_undegraded":"2024-03-16T10:50:50.200945+0000","last_fullsized":"2024-03-16T10:50:50.200945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:18:21.876792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508015+0000","last_change":"2024-03-16T10:48:48.834814+0000","last_active":"2024-03-16T10:50:10.508015+0000","last_peered":"2024-03-16T10:50:10.508015+0000","last_clean":"2024-03-16T10:50:10.508015+0000","last_became_active":"2024-03-16T10:48:48.834493+0000","last_became_peered":"2024-03-16T10:48:48.834493+0000","last_unstale":"2024-03-16T10:50:10.508015+0000","last_undegraded":"2024-03-16T10:50:10.508015+0000","last_fullsized":"2024-03-16T10:50:10.508015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:49:21.651765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272187+0000","last_change":"2024-03-16T10:48:48.391741+0000","last_active":"2024-03-16T10:49:42.272187+0000","last_peered":"2024-03-16T10:49:42.272187+0000","last_clean":"2024-03-16T10:49:42.272187+0000","last_became_active":"2024-03-16T10:48:48.391438+0000","last_became_peered":"2024-03-16T10:48:48.391438+0000","last_unstale":"2024-03-16T10:49:42.272187+0000","last_undegraded":"2024-03-16T10:49:42.272187+0000","last_fullsized":"2024-03-16T10:49:42.272187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:38.760435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509461+0000","last_change":"2024-03-16T10:48:48.837946+0000","last_active":"2024-03-16T10:50:10.509461+0000","last_peered":"2024-03-16T10:50:10.509461+0000","last_clean":"2024-03-16T10:50:10.509461+0000","last_became_active":"2024-03-16T10:48:48.837307+0000","last_became_peered":"2024-03-16T10:48:48.837307+0000","last_unstale":"2024-03-16T10:50:10.509461+0000","last_undegraded":"2024-03-16T10:50:10.509461+0000","last_fullsized":"2024-03-16T10:50:10.509461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:58.390989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"87'13","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275821+0000","last_change":"2024-03-16T10:48:48.379087+0000","last_active":"2024-03-16T10:49:42.275821+0000","last_peered":"2024-03-16T10:49:42.275821+0000","last_clean":"2024-03-16T10:49:42.275821+0000","last_became_active":"2024-03-16T10:48:48.378333+0000","last_became_peered":"2024-03-16T10:48:48.378333+0000","last_unstale":"2024-03-16T10:49:42.275821+0000","last_undegraded":"2024-03-16T10:49:42.275821+0000","last_fullsized":"2024-03-16T10:49:42.275821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:25.587594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522168+0000","last_change":"2024-03-16T10:48:48.846459+0000","last_active":"2024-03-16T10:50:10.522168+0000","last_peered":"2024-03-16T10:50:10.522168+0000","last_clean":"2024-03-16T10:50:10.522168+0000","last_became_active":"2024-03-16T10:48:48.846140+0000","last_became_peered":"2024-03-16T10:48:48.846140+0000","last_unstale":"2024-03-16T10:50:10.522168+0000","last_undegraded":"2024-03-16T10:50:10.522168+0000","last_fullsized":"2024-03-16T10:50:10.522168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:08.474919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.282326+0000","last_change":"2024-03-16T10:49:42.282326+0000","last_active":"2024-03-16T10:49:42.282326+0000","last_peered":"2024-03-16T10:49:42.282326+0000","last_clean":"2024-03-16T10:49:42.282326+0000","last_became_active":"2024-03-16T10:49:42.277256+0000","last_became_peered":"2024-03-16T10:49:42.277256+0000","last_unstale":"2024-03-16T10:49:42.282326+0000","last_undegraded":"2024-03-16T10:49:42.282326+0000","last_fullsized":"2024-03-16T10:49:42.282326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:18.193268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516615+0000","last_change":"2024-03-16T10:48:48.844874+0000","last_active":"2024-03-16T10:50:10.516615+0000","last_peered":"2024-03-16T10:50:10.516615+0000","last_clean":"2024-03-16T10:50:10.516615+0000","last_became_active":"2024-03-16T10:48:48.844524+0000","last_became_peered":"2024-03-16T10:48:48.844524+0000","last_unstale":"2024-03-16T10:50:10.516615+0000","last_undegraded":"2024-03-16T10:50:10.516615+0000","last_fullsized":"2024-03-16T10:50:10.516615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:03.755945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:48.295938+0000","last_change":"2024-03-16T10:48:48.378212+0000","last_active":"2024-03-16T10:50:48.295938+0000","last_peered":"2024-03-16T10:50:48.295938+0000","last_clean":"2024-03-16T10:50:48.295938+0000","last_became_active":"2024-03-16T10:48:48.377885+0000","last_became_peered":"2024-03-16T10:48:48.377885+0000","last_unstale":"2024-03-16T10:50:48.295938+0000","last_undegraded":"2024-03-16T10:50:48.295938+0000","last_fullsized":"2024-03-16T10:50:48.295938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:59.986711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.490396+0000","last_change":"2024-03-16T10:48:48.842042+0000","last_active":"2024-03-16T10:50:10.490396+0000","last_peered":"2024-03-16T10:50:10.490396+0000","last_clean":"2024-03-16T10:50:10.490396+0000","last_became_active":"2024-03-16T10:48:48.840666+0000","last_became_peered":"2024-03-16T10:48:48.840666+0000","last_unstale":"2024-03-16T10:50:10.490396+0000","last_undegraded":"2024-03-16T10:50:10.490396+0000","last_fullsized":"2024-03-16T10:50:10.490396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:00:45.529203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274044+0000","last_change":"2024-03-16T10:48:48.377100+0000","last_active":"2024-03-16T10:49:42.274044+0000","last_peered":"2024-03-16T10:49:42.274044+0000","last_clean":"2024-03-16T10:49:42.274044+0000","last_became_active":"2024-03-16T10:48:48.376794+0000","last_became_peered":"2024-03-16T10:48:48.376794+0000","last_unstale":"2024-03-16T10:49:42.274044+0000","last_undegraded":"2024-03-16T10:49:42.274044+0000","last_fullsized":"2024-03-16T10:49:42.274044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:54.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502515+0000","last_change":"2024-03-16T10:48:48.842362+0000","last_active":"2024-03-16T10:50:10.502515+0000","last_peered":"2024-03-16T10:50:10.502515+0000","last_clean":"2024-03-16T10:50:10.502515+0000","last_became_active":"2024-03-16T10:48:48.842046+0000","last_became_peered":"2024-03-16T10:48:48.842046+0000","last_unstale":"2024-03-16T10:50:10.502515+0000","last_undegraded":"2024-03-16T10:50:10.502515+0000","last_fullsized":"2024-03-16T10:50:10.502515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:14:10.777493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274332+0000","last_change":"2024-03-16T10:48:48.388128+0000","last_active":"2024-03-16T10:49:42.274332+0000","last_peered":"2024-03-16T10:49:42.274332+0000","last_clean":"2024-03-16T10:49:42.274332+0000","last_became_active":"2024-03-16T10:48:48.387808+0000","last_became_peered":"2024-03-16T10:48:48.387808+0000","last_unstale":"2024-03-16T10:49:42.274332+0000","last_undegraded":"2024-03-16T10:49:42.274332+0000","last_fullsized":"2024-03-16T10:49:42.274332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:03.907334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503068+0000","last_change":"2024-03-16T10:48:48.839786+0000","last_active":"2024-03-16T10:50:10.503068+0000","last_peered":"2024-03-16T10:50:10.503068+0000","last_clean":"2024-03-16T10:50:10.503068+0000","last_became_active":"2024-03-16T10:48:48.839460+0000","last_became_peered":"2024-03-16T10:48:48.839460+0000","last_unstale":"2024-03-16T10:50:10.503068+0000","last_undegraded":"2024-03-16T10:50:10.503068+0000","last_fullsized":"2024-03-16T10:50:10.503068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:35:59.272480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275292+0000","last_change":"2024-03-16T10:48:48.378700+0000","last_active":"2024-03-16T10:49:42.275292+0000","last_peered":"2024-03-16T10:49:42.275292+0000","last_clean":"2024-03-16T10:49:42.275292+0000","last_became_active":"2024-03-16T10:48:48.378096+0000","last_became_peered":"2024-03-16T10:48:48.378096+0000","last_unstale":"2024-03-16T10:49:42.275292+0000","last_undegraded":"2024-03-16T10:49:42.275292+0000","last_fullsized":"2024-03-16T10:49:42.275292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:48:14.672068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.498981+0000","last_change":"2024-03-16T10:48:48.843216+0000","last_active":"2024-03-16T10:50:10.498981+0000","last_peered":"2024-03-16T10:50:10.498981+0000","last_clean":"2024-03-16T10:50:10.498981+0000","last_became_active":"2024-03-16T10:48:48.842674+0000","last_became_peered":"2024-03-16T10:48:48.842674+0000","last_unstale":"2024-03-16T10:50:10.498981+0000","last_undegraded":"2024-03-16T10:50:10.498981+0000","last_fullsized":"2024-03-16T10:50:10.498981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:33:52.229085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":254,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296384+0000","last_change":"2024-03-16T10:48:48.379249+0000","last_active":"2024-03-16T10:50:49.296384+0000","last_peered":"2024-03-16T10:50:49.296384+0000","last_clean":"2024-03-16T10:50:49.296384+0000","last_became_active":"2024-03-16T10:48:48.378918+0000","last_became_peered":"2024-03-16T10:48:48.378918+0000","last_unstale":"2024-03-16T10:50:49.296384+0000","last_undegraded":"2024-03-16T10:50:49.296384+0000","last_fullsized":"2024-03-16T10:50:49.296384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:39:52.494325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522515+0000","last_change":"2024-03-16T10:48:48.843095+0000","last_active":"2024-03-16T10:50:10.522515+0000","last_peered":"2024-03-16T10:50:10.522515+0000","last_clean":"2024-03-16T10:50:10.522515+0000","last_became_active":"2024-03-16T10:48:48.842778+0000","last_became_peered":"2024-03-16T10:48:48.842778+0000","last_unstale":"2024-03-16T10:50:10.522515+0000","last_undegraded":"2024-03-16T10:50:10.522515+0000","last_fullsized":"2024-03-16T10:50:10.522515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:30:16.089516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275650+0000","last_change":"2024-03-16T10:48:48.381372+0000","last_active":"2024-03-16T10:49:42.275650+0000","last_peered":"2024-03-16T10:49:42.275650+0000","last_clean":"2024-03-16T10:49:42.275650+0000","last_became_active":"2024-03-16T10:48:48.381050+0000","last_became_peered":"2024-03-16T10:48:48.381050+0000","last_unstale":"2024-03-16T10:49:42.275650+0000","last_undegraded":"2024-03-16T10:49:42.275650+0000","last_fullsized":"2024-03-16T10:49:42.275650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:39.133068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508883+0000","last_change":"2024-03-16T10:48:48.842087+0000","last_active":"2024-03-16T10:50:10.508883+0000","last_peered":"2024-03-16T10:50:10.508883+0000","last_clean":"2024-03-16T10:50:10.508883+0000","last_became_active":"2024-03-16T10:48:48.841788+0000","last_became_peered":"2024-03-16T10:48:48.841788+0000","last_unstale":"2024-03-16T10:50:10.508883+0000","last_undegraded":"2024-03-16T10:50:10.508883+0000","last_fullsized":"2024-03-16T10:50:10.508883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:26.442185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275492+0000","last_change":"2024-03-16T10:48:48.384414+0000","last_active":"2024-03-16T10:49:42.275492+0000","last_peered":"2024-03-16T10:49:42.275492+0000","last_clean":"2024-03-16T10:49:42.275492+0000","last_became_active":"2024-03-16T10:48:48.384110+0000","last_became_peered":"2024-03-16T10:48:48.384110+0000","last_unstale":"2024-03-16T10:49:42.275492+0000","last_undegraded":"2024-03-16T10:49:42.275492+0000","last_fullsized":"2024-03-16T10:49:42.275492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:34:30.213839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.519219+0000","last_change":"2024-03-16T10:48:48.841300+0000","last_active":"2024-03-16T10:50:10.519219+0000","last_peered":"2024-03-16T10:50:10.519219+0000","last_clean":"2024-03-16T10:50:10.519219+0000","last_became_active":"2024-03-16T10:48:48.840869+0000","last_became_peered":"2024-03-16T10:48:48.840869+0000","last_unstale":"2024-03-16T10:50:10.519219+0000","last_undegraded":"2024-03-16T10:50:10.519219+0000","last_fullsized":"2024-03-16T10:50:10.519219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:21.512935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'33","reported_seq":290,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296382+0000","last_change":"2024-03-16T10:48:48.377914+0000","last_active":"2024-03-16T10:50:49.296382+0000","last_peered":"2024-03-16T10:50:49.296382+0000","last_clean":"2024-03-16T10:50:49.296382+0000","last_became_active":"2024-03-16T10:48:48.377546+0000","last_became_peered":"2024-03-16T10:48:48.377546+0000","last_unstale":"2024-03-16T10:50:49.296382+0000","last_undegraded":"2024-03-16T10:50:49.296382+0000","last_fullsized":"2024-03-16T10:50:49.296382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:14:15.417435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":179,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513536+0000","last_change":"2024-03-16T10:48:48.848284+0000","last_active":"2024-03-16T10:50:10.513536+0000","last_peered":"2024-03-16T10:50:10.513536+0000","last_clean":"2024-03-16T10:50:10.513536+0000","last_became_active":"2024-03-16T10:48:48.847907+0000","last_became_peered":"2024-03-16T10:48:48.847907+0000","last_unstale":"2024-03-16T10:50:10.513536+0000","last_undegraded":"2024-03-16T10:50:10.513536+0000","last_fullsized":"2024-03-16T10:50:10.513536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:49.975785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271826+0000","last_change":"2024-03-16T10:48:48.371546+0000","last_active":"2024-03-16T10:49:42.271826+0000","last_peered":"2024-03-16T10:49:42.271826+0000","last_clean":"2024-03-16T10:49:42.271826+0000","last_became_active":"2024-03-16T10:48:48.371225+0000","last_became_peered":"2024-03-16T10:48:48.371225+0000","last_unstale":"2024-03-16T10:49:42.271826+0000","last_undegraded":"2024-03-16T10:49:42.271826+0000","last_fullsized":"2024-03-16T10:49:42.271826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:52:40.970446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514034+0000","last_change":"2024-03-16T10:48:48.856357+0000","last_active":"2024-03-16T10:50:10.514034+0000","last_peered":"2024-03-16T10:50:10.514034+0000","last_clean":"2024-03-16T10:50:10.514034+0000","last_became_active":"2024-03-16T10:48:48.856010+0000","last_became_peered":"2024-03-16T10:48:48.856010+0000","last_unstale":"2024-03-16T10:50:10.514034+0000","last_undegraded":"2024-03-16T10:50:10.514034+0000","last_fullsized":"2024-03-16T10:50:10.514034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:43:13.696416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275782+0000","last_change":"2024-03-16T10:48:48.385436+0000","last_active":"2024-03-16T10:49:42.275782+0000","last_peered":"2024-03-16T10:49:42.275782+0000","last_clean":"2024-03-16T10:49:42.275782+0000","last_became_active":"2024-03-16T10:48:48.385126+0000","last_became_peered":"2024-03-16T10:48:48.385126+0000","last_unstale":"2024-03-16T10:49:42.275782+0000","last_undegraded":"2024-03-16T10:49:42.275782+0000","last_fullsized":"2024-03-16T10:49:42.275782+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:06.777871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.520279+0000","last_change":"2024-03-16T10:49:42.792180+0000","last_active":"2024-03-16T10:50:10.520279+0000","last_peered":"2024-03-16T10:50:10.520279+0000","last_clean":"2024-03-16T10:50:10.520279+0000","last_became_active":"2024-03-16T10:49:42.791813+0000","last_became_peered":"2024-03-16T10:49:42.791813+0000","last_unstale":"2024-03-16T10:50:10.520279+0000","last_undegraded":"2024-03-16T10:50:10.520279+0000","last_fullsized":"2024-03-16T10:50:10.520279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:48.571823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'7","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.297161+0000","last_change":"2024-03-16T10:48:48.375380+0000","last_active":"2024-03-16T10:50:49.297161+0000","last_peered":"2024-03-16T10:50:49.297161+0000","last_clean":"2024-03-16T10:50:49.297161+0000","last_became_active":"2024-03-16T10:48:48.375040+0000","last_became_peered":"2024-03-16T10:48:48.375040+0000","last_unstale":"2024-03-16T10:50:49.297161+0000","last_undegraded":"2024-03-16T10:50:49.297161+0000","last_fullsized":"2024-03-16T10:50:49.297161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:33.780389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511547+0000","last_change":"2024-03-16T10:48:48.841635+0000","last_active":"2024-03-16T10:50:10.511547+0000","last_peered":"2024-03-16T10:50:10.511547+0000","last_clean":"2024-03-16T10:50:10.511547+0000","last_became_active":"2024-03-16T10:48:48.841147+0000","last_became_peered":"2024-03-16T10:48:48.841147+0000","last_unstale":"2024-03-16T10:50:10.511547+0000","last_undegraded":"2024-03-16T10:50:10.511547+0000","last_fullsized":"2024-03-16T10:50:10.511547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:12.344034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275173+0000","last_change":"2024-03-16T10:48:48.382666+0000","last_active":"2024-03-16T10:49:42.275173+0000","last_peered":"2024-03-16T10:49:42.275173+0000","last_clean":"2024-03-16T10:49:42.275173+0000","last_became_active":"2024-03-16T10:48:48.382345+0000","last_became_peered":"2024-03-16T10:48:48.382345+0000","last_unstale":"2024-03-16T10:49:42.275173+0000","last_undegraded":"2024-03-16T10:49:42.275173+0000","last_fullsized":"2024-03-16T10:49:42.275173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:24.352240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.515883+0000","last_change":"2024-03-16T10:48:48.843795+0000","last_active":"2024-03-16T10:50:10.515883+0000","last_peered":"2024-03-16T10:50:10.515883+0000","last_clean":"2024-03-16T10:50:10.515883+0000","last_became_active":"2024-03-16T10:48:48.843503+0000","last_became_peered":"2024-03-16T10:48:48.843503+0000","last_unstale":"2024-03-16T10:50:10.515883+0000","last_undegraded":"2024-03-16T10:50:10.515883+0000","last_fullsized":"2024-03-16T10:50:10.515883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:18:45.681022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275702+0000","last_change":"2024-03-16T10:48:48.379382+0000","last_active":"2024-03-16T10:49:42.275702+0000","last_peered":"2024-03-16T10:49:42.275702+0000","last_clean":"2024-03-16T10:49:42.275702+0000","last_became_active":"2024-03-16T10:48:48.378894+0000","last_became_peered":"2024-03-16T10:48:48.378894+0000","last_unstale":"2024-03-16T10:49:42.275702+0000","last_undegraded":"2024-03-16T10:49:42.275702+0000","last_fullsized":"2024-03-16T10:49:42.275702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.061093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503929+0000","last_change":"2024-03-16T10:48:48.852269+0000","last_active":"2024-03-16T10:50:10.503929+0000","last_peered":"2024-03-16T10:50:10.503929+0000","last_clean":"2024-03-16T10:50:10.503929+0000","last_became_active":"2024-03-16T10:48:48.851893+0000","last_became_peered":"2024-03-16T10:48:48.851893+0000","last_unstale":"2024-03-16T10:50:10.503929+0000","last_undegraded":"2024-03-16T10:50:10.503929+0000","last_fullsized":"2024-03-16T10:50:10.503929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:02:54.348384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791042+0000","last_change":"2024-03-16T10:48:48.392269+0000","last_active":"2024-03-16T10:49:42.791042+0000","last_peered":"2024-03-16T10:49:42.791042+0000","last_clean":"2024-03-16T10:49:42.791042+0000","last_became_active":"2024-03-16T10:48:48.391941+0000","last_became_peered":"2024-03-16T10:48:48.391941+0000","last_unstale":"2024-03-16T10:49:42.791042+0000","last_undegraded":"2024-03-16T10:49:42.791042+0000","last_fullsized":"2024-03-16T10:49:42.791042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:43:31.131713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509779+0000","last_change":"2024-03-16T10:48:48.849954+0000","last_active":"2024-03-16T10:50:10.509779+0000","last_peered":"2024-03-16T10:50:10.509779+0000","last_clean":"2024-03-16T10:50:10.509779+0000","last_became_active":"2024-03-16T10:48:48.849651+0000","last_became_peered":"2024-03-16T10:48:48.849651+0000","last_unstale":"2024-03-16T10:50:10.509779+0000","last_undegraded":"2024-03-16T10:50:10.509779+0000","last_fullsized":"2024-03-16T10:50:10.509779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:50.526558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'6","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:50.301086+0000","last_change":"2024-03-16T10:48:48.382967+0000","last_active":"2024-03-16T10:50:50.301086+0000","last_peered":"2024-03-16T10:50:50.301086+0000","last_clean":"2024-03-16T10:50:50.301086+0000","last_became_active":"2024-03-16T10:48:48.382681+0000","last_became_peered":"2024-03-16T10:48:48.382681+0000","last_unstale":"2024-03-16T10:50:50.301086+0000","last_undegraded":"2024-03-16T10:50:50.301086+0000","last_fullsized":"2024-03-16T10:50:50.301086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:00.226978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.510526+0000","last_change":"2024-03-16T10:48:48.853641+0000","last_active":"2024-03-16T10:50:10.510526+0000","last_peered":"2024-03-16T10:50:10.510526+0000","last_clean":"2024-03-16T10:50:10.510526+0000","last_became_active":"2024-03-16T10:48:48.853357+0000","last_became_peered":"2024-03-16T10:48:48.853357+0000","last_unstale":"2024-03-16T10:50:10.510526+0000","last_undegraded":"2024-03-16T10:50:10.510526+0000","last_fullsized":"2024-03-16T10:50:10.510526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:23.554479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.502799+0000","last_change":"2024-03-16T10:48:48.840566+0000","last_active":"2024-03-16T10:50:10.502799+0000","last_peered":"2024-03-16T10:50:10.502799+0000","last_clean":"2024-03-16T10:50:10.502799+0000","last_became_active":"2024-03-16T10:48:48.840250+0000","last_became_peered":"2024-03-16T10:48:48.840250+0000","last_unstale":"2024-03-16T10:50:10.502799+0000","last_undegraded":"2024-03-16T10:50:10.502799+0000","last_fullsized":"2024-03-16T10:50:10.502799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:00.167612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296858+0000","last_change":"2024-03-16T10:48:48.386336+0000","last_active":"2024-03-16T10:50:49.296858+0000","last_peered":"2024-03-16T10:50:49.296858+0000","last_clean":"2024-03-16T10:50:49.296858+0000","last_became_active":"2024-03-16T10:48:48.386016+0000","last_became_peered":"2024-03-16T10:48:48.386016+0000","last_unstale":"2024-03-16T10:50:49.296858+0000","last_undegraded":"2024-03-16T10:50:49.296858+0000","last_fullsized":"2024-03-16T10:50:49.296858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.586408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.513394+0000","last_change":"2024-03-16T10:48:48.835864+0000","last_active":"2024-03-16T10:50:10.513394+0000","last_peered":"2024-03-16T10:50:10.513394+0000","last_clean":"2024-03-16T10:50:10.513394+0000","last_became_active":"2024-03-16T10:48:48.835555+0000","last_became_peered":"2024-03-16T10:48:48.835555+0000","last_unstale":"2024-03-16T10:50:10.513394+0000","last_undegraded":"2024-03-16T10:50:10.513394+0000","last_fullsized":"2024-03-16T10:50:10.513394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:08:46.995124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272073+0000","last_change":"2024-03-16T10:48:48.381025+0000","last_active":"2024-03-16T10:49:42.272073+0000","last_peered":"2024-03-16T10:49:42.272073+0000","last_clean":"2024-03-16T10:49:42.272073+0000","last_became_active":"2024-03-16T10:48:48.380667+0000","last_became_peered":"2024-03-16T10:48:48.380667+0000","last_unstale":"2024-03-16T10:49:42.272073+0000","last_undegraded":"2024-03-16T10:49:42.272073+0000","last_fullsized":"2024-03-16T10:49:42.272073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:51.908570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274675+0000","last_change":"2024-03-16T10:47:34.237446+0000","last_active":"2024-03-16T10:49:42.274675+0000","last_peered":"2024-03-16T10:49:42.274675+0000","last_clean":"2024-03-16T10:49:42.274675+0000","last_became_active":"2024-03-16T10:47:34.237013+0000","last_became_peered":"2024-03-16T10:47:34.237013+0000","last_unstale":"2024-03-16T10:49:42.274675+0000","last_undegraded":"2024-03-16T10:49:42.274675+0000","last_fullsized":"2024-03-16T10:49:42.274675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:44:06.737287+0000","last_clean_scrub_stamp":"2024-03-16T10:44:06.737287+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:34:29.893978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507559+0000","last_change":"2024-03-16T10:48:48.843411+0000","last_active":"2024-03-16T10:50:10.507559+0000","last_peered":"2024-03-16T10:50:10.507559+0000","last_clean":"2024-03-16T10:50:10.507559+0000","last_became_active":"2024-03-16T10:48:48.843089+0000","last_became_peered":"2024-03-16T10:48:48.843089+0000","last_unstale":"2024-03-16T10:50:10.507559+0000","last_undegraded":"2024-03-16T10:50:10.507559+0000","last_fullsized":"2024-03-16T10:50:10.507559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:20.454783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274875+0000","last_change":"2024-03-16T10:48:48.381120+0000","last_active":"2024-03-16T10:49:42.274875+0000","last_peered":"2024-03-16T10:49:42.274875+0000","last_clean":"2024-03-16T10:49:42.274875+0000","last_became_active":"2024-03-16T10:48:48.380807+0000","last_became_peered":"2024-03-16T10:48:48.380807+0000","last_unstale":"2024-03-16T10:49:42.274875+0000","last_undegraded":"2024-03-16T10:49:42.274875+0000","last_fullsized":"2024-03-16T10:49:42.274875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:50.891061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275632+0000","last_change":"2024-03-16T10:48:48.386496+0000","last_active":"2024-03-16T10:49:42.275632+0000","last_peered":"2024-03-16T10:49:42.275632+0000","last_clean":"2024-03-16T10:49:42.275632+0000","last_became_active":"2024-03-16T10:48:48.386184+0000","last_became_peered":"2024-03-16T10:48:48.386184+0000","last_unstale":"2024-03-16T10:49:42.275632+0000","last_undegraded":"2024-03-16T10:49:42.275632+0000","last_fullsized":"2024-03-16T10:49:42.275632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:37:03.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508631+0000","last_change":"2024-03-16T10:48:48.838642+0000","last_active":"2024-03-16T10:50:10.508631+0000","last_peered":"2024-03-16T10:50:10.508631+0000","last_clean":"2024-03-16T10:50:10.508631+0000","last_became_active":"2024-03-16T10:48:48.838059+0000","last_became_peered":"2024-03-16T10:48:48.838059+0000","last_unstale":"2024-03-16T10:50:10.508631+0000","last_undegraded":"2024-03-16T10:50:10.508631+0000","last_fullsized":"2024-03-16T10:50:10.508631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:54.306856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'14","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.791283+0000","last_change":"2024-03-16T10:48:48.384349+0000","last_active":"2024-03-16T10:49:42.791283+0000","last_peered":"2024-03-16T10:49:42.791283+0000","last_clean":"2024-03-16T10:49:42.791283+0000","last_became_active":"2024-03-16T10:48:48.384059+0000","last_became_peered":"2024-03-16T10:48:48.384059+0000","last_unstale":"2024-03-16T10:49:42.791283+0000","last_undegraded":"2024-03-16T10:49:42.791283+0000","last_fullsized":"2024-03-16T10:49:42.791283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:08.456259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509871+0000","last_change":"2024-03-16T10:48:48.847050+0000","last_active":"2024-03-16T10:50:10.509871+0000","last_peered":"2024-03-16T10:50:10.509871+0000","last_clean":"2024-03-16T10:50:10.509871+0000","last_became_active":"2024-03-16T10:48:48.846719+0000","last_became_peered":"2024-03-16T10:48:48.846719+0000","last_unstale":"2024-03-16T10:50:10.509871+0000","last_undegraded":"2024-03-16T10:50:10.509871+0000","last_fullsized":"2024-03-16T10:50:10.509871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:23:52.407683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272671+0000","last_change":"2024-03-16T10:48:48.388633+0000","last_active":"2024-03-16T10:49:42.272671+0000","last_peered":"2024-03-16T10:49:42.272671+0000","last_clean":"2024-03-16T10:49:42.272671+0000","last_became_active":"2024-03-16T10:48:48.388385+0000","last_became_peered":"2024-03-16T10:48:48.388385+0000","last_unstale":"2024-03-16T10:49:42.272671+0000","last_undegraded":"2024-03-16T10:49:42.272671+0000","last_fullsized":"2024-03-16T10:49:42.272671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:58:06.379815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.511731+0000","last_change":"2024-03-16T10:48:48.841184+0000","last_active":"2024-03-16T10:50:10.511731+0000","last_peered":"2024-03-16T10:50:10.511731+0000","last_clean":"2024-03-16T10:50:10.511731+0000","last_became_active":"2024-03-16T10:48:48.840808+0000","last_became_peered":"2024-03-16T10:48:48.840808+0000","last_unstale":"2024-03-16T10:50:10.511731+0000","last_undegraded":"2024-03-16T10:50:10.511731+0000","last_fullsized":"2024-03-16T10:50:10.511731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:05.148018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.280047+0000","last_change":"2024-03-16T10:49:42.280047+0000","last_active":"2024-03-16T10:49:42.280047+0000","last_peered":"2024-03-16T10:49:42.280047+0000","last_clean":"2024-03-16T10:49:42.280047+0000","last_became_active":"2024-03-16T10:49:42.277477+0000","last_became_peered":"2024-03-16T10:49:42.277477+0000","last_unstale":"2024-03-16T10:49:42.280047+0000","last_undegraded":"2024-03-16T10:49:42.280047+0000","last_fullsized":"2024-03-16T10:49:42.280047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:04.299467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.468905+0000","last_change":"2024-03-16T10:48:48.841581+0000","last_active":"2024-03-16T10:50:10.468905+0000","last_peered":"2024-03-16T10:50:10.468905+0000","last_clean":"2024-03-16T10:50:10.468905+0000","last_became_active":"2024-03-16T10:48:48.841263+0000","last_became_peered":"2024-03-16T10:48:48.841263+0000","last_unstale":"2024-03-16T10:50:10.468905+0000","last_undegraded":"2024-03-16T10:50:10.468905+0000","last_fullsized":"2024-03-16T10:50:10.468905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:07.257807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.271623+0000","last_change":"2024-03-16T10:48:48.374807+0000","last_active":"2024-03-16T10:49:42.271623+0000","last_peered":"2024-03-16T10:49:42.271623+0000","last_clean":"2024-03-16T10:49:42.271623+0000","last_became_active":"2024-03-16T10:48:48.374433+0000","last_became_peered":"2024-03-16T10:48:48.374433+0000","last_unstale":"2024-03-16T10:49:42.271623+0000","last_undegraded":"2024-03-16T10:49:42.271623+0000","last_fullsized":"2024-03-16T10:49:42.271623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:20.355487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505065+0000","last_change":"2024-03-16T10:48:48.840051+0000","last_active":"2024-03-16T10:50:10.505065+0000","last_peered":"2024-03-16T10:50:10.505065+0000","last_clean":"2024-03-16T10:50:10.505065+0000","last_became_active":"2024-03-16T10:48:48.839783+0000","last_became_peered":"2024-03-16T10:48:48.839783+0000","last_unstale":"2024-03-16T10:50:10.505065+0000","last_undegraded":"2024-03-16T10:50:10.505065+0000","last_fullsized":"2024-03-16T10:50:10.505065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:27.424858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.272057+0000","last_change":"2024-03-16T10:48:48.375133+0000","last_active":"2024-03-16T10:49:42.272057+0000","last_peered":"2024-03-16T10:49:42.272057+0000","last_clean":"2024-03-16T10:49:42.272057+0000","last_became_active":"2024-03-16T10:48:48.374800+0000","last_became_peered":"2024-03-16T10:48:48.374800+0000","last_unstale":"2024-03-16T10:49:42.272057+0000","last_undegraded":"2024-03-16T10:49:42.272057+0000","last_fullsized":"2024-03-16T10:49:42.272057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:12:21.926221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503887+0000","last_change":"2024-03-16T10:48:48.845555+0000","last_active":"2024-03-16T10:50:10.503887+0000","last_peered":"2024-03-16T10:50:10.503887+0000","last_clean":"2024-03-16T10:50:10.503887+0000","last_became_active":"2024-03-16T10:48:48.845200+0000","last_became_peered":"2024-03-16T10:48:48.845200+0000","last_unstale":"2024-03-16T10:50:10.503887+0000","last_undegraded":"2024-03-16T10:50:10.503887+0000","last_fullsized":"2024-03-16T10:50:10.503887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:31.870333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275122+0000","last_change":"2024-03-16T10:48:48.379609+0000","last_active":"2024-03-16T10:49:42.275122+0000","last_peered":"2024-03-16T10:49:42.275122+0000","last_clean":"2024-03-16T10:49:42.275122+0000","last_became_active":"2024-03-16T10:48:48.379005+0000","last_became_peered":"2024-03-16T10:48:48.379005+0000","last_unstale":"2024-03-16T10:49:42.275122+0000","last_undegraded":"2024-03-16T10:49:42.275122+0000","last_fullsized":"2024-03-16T10:49:42.275122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:44.288970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521695+0000","last_change":"2024-03-16T10:48:48.853849+0000","last_active":"2024-03-16T10:50:10.521695+0000","last_peered":"2024-03-16T10:50:10.521695+0000","last_clean":"2024-03-16T10:50:10.521695+0000","last_became_active":"2024-03-16T10:48:48.853550+0000","last_became_peered":"2024-03-16T10:48:48.853550+0000","last_unstale":"2024-03-16T10:50:10.521695+0000","last_undegraded":"2024-03-16T10:50:10.521695+0000","last_fullsized":"2024-03-16T10:50:10.521695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:53:11.507718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:49.296839+0000","last_change":"2024-03-16T10:48:48.389260+0000","last_active":"2024-03-16T10:50:49.296839+0000","last_peered":"2024-03-16T10:50:49.296839+0000","last_clean":"2024-03-16T10:50:49.296839+0000","last_became_active":"2024-03-16T10:48:48.388908+0000","last_became_peered":"2024-03-16T10:48:48.388908+0000","last_unstale":"2024-03-16T10:50:49.296839+0000","last_undegraded":"2024-03-16T10:50:49.296839+0000","last_fullsized":"2024-03-16T10:50:49.296839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:15:17.622886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.521009+0000","last_change":"2024-03-16T10:48:48.856123+0000","last_active":"2024-03-16T10:50:10.521009+0000","last_peered":"2024-03-16T10:50:10.521009+0000","last_clean":"2024-03-16T10:50:10.521009+0000","last_became_active":"2024-03-16T10:48:48.855803+0000","last_became_peered":"2024-03-16T10:48:48.855803+0000","last_unstale":"2024-03-16T10:50:10.521009+0000","last_undegraded":"2024-03-16T10:50:10.521009+0000","last_fullsized":"2024-03-16T10:50:10.521009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:38:40.632570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.275274+0000","last_change":"2024-03-16T10:48:48.385431+0000","last_active":"2024-03-16T10:49:42.275274+0000","last_peered":"2024-03-16T10:49:42.275274+0000","last_clean":"2024-03-16T10:49:42.275274+0000","last_became_active":"2024-03-16T10:48:48.385052+0000","last_became_peered":"2024-03-16T10:48:48.385052+0000","last_unstale":"2024-03-16T10:49:42.275274+0000","last_undegraded":"2024-03-16T10:49:42.275274+0000","last_fullsized":"2024-03-16T10:49:42.275274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:00.552812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508093+0000","last_change":"2024-03-16T10:48:48.843257+0000","last_active":"2024-03-16T10:50:10.508093+0000","last_peered":"2024-03-16T10:50:10.508093+0000","last_clean":"2024-03-16T10:50:10.508093+0000","last_became_active":"2024-03-16T10:48:48.842917+0000","last_became_peered":"2024-03-16T10:48:48.842917+0000","last_unstale":"2024-03-16T10:50:10.508093+0000","last_undegraded":"2024-03-16T10:50:10.508093+0000","last_fullsized":"2024-03-16T10:50:10.508093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:09.472717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:49:42.274672+0000","last_change":"2024-03-16T10:48:48.385086+0000","last_active":"2024-03-16T10:49:42.274672+0000","last_peered":"2024-03-16T10:49:42.274672+0000","last_clean":"2024-03-16T10:49:42.274672+0000","last_became_active":"2024-03-16T10:48:48.384757+0000","last_became_peered":"2024-03-16T10:48:48.384757+0000","last_unstale":"2024-03-16T10:49:42.274672+0000","last_undegraded":"2024-03-16T10:49:42.274672+0000","last_fullsized":"2024-03-16T10:49:42.274672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:47.358079+0000","last_clean_scrub_stamp":"2024-03-16T10:48:47.358079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:15.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.516795+0000","last_change":"2024-03-16T10:48:48.852431+0000","last_active":"2024-03-16T10:50:10.516795+0000","last_peered":"2024-03-16T10:50:10.516795+0000","last_clean":"2024-03-16T10:50:10.516795+0000","last_became_active":"2024-03-16T10:48:48.852142+0000","last_became_peered":"2024-03-16T10:48:48.852142+0000","last_unstale":"2024-03-16T10:50:10.516795+0000","last_undegraded":"2024-03-16T10:50:10.516795+0000","last_fullsized":"2024-03-16T10:50:10.516795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:41.392483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505205+0000","last_change":"2024-03-16T10:49:42.792025+0000","last_active":"2024-03-16T10:50:10.505205+0000","last_peered":"2024-03-16T10:50:10.505205+0000","last_clean":"2024-03-16T10:50:10.505205+0000","last_became_active":"2024-03-16T10:49:42.791745+0000","last_became_peered":"2024-03-16T10:49:42.791745+0000","last_unstale":"2024-03-16T10:50:10.505205+0000","last_undegraded":"2024-03-16T10:50:10.505205+0000","last_fullsized":"2024-03-16T10:50:10.505205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:50:32.041055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":29,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.495402+0000","last_change":"2024-03-16T10:48:48.840519+0000","last_active":"2024-03-16T10:50:10.495402+0000","last_peered":"2024-03-16T10:50:10.495402+0000","last_clean":"2024-03-16T10:50:10.495402+0000","last_became_active":"2024-03-16T10:48:48.840200+0000","last_became_peered":"2024-03-16T10:48:48.840200+0000","last_unstale":"2024-03-16T10:50:10.495402+0000","last_undegraded":"2024-03-16T10:50:10.495402+0000","last_fullsized":"2024-03-16T10:50:10.495402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:51:28.501653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.500502+0000","last_change":"2024-03-16T10:48:48.835418+0000","last_active":"2024-03-16T10:50:10.500502+0000","last_peered":"2024-03-16T10:50:10.500502+0000","last_clean":"2024-03-16T10:50:10.500502+0000","last_became_active":"2024-03-16T10:48:48.835092+0000","last_became_peered":"2024-03-16T10:48:48.835092+0000","last_unstale":"2024-03-16T10:50:10.500502+0000","last_undegraded":"2024-03-16T10:50:10.500502+0000","last_fullsized":"2024-03-16T10:50:10.500502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:21.265684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.509363+0000","last_change":"2024-03-16T10:48:48.848449+0000","last_active":"2024-03-16T10:50:10.509363+0000","last_peered":"2024-03-16T10:50:10.509363+0000","last_clean":"2024-03-16T10:50:10.509363+0000","last_became_active":"2024-03-16T10:48:48.847475+0000","last_became_peered":"2024-03-16T10:48:48.847475+0000","last_unstale":"2024-03-16T10:50:10.509363+0000","last_undegraded":"2024-03-16T10:50:10.509363+0000","last_fullsized":"2024-03-16T10:50:10.509363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:03.581657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.505148+0000","last_change":"2024-03-16T10:49:42.792395+0000","last_active":"2024-03-16T10:50:10.505148+0000","last_peered":"2024-03-16T10:50:10.505148+0000","last_clean":"2024-03-16T10:50:10.505148+0000","last_became_active":"2024-03-16T10:49:42.791992+0000","last_became_peered":"2024-03-16T10:49:42.791992+0000","last_unstale":"2024-03-16T10:50:10.505148+0000","last_undegraded":"2024-03-16T10:50:10.505148+0000","last_fullsized":"2024-03-16T10:50:10.505148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:15:16.825389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503402+0000","last_change":"2024-03-16T10:48:48.845246+0000","last_active":"2024-03-16T10:50:10.503402+0000","last_peered":"2024-03-16T10:50:10.503402+0000","last_clean":"2024-03-16T10:50:10.503402+0000","last_became_active":"2024-03-16T10:48:48.844914+0000","last_became_peered":"2024-03-16T10:48:48.844914+0000","last_unstale":"2024-03-16T10:50:10.503402+0000","last_undegraded":"2024-03-16T10:50:10.503402+0000","last_fullsized":"2024-03-16T10:50:10.503402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.106240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.508503+0000","last_change":"2024-03-16T10:48:48.834146+0000","last_active":"2024-03-16T10:50:10.508503+0000","last_peered":"2024-03-16T10:50:10.508503+0000","last_clean":"2024-03-16T10:50:10.508503+0000","last_became_active":"2024-03-16T10:48:48.833853+0000","last_became_peered":"2024-03-16T10:48:48.833853+0000","last_unstale":"2024-03-16T10:50:10.508503+0000","last_undegraded":"2024-03-16T10:50:10.508503+0000","last_fullsized":"2024-03-16T10:50:10.508503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:32.502897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.506446+0000","last_change":"2024-03-16T10:48:48.841919+0000","last_active":"2024-03-16T10:50:10.506446+0000","last_peered":"2024-03-16T10:50:10.506446+0000","last_clean":"2024-03-16T10:50:10.506446+0000","last_became_active":"2024-03-16T10:48:48.841615+0000","last_became_peered":"2024-03-16T10:48:48.841615+0000","last_unstale":"2024-03-16T10:50:10.506446+0000","last_undegraded":"2024-03-16T10:50:10.506446+0000","last_fullsized":"2024-03-16T10:50:10.506446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:01.302102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.501919+0000","last_change":"2024-03-16T10:48:48.835101+0000","last_active":"2024-03-16T10:50:10.501919+0000","last_peered":"2024-03-16T10:50:10.501919+0000","last_clean":"2024-03-16T10:50:10.501919+0000","last_became_active":"2024-03-16T10:48:48.834804+0000","last_became_peered":"2024-03-16T10:48:48.834804+0000","last_unstale":"2024-03-16T10:50:10.501919+0000","last_undegraded":"2024-03-16T10:50:10.501919+0000","last_fullsized":"2024-03-16T10:50:10.501919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:05:07.738961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.507838+0000","last_change":"2024-03-16T10:48:48.839664+0000","last_active":"2024-03-16T10:50:10.507838+0000","last_peered":"2024-03-16T10:50:10.507838+0000","last_clean":"2024-03-16T10:50:10.507838+0000","last_became_active":"2024-03-16T10:48:48.839349+0000","last_became_peered":"2024-03-16T10:48:48.839349+0000","last_unstale":"2024-03-16T10:50:10.507838+0000","last_undegraded":"2024-03-16T10:50:10.507838+0000","last_fullsized":"2024-03-16T10:50:10.507838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:27.765087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.522414+0000","last_change":"2024-03-16T10:48:48.848580+0000","last_active":"2024-03-16T10:50:10.522414+0000","last_peered":"2024-03-16T10:50:10.522414+0000","last_clean":"2024-03-16T10:50:10.522414+0000","last_became_active":"2024-03-16T10:48:48.848052+0000","last_became_peered":"2024-03-16T10:48:48.848052+0000","last_unstale":"2024-03-16T10:50:10.522414+0000","last_undegraded":"2024-03-16T10:50:10.522414+0000","last_fullsized":"2024-03-16T10:50:10.522414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:21:15.355734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.514335+0000","last_change":"2024-03-16T10:48:48.856405+0000","last_active":"2024-03-16T10:50:10.514335+0000","last_peered":"2024-03-16T10:50:10.514335+0000","last_clean":"2024-03-16T10:50:10.514335+0000","last_became_active":"2024-03-16T10:48:48.856041+0000","last_became_peered":"2024-03-16T10:48:48.856041+0000","last_unstale":"2024-03-16T10:50:10.514335+0000","last_undegraded":"2024-03-16T10:50:10.514335+0000","last_fullsized":"2024-03-16T10:50:10.514335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:53.898709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-03-16T10:50:10.503699+0000","last_change":"2024-03-16T10:48:48.845270+0000","last_active":"2024-03-16T10:50:10.503699+0000","last_peered":"2024-03-16T10:50:10.503699+0000","last_clean":"2024-03-16T10:50:10.503699+0000","last_became_active":"2024-03-16T10:48:48.844961+0000","last_became_peered":"2024-03-16T10:48:48.844961+0000","last_unstale":"2024-03-16T10:50:10.503699+0000","last_undegraded":"2024-03-16T10:50:10.503699+0000","last_fullsized":"2024-03-16T10:50:10.503699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T10:48:48.362112+0000","last_clean_scrub_stamp":"2024-03-16T10:48:48.362112+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:19:21.569960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283769,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69089,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1194,"num_read_kb":672,"num_write":252,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":212979,"data_compressed":5628,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":457215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":1109489,"data_compressed":37961,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070519,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":456359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":1050440,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":958464,"data_stored":456588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":519104,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":978944,"data_stored":457619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":519240,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":1049278,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34448,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36085,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68368,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64107,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":63563,"data_compressed":1876,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T10:50:55.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:55.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- 172.21.15.17:0/2193440874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb141033b0 msgr2=0x7fdb14109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 --2- 172.21.15.17:0/2193440874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb141033b0 0x7fdb14109c40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009ca0 tx=0x7fdb0c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- 172.21.15.17:0/2193440874 shutdown_connections 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 --2- 172.21.15.17:0/2193440874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb141033b0 0x7fdb14109c40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 --2- 172.21.15.17:0/2193440874 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 0x7fdb14102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 --2- 172.21.15.17:0/2193440874 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb14101800 0x7fdb14101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- 172.21.15.17:0/2193440874 >> 172.21.15.17:0/2193440874 conn(0x7fdb140fcd90 msgr2=0x7fdb140ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- 172.21.15.17:0/2193440874 shutdown_connections 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- 172.21.15.17:0/2193440874 wait complete. 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 Processor -- start 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.842+0000 7fdb197f4640 1 -- start start 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 0x7fdb14198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb141033b0 0x7fdb1419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410d480 con 0x7fdb14101800 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410d300 con 0x7fdb141033b0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1410d600 con 0x7fdb141029f0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42490/0 (socket says 172.21.15.17:42490) 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 -- 172.21.15.17:0/3776290005 learned_addr learned my addr 172.21.15.17:0/3776290005 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb137fe640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb141033b0 0x7fdb1419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb127fc640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 0x7fdb14198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 -- 172.21.15.17:0/3776290005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 msgr2=0x7fdb14198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 0x7fdb14198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 -- 172.21.15.17:0/3776290005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb141033b0 msgr2=0x7fdb1419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb141033b0 0x7fdb1419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 -- 172.21.15.17:0/3776290005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1419f750 con 0x7fdb14101800 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb12ffd640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9c0 tx=0x7fdb0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800cd80 con 0x7fdb14101800 2024-03-16T10:50:55.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1419fa40 con 0x7fdb14101800 2024-03-16T10:50:55.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb080035f0 con 0x7fdb14101800 2024-03-16T10:50:55.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08010690 con 0x7fdb14101800 2024-03-16T10:50:55.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.843+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1419ff90 con 0x7fdb14101800 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.845+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb14108ac0 con 0x7fdb14101800 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.846+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fdb080037a0 con 0x7fdb14101800 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.846+0000 7fdafbfff640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 0x7fdafc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.846+0000 7fdb127fc640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 0x7fdafc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.846+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fdb080cef80 con 0x7fdb14101800 2024-03-16T10:50:55.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.847+0000 7fdb127fc640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 0x7fdafc0a4d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb14199040 tx=0x7fdb04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:55.850+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fdb0809c050 con 0x7fdb14101800 2024-03-16T10:50:56.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.038+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb1402d3a0 con 0x7fdb14101800 2024-03-16T10:50:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.039+0000 7fdafbfff640 1 -- 172.21.15.17:0/3776290005 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fdb0809b950 con 0x7fdb14101800 2024-03-16T10:50:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:56.040 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 msgr2=0x7fdafc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 0x7fdafc0a4d50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb14199040 tx=0x7fdb04005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 msgr2=0x7fdb14197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9c0 tx=0x7fdb0800ee80 comp rx=0 tx=0).stop 2024-03-16T10:50:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 shutdown_connections 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fdafc0a2890 0x7fdafc0a4d50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb141033b0 0x7fdb1419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb141029f0 0x7fdb14198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 --2- 172.21.15.17:0/3776290005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb14101800 0x7fdb14197b30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.041+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 >> 172.21.15.17:0/3776290005 conn(0x7fdb140fcd90 msgr2=0x7fdb14105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.042+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 shutdown_connections 2024-03-16T10:50:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.042+0000 7fdb197f4640 1 -- 172.21.15.17:0/3776290005 wait complete. 2024-03-16T10:50:56.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:50:56.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:50:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 -- 172.21.15.17:0/487404584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404104c50 msgr2=0x7fb404107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 --2- 172.21.15.17:0/487404584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404104c50 0x7fb404107040 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb400009900 tx=0x7fb40002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 -- 172.21.15.17:0/487404584 shutdown_connections 2024-03-16T10:50:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 --2- 172.21.15.17:0/487404584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404107580 0x7fb404109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 --2- 172.21.15.17:0/487404584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404104c50 0x7fb404107040 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 --2- 172.21.15.17:0/487404584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404102320 0x7fb404104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 -- 172.21.15.17:0/487404584 >> 172.21.15.17:0/487404584 conn(0x7fb4040fbc70 msgr2=0x7fb4040fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 -- 172.21.15.17:0/487404584 shutdown_connections 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.172+0000 7fb40bc52640 1 -- 172.21.15.17:0/487404584 wait complete. 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 Processor -- start 2024-03-16T10:50:56.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 -- start start 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404104c50 0x7fb4041980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404107580 0x7fb40419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d490 con 0x7fb404102320 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d310 con 0x7fb404107580 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40bc52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d610 con 0x7fb404104c50 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42498/0 (socket says 172.21.15.17:42498) 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 -- 172.21.15.17:0/379251882 learned_addr learned my addr 172.21.15.17:0/379251882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb40a1ef640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404107580 0x7fb40419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4091ed640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404104c50 0x7fb4041980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 -- 172.21.15.17:0/379251882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404104c50 msgr2=0x7fb4041980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404104c50 0x7fb4041980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 -- 172.21.15.17:0/379251882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404107580 msgr2=0x7fb40419f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404107580 0x7fb40419f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.173+0000 7fb4099ee640 1 -- 172.21.15.17:0/379251882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40419f7b0 con 0x7fb404102320 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb4099ee640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400ea60 tx=0x7fb3f400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400cd20 con 0x7fb404102320 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419faa0 con 0x7fb404102320 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f40035f0 con 0x7fb404102320 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4010690 con 0x7fb404102320 2024-03-16T10:50:56.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.174+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041a0010 con 0x7fb404102320 2024-03-16T10:50:56.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.175+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4040fd760 con 0x7fb404102320 2024-03-16T10:50:56.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.176+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fb3f40037a0 con 0x7fb404102320 2024-03-16T10:50:56.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.177+0000 7fb3faffd640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 0x7fb3f00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.177+0000 7fb4091ed640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 0x7fb3f00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.177+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3f40cee90 con 0x7fb404102320 2024-03-16T10:50:56.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.177+0000 7fb4091ed640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 0x7fb3f00a4d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb40002c170 tx=0x7fb40002df90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.181+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb3f409bf60 con 0x7fb404102320 2024-03-16T10:50:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:56 smithi017 ceph-mon[32078]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:50:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:56 smithi017 ceph-mon[32078]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:56 smithi017 ceph-mon[32078]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:56 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3776290005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.443+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb40402d3a0 con 0x7fb404102320 2024-03-16T10:50:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.443+0000 7fb3faffd640 1 -- 172.21.15.17:0/379251882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fb3f409b860 con 0x7fb404102320 2024-03-16T10:50:56.444 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 msgr2=0x7fb3f00a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 0x7fb3f00a4d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb40002c170 tx=0x7fb40002df90 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 msgr2=0x7fb404197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400ea60 tx=0x7fb3f400ee60 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 shutdown_connections 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb3f00a2890 0x7fb3f00a4d50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb404107580 0x7fb40419f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb404104c50 0x7fb4041980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 --2- 172.21.15.17:0/379251882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb404102320 0x7fb404197b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 >> 172.21.15.17:0/379251882 conn(0x7fb4040fbc70 msgr2=0x7fb404102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 shutdown_connections 2024-03-16T10:50:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.445+0000 7fb40bc52640 1 -- 172.21.15.17:0/379251882 wait complete. 2024-03-16T10:50:56.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:50:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:56 smithi174 ceph-mon[36202]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:50:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:56 smithi174 ceph-mon[36202]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:56 smithi174 ceph-mon[36202]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:56 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3776290005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 -- 172.21.15.17:0/3315132392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981029e0 msgr2=0x7f2098102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 --2- 172.21.15.17:0/3315132392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981029e0 0x7f2098102e60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f208c009900 tx=0x7f208c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 -- 172.21.15.17:0/3315132392 shutdown_connections 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 --2- 172.21.15.17:0/3315132392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981033a0 0x7f2098109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 --2- 172.21.15.17:0/3315132392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981029e0 0x7f2098102e60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 --2- 172.21.15.17:0/3315132392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.562+0000 7f209fcf7640 1 -- 172.21.15.17:0/3315132392 >> 172.21.15.17:0/3315132392 conn(0x7f20980fcd80 msgr2=0x7f20980ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.563+0000 7f209fcf7640 1 -- 172.21.15.17:0/3315132392 shutdown_connections 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.563+0000 7f209fcf7640 1 -- 172.21.15.17:0/3315132392 wait complete. 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.563+0000 7f209fcf7640 1 Processor -- start 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.563+0000 7f209fcf7640 1 -- start start 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.563+0000 7f209fcf7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 0x7f2098198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f209810d450 con 0x7f20981033a0 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f209810d2d0 con 0x7f20981029e0 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f209810d5d0 con 0x7f20981017f0 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209da93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209da93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:39848/0 (socket says 172.21.15.17:39848) 2024-03-16T10:50:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42518/0 (socket says 172.21.15.17:42518) 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209da93640 1 -- 172.21.15.17:0/1953212039 learned_addr learned my addr 172.21.15.17:0/1953212039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209d292640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 0x7f2098198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 -- 172.21.15.17:0/1953212039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 msgr2=0x7f2098197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 -- 172.21.15.17:0/1953212039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 msgr2=0x7f2098198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 0x7f2098198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 -- 172.21.15.17:0/1953212039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209819f710 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209d292640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 0x7f2098198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209e294640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f209000e970 tx=0x7f209000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209000ccc0 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2090005020 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209819fa00 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090004a00 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.564+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209819fed0 con 0x7f20981033a0 2024-03-16T10:50:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.566+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2098108b90 con 0x7f20981033a0 2024-03-16T10:50:56.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.567+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f20900051d0 con 0x7f20981033a0 2024-03-16T10:50:56.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.567+0000 7f2096ffd640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 0x7f20800a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.567+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f20900cea60 con 0x7f20981033a0 2024-03-16T10:50:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.567+0000 7f209da93640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 0x7f20800a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.568+0000 7f209da93640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 0x7f20800a4d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2088011440 tx=0x7f2088009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.572+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f209009baa0 con 0x7f20981033a0 2024-03-16T10:50:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:56 smithi111 ceph-mon[36315]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:50:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:56 smithi111 ceph-mon[36315]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:56 smithi111 ceph-mon[36315]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:56.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:56 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3776290005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.754+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f209802d1b0 con 0x7f20981033a0 2024-03-16T10:50:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.755+0000 7f2096ffd640 1 -- 172.21.15.17:0/1953212039 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f209009b3a0 con 0x7f20981033a0 2024-03-16T10:50:56.756 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 msgr2=0x7f20800a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 0x7f20800a4d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2088011440 tx=0x7f2088009500 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 msgr2=0x7f209819f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f209000e970 tx=0x7f209000ee30 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 shutdown_connections 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20800a2890 0x7f20800a4d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20981033a0 0x7f209819f0a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20981029e0 0x7f2098198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 --2- 172.21.15.17:0/1953212039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20981017f0 0x7f2098197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 >> 172.21.15.17:0/1953212039 conn(0x7f20980fcd80 msgr2=0x7f2098105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 shutdown_connections 2024-03-16T10:50:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.757+0000 7f209fcf7640 1 -- 172.21.15.17:0/1953212039 wait complete. 2024-03-16T10:50:56.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 -- 172.21.15.17:0/2409332599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80757a0 msgr2=0x7fb8a8073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 --2- 172.21.15.17:0/2409332599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80757a0 0x7fb8a8073bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb898009900 tx=0x7fb89802bcd0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 -- 172.21.15.17:0/2409332599 shutdown_connections 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 --2- 172.21.15.17:0/2409332599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a81096c0 0x7fb8a810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 --2- 172.21.15.17:0/2409332599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a80741c0 0x7fb8a8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 --2- 172.21.15.17:0/2409332599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80757a0 0x7fb8a8073bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 -- 172.21.15.17:0/2409332599 >> 172.21.15.17:0/2409332599 conn(0x7fb8a80fcd80 msgr2=0x7fb8a80ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 -- 172.21.15.17:0/2409332599 shutdown_connections 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 -- 172.21.15.17:0/2409332599 wait complete. 2024-03-16T10:50:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.877+0000 7fb8acde6640 1 Processor -- start 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 -- start start 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80757a0 0x7fb8a819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 0x7fb8a81a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810f670 con 0x7fb8a80741c0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810f4f0 con 0x7fb8a81096c0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8acde6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810f7f0 con 0x7fb8a80757a0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42534/0 (socket says 172.21.15.17:42534) 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 -- 172.21.15.17:0/1021291319 learned_addr learned my addr 172.21.15.17:0/1021291319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a6d9d640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 0x7fb8a81a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a5d9b640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80757a0 0x7fb8a819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 -- 172.21.15.17:0/1021291319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80757a0 msgr2=0x7fb8a819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80757a0 0x7fb8a819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 -- 172.21.15.17:0/1021291319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 msgr2=0x7fb8a81a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 0x7fb8a81a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 -- 172.21.15.17:0/1021291319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a81a1960 con 0x7fb8a80741c0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a6d9d640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 0x7fb8a81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8a659c640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb898005ab0 tx=0x7fb89802c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.878+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898041070 con 0x7fb8a80741c0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.879+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb898004450 con 0x7fb8a80741c0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.879+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a81a1bf0 con 0x7fb8a80741c0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.879+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898034440 con 0x7fb8a80741c0 2024-03-16T10:50:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.879+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a81a20e0 con 0x7fb8a80741c0 2024-03-16T10:50:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.880+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a8108480 con 0x7fb8a80741c0 2024-03-16T10:50:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.881+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fb898044070 con 0x7fb8a80741c0 2024-03-16T10:50:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.881+0000 7fb8977fe640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 0x7fb8900a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.881+0000 7fb8a5d9b640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 0x7fb8900a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.881+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb8980f0470 con 0x7fb8a80741c0 2024-03-16T10:50:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.882+0000 7fb8a5d9b640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 0x7fb8900a4d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0095f0 tx=0x7fb89c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:56.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:56.886+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb8980bd000 con 0x7fb8a80741c0 2024-03-16T10:50:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.069+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb8a802d1b0 con 0x7fb8a80741c0 2024-03-16T10:50:57.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.069+0000 7fb8977fe640 1 -- 172.21.15.17:0/1021291319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fb8980c10a0 con 0x7fb8a80741c0 2024-03-16T10:50:57.070 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 msgr2=0x7fb8900a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 0x7fb8900a4d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0095f0 tx=0x7fb89c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 msgr2=0x7fb8a8199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb898005ab0 tx=0x7fb89802c6e0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 shutdown_connections 2024-03-16T10:50:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8900a2890 0x7fb8900a4d50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a81096c0 0x7fb8a81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a80757a0 0x7fb8a819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 --2- 172.21.15.17:0/1021291319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a80741c0 0x7fb8a8199d40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 >> 172.21.15.17:0/1021291319 conn(0x7fb8a80fcd80 msgr2=0x7fb8a8105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 shutdown_connections 2024-03-16T10:50:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.071+0000 7fb8acde6640 1 -- 172.21.15.17:0/1021291319 wait complete. 2024-03-16T10:50:57.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:50:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 -- 172.21.15.17:0/1467805409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5298101800 msgr2=0x7f5298101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1467805409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5298101800 0x7f5298101c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5290009900 tx=0x7f529002bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 -- 172.21.15.17:0/1467805409 shutdown_connections 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1467805409 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52981033b0 0x7f5298109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1467805409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1467805409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5298101800 0x7f5298101c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 -- 172.21.15.17:0/1467805409 >> 172.21.15.17:0/1467805409 conn(0x7f52980fcd90 msgr2=0x7f52980ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 -- 172.21.15.17:0/1467805409 shutdown_connections 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.192+0000 7f529d6dc640 1 -- 172.21.15.17:0/1467805409 wait complete. 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 Processor -- start 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 -- start start 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52981033b0 0x7f529819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f529810d450 con 0x7f52981029f0 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f529810d2d0 con 0x7f52981033b0 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f529d6dc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f529810d5d0 con 0x7f5298101800 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f52967fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f5296ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f5296ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:39884/0 (socket says 172.21.15.17:39884) 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f5296ffd640 1 -- 172.21.15.17:0/1498557617 learned_addr learned my addr 172.21.15.17:0/1498557617 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.193+0000 7f52977fe640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52981033b0 0x7f529819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 -- 172.21.15.17:0/1498557617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52981033b0 msgr2=0x7f529819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52981033b0 0x7f529819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 -- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 msgr2=0x7f5298198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 -- 172.21.15.17:0/1498557617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529819f740 con 0x7f5298101800 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f52967fc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f5296ffd640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f529002c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290041070 con 0x7f5298101800 2024-03-16T10:50:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529819f9d0 con 0x7f5298101800 2024-03-16T10:50:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5290004450 con 0x7f5298101800 2024-03-16T10:50:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290034440 con 0x7f5298101800 2024-03-16T10:50:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.194+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529819ff10 con 0x7f5298101800 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.195+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5298108ba0 con 0x7f5298101800 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.197+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f5290044070 con 0x7f5298101800 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.198+0000 7f528ffff640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 0x7f52840a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.198+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f52900f07a0 con 0x7f5298101800 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.198+0000 7f52967fc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 0x7f52840a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.198+0000 7f52967fc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 0x7f52840a4d50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52800095f0 tx=0x7f5280005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.200+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f52900bd230 con 0x7f5298101800 2024-03-16T10:50:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:57 smithi017 ceph-mon[32078]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/379251882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1953212039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:57 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1021291319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.427+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f529802d1b0 con 0x7f5298101800 2024-03-16T10:50:57.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.428+0000 7f528ffff640 1 -- 172.21.15.17:0/1498557617 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11935 (secure 0 0 0) 0x7f52900c12d0 con 0x7f5298101800 2024-03-16T10:50:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:57.429 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:50:51.056785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[14655,24497,24470,24493,24536]},"id":1}]} 2024-03-16T10:50:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-03-16T10:50:57.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 msgr2=0x7f52840a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 0x7f52840a4d50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52800095f0 tx=0x7f5280005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 msgr2=0x7f5298197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5290000c00 tx=0x7f529002c640 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 shutdown_connections 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f52840a2890 0x7f52840a4d50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52981033b0 0x7f529819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52981029f0 0x7f5298198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 --2- 172.21.15.17:0/1498557617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5298101800 0x7f5298197b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 >> 172.21.15.17:0/1498557617 conn(0x7f52980fcd90 msgr2=0x7f5298105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 shutdown_connections 2024-03-16T10:50:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.430+0000 7f529d6dc640 1 -- 172.21.15.17:0/1498557617 wait complete. 2024-03-16T10:50:57.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- 172.21.15.17:0/1992519171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48104bb0 msgr2=0x7eff48106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 --2- 172.21.15.17:0/1992519171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48104bb0 0x7eff48106fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7eff38009900 tx=0x7eff3802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- 172.21.15.17:0/1992519171 shutdown_connections 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 --2- 172.21.15.17:0/1992519171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 0x7eff48109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 --2- 172.21.15.17:0/1992519171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48104bb0 0x7eff48106fa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 --2- 172.21.15.17:0/1992519171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48102280 0x7eff48104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- 172.21.15.17:0/1992519171 >> 172.21.15.17:0/1992519171 conn(0x7eff480fbc70 msgr2=0x7eff480fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- 172.21.15.17:0/1992519171 shutdown_connections 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- 172.21.15.17:0/1992519171 wait complete. 2024-03-16T10:50:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 Processor -- start 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.544+0000 7eff4f5da640 1 -- start start 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48104bb0 0x7eff48198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 0x7eff4819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff4810d470 con 0x7eff48102280 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7eff4810d2f0 con 0x7eff48104bb0 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff4810d5f0 con 0x7eff481074e0 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42572/0 (socket says 172.21.15.17:42572) 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 -- 172.21.15.17:0/781718394 learned_addr learned my addr 172.21.15.17:0/781718394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4cb75640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48104bb0 0x7eff48198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4db77640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 0x7eff4819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 -- 172.21.15.17:0/781718394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 msgr2=0x7eff4819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 0x7eff4819f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 -- 172.21.15.17:0/781718394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48104bb0 msgr2=0x7eff48198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48104bb0 0x7eff48198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 -- 172.21.15.17:0/781718394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4819f730 con 0x7eff48102280 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4d376640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e9f0 tx=0x7eff4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4400cd80 con 0x7eff48102280 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff44010910 con 0x7eff48102280 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4819fa20 con 0x7eff48102280 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.545+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44018990 con 0x7eff48102280 2024-03-16T10:50:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.546+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4819ff90 con 0x7eff48102280 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.547+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff480fd760 con 0x7eff48102280 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.547+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7eff44010ac0 con 0x7eff48102280 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.548+0000 7eff3e7fc640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 0x7eff340a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.548+0000 7eff4cb75640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 0x7eff340a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.548+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7eff440ceea0 con 0x7eff48102280 2024-03-16T10:50:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.549+0000 7eff4cb75640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 0x7eff340a4dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff38000c00 tx=0x7eff38005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.553+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7eff4409b790 con 0x7eff48102280 2024-03-16T10:50:57.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:57 smithi174 ceph-mon[36202]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/379251882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1953212039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:57 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1021291319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:57 smithi111 ceph-mon[36315]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-16T10:50:57.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/379251882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1953212039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:57 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1021291319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:50:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.764+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff4802d1b0 con 0x7eff48102280 2024-03-16T10:50:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.766+0000 7eff3e7fc640 1 -- 172.21.15.17:0/781718394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7eff4409f830 con 0x7eff48102280 2024-03-16T10:50:57.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:50:57.767 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 msgr2=0x7eff340a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 0x7eff340a4dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff38000c00 tx=0x7eff38005fd0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 msgr2=0x7eff48197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e9f0 tx=0x7eff4400eeb0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 shutdown_connections 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7eff340a2910 0x7eff340a4dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff481074e0 0x7eff4819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff48104bb0 0x7eff48198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 --2- 172.21.15.17:0/781718394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff48102280 0x7eff48197b10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 >> 172.21.15.17:0/781718394 conn(0x7eff480fbc70 msgr2=0x7eff48102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 shutdown_connections 2024-03-16T10:50:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.768+0000 7eff4f5da640 1 -- 172.21.15.17:0/781718394 wait complete. 2024-03-16T10:50:57.780 DEBUG:tasks.fwd_scrub:Yielding 2024-03-16T10:50:57.780 INFO:teuthology.run_tasks:Running task background_exec... 2024-03-16T10:50:57.791 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:50:57.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-03-16T10:50:57.791 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-16T10:50:57.791 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T10:50:57.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:50:57.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T10:50:57.794 INFO:teuthology.run_tasks:Running task workunit... 2024-03-16T10:50:57.805 INFO:tasks.workunit:Pulling workunits from ref 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:50:57.805 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-16T10:50:57.805 INFO:tasks.workunit:timeout=6h 2024-03-16T10:50:57.805 INFO:tasks.workunit:cleanup=True 2024-03-16T10:50:57.806 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-16 10:48:55.638069530 +0000 2024-03-16T10:50:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-16 10:48:55.638069530 +0000 2024-03-16T10:50:57.823 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-16 10:50:50.271161560 +0000 2024-03-16T10:50:57.823 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-16 10:48:55.638069530 +0000 2024-03-16T10:50:57.823 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-16T10:50:57.823 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-16T10:50:57.897 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T10:50:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 -- 172.21.15.17:0/422654927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 msgr2=0x7f8754102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 --2- 172.21.15.17:0/422654927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754102e80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8744009900 tx=0x7f874402bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 -- 172.21.15.17:0/422654927 shutdown_connections 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 --2- 172.21.15.17:0/422654927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f87541033c0 0x7f8754109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 --2- 172.21.15.17:0/422654927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754102e80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 --2- 172.21.15.17:0/422654927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8754101810 0x7f8754101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.901+0000 7f875b777640 1 -- 172.21.15.17:0/422654927 >> 172.21.15.17:0/422654927 conn(0x7f87540fcd80 msgr2=0x7f87540ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- 172.21.15.17:0/422654927 shutdown_connections 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- 172.21.15.17:0/422654927 wait complete. 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 Processor -- start 2024-03-16T10:50:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- start start 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8754101810 0x7f8754075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 0x7f8754074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f875410d470 con 0x7f8754102a00 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f875410d2f0 con 0x7f8754101810 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f875b777640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f875410d5f0 con 0x7f87541033c0 2024-03-16T10:50:57.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42602/0 (socket says 172.21.15.17:42602) 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.902+0000 7f8758d12640 1 -- 172.21.15.17:0/1679208969 learned_addr learned my addr 172.21.15.17:0/1679208969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8759513640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8754101810 0x7f8754075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8759d14640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 0x7f8754074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 -- 172.21.15.17:0/1679208969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 msgr2=0x7f8754074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 0x7f8754074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 -- 172.21.15.17:0/1679208969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8754101810 msgr2=0x7f8754075590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8754101810 0x7f8754075590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 -- 172.21.15.17:0/1679208969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540749a0 con 0x7f8754102a00 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8759d14640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 0x7f8754074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f8758d12640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8744009230 tx=0x7f874402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f874a7fc640 1 -- 172.21.15.17:0/1679208969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744041070 con 0x7f8754102a00 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87541a1bf0 con 0x7f8754102a00 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f874a7fc640 1 -- 172.21.15.17:0/1679208969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8744004450 con 0x7f8754102a00 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f874a7fc640 1 -- 172.21.15.17:0/1679208969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744003e20 con 0x7f8754102a00 2024-03-16T10:50:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.903+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87541a2140 con 0x7f8754102a00 2024-03-16T10:50:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.906+0000 7f874a7fc640 1 -- 172.21.15.17:0/1679208969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f8744044070 con 0x7f8754102a00 2024-03-16T10:50:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 Processor -- start 2024-03-16T10:50:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 -- start start 2024-03-16T10:50:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa707e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa70a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dfa6670d0 con 0x557dfa7084f0 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557dfa60fc70 con 0x557dfa702990 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f875e366740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557dfa663170 con 0x557dfa703380 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f874a7fc640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 0x7f87400a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48016/0 (socket says 172.21.15.17:48016) 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 -- 172.21.15.17:0/154931472 learned_addr learned my addr 172.21.15.17:0/154931472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759513640 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa707e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8758d12640 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa70a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 0x7f87400a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f874a7fc640 1 -- 172.21.15.17:0/1679208969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f87440f0610 con 0x7f8754102a00 2024-03-16T10:50:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 -- 172.21.15.17:0/154931472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 msgr2=0x557dfa707e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa707e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 -- 172.21.15.17:0/154931472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 msgr2=0x557dfa70a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa70a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.907+0000 7f8759d14640 1 -- 172.21.15.17:0/154931472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dfa4437e0 con 0x557dfa702990 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.908+0000 7f8759d14640 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8750012e10 tx=0x7f87500107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248c2e794c4e02c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.908+0000 7f8759d14640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 0x7f87400a4d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8750010ca0 tx=0x7f875001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.908+0000 7f873f7fe640 1 -- 172.21.15.17:0/154931472 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750012600 con 0x557dfa702990 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.908+0000 7f873f7fe640 1 -- 172.21.15.17:0/154931472 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8750009d80 con 0x557dfa702990 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.908+0000 7f873f7fe640 1 -- 172.21.15.17:0/154931472 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87500054c0 con 0x557dfa702990 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- 172.21.15.17:0/154931472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 msgr2=0x557dfa702db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8750012e10 tx=0x7f87500107a0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- 172.21.15.17:0/154931472 shutdown_connections 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa70a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa707e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- 172.21.15.17:0/154931472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa702db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- 172.21.15.17:0/154931472 >> 172.21.15.17:0/154931472 conn(0x557dfa6cac50 msgr2=0x557dfa6fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- 172.21.15.17:0/154931472 shutdown_connections 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- 172.21.15.17:0/154931472 wait complete. 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 -- start start 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 Processor -- start 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 0x557dfa70cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.909+0000 7f875e366740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 0x557dfa714420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f875e366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dfa70b3e0 con 0x557dfa703380 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f875e366740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557dfa6230d0 con 0x557dfa7084f0 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f875e366740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557dfa70b560 con 0x557dfa702990 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f875e366740 10 client.0 _ll_register_callbacks cb 0x557dfa5ec760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42622/0 (socket says 172.21.15.17:42622) 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8758d12640 1 -- 172.21.15.17:0/2711536446 learned_addr learned my addr 172.21.15.17:0/2711536446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 0x557dfa714420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759513640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 0x557dfa70cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 -- 172.21.15.17:0/2711536446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 msgr2=0x557dfa70cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 0x557dfa70cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 -- 172.21.15.17:0/2711536446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 msgr2=0x557dfa70d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 -- 172.21.15.17:0/2711536446 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dfa4a3f70 con 0x557dfa7084f0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8758d12640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759513640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 0x557dfa70cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f8759d14640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 0x557dfa714420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f875000dc60 tx=0x7f8750012a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f4d27fac7eccb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f873cff9640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750004d70 con 0x557dfa7084f0 2024-03-16T10:50:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8750009d80 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.910+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f875001b070 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f87500051c0 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 10 client.25355 fetch_fsmap learned FSMap version 27 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dfa33b170 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8750009d80 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8750038030 con 0x557dfa7084f0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 10 client.25355 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 10 client.25355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 20 client.25355 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa718690 0x557dfa71aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 4 client.25355 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dfa674610 con 0x557dfa718690 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.911+0000 7f8759513640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa718690 0x557dfa71aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.912+0000 7f8759513640 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa718690 0x557dfa71aa80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d9388f00bb90703 server_cookie=5f290a1982096014 in_seq=0 out_seq=0 2024-03-16T10:50:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.912+0000 7f873cff9640 10 client.25355 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f873cff9640 1 -- 172.21.15.17:0/2711536446 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557dfa674610 con 0x557dfa718690 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f873cff9640 10 client.25355 handle_command_reply: tid=0 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 client.25355 shutdown 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 msgr2=0x557dfa714420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 0x557dfa714420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f875000dc60 tx=0x7f8750012a60 comp rx=0 tx=0).stop 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 shutdown_connections 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa718690 0x557dfa71aa80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa7084f0 0x557dfa714420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa70d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 --2- 172.21.15.17:0/2711536446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa702990 0x557dfa70cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 >> 172.21.15.17:0/2711536446 conn(0x557dfa6cac50 msgr2=0x557dfa6fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f873cff9640 0 client.25355 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:57.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 shutdown_connections 2024-03-16T10:50:57.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 1 -- 172.21.15.17:0/2711536446 wait complete. 2024-03-16T10:50:57.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.913+0000 7f875e366740 20 client.25355 trim_cache size 0 max 16384 2024-03-16T10:50:57.920 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-16T10:50:57.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 Processor -- start 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 -- start start 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa70b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa7084f0 0x557dfa70bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87541aadc0 con 0x557dfa703380 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f87541ac900 con 0x557dfa702990 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f875e366740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87541ab490 con 0x557dfa7084f0 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8759513640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa70b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8758d12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42636/0 (socket says 172.21.15.17:42636) 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8758d12640 1 -- 172.21.15.17:0/1838549776 learned_addr learned my addr 172.21.15.17:0/1838549776 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8759d14640 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa7084f0 0x557dfa70bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.931+0000 7f8759513640 1 -- 172.21.15.17:0/1838549776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa7084f0 msgr2=0x557dfa70bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8759513640 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa7084f0 0x557dfa70bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8759513640 1 -- 172.21.15.17:0/1838549776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 msgr2=0x557dfa7143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8759513640 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8759513640 1 -- 172.21.15.17:0/1838549776 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dfa7025d0 con 0x557dfa702990 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8758d12640 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f8759513640 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa70b960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x557dfa71b2f0 tx=0x7f874c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=160011b3e5149240 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f873effd640 1 -- 172.21.15.17:0/1838549776 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c0122d0 con 0x557dfa702990 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f873effd640 1 -- 172.21.15.17:0/1838549776 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874c0221b0 con 0x557dfa702990 2024-03-16T10:50:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.932+0000 7f873effd640 1 -- 172.21.15.17:0/1838549776 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c00fc80 con 0x557dfa702990 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- 172.21.15.17:0/1838549776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 msgr2=0x557dfa70b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa70b960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x557dfa71b2f0 tx=0x7f874c005f90 comp rx=0 tx=0).stop 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- 172.21.15.17:0/1838549776 shutdown_connections 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa7084f0 0x557dfa70bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa703380 0x557dfa7143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 --2- 172.21.15.17:0/1838549776 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa70b960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- 172.21.15.17:0/1838549776 >> 172.21.15.17:0/1838549776 conn(0x557dfa6cac50 msgr2=0x557dfa704910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- 172.21.15.17:0/1838549776 shutdown_connections 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- 172.21.15.17:0/1838549776 wait complete. 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 -- start start 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.933+0000 7f875e366740 1 Processor -- start 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa711e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87541ac230 con 0x557dfa7084f0 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f87541abb60 con 0x557dfa702990 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87541a8da0 con 0x557dfa703380 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f875e366740 10 client.0 _ll_register_callbacks cb 0x7f874c009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759513640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42648/0 (socket says 172.21.15.17:42648) 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759513640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48036/0 (socket says 172.21.15.17:48036) 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 -- 172.21.15.17:0/3319024492 learned_addr learned my addr 172.21.15.17:0/3319024492 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8758d12640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa711e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 -- 172.21.15.17:0/3319024492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 msgr2=0x557dfa711e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa711e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 -- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 msgr2=0x557dfa711900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 -- 172.21.15.17:0/3319024492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dfa7133f0 con 0x557dfa7084f0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759513640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f8759d14640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8750005c40 tx=0x7f8750009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b3d4e1cbeb873e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f873cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.934+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875002fae0 con 0x557dfa7084f0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f874c0221b0 con 0x557dfa7084f0 2024-03-16T10:50:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f875001b040 con 0x557dfa7084f0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f875002fc80 con 0x557dfa7084f0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557dfa77e980 con 0x557dfa7084f0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874c0221b0 con 0x557dfa7084f0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8750005520 con 0x557dfa7084f0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 20 client.15486 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa77f290 0x557dfa7816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 4 client.15486 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557dfa70cc90 con 0x557dfa77f290 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.935+0000 7f8759513640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa77f290 0x557dfa7816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.936+0000 7f8759513640 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa77f290 0x557dfa7816b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2dbb79ac2a1b6c server_cookie=4e23e00ef207c816 in_seq=0 out_seq=0 2024-03-16T10:50:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.936+0000 7f873cff9640 10 client.15486 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f873cff9640 1 -- 172.21.15.17:0/3319024492 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557dfa70cc90 con 0x557dfa77f290 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f873cff9640 10 client.15486 handle_command_reply: tid=0 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 client.15486 shutdown 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 msgr2=0x557dfa712e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8750005c40 tx=0x7f8750009500 comp rx=0 tx=0).stop 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 shutdown_connections 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557dfa77f290 0x557dfa7816b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f873cff9640 0 client.15486 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dfa7084f0 0x557dfa712e00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dfa703380 0x557dfa711e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 --2- 172.21.15.17:0/3319024492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dfa702990 0x557dfa711900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.937+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 >> 172.21.15.17:0/3319024492 conn(0x557dfa6cac50 msgr2=0x557dfa70ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 shutdown_connections 2024-03-16T10:50:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875e366740 1 -- 172.21.15.17:0/3319024492 wait complete. 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875e366740 20 client.15486 trim_cache size 0 max 16384 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "0c980b69-880a-4591-bd1a-271ed903494d", 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-03-16T10:50:57.943 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 msgr2=0x7f87400a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 0x7f87400a4d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8750010ca0 tx=0x7f875001d000 comp rx=0 tx=0).stop 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 msgr2=0x7f8754073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8744009230 tx=0x7f874402c650 comp rx=0 tx=0).stop 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 shutdown_connections 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f87400a2890 0x7f87400a4d50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87541033c0 0x7f8754074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8754102a00 0x7f8754073bd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 --2- 172.21.15.17:0/1679208969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8754101810 0x7f8754075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 >> 172.21.15.17:0/1679208969 conn(0x7f87540fcd80 msgr2=0x7f8754105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.938+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 shutdown_connections 2024-03-16T10:50:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:57.939+0000 7f875b777640 1 -- 172.21.15.17:0/1679208969 wait complete. 2024-03-16T10:50:57.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:50:57.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 -- 172.21.15.17:0/4275168504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba141018d0 msgr2=0x7fba14101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/4275168504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba141018d0 0x7fba14101d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba08009900 tx=0x7fba0802bc30 comp rx=0 tx=0).stop 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 -- 172.21.15.17:0/4275168504 shutdown_connections 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/4275168504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba14102290 0x7fba14108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/4275168504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba141018d0 0x7fba14101d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/4275168504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 -- 172.21.15.17:0/4275168504 >> 172.21.15.17:0/4275168504 conn(0x7fba140fbc70 msgr2=0x7fba140fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 -- 172.21.15.17:0/4275168504 shutdown_connections 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 -- 172.21.15.17:0/4275168504 wait complete. 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.095+0000 7fba1a1f4640 1 Processor -- start 2024-03-16T10:50:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 -- start start 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba141018d0 0x7fba1419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 0x7fba1419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410c360 con 0x7fba141006e0 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410c1e0 con 0x7fba14102290 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba1a1f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410c4e0 con 0x7fba141018d0 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42666/0 (socket says 172.21.15.17:42666) 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 -- 172.21.15.17:0/1746533521 learned_addr learned my addr 172.21.15.17:0/1746533521 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba13fff640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 0x7fba1419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba12ffd640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba141018d0 0x7fba1419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 -- 172.21.15.17:0/1746533521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba141018d0 msgr2=0x7fba1419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba141018d0 0x7fba1419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 -- 172.21.15.17:0/1746533521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 msgr2=0x7fba1419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 0x7fba1419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba137fe640 1 -- 172.21.15.17:0/1746533521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1419f740 con 0x7fba141006e0 2024-03-16T10:50:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.096+0000 7fba13fff640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 0x7fba1419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba137fe640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fba0400ebc0 tx=0x7fba0400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba10ff9640 1 -- 172.21.15.17:0/1746533521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04003b70 con 0x7fba141006e0 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba10ff9640 1 -- 172.21.15.17:0/1746533521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04003d10 con 0x7fba141006e0 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1419fa30 con 0x7fba141006e0 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba10ff9640 1 -- 172.21.15.17:0/1746533521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04019980 con 0x7fba141006e0 2024-03-16T10:50:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.097+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1419ff50 con 0x7fba141006e0 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba10ff9640 1 -- 172.21.15.17:0/1746533521 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fba04019b20 con 0x7fba141006e0 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 Processor -- start 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 -- start start 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba10ff9640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 0x7fb9fc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d4cb60 0x5619a5d51660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d51cd0 0x5619a5d54160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5619a5cb1500 con 0x5619a5d4cb60 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619a5c59be0 con 0x5619a5d4c170 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.100+0000 7fba1cde8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5619a5cad5a0 con 0x5619a5d51cd0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba13fff640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 0x7fb9fc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba10ff9640 1 -- 172.21.15.17:0/1746533521 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fba040cf2d0 con 0x7fba141006e0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba12ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d4cb60 0x5619a5d51660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48054/0 (socket says 172.21.15.17:48054) 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 -- 172.21.15.17:0/895751946 learned_addr learned my addr 172.21.15.17:0/895751946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba13fff640 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d51cd0 0x5619a5d54160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 -- 172.21.15.17:0/895751946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d51cd0 msgr2=0x5619a5d54160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d51cd0 0x5619a5d54160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 -- 172.21.15.17:0/895751946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d4cb60 msgr2=0x5619a5d51660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d4cb60 0x5619a5d51660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 -- 172.21.15.17:0/895751946 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a5c6d4b0 con 0x5619a5d4c170 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba13fff640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 0x7fb9fc0a4d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009fd0 tx=0x7fba0c011c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fba137fe640 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba040a3e80 tx=0x7fba0409b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c6abbec15379df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fb9f9ffb640 1 -- 172.21.15.17:0/895751946 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04067c90 con 0x5619a5d4c170 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fb9f9ffb640 1 -- 172.21.15.17:0/895751946 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0409bc10 con 0x5619a5d4c170 2024-03-16T10:50:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.101+0000 7fb9f9ffb640 1 -- 172.21.15.17:0/895751946 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0409c0d0 con 0x5619a5d4c170 2024-03-16T10:50:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- 172.21.15.17:0/895751946 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 msgr2=0x5619a5d4c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba040a3e80 tx=0x7fba0409b810 comp rx=0 tx=0).stop 2024-03-16T10:50:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- 172.21.15.17:0/895751946 shutdown_connections 2024-03-16T10:50:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d51cd0 0x5619a5d54160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d4cb60 0x5619a5d51660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 --2- 172.21.15.17:0/895751946 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4c170 0x5619a5d4c590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- 172.21.15.17:0/895751946 >> 172.21.15.17:0/895751946 conn(0x5619a5d476e0 msgr2=0x5619a5d47ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- 172.21.15.17:0/895751946 shutdown_connections 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- 172.21.15.17:0/895751946 wait complete. 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.102+0000 7fba1cde8740 1 -- start start 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 Processor -- start 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d56710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d56c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5619a5d54c80 con 0x5619a5d51cd0 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619a5c6d160 con 0x5619a5d4cb60 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5619a5d54e00 con 0x5619a5d4c170 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba1cde8740 10 client.0 _ll_register_callbacks cb 0x5619a5c51150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:58.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d56c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42686/0 (socket says 172.21.15.17:42686) 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba13fff640 1 -- 172.21.15.17:0/168991665 learned_addr learned my addr 172.21.15.17:0/168991665 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba137fe640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d56710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 -- 172.21.15.17:0/168991665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 msgr2=0x5619a5d56710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d56710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 -- 172.21.15.17:0/168991665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 msgr2=0x5619a5d5dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba12ffd640 1 -- 172.21.15.17:0/168991665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a5a8f7d0 con 0x5619a5d4cb60 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba137fe640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d56710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.103+0000 7fba13fff640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba12ffd640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d56c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba08009230 tx=0x7fba08004250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1f86ed0f299a23 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08005d50 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba0409bc10 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fba08005230 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba08005430 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 10 client.25373 fetch_fsmap learned FSMap version 27 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619a59c53f0 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0409bc10 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba08003850 con 0x5619a5d4cb60 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 10 client.25373 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 10 client.25373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:50:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 20 client.25373 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5d62200 0x5619a5d64660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 4 client.25373 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.104+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619a5cbea40 con 0x5619a5d62200 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.105+0000 7fba137fe640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5d62200 0x5619a5d64660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.105+0000 7fb9f2ffd640 10 client.25373 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.105+0000 7fba137fe640 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5d62200 0x5619a5d64660 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92f197949a6930b2 server_cookie=5e2663425be51fe5 in_seq=0 out_seq=0 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/168991665 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5619a5cbea40 con 0x5619a5d62200 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fb9f2ffd640 10 client.25373 handle_command_reply: tid=0 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 client.25373 shutdown 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 msgr2=0x5619a5d56c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d56c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba08009230 tx=0x7fba08004250 comp rx=0 tx=0).stop 2024-03-16T10:50:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 shutdown_connections 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5d62200 0x5619a5d64660 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d5dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d56c50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 --2- 172.21.15.17:0/168991665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d56710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fb9f2ffd640 0 client.25373 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 >> 172.21.15.17:0/168991665 conn(0x5619a5d476e0 msgr2=0x5619a5d46900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 shutdown_connections 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 1 -- 172.21.15.17:0/168991665 wait complete. 2024-03-16T10:50:58.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.106+0000 7fba1cde8740 20 client.25373 trim_cache size 0 max 16384 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 Processor -- start 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 -- start start 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d46070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba141a8b50 con 0x5619a5d51cd0 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fba141aa690 con 0x5619a5d4cb60 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba1cde8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba141a9220 con 0x5619a5d4c170 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42698/0 (socket says 172.21.15.17:42698) 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba13fff640 1 -- 172.21.15.17:0/2510282933 learned_addr learned my addr 172.21.15.17:0/2510282933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d46070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba12ffd640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 -- 172.21.15.17:0/2510282933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 msgr2=0x5619a5d465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 -- 172.21.15.17:0/2510282933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 msgr2=0x5619a5d46af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba137fe640 1 -- 172.21.15.17:0/2510282933 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619a59850f0 con 0x5619a5d4c170 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.127+0000 7fba13fff640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.128+0000 7fba137fe640 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d46070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5619a5d548d0 tx=0x7fba04003ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15929664bf557ffa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.128+0000 7fb9f97fa640 1 -- 172.21.15.17:0/2510282933 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0409fd60 con 0x5619a5d4c170 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.128+0000 7fb9f97fa640 1 -- 172.21.15.17:0/2510282933 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba040a43b0 con 0x5619a5d4c170 2024-03-16T10:50:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.128+0000 7fb9f97fa640 1 -- 172.21.15.17:0/2510282933 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04004b60 con 0x5619a5d4c170 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- 172.21.15.17:0/2510282933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 msgr2=0x5619a5d46070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d46070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5619a5d548d0 tx=0x7fba04003ec0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- 172.21.15.17:0/2510282933 shutdown_connections 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5d46af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5d465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- 172.21.15.17:0/2510282933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5d46070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- 172.21.15.17:0/2510282933 >> 172.21.15.17:0/2510282933 conn(0x5619a5d476e0 msgr2=0x5619a5d551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- 172.21.15.17:0/2510282933 shutdown_connections 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- 172.21.15.17:0/2510282933 wait complete. 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- start start 2024-03-16T10:50:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 Processor -- start 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5dc3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5dc3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba141a9fc0 con 0x5619a5d51cd0 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fba141a98f0 con 0x5619a5d4cb60 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba141a6b30 con 0x5619a5d4c170 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.129+0000 7fba1cde8740 10 client.0 _ll_register_callbacks cb 0x7fba08009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba12ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5dc3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba137fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5dc3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42706/0 (socket says 172.21.15.17:42706) 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 -- 172.21.15.17:0/120426965 learned_addr learned my addr 172.21.15.17:0/120426965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 -- 172.21.15.17:0/120426965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 msgr2=0x5619a5dc3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5dc3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 -- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 msgr2=0x5619a5dc3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5dc3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 -- 172.21.15.17:0/120426965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619a5c789d0 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba137fe640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5dc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba12ffd640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5dc3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba13fff640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fba0c004530 tx=0x7fba0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c434af97ad2ad72 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fb9f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c01a040 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fba0c021430 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba040a43b0 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba0c021630 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba1cde8740 10 client.15504 fetch_fsmap learned FSMap version 27 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.130+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619a5dcc260 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba040a43b0 con 0x5619a5d51cd0 2024-03-16T10:50:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fba0c02b720 con 0x5619a5d51cd0 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 10 client.15504 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 20 client.15504 populate_metadata read hostname 'smithi017' 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5dccc90 0x5619a5dcf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 4 client.15504 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5619a5cb8d90 con 0x5619a5dccc90 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba137fe640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5dccc90 0x5619a5dcf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fba137fe640 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5dccc90 0x5619a5dcf0b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b226efdb6c673b server_cookie=86578f8523c2e0ca in_seq=0 out_seq=0 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.131+0000 7fb9f2ffd640 10 client.15504 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fb9f2ffd640 1 -- 172.21.15.17:0/120426965 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5619a5cb8d90 con 0x5619a5dccc90 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fb9f2ffd640 10 client.15504 handle_command_reply: tid=0 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 client.15504 shutdown 2024-03-16T10:50:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 msgr2=0x5619a5dcaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fba0c004530 tx=0x7fba0c004730 comp rx=0 tx=0).stop 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 shutdown_connections 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5619a5dccc90 0x5619a5dcf0b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619a5d51cd0 0x5619a5dcaac0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fb9f2ffd640 0 client.15504 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619a5d4cb60 0x5619a5dc3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 --2- 172.21.15.17:0/120426965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5619a5d4c170 0x5619a5dc3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 >> 172.21.15.17:0/120426965 conn(0x5619a5d476e0 msgr2=0x5619a5d4a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 shutdown_connections 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 1 -- 172.21.15.17:0/120426965 wait complete. 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1cde8740 20 client.15504 trim_cache size 0 max 16384 2024-03-16T10:50:58.139 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "0c980b69-880a-4591-bd1a-271ed903494d": { 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "0c980b69-880a-4591-bd1a-271ed903494d", 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:50:58.140 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 msgr2=0x7fb9fc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 0x7fb9fc0a4d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009fd0 tx=0x7fba0c011c10 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 msgr2=0x7fba14069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fba0400ebc0 tx=0x7fba0400c6a0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 shutdown_connections 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb9fc0a2890 0x7fb9fc0a4d50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba14102290 0x7fba1419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba141018d0 0x7fba1419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.132+0000 7fba1a1f4640 1 --2- 172.21.15.17:0/1746533521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141006e0 0x7fba14069510 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:50:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.133+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 >> 172.21.15.17:0/1746533521 conn(0x7fba140fbc70 msgr2=0x7fba14104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:50:58.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.133+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 shutdown_connections 2024-03-16T10:50:58.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:50:58.133+0000 7fba1a1f4640 1 -- 172.21.15.17:0/1746533521 wait complete. 2024-03-16T10:50:58.144 INFO:tasks.cephfs.filesystem:scrub status for tag:0c980b69-880a-4591-bd1a-271ed903494d - {'path': '/', 'tag': '0c980b69-880a-4591-bd1a-271ed903494d', 'options': 'recursive,force'} 2024-03-16T10:50:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:58 smithi174 ceph-mon[36202]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:50:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:58 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1498557617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:58 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/781718394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:58 smithi017 ceph-mon[32078]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:50:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:58 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1498557617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:58 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/781718394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:58 smithi111 ceph-mon[36315]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:50:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:58 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1498557617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:50:58.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:58 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/781718394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:50:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:59 smithi174 ceph-mon[36202]: scrub queued for path: / 2024-03-16T10:50:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:59 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:50:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:59 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:50:59.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:50:59 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:50:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:59 smithi017 ceph-mon[32078]: scrub queued for path: / 2024-03-16T10:50:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:59 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:50:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:59 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:50:59.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:50:59 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:50:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:59 smithi111 ceph-mon[36315]: scrub queued for path: / 2024-03-16T10:50:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:59 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:50:59.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:59 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:50:59.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:50:59 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:00 smithi174 ceph-mon[36202]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-16T10:51:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:00 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:51:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:00 smithi017 ceph-mon[32078]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-16T10:51:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:00 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:51:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:00 smithi111 ceph-mon[36315]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-16T10:51:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:00 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:51:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:02 smithi174 ceph-mon[36202]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:02 smithi017 ceph-mon[32078]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:02 smithi111 ceph-mon[36315]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:04 smithi174 ceph-mon[36202]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:04.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:04 smithi017 ceph-mon[32078]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:04 smithi111 ceph-mon[36315]: pgmap v358: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-16T10:51:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:06 smithi174 ceph-mon[36202]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-16T10:51:06.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:06 smithi017 ceph-mon[32078]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-16T10:51:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:06 smithi111 ceph-mon[36315]: pgmap v359: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-03-16T10:51:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:08 smithi174 ceph-mon[36202]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-16T10:51:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:08 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:51:08.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:08 smithi017 ceph-mon[32078]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-16T10:51:08.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:08 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:51:08.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:08 smithi111 ceph-mon[36315]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-16T10:51:08.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:08 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-16T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:10 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:10 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: pgmap v361: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:10 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- 172.21.15.17:0/1568797608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 msgr2=0x7fefa4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1568797608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4102f50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fef98009930 tx=0x7fef9802bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- 172.21.15.17:0/1568797608 shutdown_connections 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1568797608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa4109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1568797608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4102f50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1568797608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 0x7fefa40fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- 172.21.15.17:0/1568797608 >> 172.21.15.17:0/1568797608 conn(0x7fefa40fb430 msgr2=0x7fefa40fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- 172.21.15.17:0/1568797608 shutdown_connections 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- 172.21.15.17:0/1568797608 wait complete. 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 Processor -- start 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.929+0000 7fefa8b89640 1 -- start start 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 0x7fefa4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa419f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fefa410d4e0 con 0x7fefa4102ad0 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fefa410d360 con 0x7fefa4103490 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa8b89640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefa410d660 con 0x7fefa40ffb00 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52398/0 (socket says 172.21.15.17:52398) 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1112408349 learned_addr learned my addr 172.21.15.17:0/1112408349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa419f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa259c640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 0x7fefa4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1112408349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 msgr2=0x7fefa4197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 0x7fefa4197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1112408349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 msgr2=0x7fefa419f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa419f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1112408349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa419f6c0 con 0x7fefa4102ad0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa419f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef9802c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.930+0000 7fef937fe640 1 -- 172.21.15.17:0/1112408349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98041070 con 0x7fefa4102ad0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.931+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa419f950 con 0x7fefa4102ad0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.931+0000 7fef937fe640 1 -- 172.21.15.17:0/1112408349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef98004450 con 0x7fefa4102ad0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.931+0000 7fef937fe640 1 -- 172.21.15.17:0/1112408349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98034440 con 0x7fefa4102ad0 2024-03-16T10:51:10.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.931+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa419fe90 con 0x7fefa4102ad0 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fef937fe640 1 -- 172.21.15.17:0/1112408349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fef98044070 con 0x7fefa4102ad0 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 Processor -- start 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 -- start start 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 0x5575b9764760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9769ea0 0x5575b976c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fef937fe640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 0x7fef8c0a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5575b96c9a40 con 0x5575b9764340 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5575b9672920 con 0x5575b9764d30 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefab779740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5575b96c5ae0 con 0x5575b9769ea0 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 0x5575b9764760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefa259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefa259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:49516/0 (socket says 172.21.15.17:49516) 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 -- 172.21.15.17:0/1679188468 learned_addr learned my addr 172.21.15.17:0/1679188468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.933+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 0x5575b9764760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52400/0 (socket says 172.21.15.17:52400) 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9769ea0 0x5575b976c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 0x7fef8c0a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fef937fe640 1 -- 172.21.15.17:0/1112408349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fef980f0480 con 0x7fefa4102ad0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 -- 172.21.15.17:0/1679188468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9769ea0 msgr2=0x5575b976c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9769ea0 0x5575b976c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 -- 172.21.15.17:0/1679188468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 msgr2=0x5575b9764760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 0x5575b9764760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 -- 172.21.15.17:0/1679188468 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b968a460 con 0x5575b9764d30 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa259c640 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef94009ca0 tx=0x7fef94011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8e483cbc1a61f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 0x7fef8c0a4e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0099e0 tx=0x7fef9c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fef90ff9640 1 -- 172.21.15.17:0/1679188468 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94004220 con 0x5575b9764d30 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fef90ff9640 1 -- 172.21.15.17:0/1679188468 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef940043c0 con 0x5575b9764d30 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.934+0000 7fef90ff9640 1 -- 172.21.15.17:0/1679188468 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef940198b0 con 0x5575b9764d30 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- 172.21.15.17:0/1679188468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 msgr2=0x5575b9769830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef94009ca0 tx=0x7fef94011810 comp rx=0 tx=0).stop 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- 172.21.15.17:0/1679188468 shutdown_connections 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9769ea0 0x5575b976c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9769830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 --2- 172.21.15.17:0/1679188468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764340 0x5575b9764760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- 172.21.15.17:0/1679188468 >> 172.21.15.17:0/1679188468 conn(0x5575b975f8b0 msgr2=0x5575b975fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- 172.21.15.17:0/1679188468 shutdown_connections 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- 172.21.15.17:0/1679188468 wait complete. 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 -- start start 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.935+0000 7fefab779740 1 Processor -- start 2024-03-16T10:51:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b976e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9769ea0 0x5575b9775ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5575b976ce50 con 0x5575b9764d30 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5575b9685d70 con 0x5575b9769ea0 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5575b976cfd0 con 0x5575b9764340 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 10 client.0 _ll_register_callbacks cb 0x5575b93dda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9769ea0 0x5575b9775ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52402/0 (socket says 172.21.15.17:52402) 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1837585242 learned_addr learned my addr 172.21.15.17:0/1837585242 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa259c640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b976e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1837585242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 msgr2=0x5575b976e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b976e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9769ea0 msgr2=0x5575b9775ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9769ea0 0x5575b9775ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 -- 172.21.15.17:0/1837585242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b93de210 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef980bcc80 tx=0x7fef980095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0299eb598417271 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fef89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9804b040 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fef9804b1e0 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.936+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef940043c0 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef980bc8e0 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 10 client.15516 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5575b94aa620 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef940043c0 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef980e6c70 con 0x5575b9764d30 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 10 client.15516 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 10 client.15516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 20 client.15516 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b977a4d0 0x5575b977c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 4 client.15516 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575b96d6f80 con 0x5575b977a4d0 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.937+0000 7fefa259c640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b977a4d0 0x5575b977c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefa259c640 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b977a4d0 0x5575b977c950 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b99b59002587fc5 server_cookie=a4be52ef0376fc43 in_seq=0 out_seq=0 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fef89ffb640 10 client.15516 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fef89ffb640 1 -- 172.21.15.17:0/1837585242 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5575b96d6f80 con 0x5575b977a4d0 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fef89ffb640 10 client.15516 handle_command_reply: tid=0 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 client.15516 shutdown 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 msgr2=0x5575b976eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef980bcc80 tx=0x7fef980095d0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 shutdown_connections 2024-03-16T10:51:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b977a4d0 0x5575b977c950 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9769ea0 0x5575b9775ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fef89ffb640 0 client.15516 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9764d30 0x5575b976eb60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 --2- 172.21.15.17:0/1837585242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b976e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 >> 172.21.15.17:0/1837585242 conn(0x5575b975f8b0 msgr2=0x5575b975ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.938+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 shutdown_connections 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.939+0000 7fefab779740 1 -- 172.21.15.17:0/1837585242 wait complete. 2024-03-16T10:51:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.939+0000 7fefab779740 20 client.15516 trim_cache size 0 max 16384 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 Processor -- start 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 -- start start 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 0x5575b976d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764d30 0x5575b9775b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41a89d0 con 0x5575b9769ea0 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41aa510 con 0x5575b9764340 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefab779740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41a90a0 con 0x5575b9764d30 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52414/0 (socket says 172.21.15.17:52414) 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefa259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 0x5575b976d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefa2d9d640 1 -- 172.21.15.17:0/1769908697 learned_addr learned my addr 172.21.15.17:0/1769908697 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.954+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764d30 0x5575b9775b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 -- 172.21.15.17:0/1769908697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764d30 msgr2=0x5575b9775b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764d30 0x5575b9775b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 -- 172.21.15.17:0/1769908697 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 msgr2=0x5575b976d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 0x5575b976d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 -- 172.21.15.17:0/1769908697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b9751140 con 0x5575b9769ea0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa259c640 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 0x5575b976d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00ff70 tx=0x7fef9c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6984043510e2c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fef8bfff640 1 -- 172.21.15.17:0/1769908697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0047d0 con 0x5575b9769ea0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fef8bfff640 1 -- 172.21.15.17:0/1769908697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9c011020 con 0x5575b9769ea0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.955+0000 7fef8bfff640 1 -- 172.21.15.17:0/1769908697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c010430 con 0x5575b9769ea0 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- 172.21.15.17:0/1769908697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 msgr2=0x5575b976de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00ff70 tx=0x7fef9c00e000 comp rx=0 tx=0).stop 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- 172.21.15.17:0/1769908697 shutdown_connections 2024-03-16T10:51:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b976de50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764d30 0x5575b9775b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- 172.21.15.17:0/1769908697 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764340 0x5575b976d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- 172.21.15.17:0/1769908697 >> 172.21.15.17:0/1769908697 conn(0x5575b975f8b0 msgr2=0x5575b975aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- 172.21.15.17:0/1769908697 shutdown_connections 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- 172.21.15.17:0/1769908697 wait complete. 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- start start 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 Processor -- start 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b97732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9773800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41a9e40 con 0x5575b9769ea0 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41a9770 con 0x5575b9764d30 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefa41a69d0 con 0x5575b9764340 2024-03-16T10:51:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefab779740 10 client.0 _ll_register_callbacks cb 0x7fef98009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefa2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52416/0 (socket says 172.21.15.17:52416) 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefa2d9d640 1 -- 172.21.15.17:0/3250690571 learned_addr learned my addr 172.21.15.17:0/3250690571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefa259c640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b97732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.956+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9773800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 -- 172.21.15.17:0/3250690571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 msgr2=0x5575b97732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b97732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 -- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 msgr2=0x5575b9773800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9773800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 -- 172.21.15.17:0/3250690571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b9774e00 con 0x5575b9769ea0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa259c640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b97732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa1d9b640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9773800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefa2d9d640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef9c004420 tx=0x7fef9c011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674d6b68fa59798f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fef89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c037020 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef9c011020 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fef9c01fcb0 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef9c02e040 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefab779740 10 client.15522 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5575b97e0890 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.957+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9c011020 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef9c01d040 con 0x5575b9769ea0 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 10 client.15522 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 20 client.15522 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b97e1260 0x5575b97e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 4 client.15522 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575b96d12d0 con 0x5575b97e1260 2024-03-16T10:51:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefa259c640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b97e1260 0x5575b97e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fef89ffb640 10 client.15522 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.958+0000 7fefa259c640 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b97e1260 0x5575b97e3680 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909caeb8fab58c5b server_cookie=6d3fb8c0aff7a173 in_seq=0 out_seq=0 2024-03-16T10:51:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fef89ffb640 1 -- 172.21.15.17:0/3250690571 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575b96d12d0 con 0x5575b97e1260 2024-03-16T10:51:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fef89ffb640 10 client.15522 handle_command_reply: tid=0 2024-03-16T10:51:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 client.15522 shutdown 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 msgr2=0x5575b9774810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef9c004420 tx=0x7fef9c011910 comp rx=0 tx=0).stop 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 shutdown_connections 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5575b97e1260 0x5575b97e3680 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5575b9769ea0 0x5575b9774810 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5575b9764d30 0x5575b9773800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fef89ffb640 0 client.15522 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 --2- 172.21.15.17:0/3250690571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575b9764340 0x5575b97732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 >> 172.21.15.17:0/3250690571 conn(0x5575b975f8b0 msgr2=0x5575b976d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 shutdown_connections 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.968+0000 7fefab779740 1 -- 172.21.15.17:0/3250690571 wait complete. 2024-03-16T10:51:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefab779740 20 client.15522 trim_cache size 0 max 16384 2024-03-16T10:51:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:51:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:51:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:51:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 msgr2=0x7fef8c0a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 0x7fef8c0a4e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0099e0 tx=0x7fef9c009500 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 msgr2=0x7fefa4197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef9802c650 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 shutdown_connections 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fef8c0a2940 0x7fef8c0a4e00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fefa4103490 0x7fefa419f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefa4102ad0 0x7fefa4197fe0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 --2- 172.21.15.17:0/1112408349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefa40ffb00 0x7fefa4197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 >> 172.21.15.17:0/1112408349 conn(0x7fefa40fb430 msgr2=0x7fefa4105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 shutdown_connections 2024-03-16T10:51:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:10.969+0000 7fefa8b89640 1 -- 172.21.15.17:0/1112408349 wait complete. 2024-03-16T10:51:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:51:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:51:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:51:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:51:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:51:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:51:11.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:51:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:12 smithi174 ceph-mon[36202]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-16T10:51:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:12 smithi017 ceph-mon[32078]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-16T10:51:12.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:12 smithi111 ceph-mon[36315]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-03-16T10:51:14.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:14 smithi174 ceph-mon[36202]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-16T10:51:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:14 smithi017 ceph-mon[32078]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-16T10:51:14.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:14 smithi111 ceph-mon[36315]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-16T10:51:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:16 smithi174 ceph-mon[36202]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:16 smithi017 ceph-mon[32078]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:16.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:16 smithi111 ceph-mon[36315]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:18 smithi174 ceph-mon[36202]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-03-16T10:51:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:18 smithi017 ceph-mon[32078]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-03-16T10:51:18.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:18 smithi111 ceph-mon[36315]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 16 op/s 2024-03-16T10:51:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:20 smithi174 ceph-mon[36202]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:51:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:20 smithi017 ceph-mon[32078]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:51:20.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:20 smithi111 ceph-mon[36315]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-16T10:51:22.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:22 smithi174 ceph-mon[36202]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:22.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:22 smithi017 ceph-mon[32078]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:22.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:22 smithi111 ceph-mon[36315]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 -- 172.21.15.17:0/3998719993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 msgr2=0x7f0d90100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 --2- 172.21.15.17:0/3998719993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90100b40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009ca0 tx=0x7f0d8002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 -- 172.21.15.17:0/3998719993 shutdown_connections 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 --2- 172.21.15.17:0/3998719993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d90108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 --2- 172.21.15.17:0/3998719993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 0x7f0d90101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 --2- 172.21.15.17:0/3998719993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90100b40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.060+0000 7f0d9866e640 1 -- 172.21.15.17:0/3998719993 >> 172.21.15.17:0/3998719993 conn(0x7f0d900fbc90 msgr2=0x7f0d900fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- 172.21.15.17:0/3998719993 shutdown_connections 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- 172.21.15.17:0/3998719993 wait complete. 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 Processor -- start 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- start start 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 0x7f0d90197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d9019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9010c390 con 0x7f0d90100720 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9010c210 con 0x7f0d901022d0 2024-03-16T10:51:24.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9866e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9010c510 con 0x7f0d90101910 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58082/0 (socket says 172.21.15.17:58082) 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d9640a640 1 -- 172.21.15.17:0/787755989 learned_addr learned my addr 172.21.15.17:0/787755989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d9019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.061+0000 7f0d95c09640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 0x7f0d90197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 -- 172.21.15.17:0/787755989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 msgr2=0x7f0d90197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 0x7f0d90197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 -- 172.21.15.17:0/787755989 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 msgr2=0x7f0d9019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d9019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 -- 172.21.15.17:0/787755989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9019f670 con 0x7f0d90100720 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d9019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9640a640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d800324c0 tx=0x7f0d80032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d8f7fe640 1 -- 172.21.15.17:0/787755989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80041020 con 0x7f0d90100720 2024-03-16T10:51:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9019f900 con 0x7f0d90100720 2024-03-16T10:51:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d8f7fe640 1 -- 172.21.15.17:0/787755989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d80034cd0 con 0x7f0d90100720 2024-03-16T10:51:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d8f7fe640 1 -- 172.21.15.17:0/787755989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80039040 con 0x7f0d90100720 2024-03-16T10:51:24.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.062+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9019fe40 con 0x7f0d90100720 2024-03-16T10:51:24.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.064+0000 7f0d8f7fe640 1 -- 172.21.15.17:0/787755989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f0d80044020 con 0x7f0d90100720 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 Processor -- start 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 -- start start 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 0x561d15477b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 0x561d1547cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d153d8a40 con 0x561d15478140 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561d15381920 con 0x561d1547d2b0 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9b257740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d153d4ae0 con 0x561d15477750 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d8f7fe640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 0x7f0d780a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 0x561d1547cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d96c0b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 0x561d15477b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d95c09640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d95c09640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:54536/0 (socket says 172.21.15.17:54536) 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d96c0b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 0x561d15477b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:58046/0 (socket says 172.21.15.17:58046) 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d95c09640 1 -- 172.21.15.17:0/787407614 learned_addr learned my addr 172.21.15.17:0/787407614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 0x7f0d780a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.065+0000 7f0d8f7fe640 1 -- 172.21.15.17:0/787755989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d800f08b0 con 0x7f0d90100720 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 -- 172.21.15.17:0/787407614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 msgr2=0x561d15477b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 0x561d15477b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 -- 172.21.15.17:0/787407614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 msgr2=0x561d1547cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 0x561d1547cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 -- 172.21.15.17:0/787407614 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d15399460 con 0x561d1547d2b0 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d9640a640 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 0x561d1547cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 0x7f0d780a4e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x561d154789a0 tx=0x7f0d88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d95c09640 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d84011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2960697fcbdb6b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d8cbfe640 1 -- 172.21.15.17:0/787407614 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8401e070 con 0x561d1547d2b0 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d8cbfe640 1 -- 172.21.15.17:0/787407614 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d84019b10 con 0x561d1547d2b0 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.066+0000 7f0d8cbfe640 1 -- 172.21.15.17:0/787407614 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400ea30 con 0x561d1547d2b0 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- 172.21.15.17:0/787407614 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 msgr2=0x561d1547f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d84011810 comp rx=0 tx=0).stop 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- 172.21.15.17:0/787407614 shutdown_connections 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d1547d2b0 0x561d1547f740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15478140 0x561d1547cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 --2- 172.21.15.17:0/787407614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15477750 0x561d15477b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- 172.21.15.17:0/787407614 >> 172.21.15.17:0/787407614 conn(0x561d1546e8b0 msgr2=0x561d1546ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- 172.21.15.17:0/787407614 shutdown_connections 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- 172.21.15.17:0/787407614 wait complete. 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 -- start start 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.067+0000 7f0d9b257740 1 Processor -- start 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 0x561d15481fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d1547d2b0 0x561d15488f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d15480260 con 0x561d15477750 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x561d15394d70 con 0x561d15478140 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d154803e0 con 0x561d1547d2b0 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 10 client.0 _ll_register_callbacks cb 0x561d150eca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58094/0 (socket says 172.21.15.17:58094) 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 -- 172.21.15.17:0/781859525 learned_addr learned my addr 172.21.15.17:0/781859525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d95c09640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 0x561d15481fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d1547d2b0 0x561d15488f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 -- 172.21.15.17:0/781859525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d1547d2b0 msgr2=0x561d15488f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d1547d2b0 0x561d15488f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 -- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 msgr2=0x561d15481fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 0x561d15481fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 -- 172.21.15.17:0/781859525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d150ed210 con 0x561d15477750 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d95c09640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 0x561d15481fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9640a640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0d800ee4a0 tx=0x7f0d8008ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c293a797cd8db39 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:24.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800bccf0 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d800f05f0 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.068+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d84019b10 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d8004c260 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 10 client.15534 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d151b9620 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d84019b10 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d8003c030 con 0x561d15477750 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 10 client.15534 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 20 client.15534 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1548d870 0x561d1548fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 4 client.15534 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:24.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d153e5f80 con 0x561d1548d870 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.069+0000 7f0d95c09640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1548d870 0x561d1548fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.070+0000 7f0d75ffb640 10 client.15534 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.070+0000 7f0d95c09640 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1548d870 0x561d1548fce0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3c27b27bb599cd server_cookie=eaf6812b8f5e5c39 in_seq=0 out_seq=0 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d75ffb640 1 -- 172.21.15.17:0/781859525 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561d153e5f80 con 0x561d1548d870 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d75ffb640 10 client.15534 handle_command_reply: tid=0 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 client.15534 shutdown 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 msgr2=0x561d15481a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0d800ee4a0 tx=0x7f0d8008ceb0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 shutdown_connections 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1548d870 0x561d1548fce0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d1547d2b0 0x561d15488f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15478140 0x561d15481fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d75ffb640 0 client.15534 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 --2- 172.21.15.17:0/781859525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d15477750 0x561d15481a60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 >> 172.21.15.17:0/781859525 conn(0x561d1546e8b0 msgr2=0x561d1546dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 shutdown_connections 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 1 -- 172.21.15.17:0/781859525 wait complete. 2024-03-16T10:51:24.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.071+0000 7f0d9b257740 20 client.15534 trim_cache size 0 max 16384 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 Processor -- start 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 -- start start 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15488f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d154945b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a67a0 con 0x561d1546e8b0 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a82e0 con 0x561d15477750 2024-03-16T10:51:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9b257740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a6e70 con 0x561d15478140 2024-03-16T10:51:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58106/0 (socket says 172.21.15.17:58106) 2024-03-16T10:51:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 -- 172.21.15.17:0/2216342016 learned_addr learned my addr 172.21.15.17:0/2216342016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d154945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d95c09640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15488f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 -- 172.21.15.17:0/2216342016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 msgr2=0x561d154945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d154945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 -- 172.21.15.17:0/2216342016 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 msgr2=0x561d15488f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15488f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 -- 172.21.15.17:0/2216342016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d154804f0 con 0x561d1546e8b0 2024-03-16T10:51:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d154945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.086+0000 7f0d9640a640 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b9d10 tx=0x7f0d800bb8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61af3cb4e8f17d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d77fff640 1 -- 172.21.15.17:0/2216342016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800bccf0 con 0x561d1546e8b0 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d77fff640 1 -- 172.21.15.17:0/2216342016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d800bda90 con 0x561d1546e8b0 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d77fff640 1 -- 172.21.15.17:0/2216342016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800c14e0 con 0x561d1546e8b0 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- 172.21.15.17:0/2216342016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 msgr2=0x561d15481d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b9d10 tx=0x7f0d800bb8a0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- 172.21.15.17:0/2216342016 shutdown_connections 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d154945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15488f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 --2- 172.21.15.17:0/2216342016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15481d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- 172.21.15.17:0/2216342016 >> 172.21.15.17:0/2216342016 conn(0x561d15478d40 msgr2=0x561d15481670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- 172.21.15.17:0/2216342016 shutdown_connections 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- 172.21.15.17:0/2216342016 wait complete. 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.087+0000 7f0d9b257740 1 -- start start 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 Processor -- start 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15487400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d15488410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a7c10 con 0x561d1546e8b0 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a7540 con 0x561d15477750 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d901a47a0 con 0x561d15478140 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 10 client.0 _ll_register_callbacks cb 0x7f0d80009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58110/0 (socket says 172.21.15.17:58110) 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 -- 172.21.15.17:0/1632065366 learned_addr learned my addr 172.21.15.17:0/1632065366 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d95c09640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15487400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d15488410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 -- 172.21.15.17:0/1632065366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 msgr2=0x561d15488410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d15488410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 -- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 msgr2=0x561d15487400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15487400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 -- 172.21.15.17:0/1632065366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d15488a00 con 0x561d1546e8b0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d96c0b640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d15488410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9640a640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b96d0 tx=0x7f0d800f0c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff33fc555f54143 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800bccf0 con 0x561d1546e8b0 2024-03-16T10:51:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d800bc7e0 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.088+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d800bda90 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d800bd390 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 10 client.15540 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561d15488a00 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d800bda90 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d800b90e0 con 0x561d1546e8b0 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 10 client.15540 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 20 client.15540 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1547d2b0 0x561d154f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 4 client.15540 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:51:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d153e02d0 con 0x561d1547d2b0 2024-03-16T10:51:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d95c09640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1547d2b0 0x561d154f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d75ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.089+0000 7f0d95c09640 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1547d2b0 0x561d154f6a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e9f87d2fca7552 server_cookie=72a8f13a1848269f in_seq=0 out_seq=0 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d75ffb640 1 -- 172.21.15.17:0/1632065366 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d153e02d0 con 0x561d1547d2b0 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d75ffb640 10 client.15540 handle_command_reply: tid=0 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d9b257740 1 client.15540 shutdown 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 msgr2=0x561d15486ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b96d0 tx=0x7f0d800f0c90 comp rx=0 tx=0).stop 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 shutdown_connections 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.092+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x561d1547d2b0 0x561d154f6a40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d15478140 0x561d15488410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x561d15477750 0x561d15487400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d75ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 --2- 172.21.15.17:0/1632065366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d1546e8b0 0x561d15486ec0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 >> 172.21.15.17:0/1632065366 conn(0x561d15478d40 msgr2=0x561d1546d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 shutdown_connections 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 1 -- 172.21.15.17:0/1632065366 wait complete. 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9b257740 20 client.15540 trim_cache size 0 max 16384 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:51:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:51:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 msgr2=0x7f0d780a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 0x7f0d780a4e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x561d154789a0 tx=0x7f0d88005f90 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 msgr2=0x7f0d90197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d800324c0 tx=0x7f0d80032f40 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 shutdown_connections 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d780a2940 0x7f0d780a4e00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d901022d0 0x7f0d9019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d90101910 0x7f0d90197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 --2- 172.21.15.17:0/787755989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d90100720 0x7f0d90197a50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 >> 172.21.15.17:0/787755989 conn(0x7f0d900fbc90 msgr2=0x7f0d90069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 shutdown_connections 2024-03-16T10:51:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:24.093+0000 7f0d9866e640 1 -- 172.21.15.17:0/787755989 wait complete. 2024-03-16T10:51:24.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:24 smithi174 ceph-mon[36202]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:24.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:24 smithi017 ceph-mon[32078]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:24 smithi111 ceph-mon[36315]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-03-16T10:51:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:26 smithi174 ceph-mon[36202]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-16T10:51:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:26 smithi017 ceph-mon[32078]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-16T10:51:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:26 smithi111 ceph-mon[36315]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-16T10:51:28.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:51:28.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 -- 172.21.15.17:0/275363136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 msgr2=0x7f9b5c108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 --2- 172.21.15.17:0/275363136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c108b20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009ca0 tx=0x7f9b5402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 -- 172.21.15.17:0/275363136 shutdown_connections 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 --2- 172.21.15.17:0/275363136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c108b20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 --2- 172.21.15.17:0/275363136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 --2- 172.21.15.17:0/275363136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 0x7f9b5c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 -- 172.21.15.17:0/275363136 >> 172.21.15.17:0/275363136 conn(0x7f9b5c0fbc70 msgr2=0x7f9b5c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 -- 172.21.15.17:0/275363136 shutdown_connections 2024-03-16T10:51:28.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.255+0000 7f9b60aea640 1 -- 172.21.15.17:0/275363136 wait complete. 2024-03-16T10:51:28.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 Processor -- start 2024-03-16T10:51:28.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 -- start start 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 0x7f9b5c10b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c10d480 con 0x7f9b5c102290 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c10d300 con 0x7f9b5c1018d0 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b60aea640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c10d600 con 0x7f9b5c1006e0 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:54590/0 (socket says 172.21.15.17:54590) 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 -- 172.21.15.17:0/1736621708 learned_addr learned my addr 172.21.15.17:0/1736621708 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58130/0 (socket says 172.21.15.17:58130) 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 0x7f9b5c10b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 -- 172.21.15.17:0/1736621708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 msgr2=0x7f9b5c10b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 0x7f9b5c10b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 -- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 msgr2=0x7f9b5c109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b59d9b640 1 -- 172.21.15.17:0/1736621708 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c10a470 con 0x7f9b5c1018d0 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.256+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000e9f0 tx=0x7f9b5000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b4b7fe640 1 -- 172.21.15.17:0/1736621708 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000cd80 con 0x7f9b5c1018d0 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5c1a1bd0 con 0x7f9b5c1018d0 2024-03-16T10:51:28.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b4b7fe640 1 -- 172.21.15.17:0/1736621708 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b50010910 con 0x7f9b5c1018d0 2024-03-16T10:51:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5c1a2170 con 0x7f9b5c1018d0 2024-03-16T10:51:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.257+0000 7f9b4b7fe640 1 -- 172.21.15.17:0/1736621708 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50018970 con 0x7f9b5c1018d0 2024-03-16T10:51:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.259+0000 7f9b637b1740 1 Processor -- start 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.259+0000 7f9b637b1740 1 -- start start 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afffb60 0x56156b004660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156b004cd0 0x56156b007160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56156af64500 con 0x56156afff170 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56156af0cbe0 con 0x56156afffb60 2024-03-16T10:51:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b637b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56156af605a0 con 0x56156b004cd0 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58146/0 (socket says 172.21.15.17:58146) 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/3572269522 learned_addr learned my addr 172.21.15.17:0/3572269522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afffb60 0x56156b004660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/3572269522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156b004cd0 msgr2=0x56156b007160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156b004cd0 0x56156b007160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/3572269522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afffb60 msgr2=0x56156b004660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afffb60 0x56156b004660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/3572269522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156af204b0 con 0x56156afff170 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b4b7fe640 1 -- 172.21.15.17:0/1736621708 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f9b50010ac0 con 0x7f9b5c1018d0 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009ca0 tx=0x7f9b54005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a6767670bd399d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b48ff9640 1 -- 172.21.15.17:0/3572269522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54043070 con 0x56156afff170 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b48ff9640 1 -- 172.21.15.17:0/3572269522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b54032c90 con 0x56156afff170 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.260+0000 7f9b48ff9640 1 -- 172.21.15.17:0/3572269522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54039040 con 0x56156afff170 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b4b7fe640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 0x7f9b440a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 0x7f9b440a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b4b7fe640 1 -- 172.21.15.17:0/1736621708 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9b500cee20 con 0x7f9b5c1018d0 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 -- 172.21.15.17:0/3572269522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 msgr2=0x56156afff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009ca0 tx=0x7f9b54005ef0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 -- 172.21.15.17:0/3572269522 shutdown_connections 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156b004cd0 0x56156b007160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afffb60 0x56156b004660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3572269522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156afff590 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 -- 172.21.15.17:0/3572269522 >> 172.21.15.17:0/3572269522 conn(0x56156affa6e0 msgr2=0x56156affaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 0x7f9b440a4d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56156affff60 tx=0x7f9b4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 -- 172.21.15.17:0/3572269522 shutdown_connections 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.261+0000 7f9b637b1740 1 -- 172.21.15.17:0/3572269522 wait complete. 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 -- start start 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 Processor -- start 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b009c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b010c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56156b007c20 con 0x56156afff170 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56156af20160 con 0x56156b004cd0 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56156b007da0 con 0x56156afffb60 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b637b1740 10 client.0 _ll_register_callbacks cb 0x56156af04150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b010c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58158/0 (socket says 172.21.15.17:58158) 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 -- 172.21.15.17:0/3874549065 learned_addr learned my addr 172.21.15.17:0/3874549065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b009c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b010c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:54608/0 (socket says 172.21.15.17:54608) 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 -- 172.21.15.17:0/3874549065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 msgr2=0x56156b009c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b009c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 -- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 msgr2=0x56156b010c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b010c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 -- 172.21.15.17:0/3874549065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156ad427d0 con 0x56156afff170 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b009c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009b80 tx=0x7f9b4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a36fa46b5fbe97 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.262+0000 7f9b41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01f630 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9b4c01f7d0 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b54032c90 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b4c01f9d0 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 10 client.15552 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56156ac783f0 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b54032c90 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9b4c027070 con 0x56156afff170 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 10 client.15552 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 20 client.15552 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b015170 0x56156b0175b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 4 client.15552 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56156af71a40 con 0x56156b015170 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.263+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b015170 0x56156b0175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.264+0000 7f9b41ffb640 10 client.15552 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.264+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b015170 0x56156b0175b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1733c3ac32182ed1 server_cookie=5aee7fe654655000 in_seq=0 out_seq=0 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b41ffb640 1 -- 172.21.15.17:0/3874549065 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56156af71a40 con 0x56156b015170 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b41ffb640 10 client.15552 handle_command_reply: tid=0 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 client.15552 shutdown 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 msgr2=0x56156b009710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009b80 tx=0x7f9b4c004730 comp rx=0 tx=0).stop 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 shutdown_connections 2024-03-16T10:51:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b015170 0x56156b0175b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b010c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b009c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 --2- 172.21.15.17:0/3874549065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afff170 0x56156b009710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 >> 172.21.15.17:0/3874549065 conn(0x56156affa6e0 msgr2=0x56156aff9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b41ffb640 0 client.15552 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 shutdown_connections 2024-03-16T10:51:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 1 -- 172.21.15.17:0/3874549065 wait complete. 2024-03-16T10:51:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.265+0000 7f9b637b1740 20 client.15552 trim_cache size 0 max 16384 2024-03-16T10:51:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 Processor -- start 2024-03-16T10:51:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 -- start start 2024-03-16T10:51:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 0x56156b009bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b0003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1aae20 con 0x56156afffb60 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1ac960 con 0x56156b004cd0 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.299+0000 7f9b637b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1ab4f0 con 0x56156afff170 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b59d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 0x56156b009bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b59d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58162/0 (socket says 172.21.15.17:58162) 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b59d9b640 1 -- 172.21.15.17:0/1282838991 learned_addr learned my addr 172.21.15.17:0/1282838991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b0003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 -- 172.21.15.17:0/1282838991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 msgr2=0x56156b0003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b0003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 -- 172.21.15.17:0/1282838991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 msgr2=0x56156b010be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 -- 172.21.15.17:0/1282838991 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156ac380f0 con 0x56156afff170 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 0x56156b009bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c029fd0 tx=0x7f9b4c005b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6239a0dc61fac097 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b43fff640 1 -- 172.21.15.17:0/1282838991 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01f630 con 0x56156afff170 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b43fff640 1 -- 172.21.15.17:0/1282838991 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4c038020 con 0x56156afff170 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.300+0000 7f9b43fff640 1 -- 172.21.15.17:0/1282838991 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c01fd50 con 0x56156afff170 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 -- 172.21.15.17:0/1282838991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 msgr2=0x56156b009bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 0x56156b009bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c029fd0 tx=0x7f9b4c005b90 comp rx=0 tx=0).stop 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 -- 172.21.15.17:0/1282838991 shutdown_connections 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156b004cd0 0x56156b0003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156afffb60 0x56156b010be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1282838991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afff170 0x56156b009bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 -- 172.21.15.17:0/1282838991 >> 172.21.15.17:0/1282838991 conn(0x56156affa6e0 msgr2=0x56156affd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 -- 172.21.15.17:0/1282838991 shutdown_connections 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.301+0000 7f9b637b1740 1 -- 172.21.15.17:0/1282838991 wait complete. 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 -- start start 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 Processor -- start 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 0x56156b00dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b00e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1ac290 con 0x56156b004cd0 2024-03-16T10:51:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1abbc0 con 0x56156afff170 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c1a8e00 con 0x56156afffb60 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b637b1740 10 client.0 _ll_register_callbacks cb 0x7f9b4c009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58178/0 (socket says 172.21.15.17:58178) 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/1685402075 learned_addr learned my addr 172.21.15.17:0/1685402075 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 0x56156b00dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b59d9b640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b00e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/1685402075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 msgr2=0x56156b00e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b00e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 msgr2=0x56156b00dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 0x56156b00dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5ad9d640 1 -- 172.21.15.17:0/1685402075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156af2b9d0 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.302+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 0x56156b00dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b5ad9d640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9b5402c700 tx=0x7f9b54032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceec12091d7b3657 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5404f070 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9b540039e0 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b4c038020 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b5405b050 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 10 client.15558 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56156b083170 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4c038020 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9b54004300 con 0x56156b004cd0 2024-03-16T10:51:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 10 client.15558 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 20 client.15558 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b083730 0x56156b085b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 4 client.15558 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.303+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56156af6bd90 con 0x56156b083730 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b083730 0x56156b085b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b5a59c640 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b083730 0x56156b085b20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa19cf0e608143a server_cookie=b6037dc366602ce7 in_seq=0 out_seq=0 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b41ffb640 10 client.15558 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b41ffb640 1 -- 172.21.15.17:0/1685402075 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56156af6bd90 con 0x56156b083730 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b41ffb640 10 client.15558 handle_command_reply: tid=0 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 client.15558 shutdown 2024-03-16T10:51:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 msgr2=0x56156b081cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9b5402c700 tx=0x7f9b54032fc0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 shutdown_connections 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56156b083730 0x56156b085b20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156b004cd0 0x56156b081cb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b41ffb640 0 client.15558 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56156afffb60 0x56156b00e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 --2- 172.21.15.17:0/1685402075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56156afff170 0x56156b00dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 >> 172.21.15.17:0/1685402075 conn(0x56156affa6e0 msgr2=0x56156b009a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 shutdown_connections 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 1 -- 172.21.15.17:0/1685402075 wait complete. 2024-03-16T10:51:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.304+0000 7f9b637b1740 20 client.15558 trim_cache size 0 max 16384 2024-03-16T10:51:28.314 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:51:28.314 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-03-16T10:51:28.314 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-03-16T10:51:28.314 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 msgr2=0x7f9b440a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 0x7f9b440a4d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x56156affff60 tx=0x7f9b4c005f90 comp rx=0 tx=0).stop 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 msgr2=0x7f9b5c1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000e9f0 tx=0x7f9b5000eeb0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 shutdown_connections 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9b440a2890 0x7f9b440a4d50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b5c102290 0x7f9b5c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b5c1018d0 0x7f9b5c1096a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 --2- 172.21.15.17:0/1736621708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b5c1006e0 0x7f9b5c10b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 >> 172.21.15.17:0/1736621708 conn(0x7f9b5c0fbc70 msgr2=0x7f9b5c104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 shutdown_connections 2024-03-16T10:51:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.305+0000 7f9b60aea640 1 -- 172.21.15.17:0/1736621708 wait complete. 2024-03-16T10:51:28.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T10:51:28.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:51:28.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- 172.21.15.17:0/3327287589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210100700 msgr2=0x7f4210100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 --2- 172.21.15.17:0/3327287589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210100700 0x7f4210100b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f420002bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- 172.21.15.17:0/3327287589 shutdown_connections 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 --2- 172.21.15.17:0/3327287589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101022b0 0x7f4210108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 --2- 172.21.15.17:0/3327287589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42101018f0 0x7f4210101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 --2- 172.21.15.17:0/3327287589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4210100700 0x7f4210100b20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- 172.21.15.17:0/3327287589 >> 172.21.15.17:0/3327287589 conn(0x7f42100fbc70 msgr2=0x7f42100fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- 172.21.15.17:0/3327287589 shutdown_connections 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- 172.21.15.17:0/3327287589 wait complete. 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 Processor -- start 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.424+0000 7f4216836640 1 -- start start 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 0x7f4210102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 0x7f4210103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f421010c370 con 0x7f42101018f0 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f421010c1f0 con 0x7f4210100700 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4216836640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f421010c4f0 con 0x7f42101022b0 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 0x7f4210102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:54650/0 (socket says 172.21.15.17:54650) 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 -- 172.21.15.17:0/3649560427 learned_addr learned my addr 172.21.15.17:0/3649560427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4214dd3640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 0x7f4210103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 -- 172.21.15.17:0/3649560427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 msgr2=0x7f4210103210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 0x7f4210103210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 -- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 msgr2=0x7f4210102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 0x7f4210102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 -- 172.21.15.17:0/3649560427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4210103aa0 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420f7fe640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 0x7f4210102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f4214dd3640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 0x7f4210103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.425+0000 7f420ffff640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f420002c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.426+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200041070 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.426+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42101a1c30 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.426+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4200004450 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.426+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200034440 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.426+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101a21d0 con 0x7f4210100700 2024-03-16T10:51:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.427+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42101a2400 con 0x7f4210100700 2024-03-16T10:51:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.429+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f4200044070 con 0x7f4210100700 2024-03-16T10:51:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.429+0000 7f420d7fa640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 0x7f41fc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.429+0000 7f420f7fe640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 0x7f41fc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.429+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f42000f06b0 con 0x7f4210100700 2024-03-16T10:51:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.430+0000 7f420f7fe640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 0x7f41fc0a4d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4210104400 tx=0x7f41f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.436+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f42000bd240 con 0x7f4210100700 2024-03-16T10:51:28.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:28 smithi174 ceph-mon[36202]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-03-16T10:51:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:28 smithi017 ceph-mon[32078]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-03-16T10:51:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.660+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42101a25d0 con 0x7f4210100700 2024-03-16T10:51:28.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:28 smithi111 ceph-mon[36315]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-03-16T10:51:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.661+0000 7f420d7fa640 1 -- 172.21.15.17:0/3649560427 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11935 (secure 0 0 0) 0x7f42000c12e0 con 0x7f4210100700 2024-03-16T10:51:28.663 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:51:28.663 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:50:51.056785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[14655,24497,24470,24493,24536]},"id":1}]} 2024-03-16T10:51:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-03-16T10:51:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 msgr2=0x7f41fc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 0x7f41fc0a4d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4210104400 tx=0x7f41f8005f90 comp rx=0 tx=0).stop 2024-03-16T10:51:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 msgr2=0x7f4210104690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f420002c640 comp rx=0 tx=0).stop 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 shutdown_connections 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f41fc0a2890 0x7f41fc0a4d50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42101022b0 0x7f4210103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42101018f0 0x7f4210102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 --2- 172.21.15.17:0/3649560427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4210100700 0x7f4210104690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 >> 172.21.15.17:0/3649560427 conn(0x7f42100fbc70 msgr2=0x7f42100fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 shutdown_connections 2024-03-16T10:51:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.663+0000 7f4216836640 1 -- 172.21.15.17:0/3649560427 wait complete. 2024-03-16T10:51:28.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-16T10:51:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- 172.21.15.17:0/3831345241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 msgr2=0x7fb0a8108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/3831345241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a8108b20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009ca0 tx=0x7fb0a002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- 172.21.15.17:0/3831345241 shutdown_connections 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/3831345241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a8108b20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/3831345241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81018d0 0x7fb0a8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/3831345241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81006e0 0x7fb0a8100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- 172.21.15.17:0/3831345241 >> 172.21.15.17:0/3831345241 conn(0x7fb0a80fbc70 msgr2=0x7fb0a80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- 172.21.15.17:0/3831345241 shutdown_connections 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- 172.21.15.17:0/3831345241 wait complete. 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 Processor -- start 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.785+0000 7fb0ae86c640 1 -- start start 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81006e0 0x7fb0a80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81018d0 0x7fb0a819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810c360 con 0x7fb0a8102290 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810c1e0 con 0x7fb0a81018d0 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ae86c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a810c4e0 con 0x7fb0a81006e0 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58226/0 (socket says 172.21.15.17:58226) 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 -- 172.21.15.17:0/1621353566 learned_addr learned my addr 172.21.15.17:0/1621353566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81018d0 0x7fb0a819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81006e0 0x7fb0a80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 -- 172.21.15.17:0/1621353566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81006e0 msgr2=0x7fb0a80694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81006e0 0x7fb0a80694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 -- 172.21.15.17:0/1621353566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81018d0 msgr2=0x7fb0a819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81018d0 0x7fb0a819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 -- 172.21.15.17:0/1621353566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a819f750 con 0x7fb0a8102290 2024-03-16T10:51:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.786+0000 7fb0ace09640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0037040 tx=0x7fb0a0032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.787+0000 7fb0a57fa640 1 -- 172.21.15.17:0/1621353566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0041020 con 0x7fb0a8102290 2024-03-16T10:51:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.787+0000 7fb0a57fa640 1 -- 172.21.15.17:0/1621353566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a0034cd0 con 0x7fb0a8102290 2024-03-16T10:51:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.787+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a819f980 con 0x7fb0a8102290 2024-03-16T10:51:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.787+0000 7fb0a57fa640 1 -- 172.21.15.17:0/1621353566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0039040 con 0x7fb0a8102290 2024-03-16T10:51:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.787+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a819fe70 con 0x7fb0a8102290 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.789+0000 7fb0a57fa640 1 -- 172.21.15.17:0/1621353566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fb0a0044020 con 0x7fb0a8102290 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 Processor -- start 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 -- start start 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b2255c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b225d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5653b21ba490 con 0x5653b2256240 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5653b2162c90 con 0x5653b225b3b0 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0b144c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5653b21b6530 con 0x5653b2255850 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a57fa640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 0x7fb0900a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0ace09640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 0x7fb0900a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b2255c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58230/0 (socket says 172.21.15.17:58230) 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 -- 172.21.15.17:0/118301418 learned_addr learned my addr 172.21.15.17:0/118301418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b225d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a57fa640 1 -- 172.21.15.17:0/1621353566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb0a00f0800 con 0x7fb0a8102290 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 -- 172.21.15.17:0/118301418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 msgr2=0x5653b2255c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b2255c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 -- 172.21.15.17:0/118301418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 msgr2=0x5653b225d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.790+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b225d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb0a7fff640 1 -- 172.21.15.17:0/118301418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b221d500 con 0x5653b2256240 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b2255c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb0ace09640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 0x7fb0900a4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00b9cb0 tx=0x7fb0a00dd040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb098009ca0 tx=0x7fb098011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea25261ab178c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb08e7fc640 1 -- 172.21.15.17:0/118301418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098004220 con 0x5653b2256240 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb08e7fc640 1 -- 172.21.15.17:0/118301418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0980043c0 con 0x5653b2256240 2024-03-16T10:51:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb08e7fc640 1 -- 172.21.15.17:0/118301418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0980198b0 con 0x5653b2256240 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.791+0000 7fb0b144c740 1 -- 172.21.15.17:0/118301418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 msgr2=0x5653b225ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb098009ca0 tx=0x7fb098011810 comp rx=0 tx=0).stop 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- 172.21.15.17:0/118301418 shutdown_connections 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b225d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b225ad40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- 172.21.15.17:0/118301418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b2255c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- 172.21.15.17:0/118301418 >> 172.21.15.17:0/118301418 conn(0x5653b2250dc0 msgr2=0x5653b22511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- 172.21.15.17:0/118301418 shutdown_connections 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- 172.21.15.17:0/118301418 wait complete. 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- start start 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 Processor -- start 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2256240 0x5653b22602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5653b225e360 con 0x5653b2255850 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5653b2176230 con 0x5653b225b3b0 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5653b225e4e0 con 0x5653b2256240 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0b144c740 10 client.0 _ll_register_callbacks cb 0x5653b21b2010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.792+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58240/0 (socket says 172.21.15.17:58240) 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 -- 172.21.15.17:0/4164200681 learned_addr learned my addr 172.21.15.17:0/4164200681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2256240 0x5653b22602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 -- 172.21.15.17:0/4164200681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2256240 msgr2=0x5653b22602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2256240 0x5653b22602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 -- 172.21.15.17:0/4164200681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 msgr2=0x5653b22672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 -- 172.21.15.17:0/4164200681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b2185100 con 0x5653b2255850 2024-03-16T10:51:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0154e0 tx=0x7fb09c015b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dc131e3968889b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c015690 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb09c004030 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0980043c0 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb09c004230 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0b144c740 10 client.15576 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653b1ece3f0 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.793+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0980043c0 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb09c02b050 con 0x5653b2255850 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 10 client.15576 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 10 client.15576 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 20 client.15576 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b226bad0 0x5653b226df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 4 client.15576 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653b21c79d0 con 0x5653b226bad0 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b226bad0 0x5653b226df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0877fe640 10 client.15576 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.794+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b226bad0 0x5653b226df70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c56f3126f84e8548 server_cookie=a7dd0e9da4638b67 in_seq=0 out_seq=0 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0877fe640 1 -- 172.21.15.17:0/4164200681 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5653b21c79d0 con 0x5653b226bad0 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0877fe640 10 client.15576 handle_command_reply: tid=0 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 client.15576 shutdown 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 msgr2=0x5653b225fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0154e0 tx=0x7fb09c015b40 comp rx=0 tx=0).stop 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 shutdown_connections 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b226bad0 0x5653b226df70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2256240 0x5653b22602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0877fe640 0 client.15576 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:51:28.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 --2- 172.21.15.17:0/4164200681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b225fd80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 >> 172.21.15.17:0/4164200681 conn(0x5653b2250dc0 msgr2=0x5653b224ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 shutdown_connections 2024-03-16T10:51:28.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 1 -- 172.21.15.17:0/4164200681 wait complete. 2024-03-16T10:51:28.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.795+0000 7fb0b144c740 20 client.15576 trim_cache size 0 max 16384 2024-03-16T10:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.808+0000 7fb0b144c740 1 Processor -- start 2024-03-16T10:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.808+0000 7fb0b144c740 1 -- start start 2024-03-16T10:51:28.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 0x5653b2267280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b225b3b0 0x5653b224fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a6930 con 0x5653b2255850 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a8470 con 0x5653b2256240 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0b144c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a7000 con 0x5653b225b3b0 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58252/0 (socket says 172.21.15.17:58252) 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 -- 172.21.15.17:0/1445916358 learned_addr learned my addr 172.21.15.17:0/1445916358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 0x5653b2267280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b225b3b0 0x5653b224fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 -- 172.21.15.17:0/1445916358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b225b3b0 msgr2=0x5653b224fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b225b3b0 0x5653b224fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 -- 172.21.15.17:0/1445916358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 msgr2=0x5653b2267280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 0x5653b2267280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 -- 172.21.15.17:0/1445916358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b1f987d0 con 0x5653b2255850 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 0x5653b2267280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0209d0 tx=0x7fb09c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00e1ee45de74174 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb08dffb640 1 -- 172.21.15.17:0/1445916358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c015690 con 0x5653b2255850 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb08dffb640 1 -- 172.21.15.17:0/1445916358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb09c012d00 con 0x5653b2255850 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.809+0000 7fb08dffb640 1 -- 172.21.15.17:0/1445916358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c010830 con 0x5653b2255850 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- 172.21.15.17:0/1445916358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 msgr2=0x5653b224f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0209d0 tx=0x7fb09c001e50 comp rx=0 tx=0).stop 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- 172.21.15.17:0/1445916358 shutdown_connections 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b225b3b0 0x5653b224fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b2256240 0x5653b2267280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 --2- 172.21.15.17:0/1445916358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2255850 0x5653b224f750 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- 172.21.15.17:0/1445916358 >> 172.21.15.17:0/1445916358 conn(0x5653b2250dc0 msgr2=0x5653b225fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- 172.21.15.17:0/1445916358 shutdown_connections 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- 172.21.15.17:0/1445916358 wait complete. 2024-03-16T10:51:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 -- start start 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.810+0000 7fb0b144c740 1 Processor -- start 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b22644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a7da0 con 0x5653b2256240 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a76d0 con 0x5653b225b3b0 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a81a4930 con 0x5653b2255850 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 10 client.0 _ll_register_callbacks cb 0x7fb09c015d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58264/0 (socket says 172.21.15.17:58264) 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 -- 172.21.15.17:0/3835019099 learned_addr learned my addr 172.21.15.17:0/3835019099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b22644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 -- 172.21.15.17:0/3835019099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 msgr2=0x5653b22644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b22644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 -- 172.21.15.17:0/3835019099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 msgr2=0x5653b22659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 -- 172.21.15.17:0/3835019099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b2265fc0 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0a7fff640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb098005fd0 tx=0x7fb098009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5102c18953d6a7f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098009e50 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb09802bc40 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.811+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c012d00 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb09802be60 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 10 client.15582 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653b2267360 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb09c012d00 con 0x5653b2256240 2024-03-16T10:51:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb0980035f0 con 0x5653b2256240 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 10 client.15582 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 10 client.15582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 20 client.15582 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b22d2250 0x5653b22d4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 4 client.15582 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653b21c1d20 con 0x5653b22d2250 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b22d2250 0x5653b22d4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0877fe640 10 client.15582 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.812+0000 7fb0a77fe640 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b22d2250 0x5653b22d4640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=61583a0049307018 server_cookie=147f14977445d0f8 in_seq=0 out_seq=0 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0877fe640 1 -- 172.21.15.17:0/3835019099 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653b21c1d20 con 0x5653b22d2250 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0877fe640 10 client.15582 handle_command_reply: tid=0 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 client.15582 shutdown 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 msgr2=0x5653b2264a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb098005fd0 tx=0x7fb098009c30 comp rx=0 tx=0).stop 2024-03-16T10:51:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 shutdown_connections 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x5653b22d2250 0x5653b22d4640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5653b225b3b0 0x5653b22659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0877fe640 0 client.15582 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653b2256240 0x5653b2264a30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 --2- 172.21.15.17:0/3835019099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653b2255850 0x5653b22644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 >> 172.21.15.17:0/3835019099 conn(0x5653b2250dc0 msgr2=0x5653b2254020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 shutdown_connections 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 1 -- 172.21.15.17:0/3835019099 wait complete. 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0b144c740 20 client.15582 trim_cache size 0 max 16384 2024-03-16T10:51:28.820 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 msgr2=0x7fb0900a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 0x7fb0900a4d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00b9cb0 tx=0x7fb0a00dd040 comp rx=0 tx=0).stop 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 msgr2=0x7fb0a819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.813+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0037040 tx=0x7fb0a0032f40 comp rx=0 tx=0).stop 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 shutdown_connections 2024-03-16T10:51:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb0900a2890 0x7fb0900a4d50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a8102290 0x7fb0a819ee40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0a81018d0 0x7fb0a819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 --2- 172.21.15.17:0/1621353566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0a81006e0 0x7fb0a80694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 >> 172.21.15.17:0/1621353566 conn(0x7fb0a80fbc70 msgr2=0x7fb0a8104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 shutdown_connections 2024-03-16T10:51:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.814+0000 7fb0ae86c640 1 -- 172.21.15.17:0/1621353566 wait complete. 2024-03-16T10:51:28.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-16T10:51:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 -- 172.21.15.17:0/457330547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 msgr2=0x7f2034101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 --2- 172.21.15.17:0/457330547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034101d50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2024009900 tx=0x7f202402bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 -- 172.21.15.17:0/457330547 shutdown_connections 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 --2- 172.21.15.17:0/457330547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 0x7f2034108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 --2- 172.21.15.17:0/457330547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034101d50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 --2- 172.21.15.17:0/457330547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 0x7f2034100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.935+0000 7f203bf87640 1 -- 172.21.15.17:0/457330547 >> 172.21.15.17:0/457330547 conn(0x7f20340fbc70 msgr2=0x7f20340fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- 172.21.15.17:0/457330547 shutdown_connections 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- 172.21.15.17:0/457330547 wait complete. 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 Processor -- start 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- start start 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 0x7f2034197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 0x7f203419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f203410c3b0 con 0x7f20341018d0 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f203410c230 con 0x7f20341006e0 2024-03-16T10:51:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203bf87640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f203410c530 con 0x7f2034102290 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58286/0 (socket says 172.21.15.17:58286) 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f2039522640 1 -- 172.21.15.17:0/3826201338 learned_addr learned my addr 172.21.15.17:0/3826201338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f2039d23640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 0x7f2034197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.936+0000 7f203a524640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 0x7f203419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 -- 172.21.15.17:0/3826201338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 msgr2=0x7f203419f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 0x7f203419f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 -- 172.21.15.17:0/3826201338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 msgr2=0x7f2034197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 0x7f2034197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 -- 172.21.15.17:0/3826201338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203419f730 con 0x7f20341018d0 2024-03-16T10:51:28.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f2039522640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2024000c00 tx=0x7f202402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f202affd640 1 -- 172.21.15.17:0/3826201338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024043020 con 0x7f20341018d0 2024-03-16T10:51:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f202affd640 1 -- 172.21.15.17:0/3826201338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20240054e0 con 0x7f20341018d0 2024-03-16T10:51:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f202affd640 1 -- 172.21.15.17:0/3826201338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024003c40 con 0x7f20341018d0 2024-03-16T10:51:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203419f9c0 con 0x7f20341018d0 2024-03-16T10:51:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.937+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203419ff60 con 0x7f20341018d0 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.939+0000 7f202affd640 1 -- 172.21.15.17:0/3826201338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f2024046020 con 0x7f20341018d0 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.939+0000 7f203eb70740 1 Processor -- start 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 -- start start 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d45650 0x55f643d4a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 0x55f643d4cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f643ca5490 con 0x55f643d4a7c0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f643c4dc90 con 0x55f643d45650 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203eb70740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f643ca1530 con 0x55f643d44c60 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f202affd640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 0x7f20200a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 0x55f643d4cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:58206/0 (socket says 172.21.15.17:58206) 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 -- 172.21.15.17:0/2945874810 learned_addr learned my addr 172.21.15.17:0/2945874810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 0x55f643d4cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58290/0 (socket says 172.21.15.17:58290) 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 0x7f20200a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f2039d23640 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d45650 0x55f643d4a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f202affd640 1 -- 172.21.15.17:0/3826201338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f20240f0ad0 con 0x7f20341018d0 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 -- 172.21.15.17:0/2945874810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d45650 msgr2=0x55f643d4a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d45650 0x55f643d4a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 -- 172.21.15.17:0/2945874810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 msgr2=0x55f643d4cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 0x55f643d4cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.940+0000 7f203a524640 1 -- 172.21.15.17:0/2945874810 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f643d08500 con 0x55f643d44c60 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f203a524640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 0x7f20200a4dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f202c00fc90 tx=0x7f202c018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f203a524640 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f202c011e00 tx=0x7f202c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd693a5499472b0d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f201ffff640 1 -- 172.21.15.17:0/2945874810 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c022070 con 0x55f643d44c60 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f201ffff640 1 -- 172.21.15.17:0/2945874810 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c00ec50 con 0x55f643d44c60 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f201ffff640 1 -- 172.21.15.17:0/2945874810 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0057b0 con 0x55f643d44c60 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f203eb70740 1 -- 172.21.15.17:0/2945874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 msgr2=0x55f643d45080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.941+0000 7f203eb70740 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f202c011e00 tx=0x7f202c00f790 comp rx=0 tx=0).stop 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- 172.21.15.17:0/2945874810 shutdown_connections 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d4a7c0 0x55f643d4cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d45650 0x55f643d4a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- 172.21.15.17:0/2945874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d45080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- 172.21.15.17:0/2945874810 >> 172.21.15.17:0/2945874810 conn(0x55f643d3bdc0 msgr2=0x55f643d3c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- 172.21.15.17:0/2945874810 shutdown_connections 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- 172.21.15.17:0/2945874810 wait complete. 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- start start 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 Processor -- start 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d4f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d56700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f643d4d710 con 0x55f643d45650 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f643c61230 con 0x55f643d4a7c0 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.942+0000 7f203eb70740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f643d4d890 con 0x55f643d44c60 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58302/0 (socket says 172.21.15.17:58302) 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039d23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 -- 172.21.15.17:0/1022235098 learned_addr learned my addr 172.21.15.17:0/1022235098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f203eb70740 10 client.0 _ll_register_callbacks cb 0x55f643c9d010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f203a524640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d56700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 -- 172.21.15.17:0/1022235098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 msgr2=0x55f643d4f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d4f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 -- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 msgr2=0x55f643d56700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d56700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 -- 172.21.15.17:0/1022235098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f643c70100 con 0x55f643d45650 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039d23640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d4f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f2039522640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f20240b9830 tx=0x7f202402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22031de5ed33bb06 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f201d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240035f0 con 0x55f643d45650 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f20240bcab0 con 0x55f643d45650 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202c00ec50 con 0x55f643d45650 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2024005690 con 0x55f643d45650 2024-03-16T10:51:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f203eb70740 10 client.15594 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6439b93f0 con 0x55f643d45650 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.943+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c00ec50 con 0x55f643d45650 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f20240b9a90 con 0x55f643d45650 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 10 client.15594 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 10 client.15594 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 20 client.15594 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643d5af70 0x55f643d5d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 4 client.15594 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f643cb29d0 con 0x55f643d5af70 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f2039d23640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643d5af70 0x55f643d5d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f2039d23640 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643d5af70 0x55f643d5d3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23475f97b8c1e6 server_cookie=9efc28b57dbb1396 in_seq=0 out_seq=0 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.944+0000 7f201d7fa640 10 client.15594 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.945+0000 7f201d7fa640 1 -- 172.21.15.17:0/1022235098 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f643cb29d0 con 0x55f643d5af70 2024-03-16T10:51:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.945+0000 7f201d7fa640 10 client.15594 handle_command_reply: tid=0 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.945+0000 7f203eb70740 1 client.15594 shutdown 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 msgr2=0x55f643d4f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f20240b9830 tx=0x7f202402bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 shutdown_connections 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643d5af70 0x55f643d5d3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d56700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d4f6c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f201d7fa640 0 client.15594 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 --2- 172.21.15.17:0/1022235098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d4f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 >> 172.21.15.17:0/1022235098 conn(0x55f643d3bdc0 msgr2=0x55f643d3afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 shutdown_connections 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 1 -- 172.21.15.17:0/1022235098 wait complete. 2024-03-16T10:51:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.946+0000 7f203eb70740 20 client.15594 trim_cache size 0 max 16384 2024-03-16T10:51:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 Processor -- start 2024-03-16T10:51:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 -- start start 2024-03-16T10:51:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d45650 0x55f643d47090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a6930 con 0x55f643d44c60 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a8470 con 0x55f643d4a7c0 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203eb70740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a7000 con 0x55f643d45650 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f2039d23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f2039d23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58304/0 (socket says 172.21.15.17:58304) 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f2039d23640 1 -- 172.21.15.17:0/1633144522 learned_addr learned my addr 172.21.15.17:0/1633144522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f2039522640 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d45650 0x55f643d47090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.967+0000 7f203a524640 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 -- 172.21.15.17:0/1633144522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d45650 msgr2=0x55f643d47090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d45650 0x55f643d47090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 -- 172.21.15.17:0/1633144522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 msgr2=0x55f643d566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 -- 172.21.15.17:0/1633144522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f643d4e260 con 0x55f643d44c60 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f2039d23640 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55f643d460c0 tx=0x7f2030005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797b2451212ff8ea server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f201f7fe640 1 -- 172.21.15.17:0/1633144522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030005020 con 0x55f643d44c60 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f201f7fe640 1 -- 172.21.15.17:0/1633144522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2030022170 con 0x55f643d44c60 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f201f7fe640 1 -- 172.21.15.17:0/1633144522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000fae0 con 0x55f643d44c60 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f203eb70740 1 -- 172.21.15.17:0/1633144522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 msgr2=0x55f643d46b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.968+0000 7f203eb70740 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55f643d460c0 tx=0x7f2030005f90 comp rx=0 tx=0).stop 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- 172.21.15.17:0/1633144522 shutdown_connections 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d45650 0x55f643d47090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- 172.21.15.17:0/1633144522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d44c60 0x55f643d46b50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- 172.21.15.17:0/1633144522 >> 172.21.15.17:0/1633144522 conn(0x55f643d3bdc0 msgr2=0x55f643d4f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- 172.21.15.17:0/1633144522 shutdown_connections 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- 172.21.15.17:0/1633144522 wait complete. 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- start start 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 Processor -- start 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d53820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d54d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a7da0 con 0x55f643d45650 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a76d0 con 0x55f643d4a7c0 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20341a4910 con 0x55f643d44c60 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203eb70740 10 client.0 _ll_register_callbacks cb 0x7f2024009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f2039d23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d53820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f2039522640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58306/0 (socket says 172.21.15.17:58306) 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f2039522640 1 -- 172.21.15.17:0/961270108 learned_addr learned my addr 172.21.15.17:0/961270108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.969+0000 7f203a524640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d54d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 -- 172.21.15.17:0/961270108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 msgr2=0x55f643d53820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d53820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 -- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 msgr2=0x55f643d54d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d54d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 -- 172.21.15.17:0/961270108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f643a837d0 con 0x55f643d45650 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f2039522640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f20240bd480 tx=0x7f20240bc6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1345b5f63e6b901 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240bd1f0 con 0x55f643d45650 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2030022170 con 0x55f643d45650 2024-03-16T10:51:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f20240c5730 con 0x55f643d45650 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20240bc4f0 con 0x55f643d45650 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f203eb70740 10 client.15600 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f643d56500 con 0x55f643d45650 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2030022170 con 0x55f643d45650 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.970+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f20240bc870 con 0x55f643d45650 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 10 client.15600 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 10 client.15600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 20 client.15600 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643dc1440 0x55f643dc3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 4 client.15600 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f643cacd20 con 0x55f643dc1440 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f2039d23640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643dc1440 0x55f643dc3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f2039d23640 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643dc1440 0x55f643dc3830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=26111b8ac20a7fe1 server_cookie=8145a306008f81e1 in_seq=0 out_seq=0 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f201d7fa640 10 client.15600 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f201d7fa640 1 -- 172.21.15.17:0/961270108 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f643cacd20 con 0x55f643dc1440 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f201d7fa640 10 client.15600 handle_command_reply: tid=0 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 client.15600 shutdown 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 msgr2=0x55f643d53d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f20240bd480 tx=0x7f20240bc6e0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 shutdown_connections 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.971+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f643dc1440 0x55f643dc3830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f643d4a7c0 0x55f643d54d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f643d45650 0x55f643d53d60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 --2- 172.21.15.17:0/961270108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f643d44c60 0x55f643d53820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 >> 172.21.15.17:0/961270108 conn(0x55f643d3bdc0 msgr2=0x55f643d4f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f201d7fa640 0 client.15600 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 shutdown_connections 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 1 -- 172.21.15.17:0/961270108 wait complete. 2024-03-16T10:51:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203eb70740 20 client.15600 trim_cache size 0 max 16384 2024-03-16T10:51:28.983 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:51:28.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 msgr2=0x7f20200a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 0x7f20200a4dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f202c00fc90 tx=0x7f202c018000 comp rx=0 tx=0).stop 2024-03-16T10:51:28.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 msgr2=0x7f2034198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:28.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2024000c00 tx=0x7f202402c650 comp rx=0 tx=0).stop 2024-03-16T10:51:28.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 shutdown_connections 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f20200a2910 0x7f20200a4dd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2034102290 0x7f203419f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20341018d0 0x7f2034198050 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 --2- 172.21.15.17:0/3826201338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20341006e0 0x7f2034197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 >> 172.21.15.17:0/3826201338 conn(0x7f20340fbc70 msgr2=0x7f20340fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 shutdown_connections 2024-03-16T10:51:28.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:28.972+0000 7f203bf87640 1 -- 172.21.15.17:0/3826201338 wait complete. 2024-03-16T10:51:28.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/509033714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 msgr2=0x7fbbc8100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/509033714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8100b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009860 tx=0x7fbbc402bb70 comp rx=0 tx=0).stop 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/509033714 shutdown_connections 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/509033714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc8108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/509033714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 0x7fbbc8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/509033714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8100b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/509033714 >> 172.21.15.17:0/509033714 conn(0x7fbbc80fbc70 msgr2=0x7fbbc80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.090+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/509033714 shutdown_connections 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/509033714 wait complete. 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 Processor -- start 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 -- start start 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 0x7fbbc81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810c330 con 0x7fbbc8102290 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810c1b0 con 0x7fbbc81018d0 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcf4ac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc810c4b0 con 0x7fbbc81006e0 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcda49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcda49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58320/0 (socket says 172.21.15.17:58320) 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcda49640 1 -- 172.21.15.17:0/1056351019 learned_addr learned my addr 172.21.15.17:0/1056351019 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.091+0000 7fbbcca47640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 0x7fbbc81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 -- 172.21.15.17:0/1056351019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 msgr2=0x7fbbc8197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 -- 172.21.15.17:0/1056351019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 msgr2=0x7fbbc81980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 0x7fbbc81980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 -- 172.21.15.17:0/1056351019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc819f7a0 con 0x7fbbc8102290 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcda49640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000efc0 tx=0x7fbbc000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbbe7fc640 1 -- 172.21.15.17:0/1056351019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003970 con 0x7fbbc8102290 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbbe7fc640 1 -- 172.21.15.17:0/1056351019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc0004020 con 0x7fbbc8102290 2024-03-16T10:51:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc819fa90 con 0x7fbbc8102290 2024-03-16T10:51:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbbe7fc640 1 -- 172.21.15.17:0/1056351019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000b9f0 con 0x7fbbc8102290 2024-03-16T10:51:29.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.092+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc819ff90 con 0x7fbbc8102290 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.095+0000 7fbbd2175740 1 Processor -- start 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.095+0000 7fbbbe7fc640 1 -- 172.21.15.17:0/1056351019 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fbbc001d020 con 0x7fbbc8102290 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.095+0000 7fbbd2175740 1 -- start start 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588d40ff490 con 0x5588d419b240 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5588d40a7c90 con 0x5588d419a850 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbd2175740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5588d40fb530 con 0x5588d41a03b0 2024-03-16T10:51:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:54800/0 (socket says 172.21.15.17:54800) 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcca47640 1 -- 172.21.15.17:0/2295514477 learned_addr learned my addr 172.21.15.17:0/2295514477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58330/0 (socket says 172.21.15.17:58330) 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcca47640 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbbe7fc640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 0x7fbbb40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcda49640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 0x7fbbb40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 -- 172.21.15.17:0/2295514477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 msgr2=0x5588d41a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 -- 172.21.15.17:0/2295514477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 msgr2=0x5588d419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 -- 172.21.15.17:0/2295514477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d4162500 con 0x5588d419b240 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcca47640 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbbe7fc640 1 -- 172.21.15.17:0/1056351019 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbbc00cea70 con 0x7fbbc8102290 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.096+0000 7fbbcd248640 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009780 tx=0x7fbbc4034ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc4b75fb8b43886 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbb37fe640 1 -- 172.21.15.17:0/2295514477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4039040 con 0x5588d419b240 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbcda49640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 0x7fbbb40a4d50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0097c80 tx=0x7fbbc0004840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbb37fe640 1 -- 172.21.15.17:0/2295514477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc4004040 con 0x5588d419b240 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbb37fe640 1 -- 172.21.15.17:0/2295514477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc402c920 con 0x5588d419b240 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 -- 172.21.15.17:0/2295514477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 msgr2=0x5588d419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009780 tx=0x7fbbc4034ab0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 -- 172.21.15.17:0/2295514477 shutdown_connections 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419b240 0x5588d419fd40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 --2- 172.21.15.17:0/2295514477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419a850 0x5588d419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 -- 172.21.15.17:0/2295514477 >> 172.21.15.17:0/2295514477 conn(0x5588d4195dc0 msgr2=0x5588d41961c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 -- 172.21.15.17:0/2295514477 shutdown_connections 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.097+0000 7fbbd2175740 1 -- 172.21.15.17:0/2295514477 wait complete. 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 -- start start 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 Processor -- start 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41ac260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588d41a3300 con 0x5588d419a850 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5588d40bb230 con 0x5588d419b240 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5588d41a3480 con 0x5588d41a03b0 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbd2175740 10 client.0 _ll_register_callbacks cb 0x5588d40f7010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58336/0 (socket says 172.21.15.17:58336) 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbcca47640 1 -- 172.21.15.17:0/1423498965 learned_addr learned my addr 172.21.15.17:0/1423498965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.098+0000 7fbbcca47640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 -- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 msgr2=0x5588d41ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 -- 172.21.15.17:0/1423498965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 msgr2=0x5588d41a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 -- 172.21.15.17:0/1423498965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d40ca100 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcca47640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbcd248640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a5260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5588d419b640 tx=0x7fbbc4032400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9898d8a45399bd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc404e020 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbbc402c660 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc4004040 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbc4039040 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbd2175740 10 client.25487 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5588d3e133f0 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.099+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc4004040 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbc4032c20 con 0x5588d419b240 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 10 client.25487 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 10 client.25487 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:51:29.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 20 client.25487 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d41b0770 0x5588d41b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 4 client.25487 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588d410c9d0 con 0x5588d41b0770 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbcca47640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d41b0770 0x5588d41b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbcca47640 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d41b0770 0x5588d41b2b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4447a1b264a664 server_cookie=d760d88d50d26ed1 in_seq=0 out_seq=0 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.100+0000 7fbbb0ff9640 10 client.25487 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/1423498965 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5588d410c9d0 con 0x5588d41b0770 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbb0ff9640 10 client.25487 handle_command_reply: tid=0 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 client.25487 shutdown 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 msgr2=0x5588d41a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a5260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5588d419b640 tx=0x7fbbc4032400 comp rx=0 tx=0).stop 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 shutdown_connections 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d41b0770 0x5588d41b2b60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d41ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbb0ff9640 0 client.25487 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a5260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 --2- 172.21.15.17:0/1423498965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 >> 172.21.15.17:0/1423498965 conn(0x5588d4195dc0 msgr2=0x5588d4194fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 shutdown_connections 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 1 -- 172.21.15.17:0/1423498965 wait complete. 2024-03-16T10:51:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.101+0000 7fbbd2175740 20 client.25487 trim_cache size 0 max 16384 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 Processor -- start 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 -- start start 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d419b240 0x5588d419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d41a03b0 0x5588d41ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a68d0 con 0x5588d419a850 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a8410 con 0x5588d41a03b0 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.114+0000 7fbbd2175740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a6fa0 con 0x5588d419b240 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58350/0 (socket says 172.21.15.17:58350) 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 -- 172.21.15.17:0/3873811553 learned_addr learned my addr 172.21.15.17:0/3873811553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcd248640 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d419b240 0x5588d419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d41a03b0 0x5588d41ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 -- 172.21.15.17:0/3873811553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d419b240 msgr2=0x5588d419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d419b240 0x5588d419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 -- 172.21.15.17:0/3873811553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d41a03b0 msgr2=0x5588d41ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d41a03b0 0x5588d41ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 -- 172.21.15.17:0/3873811553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d41a3dc0 con 0x5588d419a850 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80058c0 tx=0x7fbbb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9b74afbda627d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbb2ffd640 1 -- 172.21.15.17:0/3873811553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8013d30 con 0x5588d419a850 2024-03-16T10:51:29.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbb2ffd640 1 -- 172.21.15.17:0/3873811553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb8005020 con 0x5588d419a850 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.115+0000 7fbbb2ffd640 1 -- 172.21.15.17:0/3873811553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80047a0 con 0x5588d419a850 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- 172.21.15.17:0/3873811553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 msgr2=0x5588d419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80058c0 tx=0x7fbbb8004730 comp rx=0 tx=0).stop 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- 172.21.15.17:0/3873811553 shutdown_connections 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d41a03b0 0x5588d41ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d419b240 0x5588d419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3873811553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d419c740 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- 172.21.15.17:0/3873811553 >> 172.21.15.17:0/3873811553 conn(0x5588d4195dc0 msgr2=0x5588d41a4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- 172.21.15.17:0/3873811553 shutdown_connections 2024-03-16T10:51:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- 172.21.15.17:0/3873811553 wait complete. 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- start start 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 Processor -- start 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d42148c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.116+0000 7fbbd2175740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a7d40 con 0x5588d419a850 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a7670 con 0x5588d419b240 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc81a48d0 con 0x5588d41a03b0 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 10 client.0 _ll_register_callbacks cb 0x7fbbb8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58360/0 (socket says 172.21.15.17:58360) 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 -- 172.21.15.17:0/3398531295 learned_addr learned my addr 172.21.15.17:0/3398531295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcd248640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d42148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 -- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 msgr2=0x5588d42148c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d42148c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 -- 172.21.15.17:0/3398531295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 msgr2=0x5588d41a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 -- 172.21.15.17:0/3398531295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d3edd7d0 con 0x5588d419a850 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbcca47640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8004700 tx=0x7fbbb8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac7e526c80f05a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8011110 con 0x5588d419a850 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbbb802c040 con 0x5588d419a850 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb8005020 con 0x5588d419a850 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbb80112b0 con 0x5588d419a850 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 10 client.15618 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.117+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5588d4215d30 con 0x5588d419a850 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb8005020 con 0x5588d419a850 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbbb803c020 con 0x5588d419a850 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 10 client.15618 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 10 client.15618 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 20 client.15618 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d42166d0 0x5588d4218af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 4 client.15618 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588d4106d20 con 0x5588d42166d0 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbcd248640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d42166d0 0x5588d4218af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbb0ff9640 10 client.15618 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbcd248640 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d42166d0 0x5588d4218af0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b337304e0baea591 server_cookie=61133ea0e8a0784 in_seq=0 out_seq=0 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbb0ff9640 1 -- 172.21.15.17:0/3398531295 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588d4106d20 con 0x5588d42166d0 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbb0ff9640 10 client.15618 handle_command_reply: tid=0 2024-03-16T10:51:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.118+0000 7fbbd2175740 1 client.15618 shutdown 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 msgr2=0x5588d41a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8004700 tx=0x7fbbb8009310 comp rx=0 tx=0).stop 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 shutdown_connections 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x5588d42166d0 0x5588d4218af0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5588d41a03b0 0x5588d42148c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbb0ff9640 0 client.15618 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5588d419b240 0x5588d41a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 --2- 172.21.15.17:0/3398531295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588d419a850 0x5588d41a9070 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 >> 172.21.15.17:0/3398531295 conn(0x5588d4195dc0 msgr2=0x5588d41a4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 shutdown_connections 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 1 -- 172.21.15.17:0/3398531295 wait complete. 2024-03-16T10:51:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbd2175740 20 client.15618 trim_cache size 0 max 16384 2024-03-16T10:51:29.127 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 msgr2=0x7fbbb40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 0x7fbbb40a4d50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0097c80 tx=0x7fbbc0004840 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 msgr2=0x7fbbc819f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000efc0 tx=0x7fbbc000c800 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 shutdown_connections 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbbb40a2890 0x7fbbb40a4d50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbc8102290 0x7fbbc819f130 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbc81018d0 0x7fbbc81980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 --2- 172.21.15.17:0/1056351019 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbc81006e0 0x7fbbc8197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 >> 172.21.15.17:0/1056351019 conn(0x7fbbc80fbc70 msgr2=0x7fbbc8068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 shutdown_connections 2024-03-16T10:51:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.119+0000 7fbbcf4ac640 1 -- 172.21.15.17:0/1056351019 wait complete. 2024-03-16T10:51:29.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 -- 172.21.15.17:0/2089335234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01006e0 msgr2=0x7fb3a0100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/2089335234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01006e0 0x7fb3a0100b00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 -- 172.21.15.17:0/2089335234 shutdown_connections 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/2089335234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a0102290 0x7fb3a0108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/2089335234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a01018d0 0x7fb3a0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/2089335234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01006e0 0x7fb3a0100b00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 -- 172.21.15.17:0/2089335234 >> 172.21.15.17:0/2089335234 conn(0x7fb3a00fbc70 msgr2=0x7fb3a00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 -- 172.21.15.17:0/2089335234 shutdown_connections 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.236+0000 7fb3a7aac640 1 -- 172.21.15.17:0/2089335234 wait complete. 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 Processor -- start 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 -- start start 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 0x7fb3a0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a0102290 0x7fb3a019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010c380 con 0x7fb3a01018d0 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010c200 con 0x7fb3a0102290 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a7aac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010c500 con 0x7fb3a01006e0 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 0x7fb3a0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58378/0 (socket says 172.21.15.17:58378) 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 -- 172.21.15.17:0/271384403 learned_addr learned my addr 172.21.15.17:0/271384403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a6049640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a0102290 0x7fb3a019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 -- 172.21.15.17:0/271384403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 msgr2=0x7fb3a0196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 0x7fb3a0196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 -- 172.21.15.17:0/271384403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a0102290 msgr2=0x7fb3a019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a0102290 0x7fb3a019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5047640 1 -- 172.21.15.17:0/271384403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a019e660 con 0x7fb3a01018d0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.237+0000 7fb3a5848640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 0x7fb3a0196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb3a5047640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb39000ea60 tx=0x7fb39000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb396ffd640 1 -- 172.21.15.17:0/271384403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000cde0 con 0x7fb3a01018d0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb396ffd640 1 -- 172.21.15.17:0/271384403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3900035f0 con 0x7fb3a01018d0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb396ffd640 1 -- 172.21.15.17:0/271384403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390010670 con 0x7fb3a01018d0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a019e950 con 0x7fb3a01018d0 2024-03-16T10:51:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.238+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a019eea0 con 0x7fb3a01018d0 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.240+0000 7fb396ffd640 1 -- 172.21.15.17:0/271384403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fb3900037a0 con 0x7fb3a01018d0 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 Processor -- start 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 -- start start 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560771474850 0x560771474c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 0x56077147c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5607713d9490 con 0x56077147a3b0 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560771381c90 con 0x560771474850 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3aa771740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607713d5530 con 0x560771475240 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb396ffd640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 0x7fb38c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 0x56077147c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:58292/0 (socket says 172.21.15.17:58292) 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 0x56077147c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58386/0 (socket says 172.21.15.17:58386) 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a5848640 1 -- 172.21.15.17:0/2318527087 learned_addr learned my addr 172.21.15.17:0/2318527087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a6049640 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560771474850 0x560771474c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.241+0000 7fb3a6049640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 0x7fb38c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 -- 172.21.15.17:0/2318527087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560771474850 msgr2=0x560771474c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560771474850 0x560771474c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 -- 172.21.15.17:0/2318527087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 msgr2=0x56077147c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 0x56077147c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 -- 172.21.15.17:0/2318527087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56077143c500 con 0x560771475240 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb396ffd640 1 -- 172.21.15.17:0/271384403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3900cede0 con 0x7fb3a01018d0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a5848640 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c240 tx=0x7fb39c009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33c64b76eff06dce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb3a6049640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 0x7fb38c0a4d50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560771475aa0 tx=0x7fb398009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb38bfff640 1 -- 172.21.15.17:0/2318527087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c045070 con 0x560771475240 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb38bfff640 1 -- 172.21.15.17:0/2318527087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c02cd30 con 0x560771475240 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.242+0000 7fb38bfff640 1 -- 172.21.15.17:0/2318527087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c005100 con 0x560771475240 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- 172.21.15.17:0/2318527087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 msgr2=0x560771479d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c240 tx=0x7fb39c009560 comp rx=0 tx=0).stop 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- 172.21.15.17:0/2318527087 shutdown_connections 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56077147a3b0 0x56077147c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771479d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 --2- 172.21.15.17:0/2318527087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560771474850 0x560771474c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- 172.21.15.17:0/2318527087 >> 172.21.15.17:0/2318527087 conn(0x56077146fdc0 msgr2=0x5607714701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- 172.21.15.17:0/2318527087 shutdown_connections 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- 172.21.15.17:0/2318527087 wait complete. 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 -- start start 2024-03-16T10:51:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.243+0000 7fb3aa771740 1 Processor -- start 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771474850 0x560771480ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771488460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56077147d300 con 0x560771475240 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560771395230 con 0x56077147a3b0 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56077147d480 con 0x560771474850 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3aa771740 10 client.0 _ll_register_callbacks cb 0x5607713d1010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58398/0 (socket says 172.21.15.17:58398) 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 -- 172.21.15.17:0/25925130 learned_addr learned my addr 172.21.15.17:0/25925130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a6049640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771488460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5848640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771474850 0x560771480ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 -- 172.21.15.17:0/25925130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771474850 msgr2=0x560771480ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771474850 0x560771480ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 -- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 msgr2=0x560771488460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771488460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 -- 172.21.15.17:0/25925130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607713a4100 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a6049640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771488460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3a5047640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d010 tx=0x7fb390097330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40b3fe52cf6633f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3897fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.244+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39009b080 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3900d2020 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c02cd30 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb39009be20 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 10 client.15630 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607710ed3f0 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c02cd30 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb39009ab70 con 0x560771475240 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 10 client.15630 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 10 client.15630 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:51:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 20 client.15630 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x56077148cdb0 0x56077148f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 4 client.15630 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607713e69d0 con 0x56077148cdb0 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.245+0000 7fb3a5848640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x56077148cdb0 0x56077148f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3a5848640 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x56077148cdb0 0x56077148f210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d17450e111123a8 server_cookie=e94adcab3e930bdd in_seq=0 out_seq=0 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3897fa640 10 client.15630 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3897fa640 1 -- 172.21.15.17:0/25925130 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5607713e69d0 con 0x56077148cdb0 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3897fa640 10 client.15630 handle_command_reply: tid=0 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3aa771740 1 client.15630 shutdown 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 msgr2=0x560771481420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.246+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb39000d010 tx=0x7fb390097330 comp rx=0 tx=0).stop 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 shutdown_connections 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x56077148cdb0 0x56077148f210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771488460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771475240 0x560771481420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3897fa640 0 client.15630 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 --2- 172.21.15.17:0/25925130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771474850 0x560771480ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 >> 172.21.15.17:0/25925130 conn(0x56077146fdc0 msgr2=0x56077146efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 shutdown_connections 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 1 -- 172.21.15.17:0/25925130 wait complete. 2024-03-16T10:51:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.247+0000 7fb3aa771740 20 client.15630 trim_cache size 0 max 16384 2024-03-16T10:51:29.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 Processor -- start 2024-03-16T10:51:29.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 -- start start 2024-03-16T10:51:29.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771488420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x56077146ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a69a0 con 0x560771474850 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a84e0 con 0x56077147a3b0 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3aa771740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a7070 con 0x560771475240 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58414/0 (socket says 172.21.15.17:58414) 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 -- 172.21.15.17:0/824051612 learned_addr learned my addr 172.21.15.17:0/824051612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a6049640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x56077146ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5047640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771488420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 -- 172.21.15.17:0/824051612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 msgr2=0x560771488420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771488420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 -- 172.21.15.17:0/824051612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 msgr2=0x56077146ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x56077146ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5848640 1 -- 172.21.15.17:0/824051612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607711b77d0 con 0x560771474850 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.260+0000 7fb3a5047640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771488420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3a5848640 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c210 tx=0x7fb39c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ba83b4b75229f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb38b7fe640 1 -- 172.21.15.17:0/824051612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c045040 con 0x560771474850 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb38b7fe640 1 -- 172.21.15.17:0/824051612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c02cd30 con 0x560771474850 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb38b7fe640 1 -- 172.21.15.17:0/824051612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0053a0 con 0x560771474850 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 -- 172.21.15.17:0/824051612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 msgr2=0x56077147fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c210 tx=0x7fb39c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 -- 172.21.15.17:0/824051612 shutdown_connections 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x56077146ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771488420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 --2- 172.21.15.17:0/824051612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x56077147fdd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 -- 172.21.15.17:0/824051612 >> 172.21.15.17:0/824051612 conn(0x56077146fdc0 msgr2=0x56077146e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 -- 172.21.15.17:0/824051612 shutdown_connections 2024-03-16T10:51:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.261+0000 7fb3aa771740 1 -- 172.21.15.17:0/824051612 wait complete. 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 -- start start 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 Processor -- start 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771486200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771487210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a7e10 con 0x560771474850 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a7740 con 0x56077147a3b0 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01a49a0 con 0x560771475240 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3aa771740 10 client.0 _ll_register_callbacks cb 0x7fb390003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3a5848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58426/0 (socket says 172.21.15.17:58426) 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3a5848640 1 -- 172.21.15.17:0/3272293804 learned_addr learned my addr 172.21.15.17:0/3272293804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3a5047640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771486200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.262+0000 7fb3a6049640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771487210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 -- 172.21.15.17:0/3272293804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 msgr2=0x560771486200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771486200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 -- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 msgr2=0x560771487210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771487210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 -- 172.21.15.17:0/3272293804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560771487800 con 0x560771474850 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5047640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771486200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a6049640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771487210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3a5848640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c170 tx=0x7fb39c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f26db15c358ac80 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3897fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c045040 con 0x560771474850 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb39c004040 con 0x560771474850 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c02cd30 con 0x560771474850 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb39c004240 con 0x560771474850 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3aa771740 10 client.15636 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607714f3180 con 0x560771474850 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.263+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39c02cd30 con 0x560771474850 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb39c003bc0 con 0x560771474850 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 10 client.15636 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 10 client.15636 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 20 client.15636 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5607714f36a0 0x5607714f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 4 client.15636 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607713e0d20 con 0x5607714f36a0 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3a5047640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5607714f36a0 0x5607714f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3897fa640 10 client.15636 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3a5047640 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5607714f36a0 0x5607714f5a90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54a54c7b8decab9f server_cookie=db003f82ee95d5ff in_seq=0 out_seq=0 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3897fa640 1 -- 172.21.15.17:0/3272293804 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607713e0d20 con 0x5607714f36a0 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3897fa640 10 client.15636 handle_command_reply: tid=0 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 1 client.15636 shutdown 2024-03-16T10:51:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 msgr2=0x560771485cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.264+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb39c02c170 tx=0x7fb39c005d50 comp rx=0 tx=0).stop 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 shutdown_connections 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x5607714f36a0 0x5607714f5a90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56077147a3b0 0x560771487210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560771475240 0x560771486200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3897fa640 0 client.15636 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 --2- 172.21.15.17:0/3272293804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560771474850 0x560771485cc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 >> 172.21.15.17:0/3272293804 conn(0x56077146fdc0 msgr2=0x560771473020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 shutdown_connections 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 1 -- 172.21.15.17:0/3272293804 wait complete. 2024-03-16T10:51:29.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3aa771740 20 client.15636 trim_cache size 0 max 16384 2024-03-16T10:51:29.273 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:51:29.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 msgr2=0x7fb38c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 0x7fb38c0a4d50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560771475aa0 tx=0x7fb398009500 comp rx=0 tx=0).stop 2024-03-16T10:51:29.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 msgr2=0x7fb3a0196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb39000ea60 tx=0x7fb39000ef20 comp rx=0 tx=0).stop 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 shutdown_connections 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb38c0a2890 0x7fb38c0a4d50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3a0102290 0x7fb3a019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01018d0 0x7fb3a0196f80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 --2- 172.21.15.17:0/271384403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a01006e0 0x7fb3a0196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 >> 172.21.15.17:0/271384403 conn(0x7fb3a00fbc70 msgr2=0x7fb3a0104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 shutdown_connections 2024-03-16T10:51:29.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.265+0000 7fb3a7aac640 1 -- 172.21.15.17:0/271384403 wait complete. 2024-03-16T10:51:29.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T10:51:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 -- 172.21.15.17:0/3375925489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 msgr2=0x7f5748108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 --2- 172.21.15.17:0/3375925489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f5748108b20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5738009900 tx=0x7f573802bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 -- 172.21.15.17:0/3375925489 shutdown_connections 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 --2- 172.21.15.17:0/3375925489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f5748108b20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 --2- 172.21.15.17:0/3375925489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 0x7f5748101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 --2- 172.21.15.17:0/3375925489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f5748100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 -- 172.21.15.17:0/3375925489 >> 172.21.15.17:0/3375925489 conn(0x7f57480fbc70 msgr2=0x7f57480fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 -- 172.21.15.17:0/3375925489 shutdown_connections 2024-03-16T10:51:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.384+0000 7f574ca9a640 1 -- 172.21.15.17:0/3375925489 wait complete. 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.385+0000 7f574ca9a640 1 Processor -- start 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.385+0000 7f574ca9a640 1 -- start start 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.385+0000 7f574ca9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.385+0000 7f574ca9a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 0x7f5748196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f574819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f574810c340 con 0x7f5748102290 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f574810c1c0 con 0x7f57481018d0 2024-03-16T10:51:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f574810c4c0 con 0x7f57481006e0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f574819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:58334/0 (socket says 172.21.15.17:58334) 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 -- 172.21.15.17:0/730320061 learned_addr learned my addr 172.21.15.17:0/730320061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f5745d9b640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 0x7f5748196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 -- 172.21.15.17:0/730320061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 msgr2=0x7f5748196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 0x7f5748196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 -- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 msgr2=0x7f574819df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f574819df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 -- 172.21.15.17:0/730320061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574819e5d0 con 0x7f57481006e0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f5746d9d640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f574819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574659c640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f574000ebc0 tx=0x7f574000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f573f7fe640 1 -- 172.21.15.17:0/730320061 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740003b70 con 0x7f57481006e0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f573f7fe640 1 -- 172.21.15.17:0/730320061 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5740003d10 con 0x7f57481006e0 2024-03-16T10:51:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574819e8c0 con 0x7f57481006e0 2024-03-16T10:51:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f573f7fe640 1 -- 172.21.15.17:0/730320061 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740019980 con 0x7f57481006e0 2024-03-16T10:51:29.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.386+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574819ee10 con 0x7f57481006e0 2024-03-16T10:51:29.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 Processor -- start 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 -- start start 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd6450 0x55c87dddaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87dddb5c0 0x55c87dddda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c87dd38490 con 0x55c87ddd5a60 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c87dce0c90 con 0x55c87dddb5c0 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574f765740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c87dd34530 con 0x55c87ddd6450 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f573f7fe640 1 -- 172.21.15.17:0/730320061 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f5740019b20 con 0x7f57481006e0 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58454/0 (socket says 172.21.15.17:58454) 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f5746d9d640 1 -- 172.21.15.17:0/1034956574 learned_addr learned my addr 172.21.15.17:0/1034956574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f5745d9b640 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87dddb5c0 0x55c87dddda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.389+0000 7f574659c640 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd6450 0x55c87dddaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 -- 172.21.15.17:0/1034956574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd6450 msgr2=0x55c87dddaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd6450 0x55c87dddaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 -- 172.21.15.17:0/1034956574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87dddb5c0 msgr2=0x55c87dddda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87dddb5c0 0x55c87dddda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 -- 172.21.15.17:0/1034956574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87dd9b500 con 0x55c87ddd5a60 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f5746d9d640 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f573802cfd0 tx=0x7f573802cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77de93ca0bf8d997 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f573f7fe640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 0x7f57340a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f573cff9640 1 -- 172.21.15.17:0/1034956574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738042070 con 0x55c87ddd5a60 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f573cff9640 1 -- 172.21.15.17:0/1034956574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5738004ba0 con 0x55c87ddd5a60 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f573cff9640 1 -- 172.21.15.17:0/1034956574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738005300 con 0x55c87ddd5a60 2024-03-16T10:51:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f574659c640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 0x7f57340a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.390+0000 7f573f7fe640 1 -- 172.21.15.17:0/730320061 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f57400cf350 con 0x7f57481006e0 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574659c640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 0x7f57340a4d50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c87ddd6ec0 tx=0x7f57400d2eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- 172.21.15.17:0/1034956574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 msgr2=0x55c87ddd5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f573802cfd0 tx=0x7f573802cd30 comp rx=0 tx=0).stop 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- 172.21.15.17:0/1034956574 shutdown_connections 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87dddb5c0 0x55c87dddda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd6450 0x55c87dddaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 --2- 172.21.15.17:0/1034956574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddd5e80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- 172.21.15.17:0/1034956574 >> 172.21.15.17:0/1034956574 conn(0x55c87ddcedc0 msgr2=0x55c87ddcf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- 172.21.15.17:0/1034956574 shutdown_connections 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- 172.21.15.17:0/1034956574 wait complete. 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.391+0000 7f574f765740 1 -- start start 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 Processor -- start 2024-03-16T10:51:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd5a60 0x55c87dddff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c87ddde510 con 0x55c87dddb5c0 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c87dcf4230 con 0x55c87ddd6450 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c87ddde690 con 0x55c87ddd5a60 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f574f765740 10 client.0 _ll_register_callbacks cb 0x55c87dd30010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5745d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56924/0 (socket says 172.21.15.17:56924) 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 -- 172.21.15.17:0/2499380604 learned_addr learned my addr 172.21.15.17:0/2499380604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd5a60 0x55c87dddff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 -- 172.21.15.17:0/2499380604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd5a60 msgr2=0x55c87dddff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd5a60 0x55c87dddff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 -- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 msgr2=0x55c87dde0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 -- 172.21.15.17:0/2499380604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87dd03100 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f573802c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360330503ea5e379 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f572dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738042070 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.392+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f573804e040 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5738004ba0 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5738034440 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 10 client.15648 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c87da4c3f0 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5738004ba0 con 0x55c87dddb5c0 2024-03-16T10:51:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5738053410 con 0x55c87dddb5c0 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 10 client.15648 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 20 client.15648 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87ddeb970 0x55c87ddedd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 4 client.15648 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c87dd459d0 con 0x55c87ddeb970 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.393+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87ddeb970 0x55c87ddedd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.394+0000 7f572dffb640 10 client.15648 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.394+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87ddeb970 0x55c87ddedd60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e346a1e2d7b644 server_cookie=649bf5366391330d in_seq=0 out_seq=0 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f572dffb640 1 -- 172.21.15.17:0/2499380604 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c87dd459d0 con 0x55c87ddeb970 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f572dffb640 10 client.15648 handle_command_reply: tid=0 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 client.15648 shutdown 2024-03-16T10:51:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 msgr2=0x55c87dde7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5738006010 tx=0x7f573802c880 comp rx=0 tx=0).stop 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 shutdown_connections 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87ddeb970 0x55c87ddedd60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87dddb5c0 0x55c87dde7480 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f572dffb640 0 client.15648 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 --2- 172.21.15.17:0/2499380604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87ddd5a60 0x55c87dddff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 >> 172.21.15.17:0/2499380604 conn(0x55c87ddcedc0 msgr2=0x55c87ddcdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 shutdown_connections 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 1 -- 172.21.15.17:0/2499380604 wait complete. 2024-03-16T10:51:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.395+0000 7f574f765740 20 client.15648 trim_cache size 0 max 16384 2024-03-16T10:51:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 Processor -- start 2024-03-16T10:51:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 -- start start 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87ddcdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a68d0 con 0x55c87ddd5a60 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a8410 con 0x55c87ddd6450 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.408+0000 7f574f765740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a6fa0 con 0x55c87dddb5c0 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56932/0 (socket says 172.21.15.17:56932) 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 -- 172.21.15.17:0/2661498729 learned_addr learned my addr 172.21.15.17:0/2661498729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87ddcdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 -- 172.21.15.17:0/2661498729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 msgr2=0x55c87ddcdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87ddcdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 -- 172.21.15.17:0/2661498729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 msgr2=0x55c87dde7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 -- 172.21.15.17:0/2661498729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87db167d0 con 0x55c87ddd5a60 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57380096c0 tx=0x7f573802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e8fb5143f5be59 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f572ffff640 1 -- 172.21.15.17:0/2661498729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738042070 con 0x55c87ddd5a60 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f572ffff640 1 -- 172.21.15.17:0/2661498729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573802cd30 con 0x55c87ddd5a60 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.409+0000 7f572ffff640 1 -- 172.21.15.17:0/2661498729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738034ac0 con 0x55c87ddd5a60 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- 172.21.15.17:0/2661498729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 msgr2=0x55c87ddcd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57380096c0 tx=0x7f573802bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- 172.21.15.17:0/2661498729 shutdown_connections 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87ddcdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 --2- 172.21.15.17:0/2661498729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87ddcd750 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- 172.21.15.17:0/2661498729 >> 172.21.15.17:0/2661498729 conn(0x55c87ddcedc0 msgr2=0x55c87dddff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- 172.21.15.17:0/2661498729 shutdown_connections 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- 172.21.15.17:0/2661498729 wait complete. 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 -- start start 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.410+0000 7f574f765740 1 Processor -- start 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87dde5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a7d40 con 0x55c87ddd5a60 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a7670 con 0x55c87ddd6450 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57481a48b0 con 0x55c87dddb5c0 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 10 client.0 _ll_register_callbacks cb 0x7f5730009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5746d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56942/0 (socket says 172.21.15.17:56942) 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5746d9d640 1 -- 172.21.15.17:0/2344328881 learned_addr learned my addr 172.21.15.17:0/2344328881 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87dde5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 -- 172.21.15.17:0/2344328881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 msgr2=0x55c87dde5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87dde5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 -- 172.21.15.17:0/2344328881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 msgr2=0x55c87dde47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 -- 172.21.15.17:0/2344328881 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87dde6300 con 0x55c87ddd6450 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f5745d9b640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde4d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c87ddee480 tx=0x7f5730012ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12825aa60e437c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f572dffb640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730004220 con 0x55c87ddd6450 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f57300043c0 con 0x55c87ddd6450 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.411+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c87dd3fd20 con 0x55c87ddd6450 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f573002f050 con 0x55c87ddd6450 2024-03-16T10:51:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 10 client.25529 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c87dde7670 con 0x55c87ddd6450 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c87dd3fd20 con 0x55c87ddd6450 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5730003c40 con 0x55c87ddd6450 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 10 client.25529 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 20 client.25529 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87de520e0 0x55c87de54500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 4 client.25529 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c87dcbd6a0 con 0x55c87de520e0 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.412+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87de520e0 0x55c87de54500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f572dffb640 10 client.25529 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f5746d9d640 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87de520e0 0x55c87de54500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3a37918947aa8 server_cookie=985da99f78e20e70 in_seq=0 out_seq=0 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f572dffb640 1 -- 172.21.15.17:0/2344328881 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c87dcbd6a0 con 0x55c87de520e0 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f572dffb640 10 client.25529 handle_command_reply: tid=0 2024-03-16T10:51:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 client.25529 shutdown 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 msgr2=0x55c87dde4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde4d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c87ddee480 tx=0x7f5730012ae0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 shutdown_connections 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c87de520e0 0x55c87de54500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87dddb5c0 0x55c87dde5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c87ddd6450 0x55c87dde4d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f572dffb640 0 client.25529 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 --2- 172.21.15.17:0/2344328881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87ddd5a60 0x55c87dde47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 >> 172.21.15.17:0/2344328881 conn(0x55c87ddcedc0 msgr2=0x55c87ddd2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 shutdown_connections 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 1 -- 172.21.15.17:0/2344328881 wait complete. 2024-03-16T10:51:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.413+0000 7f574f765740 20 client.25529 trim_cache size 0 max 16384 2024-03-16T10:51:29.421 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:51:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 msgr2=0x7f57340a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 0x7f57340a4d50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55c87ddd6ec0 tx=0x7f57400d2eb0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 msgr2=0x7f57481969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f574000ebc0 tx=0x7f574000c6a0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 shutdown_connections 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57340a2890 0x7f57340a4d50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5748102290 0x7f574819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57481018d0 0x7f5748196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 --2- 172.21.15.17:0/730320061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57481006e0 0x7f57481969b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 >> 172.21.15.17:0/730320061 conn(0x7f57480fbc70 msgr2=0x7f5748104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 shutdown_connections 2024-03-16T10:51:29.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:29.414+0000 7f574ca9a640 1 -- 172.21.15.17:0/730320061 wait complete. 2024-03-16T10:51:29.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:29 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3649560427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:51:29.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:29 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3649560427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:51:29.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:29 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3649560427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:51:30.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T10:51:30.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:51:30.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T10:51:30.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.535+0000 7f9ff5619640 1 -- 172.21.15.17:0/2122601562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0107580 msgr2=0x7f9ff0109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.535+0000 7f9ff5619640 1 --2- 172.21.15.17:0/2122601562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0107580 0x7f9ff0109970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009ca0 tx=0x7f9fe802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 -- 172.21.15.17:0/2122601562 shutdown_connections 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 --2- 172.21.15.17:0/2122601562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0107580 0x7f9ff0109970 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 --2- 172.21.15.17:0/2122601562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0104c50 0x7f9ff0107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 --2- 172.21.15.17:0/2122601562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0102320 0x7f9ff0104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 -- 172.21.15.17:0/2122601562 >> 172.21.15.17:0/2122601562 conn(0x7f9ff00fbc70 msgr2=0x7f9ff00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 -- 172.21.15.17:0/2122601562 shutdown_connections 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 -- 172.21.15.17:0/2122601562 wait complete. 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 Processor -- start 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.536+0000 7f9ff5619640 1 -- start start 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0104c50 0x7f9ff01002d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0107580 0x7f9ff0100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010d490 con 0x7f9ff0102320 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010d310 con 0x7f9ff0104c50 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010d610 con 0x7f9ff0107580 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56958/0 (socket says 172.21.15.17:56958) 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 -- 172.21.15.17:0/3203396805 learned_addr learned my addr 172.21.15.17:0/3203396805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0104c50 0x7f9ff01002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0107580 0x7f9ff0100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 -- 172.21.15.17:0/3203396805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0107580 msgr2=0x7f9ff0100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0107580 0x7f9ff0100810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 -- 172.21.15.17:0/3203396805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0104c50 msgr2=0x7f9ff01002d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0104c50 0x7f9ff01002d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 -- 172.21.15.17:0/3203396805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff01010a0 con 0x7f9ff0102320 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e9f0 tx=0x7f9fe000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9fecff9640 1 -- 172.21.15.17:0/3203396805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000cd80 con 0x7f9ff0102320 2024-03-16T10:51:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9fecff9640 1 -- 172.21.15.17:0/3203396805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0010910 con 0x7f9ff0102320 2024-03-16T10:51:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01a1c50 con 0x7f9ff0102320 2024-03-16T10:51:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9fecff9640 1 -- 172.21.15.17:0/3203396805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0018990 con 0x7f9ff0102320 2024-03-16T10:51:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.537+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01a21a0 con 0x7f9ff0102320 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.539+0000 7f9fecff9640 1 -- 172.21.15.17:0/3203396805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f9fe0010ac0 con 0x7f9ff0102320 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.540+0000 7f9fecff9640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 0x7f9fdc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.540+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 0x7f9fdc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.540+0000 7f9fecff9640 1 -- 172.21.15.17:0/3203396805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9fe00cee40 con 0x7f9ff0102320 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.540+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 0x7f9fdc0a4d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0101a00 tx=0x7f9fd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 Processor -- start 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 -- start start 2024-03-16T10:51:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b2ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b2f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635b9a8c0d0 con 0x5635b9b27990 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5635b9a34c70 con 0x5635b9b2d4f0 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9ff8209740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5635b9a88170 con 0x5635b9b28380 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56964/0 (socket says 172.21.15.17:56964) 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9feeffd640 1 -- 172.21.15.17:0/2466820293 learned_addr learned my addr 172.21.15.17:0/2466820293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b2f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.541+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b2ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 -- 172.21.15.17:0/2466820293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 msgr2=0x5635b9b2ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b2ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 -- 172.21.15.17:0/2466820293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 msgr2=0x5635b9b2f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b2f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 -- 172.21.15.17:0/2466820293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b98687e0 con 0x5635b9b27990 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a39f0 tx=0x7f9fe009f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c276a982f06709 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9fe57fa640 1 -- 172.21.15.17:0/2466820293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00860e0 con 0x5635b9b27990 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9fe57fa640 1 -- 172.21.15.17:0/2466820293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe00ccb40 con 0x5635b9b27990 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.542+0000 7f9fe57fa640 1 -- 172.21.15.17:0/2466820293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe009ac80 con 0x5635b9b27990 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- 172.21.15.17:0/2466820293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 msgr2=0x5635b9b27db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a39f0 tx=0x7f9fe009f8d0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- 172.21.15.17:0/2466820293 shutdown_connections 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b2f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b2ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2466820293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b27db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- 172.21.15.17:0/2466820293 >> 172.21.15.17:0/2466820293 conn(0x5635b9aefc50 msgr2=0x5635b9b23300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- 172.21.15.17:0/2466820293 shutdown_connections 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- 172.21.15.17:0/2466820293 wait complete. 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- start start 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 Processor -- start 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b27990 0x5635b9b31de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b32320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635b9b303e0 con 0x5635b9b2d4f0 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5635b9a480d0 con 0x5635b9b27990 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5635b9b30560 con 0x5635b9b28380 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.543+0000 7f9ff8209740 10 client.0 _ll_register_callbacks cb 0x5635b9a11760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56978/0 (socket says 172.21.15.17:56978) 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 -- 172.21.15.17:0/4247406394 learned_addr learned my addr 172.21.15.17:0/4247406394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b32320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9feeffd640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b27990 0x5635b9b31de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 -- 172.21.15.17:0/4247406394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 msgr2=0x5635b9b32320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b32320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 -- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b27990 msgr2=0x5635b9b31de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b27990 0x5635b9b31de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 -- 172.21.15.17:0/4247406394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b98c8f70 con 0x5635b9b2d4f0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009ca0 tx=0x7f9fe8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb2c52904925133 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8044070 con 0x5635b9b2d4f0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9fe8032890 con 0x5635b9b2d4f0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe00ccb40 con 0x5635b9b2d4f0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fe8039040 con 0x5635b9b2d4f0 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9ff8209740 10 client.15666 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:30.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.544+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5635b9760170 con 0x5635b9b2d4f0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe00ccb40 con 0x5635b9b2d4f0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9fe80045d0 con 0x5635b9b2d4f0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 10 client.15666 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 20 client.15666 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9b3d900 0x5635b9b3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 4 client.15666 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b9a99610 con 0x5635b9b3d900 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9feeffd640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9b3d900 0x5635b9b3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9fd67fc640 10 client.15666 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.545+0000 7f9feeffd640 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9b3d900 0x5635b9b3fda0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95efc5e609964bd3 server_cookie=29339a2fd0d18dca in_seq=0 out_seq=0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.546+0000 7f9fd67fc640 1 -- 172.21.15.17:0/4247406394 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5635b9a99610 con 0x5635b9b3d900 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.546+0000 7f9fd67fc640 10 client.15666 handle_command_reply: tid=0 2024-03-16T10:51:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.546+0000 7f9ff8209740 1 client.15666 shutdown 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.546+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 msgr2=0x5635b9b39360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.546+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009ca0 tx=0x7f9fe8009800 comp rx=0 tx=0).stop 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 shutdown_connections 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9b3d900 0x5635b9b3fda0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b2d4f0 0x5635b9b39360 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b32320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9fd67fc640 0 client.15666 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 --2- 172.21.15.17:0/4247406394 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b27990 0x5635b9b31de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 >> 172.21.15.17:0/4247406394 conn(0x5635b9aefc50 msgr2=0x5635b9b224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 shutdown_connections 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 1 -- 172.21.15.17:0/4247406394 wait complete. 2024-03-16T10:51:30.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.547+0000 7f9ff8209740 20 client.15666 trim_cache size 0 max 16384 2024-03-16T10:51:30.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:30 smithi174 ceph-mon[36202]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 Processor -- start 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 -- start start 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01aade0 con 0x5635b9b28380 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01ac920 con 0x5635b9b2d4f0 2024-03-16T10:51:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.564+0000 7f9ff8209740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01ab4b0 con 0x5635b9b27990 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:60866/0 (socket says 172.21.15.17:60866) 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 -- 172.21.15.17:0/3788913587 learned_addr learned my addr 172.21.15.17:0/3788913587 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56984/0 (socket says 172.21.15.17:56984) 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 -- 172.21.15.17:0/3788913587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 msgr2=0x5635b9b44660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b44660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 -- 172.21.15.17:0/3788913587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 msgr2=0x5635b9b39320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 -- 172.21.15.17:0/3788913587 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b9b275d0 con 0x5635b9b27990 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9feeffd640 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a40e0 tx=0x7f9fe000cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2028f03a3ec3c30d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe4ff9640 1 -- 172.21.15.17:0/3788913587 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00aa9c0 con 0x5635b9b27990 2024-03-16T10:51:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe4ff9640 1 -- 172.21.15.17:0/3788913587 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe00ccb40 con 0x5635b9b27990 2024-03-16T10:51:30.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.565+0000 7f9fe4ff9640 1 -- 172.21.15.17:0/3788913587 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0018d90 con 0x5635b9b27990 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- 172.21.15.17:0/3788913587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 msgr2=0x5635b9b26c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00a40e0 tx=0x7f9fe000cf20 comp rx=0 tx=0).stop 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- 172.21.15.17:0/3788913587 shutdown_connections 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b44660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b28380 0x5635b9b39320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 --2- 172.21.15.17:0/3788913587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b27990 0x5635b9b26c50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- 172.21.15.17:0/3788913587 >> 172.21.15.17:0/3788913587 conn(0x5635b9aefc50 msgr2=0x5635b9b26540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- 172.21.15.17:0/3788913587 shutdown_connections 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- 172.21.15.17:0/3788913587 wait complete. 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 -- start start 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.566+0000 7f9ff8209740 1 Processor -- start 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b37dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01ac250 con 0x5635b9b27990 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01abb80 con 0x5635b9b2d4f0 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01a8dc0 con 0x5635b9b28380 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 10 client.0 _ll_register_callbacks cb 0x7f9fd8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56996/0 (socket says 172.21.15.17:56996) 2024-03-16T10:51:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 -- 172.21.15.17:0/2021041896 learned_addr learned my addr 172.21.15.17:0/2021041896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 -- 172.21.15.17:0/2021041896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 msgr2=0x5635b9b37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 -- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 msgr2=0x5635b9b37dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b37dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 -- 172.21.15.17:0/2021041896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b9b38550 con 0x5635b9b27990 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9feeffd640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0086180 tx=0x7f9fe00998d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa9985750112f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00a5060 con 0x5635b9b27990 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9fe0018b30 con 0x5635b9b27990 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe00ccb40 con 0x5635b9b27990 2024-03-16T10:51:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fe0086230 con 0x5635b9b27990 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 10 client.15672 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.567+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5635b9ba4cb0 con 0x5635b9b27990 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe00ccb40 con 0x5635b9b27990 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9fe0097580 con 0x5635b9b27990 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 10 client.15672 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 20 client.15672 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9ba5230 0x5635b9ba7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 4 client.15672 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5635b9a93960 con 0x5635b9ba5230 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9ba5230 0x5635b9ba7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9fd67fc640 10 client.15672 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.568+0000 7f9fe7fff640 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9ba5230 0x5635b9ba7650 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8d26ff2fc7552 server_cookie=e0239c23833504cf in_seq=0 out_seq=0 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9fd67fc640 1 -- 172.21.15.17:0/2021041896 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5635b9a93960 con 0x5635b9ba5230 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9fd67fc640 10 client.15672 handle_command_reply: tid=0 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 client.15672 shutdown 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 msgr2=0x5635b9b39270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0086180 tx=0x7f9fe00998d0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 shutdown_connections 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5635b9ba5230 0x5635b9ba7650 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5635b9b2d4f0 0x5635b9b37dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5635b9b28380 0x5635b9b37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 --2- 172.21.15.17:0/2021041896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b9b27990 0x5635b9b39270 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 >> 172.21.15.17:0/2021041896 conn(0x5635b9aefc50 msgr2=0x5635b9b26dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9fd67fc640 0 client.15672 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 shutdown_connections 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 1 -- 172.21.15.17:0/2021041896 wait complete. 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.570+0000 7f9ff8209740 20 client.15672 trim_cache size 0 max 16384 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "5c59eb8e-b371-4f1a-9eeb-d5c156727c5d", 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-03-16T10:51:30.577 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 msgr2=0x7f9fdc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 0x7f9fdc0a4d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0101a00 tx=0x7f9fd8005f90 comp rx=0 tx=0).stop 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 msgr2=0x7f9ff0101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e9f0 tx=0x7f9fe000eeb0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 shutdown_connections 2024-03-16T10:51:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9fdc0a2890 0x7f9fdc0a4d50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ff0107580 0x7f9ff0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ff0104c50 0x7f9ff01002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 --2- 172.21.15.17:0/3203396805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff0102320 0x7f9ff0101c90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 >> 172.21.15.17:0/3203396805 conn(0x7f9ff00fbc70 msgr2=0x7f9ff0102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 shutdown_connections 2024-03-16T10:51:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.571+0000 7f9ff5619640 1 -- 172.21.15.17:0/3203396805 wait complete. 2024-03-16T10:51:30.581 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:30 smithi017 ceph-mon[32078]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:30.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:51:30.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:51:30.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:30 smithi111 ceph-mon[36315]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/560132648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 msgr2=0x7fe5d8108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/560132648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d8108b20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009ca0 tx=0x7fe5d002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/560132648 shutdown_connections 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/560132648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d8108b20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/560132648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81018d0 0x7fe5d8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/560132648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81006e0 0x7fe5d8100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/560132648 >> 172.21.15.17:0/560132648 conn(0x7fe5d80fbc70 msgr2=0x7fe5d80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/560132648 shutdown_connections 2024-03-16T10:51:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.687+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/560132648 wait complete. 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 Processor -- start 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 -- start start 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 0x7fe5d8069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 0x7fe5d819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d810c340 con 0x7fe5d8102290 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d810c1c0 con 0x7fe5d81018d0 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5dcc1f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d810c4c0 con 0x7fe5d81006e0 2024-03-16T10:51:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57016/0 (socket says 172.21.15.17:57016) 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d6d9d640 1 -- 172.21.15.17:0/2374867311 learned_addr learned my addr 172.21.15.17:0/2374867311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5cdd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 0x7fe5d819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 0x7fe5d8069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 -- 172.21.15.17:0/2374867311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 msgr2=0x7fe5d819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 0x7fe5d819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 -- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 msgr2=0x7fe5d819ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.688+0000 7fe5d659c640 1 -- 172.21.15.17:0/2374867311 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d819f700 con 0x7fe5d81006e0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 0x7fe5d819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 0x7fe5d8069510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e9c0 tx=0x7fe5c800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5cffff640 1 -- 172.21.15.17:0/2374867311 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800cd80 con 0x7fe5d81006e0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d819f9f0 con 0x7fe5d81006e0 2024-03-16T10:51:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5cffff640 1 -- 172.21.15.17:0/2374867311 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c8010910 con 0x7fe5d81006e0 2024-03-16T10:51:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5cffff640 1 -- 172.21.15.17:0/2374867311 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8018980 con 0x7fe5d81006e0 2024-03-16T10:51:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.689+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d819ff90 con 0x7fe5d81006e0 2024-03-16T10:51:30.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.691+0000 7fe5cffff640 1 -- 172.21.15.17:0/2374867311 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fe5c801f020 con 0x7fe5d81006e0 2024-03-16T10:51:30.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.691+0000 7fe5df805740 1 Processor -- start 2024-03-16T10:51:30.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 -- start start 2024-03-16T10:51:30.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cffff640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 0x7fe5c40a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8188590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a818dcd0 0x5607a8190160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5607a80ed500 con 0x5607a8188170 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5607a8095be0 con 0x5607a818dcd0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5df805740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607a80e95a0 con 0x5607a8188b60 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 0x7fe5c40a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8188590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:60896/0 (socket says 172.21.15.17:60896) 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cffff640 1 -- 172.21.15.17:0/2374867311 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe5c80cebe0 con 0x7fe5d81006e0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 -- 172.21.15.17:0/2119260951 learned_addr learned my addr 172.21.15.17:0/2119260951 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a818dcd0 0x5607a8190160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 -- 172.21.15.17:0/2119260951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a818dcd0 msgr2=0x5607a8190160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a818dcd0 0x5607a8190160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 -- 172.21.15.17:0/2119260951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 msgr2=0x5607a8188590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8188590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.692+0000 7fe5cdd9b640 1 -- 172.21.15.17:0/2119260951 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a80a94b0 con 0x5607a8188b60 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 0x7fe5c40a4d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009a60 tx=0x7fe5d002cea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00114f0 tx=0x7fe5c00119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc99721ba9feb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5ccd99640 1 -- 172.21.15.17:0/2119260951 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0004020 con 0x5607a8188b60 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5ccd99640 1 -- 172.21.15.17:0/2119260951 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c00041c0 con 0x5607a8188b60 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5ccd99640 1 -- 172.21.15.17:0/2119260951 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000f950 con 0x5607a8188b60 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5df805740 1 -- 172.21.15.17:0/2119260951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 msgr2=0x5607a818d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.693+0000 7fe5df805740 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00114f0 tx=0x7fe5c00119b0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 -- 172.21.15.17:0/2119260951 shutdown_connections 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a818dcd0 0x5607a8190160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a818d660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 --2- 172.21.15.17:0/2119260951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8188590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 -- 172.21.15.17:0/2119260951 >> 172.21.15.17:0/2119260951 conn(0x5607a81836e0 msgr2=0x5607a8183ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 -- 172.21.15.17:0/2119260951 shutdown_connections 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 -- 172.21.15.17:0/2119260951 wait complete. 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 -- start start 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 Processor -- start 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.694+0000 7fe5df805740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8192b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5607a8190c80 con 0x5607a8188170 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5607a80a9160 con 0x5607a8188b60 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607a8190e00 con 0x5607a818dcd0 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 10 client.0 _ll_register_callbacks cb 0x5607a808d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57036/0 (socket says 172.21.15.17:57036) 2024-03-16T10:51:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 -- 172.21.15.17:0/2478672982 learned_addr learned my addr 172.21.15.17:0/2478672982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8192b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 -- 172.21.15.17:0/2478672982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 msgr2=0x5607a8199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 -- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 msgr2=0x5607a8192b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8192b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 -- 172.21.15.17:0/2478672982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a7ecb7d0 con 0x5607a8188170 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8192b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5d659c640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8097880 tx=0x7fe5c809ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c41260fa14f9fac server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c809f570 con 0x5607a8188170 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe5c80cc120 con 0x5607a8188170 2024-03-16T10:51:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c00041c0 con 0x5607a8188170 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5c80a3bc0 con 0x5607a8188170 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 10 client.15684 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.695+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607a7e013f0 con 0x5607a8188170 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c00041c0 con 0x5607a8188170 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe5c809f1b0 con 0x5607a8188170 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 10 client.15684 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 20 client.15684 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a819e120 0x5607a81a0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 4 client.15684 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607a80faa40 con 0x5607a819e120 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a819e120 0x5607a81a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a819e120 0x5607a81a0590 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53c7c5c471f414d6 server_cookie=15c641753ece6474 in_seq=0 out_seq=0 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.696+0000 7fe5bdffb640 10 client.15684 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.697+0000 7fe5bdffb640 1 -- 172.21.15.17:0/2478672982 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5607a80faa40 con 0x5607a819e120 2024-03-16T10:51:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.697+0000 7fe5bdffb640 10 client.15684 handle_command_reply: tid=0 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.697+0000 7fe5df805740 1 client.15684 shutdown 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 msgr2=0x5607a8192640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8097880 tx=0x7fe5c809ae40 comp rx=0 tx=0).stop 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 shutdown_connections 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a819e120 0x5607a81a0590 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8192b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 --2- 172.21.15.17:0/2478672982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192640 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5bdffb640 0 client.15684 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 >> 172.21.15.17:0/2478672982 conn(0x5607a81836e0 msgr2=0x5607a8182900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 shutdown_connections 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 1 -- 172.21.15.17:0/2478672982 wait complete. 2024-03-16T10:51:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.698+0000 7fe5df805740 20 client.15684 trim_cache size 0 max 16384 2024-03-16T10:51:30.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 Processor -- start 2024-03-16T10:51:30.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 -- start start 2024-03-16T10:51:30.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8199b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8182070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81a8bb0 con 0x5607a8188170 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81aa6f0 con 0x5607a8188b60 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5df805740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81a9280 con 0x5607a818dcd0 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57048/0 (socket says 172.21.15.17:57048) 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5d659c640 1 -- 172.21.15.17:0/242601080 learned_addr learned my addr 172.21.15.17:0/242601080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.715+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8182070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 -- 172.21.15.17:0/242601080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 msgr2=0x5607a8182070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8182070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 -- 172.21.15.17:0/242601080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 msgr2=0x5607a8199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 -- 172.21.15.17:0/242601080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a7dc10f0 con 0x5607a8188170 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5d659c640 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009fb0 tx=0x7fe5c8099930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496368e7156bd9a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5bffff640 1 -- 172.21.15.17:0/242601080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c809f570 con 0x5607a8188170 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5bffff640 1 -- 172.21.15.17:0/242601080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c80bb030 con 0x5607a8188170 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5bffff640 1 -- 172.21.15.17:0/242601080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8097a90 con 0x5607a8188170 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 -- 172.21.15.17:0/242601080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 msgr2=0x5607a8192960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009fb0 tx=0x7fe5c8099930 comp rx=0 tx=0).stop 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 -- 172.21.15.17:0/242601080 shutdown_connections 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a818dcd0 0x5607a8182070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188b60 0x5607a8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.716+0000 7fe5df805740 1 --2- 172.21.15.17:0/242601080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a8188170 0x5607a8192960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- 172.21.15.17:0/242601080 >> 172.21.15.17:0/242601080 conn(0x5607a81836e0 msgr2=0x5607a8192250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- 172.21.15.17:0/242601080 shutdown_connections 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- 172.21.15.17:0/242601080 wait complete. 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- start start 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 Processor -- start 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 0x5607a8196d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a8197290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81aa020 con 0x5607a818dcd0 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81a9950 con 0x5607a8188170 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d81a6b90 con 0x5607a8188b60 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5df805740 10 client.0 _ll_register_callbacks cb 0x7fe5c80094b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5d6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5d6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57058/0 (socket says 172.21.15.17:57058) 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5cdd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a8197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5d6d9d640 1 -- 172.21.15.17:0/3617717742 learned_addr learned my addr 172.21.15.17:0/3617717742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:30.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.717+0000 7fe5d659c640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 0x5607a8196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 -- 172.21.15.17:0/3617717742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 msgr2=0x5607a8197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a8197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 -- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 msgr2=0x5607a8196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 0x5607a8196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 -- 172.21.15.17:0/3617717742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a80b49d0 con 0x5607a818dcd0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5cdd9b640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d659c640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 0x5607a8196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5d6d9d640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0037040 tx=0x7fe5d002c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447f001949c41f15 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0039040 con 0x5607a818dcd0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe5d00349f0 con 0x5607a818dcd0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c80bb030 con 0x5607a818dcd0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5d0034bf0 con 0x5607a818dcd0 2024-03-16T10:51:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5df805740 10 client.15690 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607a8199a40 con 0x5607a818dcd0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.718+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5c80bb030 con 0x5607a818dcd0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe5d004d070 con 0x5607a818dcd0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 10 client.15690 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 20 client.15690 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a8204780 0x5607a8206ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 4 client.15690 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5607a80f4d90 con 0x5607a8204780 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5d659c640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a8204780 0x5607a8206ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5bdffb640 10 client.15690 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5d659c640 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a8204780 0x5607a8206ba0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f91643c0653579e server_cookie=4d6b4f744aafb03 in_seq=0 out_seq=0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5bdffb640 1 -- 172.21.15.17:0/3617717742 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5607a80f4d90 con 0x5607a8204780 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5bdffb640 10 client.15690 handle_command_reply: tid=0 2024-03-16T10:51:30.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 1 client.15690 shutdown 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 msgr2=0x5607a81982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.719+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0037040 tx=0x7fe5d002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 shutdown_connections 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5607a8204780 0x5607a8206ba0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5607a818dcd0 0x5607a81982a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607a8188b60 0x5607a8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5bdffb640 0 client.15690 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 --2- 172.21.15.17:0/3617717742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5607a8188170 0x5607a8196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 >> 172.21.15.17:0/3617717742 conn(0x5607a81836e0 msgr2=0x5607a8186940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 shutdown_connections 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 1 -- 172.21.15.17:0/3617717742 wait complete. 2024-03-16T10:51:30.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5df805740 20 client.15690 trim_cache size 0 max 16384 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "5c59eb8e-b371-4f1a-9eeb-d5c156727c5d": { 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "5c59eb8e-b371-4f1a-9eeb-d5c156727c5d", 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:51:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:51:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 msgr2=0x7fe5c40a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 0x7fe5c40a4d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009a60 tx=0x7fe5d002cea0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 msgr2=0x7fe5d8069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 0x7fe5d8069510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800e9c0 tx=0x7fe5c800ee80 comp rx=0 tx=0).stop 2024-03-16T10:51:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 shutdown_connections 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe5c40a2890 0x7fe5c40a4d50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5d8102290 0x7fe5d819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d81018d0 0x7fe5d819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 --2- 172.21.15.17:0/2374867311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5d81006e0 0x7fe5d8069510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 >> 172.21.15.17:0/2374867311 conn(0x7fe5d80fbc70 msgr2=0x7fe5d8104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 shutdown_connections 2024-03-16T10:51:30.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:51:30.720+0000 7fe5dcc1f640 1 -- 172.21.15.17:0/2374867311 wait complete. 2024-03-16T10:51:30.733 INFO:tasks.cephfs.filesystem:scrub status for tag:5c59eb8e-b371-4f1a-9eeb-d5c156727c5d - {'path': '/', 'tag': '5c59eb8e-b371-4f1a-9eeb-d5c156727c5d', 'options': 'recursive,force'} 2024-03-16T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:32 smithi174 ceph-mon[36202]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:32 smithi174 ceph-mon[36202]: scrub queued for path: / 2024-03-16T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:32 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:32 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:32 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:32 smithi017 ceph-mon[32078]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:51:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:32 smithi017 ceph-mon[32078]: scrub queued for path: / 2024-03-16T10:51:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:32 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:32 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:51:32.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:32 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:32 smithi111 ceph-mon[36315]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:51:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:32 smithi111 ceph-mon[36315]: scrub queued for path: / 2024-03-16T10:51:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:32 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:32 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:51:32.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:32 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:51:34.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:34 smithi174 ceph-mon[36202]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:51:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:34 smithi017 ceph-mon[32078]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:51:34.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:34 smithi111 ceph-mon[36315]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:51:35.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:35 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:51:35.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:35 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:51:35.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:35 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:51:36.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:36 smithi174 ceph-mon[36202]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:36.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:36 smithi017 ceph-mon[32078]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:36 smithi111 ceph-mon[36315]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:51:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 -- 172.21.15.17:0/3393110858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c1075a0 msgr2=0x7f4a3c109990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 --2- 172.21.15.17:0/3393110858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c109990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009ca0 tx=0x7f4a3402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 -- 172.21.15.17:0/3393110858 shutdown_connections 2024-03-16T10:51:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 --2- 172.21.15.17:0/3393110858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c109990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 --2- 172.21.15.17:0/3393110858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c104c70 0x7f4a3c107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 --2- 172.21.15.17:0/3393110858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c102340 0x7f4a3c104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 -- 172.21.15.17:0/3393110858 >> 172.21.15.17:0/3393110858 conn(0x7f4a3c0fbc70 msgr2=0x7f4a3c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 -- 172.21.15.17:0/3393110858 shutdown_connections 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.181+0000 7f4a42b77640 1 -- 172.21.15.17:0/3393110858 wait complete. 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 Processor -- start 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 -- start start 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c104c70 0x7f4a3c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10d490 con 0x7f4a3c102340 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10d310 con 0x7f4a3c104c70 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a42b77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10d610 con 0x7f4a3c1075a0 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57064/0 (socket says 172.21.15.17:57064) 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 -- 172.21.15.17:0/1269903715 learned_addr learned my addr 172.21.15.17:0/1269903715 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a33fff640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c104c70 0x7f4a3c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a41114640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 -- 172.21.15.17:0/1269903715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c1075a0 msgr2=0x7f4a3c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 -- 172.21.15.17:0/1269903715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c104c70 msgr2=0x7f4a3c197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c104c70 0x7f4a3c197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.182+0000 7f4a40913640 1 -- 172.21.15.17:0/1269903715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c19f670 con 0x7f4a3c102340 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a40913640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800e9f0 tx=0x7f4a3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a31ffb640 1 -- 172.21.15.17:0/1269903715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800cd80 con 0x7f4a3c102340 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c19f960 con 0x7f4a3c102340 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a31ffb640 1 -- 172.21.15.17:0/1269903715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a38010910 con 0x7f4a3c102340 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a31ffb640 1 -- 172.21.15.17:0/1269903715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38018990 con 0x7f4a3c102340 2024-03-16T10:51:37.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.183+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c19feb0 con 0x7f4a3c102340 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.185+0000 7f4a31ffb640 1 -- 172.21.15.17:0/1269903715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f4a38010ac0 con 0x7f4a3c102340 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a31ffb640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 0x7f4a240a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 Processor -- start 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 -- start start 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a33fff640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 0x7f4a240a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a31ffb640 1 -- 172.21.15.17:0/1269903715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4a380cee40 con 0x7f4a3c102340 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f3b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f3bea0 0x559ed2f3e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559ed2e9ba40 con 0x559ed2f36340 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x559ed2e44920 con 0x559ed2f36d30 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a45839740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559ed2e97ae0 con 0x559ed2f3bea0 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a40913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a40913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57074/0 (socket says 172.21.15.17:57074) 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a40913640 1 -- 172.21.15.17:0/3314301369 learned_addr learned my addr 172.21.15.17:0/3314301369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a41114640 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f3bea0 0x559ed2f3e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.186+0000 7f4a33fff640 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 -- 172.21.15.17:0/3314301369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f3bea0 msgr2=0x559ed2f3e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f3bea0 0x559ed2f3e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a33fff640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 0x7f4a240a4e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c198f60 tx=0x7f4a2c011440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 -- 172.21.15.17:0/3314301369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 msgr2=0x559ed2f3b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f3b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 -- 172.21.15.17:0/3314301369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed2e5c460 con 0x559ed2f36340 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a40913640 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a39f0 tx=0x7f4a3809b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cd419537e73a50 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a22ffd640 1 -- 172.21.15.17:0/3314301369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38097ea0 con 0x559ed2f36340 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a22ffd640 1 -- 172.21.15.17:0/3314301369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380860b0 con 0x559ed2f36340 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.187+0000 7f4a22ffd640 1 -- 172.21.15.17:0/3314301369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380ccda0 con 0x559ed2f36340 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- 172.21.15.17:0/3314301369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 msgr2=0x559ed2f36760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a39f0 tx=0x7f4a3809b730 comp rx=0 tx=0).stop 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- 172.21.15.17:0/3314301369 shutdown_connections 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f3bea0 0x559ed2f3e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f3b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- 172.21.15.17:0/3314301369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36340 0x559ed2f36760 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- 172.21.15.17:0/3314301369 >> 172.21.15.17:0/3314301369 conn(0x559ed2f318b0 msgr2=0x559ed2f31cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- 172.21.15.17:0/3314301369 shutdown_connections 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- 172.21.15.17:0/3314301369 wait complete. 2024-03-16T10:51:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- start start 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 Processor -- start 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f40b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f47ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559ed2f3ee50 con 0x559ed2f3bea0 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x559ed2e57d70 con 0x559ed2f36d30 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.188+0000 7f4a45839740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559ed2f3efd0 con 0x559ed2f36340 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a45839740 10 client.0 _ll_register_callbacks cb 0x559ed2bafa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a41114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f47ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a41114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f47ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57076/0 (socket says 172.21.15.17:57076) 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f40b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a41114640 1 -- 172.21.15.17:0/3238123471 learned_addr learned my addr 172.21.15.17:0/3238123471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 -- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 msgr2=0x559ed2f40b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f40b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 -- 172.21.15.17:0/3238123471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 msgr2=0x559ed2f47ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f47ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 -- 172.21.15.17:0/3238123471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed2bb0210 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a33fff640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f40b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a40913640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f40620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a38097c90 tx=0x7f4a3809af30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a6d508b53f96b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38086260 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4a380ccd50 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a380860b0 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4a380a5070 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a45839740 10 client.25546 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.189+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559ed2c7c620 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380860b0 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4a38097610 con 0x559ed2f36340 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 10 client.25546 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 10 client.25546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 20 client.25546 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2f4c090 0x559ed2f4e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 4 client.25546 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ed2ea8f80 con 0x559ed2f4c090 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a33fff640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2f4c090 0x559ed2f4e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a1bfff640 10 client.25546 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.190+0000 7f4a33fff640 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2f4c090 0x559ed2f4e480 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99deca20fbd7b9ea server_cookie=cc2a28fe172d3555 in_seq=0 out_seq=0 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.191+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3238123471 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559ed2ea8f80 con 0x559ed2f4c090 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.191+0000 7f4a1bfff640 10 client.25546 handle_command_reply: tid=0 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.191+0000 7f4a45839740 1 client.25546 shutdown 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.191+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 msgr2=0x559ed2f40620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.191+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f40620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a38097c90 tx=0x7f4a3809af30 comp rx=0 tx=0).stop 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 shutdown_connections 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2f4c090 0x559ed2f4e480 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f47ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a1bfff640 0 client.25546 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f40b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 --2- 172.21.15.17:0/3238123471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f40620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 >> 172.21.15.17:0/3238123471 conn(0x559ed2f318b0 msgr2=0x559ed2f30bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 shutdown_connections 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 1 -- 172.21.15.17:0/3238123471 wait complete. 2024-03-16T10:51:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.192+0000 7f4a45839740 20 client.25546 trim_cache size 0 max 16384 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 Processor -- start 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 -- start start 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f34b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 0x559ed2f35050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a8a70 con 0x559ed2f36d30 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1aa5b0 con 0x559ed2f3bea0 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a45839740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a9140 con 0x559ed2f36340 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57086/0 (socket says 172.21.15.17:57086) 2024-03-16T10:51:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 -- 172.21.15.17:0/2889306903 learned_addr learned my addr 172.21.15.17:0/2889306903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a40913640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f34b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a41114640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 0x559ed2f35050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 -- 172.21.15.17:0/2889306903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 msgr2=0x559ed2f34b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f34b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 -- 172.21.15.17:0/2889306903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 msgr2=0x559ed2f35050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 0x559ed2f35050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 -- 172.21.15.17:0/2889306903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed2f35950 con 0x559ed2f36d30 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a41114640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 0x559ed2f35050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a33fff640 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c01b000 tx=0x7f4a2c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abcfb294f28eeb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a227fc640 1 -- 172.21.15.17:0/2889306903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c017040 con 0x559ed2f36d30 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a227fc640 1 -- 172.21.15.17:0/2889306903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a2c019050 con 0x559ed2f36d30 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.207+0000 7f4a227fc640 1 -- 172.21.15.17:0/2889306903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0053e0 con 0x559ed2f36d30 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- 172.21.15.17:0/2889306903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 msgr2=0x559ed2f47b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c01b000 tx=0x7f4a2c01c000 comp rx=0 tx=0).stop 2024-03-16T10:51:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- 172.21.15.17:0/2889306903 shutdown_connections 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f3bea0 0x559ed2f35050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f36d30 0x559ed2f47b30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 --2- 172.21.15.17:0/2889306903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f34b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- 172.21.15.17:0/2889306903 >> 172.21.15.17:0/2889306903 conn(0x559ed2f318b0 msgr2=0x559ed2f2ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- 172.21.15.17:0/2889306903 shutdown_connections 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- 172.21.15.17:0/2889306903 wait complete. 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 -- start start 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.208+0000 7f4a45839740 1 Processor -- start 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f45830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a9ee0 con 0x559ed2f3bea0 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a9810 con 0x559ed2f36d30 2024-03-16T10:51:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a6a50 con 0x559ed2f36340 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 10 client.0 _ll_register_callbacks cb 0x7f4a3809f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57090/0 (socket says 172.21.15.17:57090) 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 -- 172.21.15.17:0/3829337241 learned_addr learned my addr 172.21.15.17:0/3829337241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a33fff640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f45830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a40913640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 -- 172.21.15.17:0/3829337241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 msgr2=0x559ed2f452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 -- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 msgr2=0x559ed2f45830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f45830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 -- 172.21.15.17:0/3829337241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed2f46e30 con 0x559ed2f3bea0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a41114640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4a34005e30 tx=0x7f4a34032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8734d3231ffe34 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34039040 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4a34003970 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.209+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a2c019050 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4a34032e90 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 10 client.15708 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559ed2fb2380 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a2c019050 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4a3404b480 con 0x559ed2f3bea0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 10 client.15708 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 20 client.15708 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2fb2db0 0x559ed2fb51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 4 client.15708 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ed2ea32d0 con 0x559ed2fb2db0 2024-03-16T10:51:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.210+0000 7f4a40913640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2fb2db0 0x559ed2fb51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.211+0000 7f4a1bfff640 10 client.15708 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.211+0000 7f4a40913640 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2fb2db0 0x559ed2fb51d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a8c3a088e458d9 server_cookie=6eb45e444c62071a in_seq=0 out_seq=0 2024-03-16T10:51:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a1bfff640 1 -- 172.21.15.17:0/3829337241 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ed2ea32d0 con 0x559ed2fb2db0 2024-03-16T10:51:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a1bfff640 10 client.15708 handle_command_reply: tid=0 2024-03-16T10:51:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 client.15708 shutdown 2024-03-16T10:51:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 msgr2=0x559ed2f46840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4a34005e30 tx=0x7f4a34032d20 comp rx=0 tx=0).stop 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 shutdown_connections 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x559ed2fb2db0 0x559ed2fb51d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ed2f3bea0 0x559ed2f46840 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559ed2f36d30 0x559ed2f45830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 --2- 172.21.15.17:0/3829337241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed2f36340 0x559ed2f452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a1bfff640 0 client.15708 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 >> 172.21.15.17:0/3829337241 conn(0x559ed2f318b0 msgr2=0x559ed2f37fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 shutdown_connections 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 1 -- 172.21.15.17:0/3829337241 wait complete. 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.217+0000 7f4a45839740 20 client.15708 trim_cache size 0 max 16384 2024-03-16T10:51:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:51:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:51:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:51:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:51:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 msgr2=0x7f4a240a4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 0x7f4a240a4e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c198f60 tx=0x7f4a2c011440 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 msgr2=0x7f4a3c197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800e9f0 tx=0x7f4a3800eeb0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 shutdown_connections 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4a240a2940 0x7f4a240a4e00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a3c1075a0 0x7f4a3c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a3c104c70 0x7f4a3c197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 --2- 172.21.15.17:0/1269903715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a3c102340 0x7f4a3c197a50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 >> 172.21.15.17:0/1269903715 conn(0x7f4a3c0fbc70 msgr2=0x7f4a3c102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 shutdown_connections 2024-03-16T10:51:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:37.218+0000 7f4a42b77640 1 -- 172.21.15.17:0/1269903715 wait complete. 2024-03-16T10:51:38.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:38 smithi174 ceph-mon[36202]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-16T10:51:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:38 smithi017 ceph-mon[32078]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-16T10:51:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:38 smithi111 ceph-mon[36315]: pgmap v375: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-16T10:51:40.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:40 smithi174 ceph-mon[36202]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-03-16T10:51:40.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:40 smithi017 ceph-mon[32078]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-03-16T10:51:40.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:40 smithi111 ceph-mon[36315]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-03-16T10:51:42.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:42 smithi174 ceph-mon[36202]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-16T10:51:42.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:42 smithi017 ceph-mon[32078]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-16T10:51:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:42 smithi111 ceph-mon[36315]: pgmap v377: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-16T10:51:44.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:44 smithi174 ceph-mon[36202]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:51:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:44 smithi017 ceph-mon[32078]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:51:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:44 smithi111 ceph-mon[36315]: pgmap v378: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-16T10:51:46.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:46 smithi174 ceph-mon[36202]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-16T10:51:46.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:46 smithi017 ceph-mon[32078]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-16T10:51:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:46 smithi111 ceph-mon[36315]: pgmap v379: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-03-16T10:51:48.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:48 smithi174 ceph-mon[36202]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-16T10:51:48.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:48 smithi017 ceph-mon[32078]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-16T10:51:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:48 smithi111 ceph-mon[36315]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/2706423679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d98100700 msgr2=0x7f0d98100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/2706423679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d98100700 0x7f0d98100b20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009900 tx=0x7f0d8802bc30 comp rx=0 tx=0).stop 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/2706423679 shutdown_connections 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/2706423679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d98108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/2706423679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d981018f0 0x7f0d98101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/2706423679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d98100700 0x7f0d98100b20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/2706423679 >> 172.21.15.17:0/2706423679 conn(0x7f0d980fbc70 msgr2=0x7f0d980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/2706423679 shutdown_connections 2024-03-16T10:51:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/2706423679 wait complete. 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.319+0000 7f0d9c9a9640 1 Processor -- start 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 -- start start 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98100700 0x7f0d98199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9810b280 con 0x7f0d981018f0 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9810b100 con 0x7f0d981022b0 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9c9a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9810b400 con 0x7f0d98100700 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43064/0 (socket says 172.21.15.17:43064) 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41460/0 (socket says 172.21.15.17:41460) 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d8dd9b640 1 -- 172.21.15.17:0/1503767299 learned_addr learned my addr 172.21.15.17:0/1503767299 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d9659c640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98100700 0x7f0d98199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 -- 172.21.15.17:0/1503767299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98100700 msgr2=0x7f0d98199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98100700 0x7f0d98199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 -- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 msgr2=0x7f0d9819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d96d9d640 1 -- 172.21.15.17:0/1503767299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d981a18f0 con 0x7f0d981022b0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.320+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d96d9d640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d900098f0 tx=0x7f0d90009db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d8ffff640 1 -- 172.21.15.17:0/1503767299 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003b70 con 0x7f0d981022b0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d8ffff640 1 -- 172.21.15.17:0/1503767299 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d90003d10 con 0x7f0d981022b0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d981a1be0 con 0x7f0d981022b0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d8ffff640 1 -- 172.21.15.17:0/1503767299 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90014420 con 0x7f0d981022b0 2024-03-16T10:51:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.321+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d981a2150 con 0x7f0d981022b0 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.323+0000 7f0d9f58c740 1 Processor -- start 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d8ffff640 1 -- 172.21.15.17:0/1503767299 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f0d90003fc0 con 0x7f0d981022b0 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 -- start start 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d4340 0x55b0706d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 0x55b0706d9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b070639a40 con 0x55b0706d9ea0 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b0705e2920 con 0x55b0706d4d30 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b070635ae0 con 0x55b0706d4340 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 0x55b0706d9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 0x55b0706d9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41476/0 (socket says 172.21.15.17:41476) 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43072/0 (socket says 172.21.15.17:43072) 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.324+0000 7f0d9659c640 1 -- 172.21.15.17:0/934603089 learned_addr learned my addr 172.21.15.17:0/934603089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d4340 0x55b0706d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8ffff640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 0x7f0d840a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 -- 172.21.15.17:0/934603089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d4340 msgr2=0x55b0706d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d4340 0x55b0706d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 -- 172.21.15.17:0/934603089 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 msgr2=0x55b0706d9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 0x55b0706d9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 -- 172.21.15.17:0/934603089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0705fa460 con 0x55b0706d9ea0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8ffff640 1 -- 172.21.15.17:0/1503767299 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d900ce790 con 0x7f0d981022b0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d96d9d640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 0x7f0d840a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009640 tx=0x7f0d80009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d3eed4c27c6dcd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8cd99640 1 -- 172.21.15.17:0/934603089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000fc20 con 0x55b0706d9ea0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8cd99640 1 -- 172.21.15.17:0/934603089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d8000fdc0 con 0x55b0706d9ea0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.325+0000 7f0d8cd99640 1 -- 172.21.15.17:0/934603089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80004e50 con 0x55b0706d9ea0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 -- 172.21.15.17:0/934603089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 msgr2=0x55b0706dc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009640 tx=0x7f0d80009590 comp rx=0 tx=0).stop 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d96d9d640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 0x7f0d840a4e80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e490 tx=0x7f0d90005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 -- 172.21.15.17:0/934603089 shutdown_connections 2024-03-16T10:51:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706dc330 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4d30 0x55b0706d9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/934603089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d4340 0x55b0706d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 -- 172.21.15.17:0/934603089 >> 172.21.15.17:0/934603089 conn(0x55b0706cf8b0 msgr2=0x55b0706cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 -- 172.21.15.17:0/934603089 shutdown_connections 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.326+0000 7f0d9f58c740 1 -- 172.21.15.17:0/934603089 wait complete. 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 -- start start 2024-03-16T10:51:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 Processor -- start 2024-03-16T10:51:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d9ea0 0x55b0706e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b0706dce50 con 0x55b0706d4d30 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b0705f5d70 con 0x55b0706d4340 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0706dcfd0 con 0x55b0706d9ea0 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9f58c740 10 client.0 _ll_register_callbacks cb 0x55b07034da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43078/0 (socket says 172.21.15.17:43078) 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 -- 172.21.15.17:0/1882612524 learned_addr learned my addr 172.21.15.17:0/1882612524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d9ea0 0x55b0706e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 -- 172.21.15.17:0/1882612524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d9ea0 msgr2=0x55b0706e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d9ea0 0x55b0706e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 -- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 msgr2=0x55b0706de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706de6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.327+0000 7f0d9659c640 1 -- 172.21.15.17:0/1882612524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b07034e210 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d9659c640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009230 tx=0x7f0d88004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23d2b8992f95a63 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88005d50 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d88005220 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d8000fdc0 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d88005420 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d9f58c740 10 client.15720 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b07041a620 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d8000fdc0 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.328+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d880038e0 con 0x55b0706d4d30 2024-03-16T10:51:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 10 client.15720 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 20 client.15720 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0706ea530 0x55b0706ec940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 4 client.15720 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b070646f80 con 0x55b0706ea530 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0706ea530 0x55b0706ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0706ea530 0x55b0706ec940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b799ce47c7074255 server_cookie=9ea2c03ca36d36e6 in_seq=0 out_seq=0 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.329+0000 7f0d7dffb640 10 client.15720 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d7dffb640 1 -- 172.21.15.17:0/1882612524 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b070646f80 con 0x55b0706ea530 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d7dffb640 10 client.15720 handle_command_reply: tid=0 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 client.15720 shutdown 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 msgr2=0x55b0706dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009230 tx=0x7f0d88004270 comp rx=0 tx=0).stop 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 shutdown_connections 2024-03-16T10:51:50.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0706ea530 0x55b0706ec940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706d9ea0 0x55b0706e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4d30 0x55b0706dec10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d7dffb640 0 client.15720 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/1882612524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706de6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 >> 172.21.15.17:0/1882612524 conn(0x55b0706cf8b0 msgr2=0x55b0706cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 shutdown_connections 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 1 -- 172.21.15.17:0/1882612524 wait complete. 2024-03-16T10:51:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.330+0000 7f0d9f58c740 20 client.15720 trim_cache size 0 max 16384 2024-03-16T10:51:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.345+0000 7f0d9f58c740 1 Processor -- start 2024-03-16T10:51:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 -- start start 2024-03-16T10:51:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 0x55b0706d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 0x55b0706e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981aad70 con 0x55b0706d4340 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981ac8b0 con 0x55b0706d9ea0 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981ab440 con 0x55b0706dc500 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 0x55b0706d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:41488/0 (socket says 172.21.15.17:41488) 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 -- 172.21.15.17:0/3218237815 learned_addr learned my addr 172.21.15.17:0/3218237815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 0x55b0706d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43086/0 (socket says 172.21.15.17:43086) 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 0x55b0706e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 -- 172.21.15.17:0/3218237815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 msgr2=0x55b0706e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 0x55b0706e5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 -- 172.21.15.17:0/3218237815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 msgr2=0x55b0706d6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 0x55b0706d6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 -- 172.21.15.17:0/3218237815 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0706ecfc0 con 0x55b0706d9ea0 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 0x55b0706e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.346+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d88003d80 tx=0x7f0d88000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236b0500007f19a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.347+0000 7f0d7ffff640 1 -- 172.21.15.17:0/3218237815 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88005d50 con 0x55b0706d9ea0 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.347+0000 7f0d7ffff640 1 -- 172.21.15.17:0/3218237815 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d88009520 con 0x55b0706d9ea0 2024-03-16T10:51:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.347+0000 7f0d7ffff640 1 -- 172.21.15.17:0/3218237815 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88034b30 con 0x55b0706d9ea0 2024-03-16T10:51:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3218237815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 msgr2=0x55b0706d6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0d88003d80 tx=0x7f0d88000bc0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3218237815 shutdown_connections 2024-03-16T10:51:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706dc500 0x55b0706e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d9ea0 0x55b0706d6590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3218237815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d4340 0x55b0706d6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3218237815 >> 172.21.15.17:0/3218237815 conn(0x55b0706cf8b0 msgr2=0x55b0706cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3218237815 shutdown_connections 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3218237815 wait complete. 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- start start 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 Processor -- start 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706e5d40 0x55b0706e4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981ac1e0 con 0x55b0706d9ea0 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981abb10 con 0x55b0706d4340 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981a8d50 con 0x55b0706e5d40 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.348+0000 7f0d9f58c740 10 client.0 _ll_register_callbacks cb 0x7f0d88009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:51:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43094/0 (socket says 172.21.15.17:43094) 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d8dd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 -- 172.21.15.17:0/3799403039 learned_addr learned my addr 172.21.15.17:0/3799403039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706e5d40 0x55b0706e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 -- 172.21.15.17:0/3799403039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706e5d40 msgr2=0x55b0706e4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706e5d40 0x55b0706e4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 -- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 msgr2=0x55b0706e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706e57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 -- 172.21.15.17:0/3799403039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0706d0620 con 0x55b0706d9ea0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9659c640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0d8802c7b0 tx=0x7f0d88005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6116d80ec63db server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:51:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88005d50 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0d880035f0 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d88009520 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d88068050 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9f58c740 10 client.15726 fetch_fsmap learned FSMap version 27 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.349+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b0707517a0 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d88009520 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0d880351f0 con 0x55b0706d9ea0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 10 client.15726 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 20 client.15726 populate_metadata read hostname 'smithi017' 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0707520c0 0x55b0707544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 4 client.15726 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0706412d0 con 0x55b0707520c0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0707520c0 0x55b0707544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:51:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d8dd9b640 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0707520c0 0x55b0707544e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d1d327cfb7ea4d server_cookie=27197fc359c062c5 in_seq=0 out_seq=0 2024-03-16T10:51:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.350+0000 7f0d7dffb640 10 client.15726 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d7dffb640 1 -- 172.21.15.17:0/3799403039 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0706412d0 con 0x55b0707520c0 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d7dffb640 10 client.15726 handle_command_reply: tid=0 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 client.15726 shutdown 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 msgr2=0x55b0706e3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0d8802c7b0 tx=0x7f0d88005fd0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 shutdown_connections 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b0707520c0 0x55b0707544e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0706e5d40 0x55b0706e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d7dffb640 0 client.15726 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0706d9ea0 0x55b0706e3dc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 --2- 172.21.15.17:0/3799403039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b0706d4340 0x55b0706e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.353+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 >> 172.21.15.17:0/3799403039 conn(0x55b0706cf8b0 msgr2=0x55b0706d9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 shutdown_connections 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9f58c740 1 -- 172.21.15.17:0/3799403039 wait complete. 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9f58c740 20 client.15726 trim_cache size 0 max 16384 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:51:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:51:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 msgr2=0x7f0d840a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 0x7f0d840a4e80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e490 tx=0x7f0d90005f30 comp rx=0 tx=0).stop 2024-03-16T10:51:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 msgr2=0x7f0d981a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:51:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d900098f0 tx=0x7f0d90009db0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 shutdown_connections 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0d840a29c0 0x7f0d840a4e80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d981022b0 0x7f0d981a1250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d981018f0 0x7f0d9819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 --2- 172.21.15.17:0/1503767299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98100700 0x7f0d98199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 >> 172.21.15.17:0/1503767299 conn(0x7f0d980fbc70 msgr2=0x7f0d98104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:51:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 shutdown_connections 2024-03-16T10:51:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:51:50.354+0000 7f0d9c9a9640 1 -- 172.21.15.17:0/1503767299 wait complete. 2024-03-16T10:51:50.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:50 smithi174 ceph-mon[36202]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-03-16T10:51:50.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:50 smithi017 ceph-mon[32078]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-03-16T10:51:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:50 smithi111 ceph-mon[36315]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-03-16T10:51:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:52 smithi174 ceph-mon[36202]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:51:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:52 smithi017 ceph-mon[32078]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:51:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:52 smithi111 ceph-mon[36315]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:51:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:54 smithi174 ceph-mon[36202]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-16T10:51:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:54 smithi017 ceph-mon[32078]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-16T10:51:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:54 smithi111 ceph-mon[36315]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-16T10:51:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:56 smithi017 ceph-mon[32078]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T10:51:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:56 smithi111 ceph-mon[36315]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T10:51:56.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:56 smithi174 ceph-mon[36202]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-16T10:51:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:51:58 smithi017 ceph-mon[32078]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-16T10:51:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:51:58 smithi111 ceph-mon[36315]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-16T10:51:58.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:51:58 smithi174 ceph-mon[36202]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-16T10:52:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:00 smithi017 ceph-mon[32078]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:00 smithi111 ceph-mon[36315]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:00.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:52:00.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:52:00.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:00 smithi174 ceph-mon[36202]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 -- 172.21.15.17:0/2046278364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41017f0 msgr2=0x7f30f4101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 --2- 172.21.15.17:0/2046278364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41017f0 0x7f30f4101c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009900 tx=0x7f30e402bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 -- 172.21.15.17:0/2046278364 shutdown_connections 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 --2- 172.21.15.17:0/2046278364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41033a0 0x7f30f4109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 --2- 172.21.15.17:0/2046278364 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41029e0 0x7f30f4102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 --2- 172.21.15.17:0/2046278364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41017f0 0x7f30f4101c10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 -- 172.21.15.17:0/2046278364 >> 172.21.15.17:0/2046278364 conn(0x7f30f40fcd80 msgr2=0x7f30f40ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 -- 172.21.15.17:0/2046278364 shutdown_connections 2024-03-16T10:52:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.877+0000 7f30f8b60640 1 -- 172.21.15.17:0/2046278364 wait complete. 2024-03-16T10:52:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.878+0000 7f30f8b60640 1 Processor -- start 2024-03-16T10:52:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.878+0000 7f30f8b60640 1 -- start start 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.878+0000 7f30f8b60640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 0x7f30f4199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f8b60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f8b60640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 0x7f30f41a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f8b60640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410d440 con 0x7f30f41029e0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f8b60640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410d2c0 con 0x7f30f41033a0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f8b60640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30f410d5c0 con 0x7f30f41017f0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 0x7f30f4199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 0x7f30f41a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49430/0 (socket says 172.21.15.17:49430) 2024-03-16T10:52:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f1d9b640 1 -- 172.21.15.17:0/4241048838 learned_addr learned my addr 172.21.15.17:0/4241048838 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 -- 172.21.15.17:0/4241048838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 msgr2=0x7f30f4199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 0x7f30f4199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 -- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 msgr2=0x7f30f419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f2d9d640 1 -- 172.21.15.17:0/4241048838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f41a1980 con 0x7f30f41033a0 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.879+0000 7f30f259c640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 0x7f30f4199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30f2d9d640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 0x7f30f41a1310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00e940 tx=0x7f30ec00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30e37fe640 1 -- 172.21.15.17:0/4241048838 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec004d20 con 0x7f30f41033a0 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f41a1c70 con 0x7f30f41033a0 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f41a21c0 con 0x7f30f41033a0 2024-03-16T10:52:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30e37fe640 1 -- 172.21.15.17:0/4241048838 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ec005020 con 0x7f30f41033a0 2024-03-16T10:52:00.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.880+0000 7f30e37fe640 1 -- 172.21.15.17:0/4241048838 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0116b0 con 0x7f30f41033a0 2024-03-16T10:52:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.883+0000 7f30fb820740 1 Processor -- start 2024-03-16T10:52:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.883+0000 7f30e37fe640 1 -- 172.21.15.17:0/4241048838 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f30ec00cb20 con 0x7f30f41033a0 2024-03-16T10:52:00.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.883+0000 7f30fb820740 1 -- start start 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.883+0000 7f30fb820740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.883+0000 7f30fb820740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50ddbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30fb820740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dde970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30fb820740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff50d33500 con 0x55ff50dd6980 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30fb820740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ff50cdbbe0 con 0x55ff50ddc4e0 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30fb820740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ff50d2f5a0 con 0x55ff50dd7370 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49438/0 (socket says 172.21.15.17:49438) 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2053089921 learned_addr learned my addr 172.21.15.17:0/2053089921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dde970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f259c640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50ddbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30e37fe640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 0x7f30dc0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2053089921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 msgr2=0x55ff50ddbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50ddbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2053089921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 msgr2=0x55ff50dde970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dde970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2053089921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff50cef4b0 con 0x55ff50dd6980 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30e37fe640 1 -- 172.21.15.17:0/4241048838 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f30ec0cea00 con 0x7f30f41033a0 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f259c640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50ddbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:00.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.884+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f30e8013ce0 tx=0x7f30e8009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8069fca05aeb3583 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30e0ff9640 1 -- 172.21.15.17:0/2053089921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8013170 con 0x55ff50dd6980 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30f2d9d640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 0x7f30dc0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30e0ff9640 1 -- 172.21.15.17:0/2053089921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e8013310 con 0x55ff50dd6980 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30e0ff9640 1 -- 172.21.15.17:0/2053089921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8010da0 con 0x55ff50dd6980 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30fb820740 1 -- 172.21.15.17:0/2053089921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 msgr2=0x55ff50dd6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.885+0000 7f30fb820740 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f30e8013ce0 tx=0x7f30e8009c10 comp rx=0 tx=0).stop 2024-03-16T10:52:00.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30f2d9d640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 0x7f30dc0a4dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f30ec097dc0 tx=0x7f30ec004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 -- 172.21.15.17:0/2053089921 shutdown_connections 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dde970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50ddbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 --2- 172.21.15.17:0/2053089921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd6980 0x55ff50dd6da0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 -- 172.21.15.17:0/2053089921 >> 172.21.15.17:0/2053089921 conn(0x55ff50dd1ef0 msgr2=0x55ff50dd22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 -- 172.21.15.17:0/2053089921 shutdown_connections 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.887+0000 7f30fb820740 1 -- 172.21.15.17:0/2053089921 wait complete. 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 -- start start 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 Processor -- start 2024-03-16T10:52:00.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50dcb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff50dc9610 con 0x55ff50ddc4e0 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55ff50cef160 con 0x55ff50dd6980 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30fb820740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ff50dc9790 con 0x55ff50dd7370 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30f259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50dcb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36598/0 (socket says 172.21.15.17:36598) 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30f1d9b640 1 -- 172.21.15.17:0/1495780556 learned_addr learned my addr 172.21.15.17:0/1495780556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.888+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30fb820740 10 client.0 _ll_register_callbacks cb 0x55ff50cd3150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:00.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 -- 172.21.15.17:0/1495780556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 msgr2=0x55ff50dcb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50dcb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 -- 172.21.15.17:0/1495780556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 msgr2=0x55ff50dd0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 -- 172.21.15.17:0/1495780556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff50b117d0 con 0x55ff50dd6980 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f259c640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50dcb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e8013310 con 0x55ff50dd6980 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30e8006010 tx=0x7f30e8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48cd1a39ffdf9bd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30d9ffb640 10 client.25613 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30d9ffb640 1 -- 172.21.15.17:0/1495780556 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8032050 con 0x55ff50dd6980 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30d9ffb640 1 -- 172.21.15.17:0/1495780556 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f30e8004030 con 0x55ff50dd6980 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30d9ffb640 1 -- 172.21.15.17:0/1495780556 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30e8004230 con 0x55ff50dd6980 2024-03-16T10:52:00.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30fb820740 10 client.25613 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.889+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ff50a473f0 con 0x55ff50dd6980 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30d9ffb640 1 -- 172.21.15.17:0/1495780556 <== mon.2 v2:172.21.15.111:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f30e8035020 con 0x55ff50dd6980 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 10 client.25613 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 10 client.25613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 20 client.25613 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50df4d10 0x55ff50df71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 4 client.25613 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff50d40a40 con 0x55ff50df4d10 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30f259c640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50df4d10 0x55ff50df71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30d9ffb640 10 client.25613 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.890+0000 7f30f259c640 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50df4d10 0x55ff50df71a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db437182e4b91d5 server_cookie=f91c3830f2ed22d3 in_seq=0 out_seq=0 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30d9ffb640 1 -- 172.21.15.17:0/1495780556 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ff50d40a40 con 0x55ff50df4d10 2024-03-16T10:52:00.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30d9ffb640 10 client.25613 handle_command_reply: tid=0 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 client.25613 shutdown 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 msgr2=0x55ff50dcb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30e8006010 tx=0x7f30e8009260 comp rx=0 tx=0).stop 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 shutdown_connections 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50df4d10 0x55ff50df71a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd7370 0x55ff50dcb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30d9ffb640 0 client.25613 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 --2- 172.21.15.17:0/1495780556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd6980 0x55ff50dcb010 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 >> 172.21.15.17:0/1495780556 conn(0x55ff50dd1ef0 msgr2=0x55ff50dc8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 shutdown_connections 2024-03-16T10:52:00.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 1 -- 172.21.15.17:0/1495780556 wait complete. 2024-03-16T10:52:00.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.891+0000 7f30fb820740 20 client.25613 trim_cache size 0 max 16384 2024-03-16T10:52:00.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 Processor -- start 2024-03-16T10:52:00.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 -- start start 2024-03-16T10:52:00.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50dd7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400e2a0 con 0x55ff50dd7370 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400fde0 con 0x55ff50ddc4e0 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30fb820740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400e970 con 0x55ff50dd6980 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49444/0 (socket says 172.21.15.17:49444) 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50dd7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30f259c640 1 -- 172.21.15.17:0/2944138742 learned_addr learned my addr 172.21.15.17:0/2944138742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.909+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2944138742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 msgr2=0x55ff50dd5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2944138742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 msgr2=0x55ff50dcb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 -- 172.21.15.17:0/2944138742 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff50a070f0 con 0x55ff50dd6980 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f259c640 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50dd7d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005820 tx=0x7f30e8024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758ddde69390d8f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30dbfff640 1 -- 172.21.15.17:0/2944138742 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8032040 con 0x55ff50dd6980 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30dbfff640 1 -- 172.21.15.17:0/2944138742 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e8013310 con 0x55ff50dd6980 2024-03-16T10:52:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.910+0000 7f30dbfff640 1 -- 172.21.15.17:0/2944138742 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8011610 con 0x55ff50dd6980 2024-03-16T10:52:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- 172.21.15.17:0/2944138742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 msgr2=0x55ff50dd7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50dd7d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005820 tx=0x7f30e8024000 comp rx=0 tx=0).stop 2024-03-16T10:52:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- 172.21.15.17:0/2944138742 shutdown_connections 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50ddc4e0 0x55ff50dd5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50dd7370 0x55ff50dcb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 --2- 172.21.15.17:0/2944138742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50dd7d90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- 172.21.15.17:0/2944138742 >> 172.21.15.17:0/2944138742 conn(0x55ff50dd1ef0 msgr2=0x55ff50dd5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- 172.21.15.17:0/2944138742 shutdown_connections 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- 172.21.15.17:0/2944138742 wait complete. 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 -- start start 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.911+0000 7f30fb820740 1 Processor -- start 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50e05680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 0x55ff50e05bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400f710 con 0x55ff50ddc4e0 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400f040 con 0x55ff50dd7370 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400c280 con 0x55ff50dd6980 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30fb820740 10 client.0 _ll_register_callbacks cb 0x7f30e8013770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49446/0 (socket says 172.21.15.17:49446) 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f1d9b640 1 -- 172.21.15.17:0/862665595 learned_addr learned my addr 172.21.15.17:0/862665595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 0x55ff50e05bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 -- 172.21.15.17:0/862665595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 msgr2=0x55ff50e05680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50e05680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 -- 172.21.15.17:0/862665595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 msgr2=0x55ff50e06b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f259c640 1 -- 172.21.15.17:0/862665595 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff50cfa9d0 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.912+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30f259c640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 0x55ff50e05bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30e402c7b0 tx=0x7f30e4004440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a54629b2af27ab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e404b070 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f30e4045390 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e8013310 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30e4056050 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30fb820740 10 client.25619 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ff50e08300 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.913+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30e8013310 con 0x55ff50dd7370 2024-03-16T10:52:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f30e40046c0 con 0x55ff50dd7370 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 10 client.25619 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 20 client.25619 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50e5af60 0x55ff50e5d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 4 client.25619 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff50d3ad90 con 0x55ff50e5af60 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50e5af60 0x55ff50e5d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30d9ffb640 10 client.25619 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30f1d9b640 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50e5af60 0x55ff50e5d380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ca083bb8a0e4a0 server_cookie=f9e065120e993fa6 in_seq=0 out_seq=0 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30d9ffb640 1 -- 172.21.15.17:0/862665595 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ff50d3ad90 con 0x55ff50e5af60 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30d9ffb640 10 client.25619 handle_command_reply: tid=0 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.914+0000 7f30fb820740 1 client.25619 shutdown 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 msgr2=0x55ff50e05bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 0x55ff50e05bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30e402c7b0 tx=0x7f30e4004440 comp rx=0 tx=0).stop 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 shutdown_connections 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55ff50e5af60 0x55ff50e5d380 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff50ddc4e0 0x55ff50e06b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30d9ffb640 0 client.25619 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55ff50dd7370 0x55ff50e05bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 --2- 172.21.15.17:0/862665595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff50dd6980 0x55ff50e05680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 >> 172.21.15.17:0/862665595 conn(0x55ff50dd1ef0 msgr2=0x55ff50dd59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 shutdown_connections 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 1 -- 172.21.15.17:0/862665595 wait complete. 2024-03-16T10:52:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30fb820740 20 client.25619 trim_cache size 0 max 16384 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 msgr2=0x7f30dc0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 0x7f30dc0a4dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f30ec097dc0 tx=0x7f30ec004a40 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 msgr2=0x7f30f41a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 0x7f30f41a1310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00e940 tx=0x7f30ec00ee00 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 shutdown_connections 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f30dc0a2910 0x7f30dc0a4dd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30f41033a0 0x7f30f41a1310 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f41029e0 0x7f30f419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.915+0000 7f30f8b60640 1 --2- 172.21.15.17:0/4241048838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30f41017f0 0x7f30f4199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.916+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 >> 172.21.15.17:0/4241048838 conn(0x7f30f40fcd80 msgr2=0x7f30f4073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.916+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 shutdown_connections 2024-03-16T10:52:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:00.916+0000 7f30f8b60640 1 -- 172.21.15.17:0/4241048838 wait complete. 2024-03-16T10:52:00.927 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T10:52:00.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 -- 172.21.15.17:0/4243076772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41022b0 msgr2=0x7f5ac4108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 --2- 172.21.15.17:0/4243076772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41022b0 0x7f5ac4108b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009ca0 tx=0x7f5abc02c100 comp rx=0 tx=0).stop 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 -- 172.21.15.17:0/4243076772 shutdown_connections 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 --2- 172.21.15.17:0/4243076772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41022b0 0x7f5ac4108b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 --2- 172.21.15.17:0/4243076772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41018f0 0x7f5ac4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 --2- 172.21.15.17:0/4243076772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac4100700 0x7f5ac4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 -- 172.21.15.17:0/4243076772 >> 172.21.15.17:0/4243076772 conn(0x7f5ac40fbc70 msgr2=0x7f5ac40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 -- 172.21.15.17:0/4243076772 shutdown_connections 2024-03-16T10:52:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.032+0000 7f5acaa80640 1 -- 172.21.15.17:0/4243076772 wait complete. 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 Processor -- start 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 -- start start 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c420 con 0x7f5ac41018f0 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c2a0 con 0x7f5ac41022b0 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5acaa80640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410c5a0 con 0x7f5ac4100700 2024-03-16T10:52:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.033+0000 7f5ac881c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac901d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49458/0 (socket says 172.21.15.17:49458) 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac881c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44486/0 (socket says 172.21.15.17:44486) 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac901d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36646/0 (socket says 172.21.15.17:36646) 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 -- 172.21.15.17:0/2348623406 learned_addr learned my addr 172.21.15.17:0/2348623406 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 -- 172.21.15.17:0/2348623406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 msgr2=0x7f5ac4196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 -- 172.21.15.17:0/2348623406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 msgr2=0x7f5ac419de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 -- 172.21.15.17:0/2348623406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4068a70 con 0x7f5ac41018f0 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac881c640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac901d640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac3fff640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000e9f0 tx=0x7f5ab000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.034+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000ccc0 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.035+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab000ce60 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.035+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0010690 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.035+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac4068d60 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.035+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac4069280 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.036+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4107950 con 0x7f5ac41018f0 2024-03-16T10:52:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.037+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f5ab00046c0 con 0x7f5ac41018f0 2024-03-16T10:52:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.038+0000 7f5ac1ffb640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 0x7f5ab40a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.038+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5ab00cef00 con 0x7f5ac41018f0 2024-03-16T10:52:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.038+0000 7f5ac881c640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 0x7f5ab40a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.039+0000 7f5ac881c640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 0x7f5ab40a4f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4101750 tx=0x7f5ab8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.046+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f5ab009be40 con 0x7f5ac41018f0 2024-03-16T10:52:01.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.495+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ac40696f0 con 0x7f5ac41018f0 2024-03-16T10:52:01.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.496+0000 7f5ac1ffb640 1 -- 172.21.15.17:0/2348623406 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11935 (secure 0 0 0) 0x7f5ab009b740 con 0x7f5ac41018f0 2024-03-16T10:52:01.497 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:52:01.497 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:50:51.056785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[14655,24497,24470,24493,24536]},"id":1}]} 2024-03-16T10:52:01.497 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 msgr2=0x7f5ab40a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 0x7f5ab40a4f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4101750 tx=0x7f5ab8009110 comp rx=0 tx=0).stop 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 msgr2=0x7f5ac4196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000e9f0 tx=0x7f5ab000edf0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 shutdown_connections 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5ab40a2a60 0x7f5ab40a4f20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ac41022b0 0x7f5ac419de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ac41018f0 0x7f5ac4196db0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 --2- 172.21.15.17:0/2348623406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4100700 0x7f5ac4196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 >> 172.21.15.17:0/2348623406 conn(0x7f5ac40fbc70 msgr2=0x7f5ac4104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 shutdown_connections 2024-03-16T10:52:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.499+0000 7f5acaa80640 1 -- 172.21.15.17:0/2348623406 wait complete. 2024-03-16T10:52:01.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.620+0000 7f391e20b640 1 -- 172.21.15.17:0/766348021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3918102290 msgr2=0x7f3918108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.620+0000 7f391e20b640 1 --2- 172.21.15.17:0/766348021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3918102290 0x7f3918108b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3910009be0 tx=0x7f391002bef0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 -- 172.21.15.17:0/766348021 shutdown_connections 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 --2- 172.21.15.17:0/766348021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3918102290 0x7f3918108b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 --2- 172.21.15.17:0/766348021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39181018d0 0x7f3918101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 --2- 172.21.15.17:0/766348021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181006e0 0x7f3918100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 -- 172.21.15.17:0/766348021 >> 172.21.15.17:0/766348021 conn(0x7f39180fbc70 msgr2=0x7f39180fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 -- 172.21.15.17:0/766348021 shutdown_connections 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 -- 172.21.15.17:0/766348021 wait complete. 2024-03-16T10:52:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 Processor -- start 2024-03-16T10:52:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.621+0000 7f391e20b640 1 -- start start 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 0x7f3918197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3918102290 0x7f391819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f391810c340 con 0x7f39181018d0 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f391810c1c0 con 0x7f39181006e0 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f391e20b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f391810c4c0 con 0x7f3918102290 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f39177fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 0x7f3918197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f39177fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 0x7f3918197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36672/0 (socket says 172.21.15.17:36672) 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49478/0 (socket says 172.21.15.17:49478) 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f39177fe640 1 -- 172.21.15.17:0/1070224046 learned_addr learned my addr 172.21.15.17:0/1070224046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3917fff640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3918102290 0x7f391819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 -- 172.21.15.17:0/1070224046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3918102290 msgr2=0x7f391819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3918102290 0x7f391819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 -- 172.21.15.17:0/1070224046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 msgr2=0x7f3918197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 0x7f3918197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 -- 172.21.15.17:0/1070224046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391819f6f0 con 0x7f39181018d0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.622+0000 7f3916ffd640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e9f0 tx=0x7f390c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.623+0000 7f3914ff9640 1 -- 172.21.15.17:0/1070224046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c00ccc0 con 0x7f39181018d0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.623+0000 7f3914ff9640 1 -- 172.21.15.17:0/1070224046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390c010910 con 0x7f39181018d0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.623+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3918102b50 con 0x7f39181018d0 2024-03-16T10:52:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.623+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39181030a0 con 0x7f39181018d0 2024-03-16T10:52:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.626+0000 7f3914ff9640 1 -- 172.21.15.17:0/1070224046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c018960 con 0x7f39181018d0 2024-03-16T10:52:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.626+0000 7f3914ff9640 1 -- 172.21.15.17:0/1070224046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f390c018bc0 con 0x7f39181018d0 2024-03-16T10:52:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 Processor -- start 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 -- start start 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3914ff9640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 0x7f39000a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f901550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f904050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557b3f858490 con 0x557b3f901bc0 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557b3f800c90 con 0x557b3f8fca50 2024-03-16T10:52:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3920df5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557b3f854530 con 0x557b3f8fc060 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f39177fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f39177fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44508/0 (socket says 172.21.15.17:44508) 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f39177fe640 1 -- 172.21.15.17:0/3596644865 learned_addr learned my addr 172.21.15.17:0/3596644865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3916ffd640 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f901550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.627+0000 7f3917fff640 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f904050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f3917fff640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 0x7f39000a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 -- 172.21.15.17:0/3596644865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 msgr2=0x557b3f901550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f901550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 -- 172.21.15.17:0/3596644865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 msgr2=0x557b3f904050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f904050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 -- 172.21.15.17:0/3596644865 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3f8bb500 con 0x557b3f8fc060 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f39177fe640 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3908010e10 tx=0x7f3908009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0b611a6bfe687f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.628+0000 7f38fdffb640 1 -- 172.21.15.17:0/3596644865 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908004220 con 0x557b3f8fc060 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f38fdffb640 1 -- 172.21.15.17:0/3596644865 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39080104f0 con 0x557b3f8fc060 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f38fdffb640 1 -- 172.21.15.17:0/3596644865 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908019840 con 0x557b3f8fc060 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3914ff9640 1 -- 172.21.15.17:0/1070224046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f390c0ceee0 con 0x7f39181018d0 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 -- 172.21.15.17:0/3596644865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 msgr2=0x557b3f8fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3917fff640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 0x7f39000a4c30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3910005f00 tx=0x7f3910005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3908010e10 tx=0x7f3908009260 comp rx=0 tx=0).stop 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 -- 172.21.15.17:0/3596644865 shutdown_connections 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f904050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f901550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 --2- 172.21.15.17:0/3596644865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fc060 0x557b3f8fc480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 -- 172.21.15.17:0/3596644865 >> 172.21.15.17:0/3596644865 conn(0x557b3f8f75d0 msgr2=0x557b3f8f79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 -- 172.21.15.17:0/3596644865 shutdown_connections 2024-03-16T10:52:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.629+0000 7f3920df5740 1 -- 172.21.15.17:0/3596644865 wait complete. 2024-03-16T10:52:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 -- start start 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 Processor -- start 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f906a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f39177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f39177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49496/0 (socket says 172.21.15.17:49496) 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f901bc0 0x557b3f90da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f39177fe640 1 -- 172.21.15.17:0/2039576097 learned_addr learned my addr 172.21.15.17:0/2039576097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557b3f904b70 con 0x557b3f8fc060 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557b3f814230 con 0x557b3f901bc0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.630+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557b3f904cf0 con 0x557b3f8fca50 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f906a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f3917fff640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f901bc0 0x557b3f90da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f3920df5740 10 client.0 _ll_register_callbacks cb 0x557b3f850010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 -- 172.21.15.17:0/2039576097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 msgr2=0x557b3f906a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f906a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 -- 172.21.15.17:0/2039576097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f901bc0 msgr2=0x557b3f90da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f901bc0 0x557b3f90da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3f823100 con 0x557b3f8fc060 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f39177fe640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3908012010 tx=0x7f3908003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb06b57b1ef8c1e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f38f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908028020 con 0x557b3f8fc060 2024-03-16T10:52:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f3908003800 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.631+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39080104f0 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3908003a00 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 10 client.15759 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b3f56c3f0 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3908003ba0 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3908004c80 con 0x557b3f8fc060 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 10 client.15759 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 10 client.15759 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 20 client.15759 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f911f60 0x557b3f914350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 4 client.15759 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f39080104f0 con 0x557b3f911f60 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.632+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f911f60 0x557b3f914350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.633+0000 7f38f6ffd640 10 client.15759 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.633+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f911f60 0x557b3f914350 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=87dcd35645fc6fc3 server_cookie=49b34da48e90f13f in_seq=0 out_seq=0 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.633+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2039576097 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f39080104f0 con 0x557b3f911f60 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.633+0000 7f38f6ffd640 10 client.15759 handle_command_reply: tid=0 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.633+0000 7f3920df5740 1 client.15759 shutdown 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 msgr2=0x557b3f9064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3908012010 tx=0x7f3908003e20 comp rx=0 tx=0).stop 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 shutdown_connections 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f911f60 0x557b3f914350 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f901bc0 0x557b3f90da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f906a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f38f6ffd640 0 client.15759 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 --2- 172.21.15.17:0/2039576097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f9064f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 >> 172.21.15.17:0/2039576097 conn(0x557b3f8f75d0 msgr2=0x557b3f8edfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 shutdown_connections 2024-03-16T10:52:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 1 -- 172.21.15.17:0/2039576097 wait complete. 2024-03-16T10:52:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.634+0000 7f3920df5740 20 client.15759 trim_cache size 0 max 16384 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.660+0000 7f3920df5740 1 Processor -- start 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.660+0000 7f3920df5740 1 -- start start 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f901bc0 0x557b3f906050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49498/0 (socket says 172.21.15.17:49498) 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3916ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36702/0 (socket says 172.21.15.17:36702) 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 -- 172.21.15.17:0/3539391027 learned_addr learned my addr 172.21.15.17:0/3539391027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a6830 con 0x557b3f8fc060 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a8370 con 0x557b3f8fca50 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a6f00 con 0x557b3f901bc0 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f3917fff640 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f901bc0 0x557b3f906050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 -- 172.21.15.17:0/3539391027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f901bc0 msgr2=0x557b3f906050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f901bc0 0x557b3f906050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 -- 172.21.15.17:0/3539391027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 msgr2=0x557b3f90da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.661+0000 7f39177fe640 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f39177fe640 1 -- 172.21.15.17:0/3539391027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3f6367d0 con 0x557b3f8fc060 2024-03-16T10:52:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f3916ffd640 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f39177fe640 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3908010d90 tx=0x7f3908010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1134a166e7ceb013 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f38fd7fa640 1 -- 172.21.15.17:0/3539391027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390803c070 con 0x557b3f8fc060 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f38fd7fa640 1 -- 172.21.15.17:0/3539391027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39080054e0 con 0x557b3f8fc060 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.662+0000 7f38fd7fa640 1 -- 172.21.15.17:0/3539391027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908019b10 con 0x557b3f8fc060 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 msgr2=0x557b3f905b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3908010d90 tx=0x7f3908010dc0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 shutdown_connections 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f901bc0 0x557b3f906050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fca50 0x557b3f90da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 --2- 172.21.15.17:0/3539391027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f8fc060 0x557b3f905b10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 >> 172.21.15.17:0/3539391027 conn(0x557b3f8f75d0 msgr2=0x557b3f8fb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 shutdown_connections 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.663+0000 7f3920df5740 1 -- 172.21.15.17:0/3539391027 wait complete. 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 -- start start 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 Processor -- start 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f90af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f976200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a7ca0 con 0x557b3f901bc0 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a75d0 con 0x557b3f8fc060 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39181a4810 con 0x557b3f8fca50 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.664+0000 7f3920df5740 10 client.0 _ll_register_callbacks cb 0x7f3908005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36708/0 (socket says 172.21.15.17:36708) 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 -- 172.21.15.17:0/2139891695 learned_addr learned my addr 172.21.15.17:0/2139891695 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f90af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f3917fff640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f976200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 -- 172.21.15.17:0/2139891695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 msgr2=0x557b3f90af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f90af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 -- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 msgr2=0x557b3f976200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f976200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 -- 172.21.15.17:0/2139891695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3f976740 con 0x557b3f8fc060 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f90af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f3917fff640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f976200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f39177fe640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3908019710 tx=0x7f3908005690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20c1ab099281f225 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f38f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:01.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390803c070 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f3908003800 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.665+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39080054e0 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3908004610 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f3920df5740 10 client.25643 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b3f977a40 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39080054e0 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f390804b070 con 0x557b3f8fc060 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f3920df5740 10 client.25643 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f3920df5740 10 client.25643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.666+0000 7f3920df5740 20 client.25643 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:01.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f978250 0x557b3f97a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f978250 0x557b3f97a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f3920df5740 4 client.25643 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b3f8659d0 con 0x557b3f978250 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f38f6ffd640 10 client.25643 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f3916ffd640 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f978250 0x557b3f97a670 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8c57e9b58e03ca77 server_cookie=9ade6c3995af612b in_seq=0 out_seq=0 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f38f6ffd640 1 -- 172.21.15.17:0/2139891695 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b3f8659d0 con 0x557b3f978250 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.667+0000 7f38f6ffd640 10 client.25643 handle_command_reply: tid=0 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 client.25643 shutdown 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 msgr2=0x557b3f90aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3908019710 tx=0x7f3908005690 comp rx=0 tx=0).stop 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 shutdown_connections 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557b3f978250 0x557b3f97a670 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f38f6ffd640 0 client.25643 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b3f901bc0 0x557b3f976200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557b3f8fca50 0x557b3f90af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 --2- 172.21.15.17:0/2139891695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557b3f8fc060 0x557b3f90aa40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.668+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 >> 172.21.15.17:0/2139891695 conn(0x557b3f8f75d0 msgr2=0x557b3f8ed750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.669+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 shutdown_connections 2024-03-16T10:52:01.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.669+0000 7f3920df5740 1 -- 172.21.15.17:0/2139891695 wait complete. 2024-03-16T10:52:01.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.669+0000 7f3920df5740 20 client.25643 trim_cache size 0 max 16384 2024-03-16T10:52:01.674 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:01.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.669+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 msgr2=0x7f39000a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 0x7f39000a4c30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3910005f00 tx=0x7f3910005e30 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 msgr2=0x7f3918198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e9f0 tx=0x7f390c00eeb0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 shutdown_connections 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f39000a2770 0x7f39000a4c30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3918102290 0x7f391819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39181018d0 0x7f3918198010 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 --2- 172.21.15.17:0/1070224046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39181006e0 0x7f3918197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 >> 172.21.15.17:0/1070224046 conn(0x7f39180fbc70 msgr2=0x7f39180fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 shutdown_connections 2024-03-16T10:52:01.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.670+0000 7f391e20b640 1 -- 172.21.15.17:0/1070224046 wait complete. 2024-03-16T10:52:01.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 -- 172.21.15.17:0/796769676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74100c30 msgr2=0x7fce74101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/796769676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74100c30 0x7fce74101050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce68009900 tx=0x7fce6802bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 -- 172.21.15.17:0/796769676 shutdown_connections 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/796769676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce74108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/796769676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74101940 0x7fce74101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/796769676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74100c30 0x7fce74101050 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 -- 172.21.15.17:0/796769676 >> 172.21.15.17:0/796769676 conn(0x7fce740fb400 msgr2=0x7fce740fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 -- 172.21.15.17:0/796769676 shutdown_connections 2024-03-16T10:52:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 -- 172.21.15.17:0/796769676 wait complete. 2024-03-16T10:52:01.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.798+0000 7fce7b0b2640 1 Processor -- start 2024-03-16T10:52:01.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 -- start start 2024-03-16T10:52:01.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 0x7fce7419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce741a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce7410c3c0 con 0x7fce74102300 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fce7410c240 con 0x7fce74101940 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7b0b2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce7410c540 con 0x7fce74100c30 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44548/0 (socket says 172.21.15.17:44548) 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 -- 172.21.15.17:0/3183421744 learned_addr learned my addr 172.21.15.17:0/3183421744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce73fff640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 0x7fce7419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7964f640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce741a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 -- 172.21.15.17:0/3183421744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 msgr2=0x7fce7419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 0x7fce7419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 -- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 msgr2=0x7fce741a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce741a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce78e4e640 1 -- 172.21.15.17:0/3183421744 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce741a19c0 con 0x7fce74100c30 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce7964f640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce741a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.799+0000 7fce73fff640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 0x7fce7419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fce68000c00 tx=0x7fce6802c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce71ffb640 1 -- 172.21.15.17:0/3183421744 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68043020 con 0x7fce74100c30 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce741a1c50 con 0x7fce74100c30 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce71ffb640 1 -- 172.21.15.17:0/3183421744 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce680054e0 con 0x7fce74100c30 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce71ffb640 1 -- 172.21.15.17:0/3183421744 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68003c40 con 0x7fce74100c30 2024-03-16T10:52:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.800+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce741a21a0 con 0x7fce74100c30 2024-03-16T10:52:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.802+0000 7fce71ffb640 1 -- 172.21.15.17:0/3183421744 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fce68046020 con 0x7fce74100c30 2024-03-16T10:52:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.803+0000 7fce71ffb640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 0x7fce640a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.803+0000 7fce73fff640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 0x7fce640a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.803+0000 7fce71ffb640 1 -- 172.21.15.17:0/3183421744 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fce680f0a80 con 0x7fce74100c30 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 Processor -- start 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 -- start start 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 0x7fce640a4dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce600095f0 tx=0x7fce60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6bec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c36e623490 con 0x55c36e6be850 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c36e5cbc90 con 0x55c36e6bf240 2024-03-16T10:52:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c36e61f530 con 0x55c36e6c43b0 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36744/0 (socket says 172.21.15.17:36744) 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 -- 172.21.15.17:0/1248557229 learned_addr learned my addr 172.21.15.17:0/1248557229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce78e4e640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 -- 172.21.15.17:0/1248557229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 msgr2=0x55c36e6c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7964f640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 -- 172.21.15.17:0/1248557229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 msgr2=0x55c36e6bec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6bec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce73fff640 1 -- 172.21.15.17:0/1248557229 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36e686500 con 0x55c36e6bf240 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.804+0000 7fce7964f640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.805+0000 7fce78e4e640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6bec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.805+0000 7fce73fff640 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce6000f690 tx=0x7fce60014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b6b38cacb1cc42 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.805+0000 7fce5effd640 1 -- 172.21.15.17:0/1248557229 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60026630 con 0x55c36e6bf240 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.805+0000 7fce5effd640 1 -- 172.21.15.17:0/1248557229 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce6000fe80 con 0x55c36e6bf240 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.805+0000 7fce5effd640 1 -- 172.21.15.17:0/1248557229 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6001d850 con 0x55c36e6bf240 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 -- 172.21.15.17:0/1248557229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 msgr2=0x55c36e6c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fce6000f690 tx=0x7fce60014000 comp rx=0 tx=0).stop 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 -- 172.21.15.17:0/1248557229 shutdown_connections 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6c3d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/1248557229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6bec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 -- 172.21.15.17:0/1248557229 >> 172.21.15.17:0/1248557229 conn(0x55c36e6b9dc0 msgr2=0x55c36e6ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 -- 172.21.15.17:0/1248557229 shutdown_connections 2024-03-16T10:52:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.806+0000 7fce7dd7b740 1 -- 172.21.15.17:0/1248557229 wait complete. 2024-03-16T10:52:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.807+0000 7fce7dd7b740 1 -- start start 2024-03-16T10:52:01.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.807+0000 7fce7dd7b740 1 Processor -- start 2024-03-16T10:52:01.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.807+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.807+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 0x55c36e6d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c36e6cfb70 con 0x55c36e6c43b0 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c36e5df230 con 0x55c36e6bf240 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c36e6cfcf0 con 0x55c36e6be850 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7dd7b740 10 client.0 _ll_register_callbacks cb 0x55c36e61b010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44566/0 (socket says 172.21.15.17:44566) 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 -- 172.21.15.17:0/2857903353 learned_addr learned my addr 172.21.15.17:0/2857903353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce73fff640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7964f640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 0x55c36e6d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 -- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 msgr2=0x55c36e6d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 -- 172.21.15.17:0/2857903353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 msgr2=0x55c36e6d8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 0x55c36e6d8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 -- 172.21.15.17:0/2857903353 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36e5ee100 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce7964f640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 0x55c36e6d8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce78e4e640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce68006010 tx=0x7fce680bce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d45f9af251b3e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce53fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.808+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680c59e0 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c36e6309d0 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fce680d6190 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce680d6390 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 10 client.25612 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c36e3373f0 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c36e6309d0 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fce680c1120 con 0x55c36e6be850 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 10 client.25612 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 10 client.25612 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 20 client.25612 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e6dd1f0 0x55c36e6df640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 4 client.25612 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.809+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c36e62ad20 con 0x55c36e6dd1f0 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.810+0000 7fce73fff640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e6dd1f0 0x55c36e6df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.810+0000 7fce53fff640 10 client.25612 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.810+0000 7fce73fff640 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e6dd1f0 0x55c36e6df640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1e0f2a2d72f7da23 server_cookie=db09cf6e55fef29c in_seq=0 out_seq=0 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce53fff640 1 -- 172.21.15.17:0/2857903353 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c36e62ad20 con 0x55c36e6dd1f0 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce53fff640 10 client.25612 handle_command_reply: tid=0 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 client.25612 shutdown 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 msgr2=0x55c36e6d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce68006010 tx=0x7fce680bce30 comp rx=0 tx=0).stop 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 shutdown_connections 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e6dd1f0 0x55c36e6df640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6c43b0 0x55c36e6d8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/2857903353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6be850 0x55c36e6d1520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 >> 172.21.15.17:0/2857903353 conn(0x55c36e6b9dc0 msgr2=0x55c36e6b8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce53fff640 0 client.25612 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 shutdown_connections 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 1 -- 172.21.15.17:0/2857903353 wait complete. 2024-03-16T10:52:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.811+0000 7fce7dd7b740 20 client.25612 trim_cache size 0 max 16384 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 Processor -- start 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 -- start start 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a6a80 con 0x55c36e6be850 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce78e4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36774/0 (socket says 172.21.15.17:36774) 2024-03-16T10:52:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce73fff640 1 -- 172.21.15.17:0/3390908496 learned_addr learned my addr 172.21.15.17:0/3390908496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7964f640 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a85c0 con 0x55c36e6bf240 2024-03-16T10:52:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.838+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a7150 con 0x55c36e6c43b0 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 -- 172.21.15.17:0/3390908496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 msgr2=0x55c36e6d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 -- 172.21.15.17:0/3390908496 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 msgr2=0x55c36e6d8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 -- 172.21.15.17:0/3390908496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36e4017d0 con 0x55c36e6be850 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce73fff640 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce78e4e640 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d1130 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fce680ee6c0 tx=0x7fce680bb9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309c889a2726ffad server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.839+0000 7fce5e7fc640 1 -- 172.21.15.17:0/3390908496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680bb610 con 0x55c36e6be850 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce5e7fc640 1 -- 172.21.15.17:0/3390908496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce680035f0 con 0x55c36e6be850 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce5e7fc640 1 -- 172.21.15.17:0/3390908496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce680c5c70 con 0x55c36e6be850 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 msgr2=0x55c36e6d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d1130 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fce680ee6c0 tx=0x7fce680bb9e0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 shutdown_connections 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/3390908496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d1130 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 >> 172.21.15.17:0/3390908496 conn(0x55c36e6b9dc0 msgr2=0x55c36e6c0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 shutdown_connections 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.840+0000 7fce7dd7b740 1 -- 172.21.15.17:0/3390908496 wait complete. 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 -- start start 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 Processor -- start 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a7ef0 con 0x55c36e6be850 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a7820 con 0x55c36e6bf240 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce741a4a80 con 0x55c36e6c43b0 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.841+0000 7fce7dd7b740 10 client.0 _ll_register_callbacks cb 0x7fce680bd2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44582/0 (socket says 172.21.15.17:44582) 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce73fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36778/0 (socket says 172.21.15.17:36778) 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 -- 172.21.15.17:0/258392981 learned_addr learned my addr 172.21.15.17:0/258392981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce78e4e640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 -- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 msgr2=0x55c36e6d61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 -- 172.21.15.17:0/258392981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 msgr2=0x55c36e6d5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 -- 172.21.15.17:0/258392981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36e6d7760 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce78e4e640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7964f640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce6c013d30 tx=0x7fce6c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2eb2f40912c6edc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce53fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c009c30 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fce6c009dd0 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c36e5a86a0 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fce6c003970 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7dd7b740 10 client.25618 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.842+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c36e6d8ad0 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c36e5a86a0 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fce6c01c490 con 0x55c36e6c43b0 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 10 client.25618 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 10 client.25618 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 20 client.25618 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e743a30 0x55c36e745e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 4 client.25618 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c36e5f4dc0 con 0x55c36e743a30 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.843+0000 7fce78e4e640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e743a30 0x55c36e745e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce53fff640 10 client.25618 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce78e4e640 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e743a30 0x55c36e745e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=38e58f656abd2180 server_cookie=c3c49e4833d7f21c in_seq=0 out_seq=0 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce53fff640 1 -- 172.21.15.17:0/258392981 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c36e5f4dc0 con 0x55c36e743a30 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce53fff640 10 client.25618 handle_command_reply: tid=0 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 client.25618 shutdown 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 msgr2=0x55c36e6d7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce6c013d30 tx=0x7fce6c011810 comp rx=0 tx=0).stop 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 shutdown_connections 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c36e743a30 0x55c36e745e50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c36e6c43b0 0x55c36e6d7170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c36e6bf240 0x55c36e6d61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 --2- 172.21.15.17:0/258392981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c36e6be850 0x55c36e6d5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 >> 172.21.15.17:0/258392981 conn(0x55c36e6b9dc0 msgr2=0x55c36e6d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce53fff640 0 client.25618 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 shutdown_connections 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 1 -- 172.21.15.17:0/258392981 wait complete. 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.844+0000 7fce7dd7b740 20 client.25618 trim_cache size 0 max 16384 2024-03-16T10:52:01.850 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 msgr2=0x7fce640a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 0x7fce640a4dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce600095f0 tx=0x7fce60005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 msgr2=0x7fce74199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fce68000c00 tx=0x7fce6802c650 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 shutdown_connections 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce640a2910 0x7fce640a4dd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce74102300 0x7fce741a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce74101940 0x7fce7419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 --2- 172.21.15.17:0/3183421744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce74100c30 0x7fce74199db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 >> 172.21.15.17:0/3183421744 conn(0x7fce740fb400 msgr2=0x7fce740fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 shutdown_connections 2024-03-16T10:52:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.845+0000 7fce7b0b2640 1 -- 172.21.15.17:0/3183421744 wait complete. 2024-03-16T10:52:01.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 -- 172.21.15.17:0/2931729228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe81011c0 msgr2=0x7fbfe8101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 --2- 172.21.15.17:0/2931729228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe81011c0 0x7fbfe8101a40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009ca0 tx=0x7fbfe002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 -- 172.21.15.17:0/2931729228 shutdown_connections 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 --2- 172.21.15.17:0/2931729228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe81011c0 0x7fbfe8101a40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 --2- 172.21.15.17:0/2931729228 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe8100800 0x7fbfe8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 --2- 172.21.15.17:0/2931729228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 0x7fbfe80ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 -- 172.21.15.17:0/2931729228 >> 172.21.15.17:0/2931729228 conn(0x7fbfe80fb3d0 msgr2=0x7fbfe80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 -- 172.21.15.17:0/2931729228 shutdown_connections 2024-03-16T10:52:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.964+0000 7fbfed7df640 1 -- 172.21.15.17:0/2931729228 wait complete. 2024-03-16T10:52:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 Processor -- start 2024-03-16T10:52:01.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 -- start start 2024-03-16T10:52:01.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 0x7fbfe81063e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 0x7fbfe8102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe810f660 con 0x7fbfe8100800 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe810f4e0 con 0x7fbfe81011c0 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfed7df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe810f7e0 con 0x7fbfe80ffaa0 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49588/0 (socket says 172.21.15.17:49588) 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.965+0000 7fbfe67fc640 1 -- 172.21.15.17:0/859692229 learned_addr learned my addr 172.21.15.17:0/859692229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 0x7fbfe8102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 0x7fbfe81063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 -- 172.21.15.17:0/859692229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 msgr2=0x7fbfe81063e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 0x7fbfe81063e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 -- 172.21.15.17:0/859692229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 msgr2=0x7fbfe8102f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 0x7fbfe8102f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 -- 172.21.15.17:0/859692229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe8103810 con 0x7fbfe8100800 2024-03-16T10:52:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 0x7fbfe8102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00e9c0 tx=0x7fbfdc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfcffff640 1 -- 172.21.15.17:0/859692229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00cde0 con 0x7fbfe8100800 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.966+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe81a5f60 con 0x7fbfe8100800 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.967+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe81a6360 con 0x7fbfe8100800 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.967+0000 7fbfcffff640 1 -- 172.21.15.17:0/859692229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfdc010910 con 0x7fbfe8100800 2024-03-16T10:52:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.967+0000 7fbfcffff640 1 -- 172.21.15.17:0/859692229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc018a10 con 0x7fbfe8100800 2024-03-16T10:52:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.969+0000 7fbff03c8740 1 Processor -- start 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 -- start start 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c05c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c0d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f851b6a490 con 0x55f851c06240 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f851b12c90 con 0x55f851c0b3b0 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbff03c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f851b66530 con 0x55f851c05850 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49600/0 (socket says 172.21.15.17:49600) 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c05c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/2233358437 learned_addr learned my addr 172.21.15.17:0/2233358437 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfcffff640 1 -- 172.21.15.17:0/859692229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fbfdc01f020 con 0x7fbfe8100800 2024-03-16T10:52:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 -- 172.21.15.17:0/2233358437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 msgr2=0x55f851c0d840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T10:52:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c0d840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 -- 172.21.15.17:0/2233358437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 msgr2=0x55f851c0ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe77fe640 1 -- 172.21.15.17:0/2233358437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f851bcd500 con 0x55f851c05850 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.970+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c05c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009bf0 tx=0x7fbfe0032440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00654e91f4b8eb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfcffff640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 0x7fbfd00a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfcd7fa640 1 -- 172.21.15.17:0/2233358437 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0043020 con 0x55f851c05850 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfcffff640 1 -- 172.21.15.17:0/859692229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbfdc0cedb0 con 0x7fbfe8100800 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfcd7fa640 1 -- 172.21.15.17:0/2233358437 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfe0032c90 con 0x55f851c05850 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfcd7fa640 1 -- 172.21.15.17:0/2233358437 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0039040 con 0x55f851c05850 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.971+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 0x7fbfd00a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- 172.21.15.17:0/2233358437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 msgr2=0x55f851c05c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 0x7fbfd00a4e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f851c06640 tx=0x7fbfd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c05c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009bf0 tx=0x7fbfe0032440 comp rx=0 tx=0).stop 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- 172.21.15.17:0/2233358437 shutdown_connections 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c0d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c0ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2233358437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c05c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- 172.21.15.17:0/2233358437 >> 172.21.15.17:0/2233358437 conn(0x55f851c00dc0 msgr2=0x55f851c011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- 172.21.15.17:0/2233358437 shutdown_connections 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- 172.21.15.17:0/2233358437 wait complete. 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.972+0000 7fbff03c8740 1 -- start start 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 Processor -- start 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c17320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f851c0e300 con 0x55f851c06240 2024-03-16T10:52:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f851b26230 con 0x55f851c0b3b0 2024-03-16T10:52:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f851c0e480 con 0x55f851c05850 2024-03-16T10:52:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49608/0 (socket says 172.21.15.17:49608) 2024-03-16T10:52:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe67fc640 1 -- 172.21.15.17:0/3935798261 learned_addr learned my addr 172.21.15.17:0/3935798261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbff03c8740 10 client.0 _ll_register_callbacks cb 0x55f851b62010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:01.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c17320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 -- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 msgr2=0x55f851c0fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 -- 172.21.15.17:0/3935798261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 msgr2=0x55f851c102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe77fe640 1 -- 172.21.15.17:0/3935798261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f851b35100 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.973+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfe77fe640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c17320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0037040 tx=0x7fbfe002c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316ab074e12396cf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe004c030 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe0032c90 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbfe003f470 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbfe0043070 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbff03c8740 10 client.25670 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f85187e3f0 con 0x55f851c0b3b0 2024-03-16T10:52:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.974+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfe0032c90 con 0x55f851c0b3b0 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbfe0048570 con 0x55f851c0b3b0 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 10 client.25670 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 10 client.25670 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 20 client.25670 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c1b810 0x55f851c1dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 4 client.25670 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f851b779d0 con 0x55f851c1b810 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c1b810 0x55f851c1dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c1b810 0x55f851c1dc00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8186f0d7fe4276d8 server_cookie=c4adab79b8f617da in_seq=0 out_seq=0 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.975+0000 7fbfcaff5640 10 client.25670 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.976+0000 7fbfcaff5640 1 -- 172.21.15.17:0/3935798261 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f851b779d0 con 0x55f851c1b810 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.976+0000 7fbfcaff5640 10 client.25670 handle_command_reply: tid=0 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.976+0000 7fbff03c8740 1 client.25670 shutdown 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.976+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 msgr2=0x55f851c17320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.976+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c17320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0037040 tx=0x7fbfe002c770 comp rx=0 tx=0).stop 2024-03-16T10:52:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 shutdown_connections 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c0b3b0 0x55f851c17320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c06240 0x55f851c102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c1b810 0x55f851c1dc00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 --2- 172.21.15.17:0/3935798261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 >> 172.21.15.17:0/3935798261 conn(0x55f851c00dc0 msgr2=0x55f851bfffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbfcaff5640 0 client.25670 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 shutdown_connections 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 1 -- 172.21.15.17:0/3935798261 wait complete. 2024-03-16T10:52:01.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:01.977+0000 7fbff03c8740 20 client.25670 trim_cache size 0 max 16384 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 Processor -- start 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 -- start start 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c172e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 0x55f851c0f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400e330 con 0x55f851c0b3b0 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400fe70 con 0x55f851c06240 2024-03-16T10:52:02.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbff03c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400ea00 con 0x55f851c05850 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 0x55f851c0f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 0x55f851c0f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49622/0 (socket says 172.21.15.17:49622) 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe77fe640 1 -- 172.21.15.17:0/4136672090 learned_addr learned my addr 172.21.15.17:0/4136672090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/4136672090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 msgr2=0x55f851c172e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c172e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/4136672090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 msgr2=0x55f851c0f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 0x55f851c0f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.003+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/4136672090 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8519487d0 con 0x55f851c05850 2024-03-16T10:52:02.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.004+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0f090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55f851c1e3a0 tx=0x7fbfd801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de088adc8d8aaf20 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.004+0000 7fbfccff9640 1 -- 172.21.15.17:0/4136672090 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8029b10 con 0x55f851c05850 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.004+0000 7fbfccff9640 1 -- 172.21.15.17:0/4136672090 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd8029cb0 con 0x55f851c05850 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.004+0000 7fbfccff9640 1 -- 172.21.15.17:0/4136672090 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8029590 con 0x55f851c05850 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- 172.21.15.17:0/4136672090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 msgr2=0x55f851c0f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0f090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55f851c1e3a0 tx=0x7fbfd801a000 comp rx=0 tx=0).stop 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- 172.21.15.17:0/4136672090 shutdown_connections 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c0b3b0 0x55f851c0f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c172e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- 172.21.15.17:0/4136672090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c05850 0x55f851c0f090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- 172.21.15.17:0/4136672090 >> 172.21.15.17:0/4136672090 conn(0x55f851c00dc0 msgr2=0x55f851c0fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- 172.21.15.17:0/4136672090 shutdown_connections 2024-03-16T10:52:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- 172.21.15.17:0/4136672090 wait complete. 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 -- start start 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 Processor -- start 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.005+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c13a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbff03c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c0b3b0 0x55f851c13f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbff03c8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400f7a0 con 0x55f851c05850 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbff03c8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400f0d0 con 0x55f851c06240 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbff03c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd400c310 con 0x55f851c0b3b0 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbff03c8740 10 client.0 _ll_register_callbacks cb 0x7fbfd80096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49634/0 (socket says 172.21.15.17:49634) 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/2293497395 learned_addr learned my addr 172.21.15.17:0/2293497395 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c13a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c0b3b0 0x55f851c13f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c0b3b0 msgr2=0x55f851c13f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c0b3b0 0x55f851c13f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/2293497395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 msgr2=0x55f851c13a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c13a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 -- 172.21.15.17:0/2293497395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f851c144b0 con 0x55f851c05850 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c13a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfe6ffd640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009670 tx=0x7fbfd80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dab6d2a6ca4f48 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.006+0000 7fbfcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8011c50 con 0x55f851c05850 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbfd8029330 con 0x55f851c05850 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd8029cb0 con 0x55f851c05850 2024-03-16T10:52:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbfd8011df0 con 0x55f851c05850 2024-03-16T10:52:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbff03c8740 10 client.15795 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f851c80a20 con 0x55f851c05850 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.007+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd8029cb0 con 0x55f851c05850 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbfd80046c0 con 0x55f851c05850 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 10 client.15795 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 20 client.15795 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:02.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c81300 0x55f851c83720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 4 client.15795 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f851b71d20 con 0x55f851c81300 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c81300 0x55f851c83720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfcaff5640 10 client.15795 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfe67fc640 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c81300 0x55f851c83720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae2589170c032578 server_cookie=827956b84e758a90 in_seq=0 out_seq=0 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfcaff5640 1 -- 172.21.15.17:0/2293497395 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f851b71d20 con 0x55f851c81300 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbfcaff5640 10 client.15795 handle_command_reply: tid=0 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.008+0000 7fbff03c8740 1 client.15795 shutdown 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 msgr2=0x55f851c16f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009670 tx=0x7fbfd80045c0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 shutdown_connections 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55f851c81300 0x55f851c83720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f851c0b3b0 0x55f851c13f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f851c06240 0x55f851c13a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbfcaff5640 0 client.15795 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 --2- 172.21.15.17:0/2293497395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f851c05850 0x55f851c16f90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 >> 172.21.15.17:0/2293497395 conn(0x55f851c00dc0 msgr2=0x55f851c048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 shutdown_connections 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 1 -- 172.21.15.17:0/2293497395 wait complete. 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbff03c8740 20 client.15795 trim_cache size 0 max 16384 2024-03-16T10:52:02.014 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 msgr2=0x7fbfd00a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 0x7fbfd00a4e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f851c06640 tx=0x7fbfd8005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 msgr2=0x7fbfe8106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.009+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00e9c0 tx=0x7fbfdc00ee80 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 shutdown_connections 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfd00a2990 0x7fbfd00a4e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfe81011c0 0x7fbfe8102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfe8100800 0x7fbfe8106920 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 --2- 172.21.15.17:0/859692229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbfe80ffaa0 0x7fbfe81063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 >> 172.21.15.17:0/859692229 conn(0x7fbfe80fb3d0 msgr2=0x7fbfe80fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 shutdown_connections 2024-03-16T10:52:02.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.010+0000 7fbfed7df640 1 -- 172.21.15.17:0/859692229 wait complete. 2024-03-16T10:52:02.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T10:52:02.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 -- 172.21.15.17:0/1783604316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81013b0 msgr2=0x7f18c8101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/1783604316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81013b0 0x7f18c8101830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ca0 tx=0x7f18c002c100 comp rx=0 tx=0).stop 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 -- 172.21.15.17:0/1783604316 shutdown_connections 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/1783604316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81013b0 0x7f18c8101830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/1783604316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/1783604316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81000b0 0x7f18c81004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 -- 172.21.15.17:0/1783604316 >> 172.21.15.17:0/1783604316 conn(0x7f18c80fbc70 msgr2=0x7f18c80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 -- 172.21.15.17:0/1783604316 shutdown_connections 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.130+0000 7f18cd9c4640 1 -- 172.21.15.17:0/1783604316 wait complete. 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 Processor -- start 2024-03-16T10:52:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 -- start start 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 0x7f18c81a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f630 con 0x7f18c8100a10 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f4b0 con 0x7f18c81000b0 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18cd9c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f7b0 con 0x7f18c81013b0 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18c67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36824/0 (socket says 172.21.15.17:36824) 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18c6ffd640 1 -- 172.21.15.17:0/13329912 learned_addr learned my addr 172.21.15.17:0/13329912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.131+0000 7f18c77fe640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 0x7f18c81a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 -- 172.21.15.17:0/13329912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 msgr2=0x7f18c81a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 0x7f18c81a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 -- 172.21.15.17:0/13329912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 msgr2=0x7f18c8199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 -- 172.21.15.17:0/13329912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81a18f0 con 0x7f18c8100a10 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c77fe640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 0x7f18c81a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18c67fc640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c819a1f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18cc9c2640 1 -- 172.21.15.17:0/13329912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00ccc0 con 0x7f18c8100a10 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18cc9c2640 1 -- 172.21.15.17:0/13329912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18bc010910 con 0x7f18c8100a10 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c81a1be0 con 0x7f18c8100a10 2024-03-16T10:52:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.132+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81a2180 con 0x7f18c8100a10 2024-03-16T10:52:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.133+0000 7f18cc9c2640 1 -- 172.21.15.17:0/13329912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc018960 con 0x7f18c8100a10 2024-03-16T10:52:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.135+0000 7f18d05af740 1 Processor -- start 2024-03-16T10:52:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.135+0000 7f18d05af740 1 -- start start 2024-03-16T10:52:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a291050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a34a1e5490 con 0x55a34a289060 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a34a18dc90 con 0x55a34a289a50 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18d05af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a34a1e1530 con 0x55a34a28ebc0 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49678/0 (socket says 172.21.15.17:49678) 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c77fe640 1 -- 172.21.15.17:0/4121170257 learned_addr learned my addr 172.21.15.17:0/4121170257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 -- 172.21.15.17:0/4121170257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 msgr2=0x55a34a291050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T10:52:02.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a291050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 -- 172.21.15.17:0/4121170257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 msgr2=0x55a34a289480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 -- 172.21.15.17:0/4121170257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34a248500 con 0x55a34a289a50 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c77fe640 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28e550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18c819ab80 tx=0x7f18b80119a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c99403bf02d0d65 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.136+0000 7f18cc9c2640 1 -- 172.21.15.17:0/13329912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f18bc010ac0 con 0x7f18c8100a10 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18adffb640 1 -- 172.21.15.17:0/4121170257 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8004030 con 0x55a34a289a50 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18adffb640 1 -- 172.21.15.17:0/4121170257 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b8005500 con 0x55a34a289a50 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18adffb640 1 -- 172.21.15.17:0/4121170257 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b80035f0 con 0x55a34a289a50 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18cc9c2640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 0x7f18b00a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18d05af740 1 -- 172.21.15.17:0/4121170257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 msgr2=0x55a34a28e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.137+0000 7f18d05af740 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28e550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18c819ab80 tx=0x7f18b80119a0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18cc9c2640 1 -- 172.21.15.17:0/13329912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f18bc0cee90 con 0x7f18c8100a10 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18c77fe640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 0x7f18b00a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18c77fe640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 0x7f18b00a4c30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f18c0032530 tx=0x7f18c0032590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 -- 172.21.15.17:0/4121170257 shutdown_connections 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a291050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28e550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 --2- 172.21.15.17:0/4121170257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a289480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 -- 172.21.15.17:0/4121170257 >> 172.21.15.17:0/4121170257 conn(0x55a34a27bdc0 msgr2=0x55a34a27c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 -- 172.21.15.17:0/4121170257 shutdown_connections 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.138+0000 7f18d05af740 1 -- 172.21.15.17:0/4121170257 wait complete. 2024-03-16T10:52:02.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.139+0000 7f18d05af740 1 -- start start 2024-03-16T10:52:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.139+0000 7f18d05af740 1 Processor -- start 2024-03-16T10:52:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.139+0000 7f18d05af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a282960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a287990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a34a280950 con 0x55a34a289060 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49692/0 (socket says 172.21.15.17:49692) 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 -- 172.21.15.17:0/751323463 learned_addr learned my addr 172.21.15.17:0/751323463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a34a1a1230 con 0x55a34a289a50 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a34a280ad0 con 0x55a34a28ebc0 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c67fc640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a282960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18d05af740 10 client.0 _ll_register_callbacks cb 0x55a34a1dd010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c77fe640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a287990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 -- 172.21.15.17:0/751323463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 msgr2=0x55a34a287990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a287990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 -- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 msgr2=0x55a34a282960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a282960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34a1b0100 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009620 tx=0x7f18b8004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ece5b8fe08385a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.140+0000 7f18a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8028020 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f18b8016040 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18b8005500 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18b8009cd0 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 10 client.15807 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a349ef93f0 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b8005500 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f18b8003bf0 con 0x55a34a289060 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 10 client.15807 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 10 client.15807 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:52:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.141+0000 7f18d05af740 20 client.15807 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a2aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18d05af740 4 client.15807 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a34a1f29d0 con 0x55a34a2a7bd0 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18c67fc640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a2aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18a6ffd640 10 client.15807 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.142+0000 7f18c67fc640 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a2aa050 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=186c6bfe8a9b512 server_cookie=dd97abfeaadea880 in_seq=0 out_seq=0 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18a6ffd640 1 -- 172.21.15.17:0/751323463 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a34a1f29d0 con 0x55a34a2a7bd0 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18a6ffd640 10 client.15807 handle_command_reply: tid=0 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18d05af740 1 client.15807 shutdown 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 msgr2=0x55a34a282420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009620 tx=0x7f18b8004e50 comp rx=0 tx=0).stop 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 shutdown_connections 2024-03-16T10:52:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.143+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a287990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a2aa050 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a282960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18a6ffd640 0 client.15807 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 --2- 172.21.15.17:0/751323463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a282420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 >> 172.21.15.17:0/751323463 conn(0x55a34a27bdc0 msgr2=0x55a34a27afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 shutdown_connections 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 1 -- 172.21.15.17:0/751323463 wait complete. 2024-03-16T10:52:02.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.144+0000 7f18d05af740 20 client.15807 trim_cache size 0 max 16384 2024-03-16T10:52:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18d05af740 1 Processor -- start 2024-03-16T10:52:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18d05af740 1 -- start start 2024-03-16T10:52:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18d05af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18d05af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18d05af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a28b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.171+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49698/0 (socket says 172.21.15.17:49698) 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36848/0 (socket says 172.21.15.17:36848) 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c6ffd640 1 -- 172.21.15.17:0/1619908371 learned_addr learned my addr 172.21.15.17:0/1619908371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a68b0 con 0x55a34a289060 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a83f0 con 0x55a34a289a50 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c77fe640 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a28b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a6f80 con 0x55a34a28ebc0 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 -- 172.21.15.17:0/1619908371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 msgr2=0x55a34a28b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a28b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 -- 172.21.15.17:0/1619908371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 msgr2=0x55a34a287950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c67fc640 1 -- 172.21.15.17:0/1619908371 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a349fc37d0 con 0x55a34a289a50 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.172+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.173+0000 7f18c67fc640 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0cc840 tx=0x7f18bc00ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df6056605e0fcf03 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.173+0000 7f18ad7fa640 1 -- 172.21.15.17:0/1619908371 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0b4070 con 0x55a34a289a50 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.173+0000 7f18ad7fa640 1 -- 172.21.15.17:0/1619908371 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18bc099820 con 0x55a34a289a50 2024-03-16T10:52:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.173+0000 7f18ad7fa640 1 -- 172.21.15.17:0/1619908371 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc09ae30 con 0x55a34a289a50 2024-03-16T10:52:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 msgr2=0x55a34a28b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0cc840 tx=0x7f18bc00ce60 comp rx=0 tx=0).stop 2024-03-16T10:52:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 shutdown_connections 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a28ebc0 0x55a34a28b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289a50 0x55a34a28b130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 --2- 172.21.15.17:0/1619908371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a289060 0x55a34a287950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 >> 172.21.15.17:0/1619908371 conn(0x55a34a27bdc0 msgr2=0x55a34a27c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 shutdown_connections 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- 172.21.15.17:0/1619908371 wait complete. 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 -- start start 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.174+0000 7f18d05af740 1 Processor -- start 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a289a50 0x55a34a2b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 0x55a34a30b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a7d20 con 0x55a34a28ebc0 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a7650 con 0x55a34a289060 2024-03-16T10:52:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81a48b0 con 0x55a34a289a50 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 10 client.0 _ll_register_callbacks cb 0x7f18bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36858/0 (socket says 172.21.15.17:36858) 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 -- 172.21.15.17:0/2281174140 learned_addr learned my addr 172.21.15.17:0/2281174140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c77fe640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 0x55a34a30b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 -- 172.21.15.17:0/2281174140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a289a50 msgr2=0x55a34a2b8430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a289a50 0x55a34a2b8430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 -- 172.21.15.17:0/2281174140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 msgr2=0x55a34a30b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 0x55a34a30b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 -- 172.21.15.17:0/2281174140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34a2b8aa0 con 0x55a34a289060 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c77fe640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 0x55a34a30b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18c6ffd640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009250 tx=0x7f18b800fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd6821de49756ee server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b803b020 con 0x55a34a289060 2024-03-16T10:52:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f18b8004880 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.175+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18bc099820 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18b80051d0 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 10 client.25694 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a34a30cf40 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b80035f0 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f18b8019450 con 0x55a34a289060 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 10 client.25694 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 10 client.25694 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 20 client.25694 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a30f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 4 client.25694 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f18bc099820 con 0x55a34a2a7bd0 2024-03-16T10:52:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.176+0000 7f18c67fc640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a30f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18a6ffd640 10 client.25694 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18c67fc640 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a30f9b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0cb83611f131ac server_cookie=9b6f3a76d9143661 in_seq=0 out_seq=0 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18a6ffd640 1 -- 172.21.15.17:0/2281174140 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f18bc099820 con 0x55a34a2a7bd0 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18a6ffd640 10 client.25694 handle_command_reply: tid=0 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 client.25694 shutdown 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 msgr2=0x55a34a2b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009250 tx=0x7f18b800fb40 comp rx=0 tx=0).stop 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 shutdown_connections 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a34a28ebc0 0x55a34a30b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a34a289a50 0x55a34a2b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55a34a2a7bd0 0x55a34a30f9b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18a6ffd640 0 client.25694 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 --2- 172.21.15.17:0/2281174140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a34a289060 0x55a34a2b7ef0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 >> 172.21.15.17:0/2281174140 conn(0x55a34a27bdc0 msgr2=0x55a34a28b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.177+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 shutdown_connections 2024-03-16T10:52:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18d05af740 1 -- 172.21.15.17:0/2281174140 wait complete. 2024-03-16T10:52:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18d05af740 20 client.25694 trim_cache size 0 max 16384 2024-03-16T10:52:02.184 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 msgr2=0x7f18b00a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 0x7f18b00a4c30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f18c0032530 tx=0x7f18c0032590 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 msgr2=0x7f18c819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c819a1f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00eeb0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 shutdown_connections 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f18b00a2770 0x7f18b00a4c30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18c81013b0 0x7f18c81a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18c8100a10 0x7f18c819a1f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 --2- 172.21.15.17:0/13329912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c81000b0 0x7f18c8199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.178+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 >> 172.21.15.17:0/13329912 conn(0x7f18c80fbc70 msgr2=0x7f18c80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.179+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 shutdown_connections 2024-03-16T10:52:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.179+0000 7f18cd9c4640 1 -- 172.21.15.17:0/13329912 wait complete. 2024-03-16T10:52:02.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 -- 172.21.15.17:0/2846764268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 msgr2=0x7f8e10109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 --2- 172.21.15.17:0/2846764268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e10109970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009be0 tx=0x7f8e0802bf10 comp rx=0 tx=0).stop 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 -- 172.21.15.17:0/2846764268 shutdown_connections 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 --2- 172.21.15.17:0/2846764268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e10109970 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 --2- 172.21.15.17:0/2846764268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e10107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 --2- 172.21.15.17:0/2846764268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 -- 172.21.15.17:0/2846764268 >> 172.21.15.17:0/2846764268 conn(0x7f8e100fbc70 msgr2=0x7f8e100fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 -- 172.21.15.17:0/2846764268 shutdown_connections 2024-03-16T10:52:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.308+0000 7f8e14a61640 1 -- 172.21.15.17:0/2846764268 wait complete. 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.309+0000 7f8e14a61640 1 Processor -- start 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.309+0000 7f8e14a61640 1 -- start start 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.309+0000 7f8e14a61640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.309+0000 7f8e14a61640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.309+0000 7f8e14a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e101a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e14a61640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010d490 con 0x7f8e10107580 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e14a61640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010d310 con 0x7f8e10104c50 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e14a61640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010d610 con 0x7f8e10102320 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0dd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0dd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36880/0 (socket says 172.21.15.17:36880) 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/911042622 learned_addr learned my addr 172.21.15.17:0/911042622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e101a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 -- 172.21.15.17:0/911042622 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 msgr2=0x7f8e1019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 -- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 msgr2=0x7f8e101a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e101a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0e59c640 1 -- 172.21.15.17:0/911042622 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e101a1950 con 0x7f8e10102320 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.310+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e101a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8e0e59c640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10199d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009fd0 tx=0x7f8e0000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8dff7fe640 1 -- 172.21.15.17:0/911042622 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000ccc0 con 0x7f8e10102320 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e101a1c40 con 0x7f8e10102320 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8dff7fe640 1 -- 172.21.15.17:0/911042622 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0000ee70 con 0x7f8e10102320 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8dff7fe640 1 -- 172.21.15.17:0/911042622 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00004a00 con 0x7f8e10102320 2024-03-16T10:52:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.311+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101a2190 con 0x7f8e10102320 2024-03-16T10:52:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 Processor -- start 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 -- start start 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8dff7fe640 1 -- 172.21.15.17:0/911042622 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7f8e00004ba0 con 0x7f8e10102320 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969c240 0x55f6396a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f639600490 con 0x55f6396a13b0 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f6395a8c90 con 0x55f63969c240 2024-03-16T10:52:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.315+0000 7f8e17651740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6395fc530 con 0x55f63969b850 2024-03-16T10:52:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969c240 0x55f6396a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44700/0 (socket says 172.21.15.17:44700) 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/3568230432 learned_addr learned my addr 172.21.15.17:0/3568230432 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/3568230432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969c240 msgr2=0x55f6396a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969c240 0x55f6396a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/3568230432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 msgr2=0x55f6396a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/3568230432 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f639663500 con 0x55f63969b850 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8dff7fe640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 0x7f8df80a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.316+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e0802e010 tx=0x7f8e08005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6e8c6d09d11fcb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.317+0000 7f8dff7fe640 1 -- 172.21.15.17:0/911042622 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8e000cea40 con 0x7f8e10102320 2024-03-16T10:52:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.317+0000 7f8e0e59c640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 0x7f8df80a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.317+0000 7f8dfcff9640 1 -- 172.21.15.17:0/3568230432 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08045070 con 0x55f63969b850 2024-03-16T10:52:02.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.317+0000 7f8dfcff9640 1 -- 172.21.15.17:0/3568230432 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0802c8b0 con 0x55f63969b850 2024-03-16T10:52:02.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.317+0000 7f8dfcff9640 1 -- 172.21.15.17:0/3568230432 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08004020 con 0x55f63969b850 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 -- 172.21.15.17:0/3568230432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 msgr2=0x55f63969bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e0802e010 tx=0x7f8e08005eb0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e0e59c640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 0x7f8df80a4dd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55f63969ccb0 tx=0x7f8e000053b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 -- 172.21.15.17:0/3568230432 shutdown_connections 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969c240 0x55f6396a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 --2- 172.21.15.17:0/3568230432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969b850 0x55f63969bc70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.318+0000 7f8e17651740 1 -- 172.21.15.17:0/3568230432 >> 172.21.15.17:0/3568230432 conn(0x55f639696dc0 msgr2=0x55f6396971c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.319+0000 7f8e17651740 1 -- 172.21.15.17:0/3568230432 shutdown_connections 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.319+0000 7f8e17651740 1 -- 172.21.15.17:0/3568230432 wait complete. 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.319+0000 7f8e17651740 1 -- start start 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.319+0000 7f8e17651740 1 Processor -- start 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36890/0 (socket says 172.21.15.17:36890) 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/4087526319 learned_addr learned my addr 172.21.15.17:0/4087526319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f6396a4300 con 0x55f6396a13b0 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f6395bc230 con 0x55f63969b850 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.320+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6396a4480 con 0x55f63969c240 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/4087526319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 msgr2=0x55f6396a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/4087526319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 msgr2=0x55f6396ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6395cb100 con 0x55f63969b850 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e08004af0 tx=0x7f8e080039e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940b9bf83c2da2bc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8df5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e17651740 10 client.0 _ll_register_callbacks cb 0x55f6395f8010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8df5ffb640 1 -- 172.21.15.17:0/4087526319 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08045040 con 0x55f63969b850 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e0802c8b0 con 0x55f63969b850 2024-03-16T10:52:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.321+0000 7f8df5ffb640 1 -- 172.21.15.17:0/4087526319 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8e08034630 con 0x55f63969b850 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8df5ffb640 1 -- 172.21.15.17:0/4087526319 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e08034830 con 0x55f63969b850 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 10 client.25706 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55f6393143f0 con 0x55f63969b850 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8df5ffb640 1 -- 172.21.15.17:0/4087526319 <== mon.2 v2:172.21.15.111:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8e080349d0 con 0x55f63969b850 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 10 client.25706 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 20 client.25706 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f6396b1360 0x55f6396b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 4 client.25706 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.323+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8e0802c8b0 con 0x55f6396b1360 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.324+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f6396b1360 0x55f6396b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.324+0000 7f8df5ffb640 10 client.25706 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:02.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.324+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f6396b1360 0x55f6396b37d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9216353117a5d48e server_cookie=e3bcd6f4f6993d8f in_seq=0 out_seq=0 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8df5ffb640 1 -- 172.21.15.17:0/4087526319 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f8e0802c8b0 con 0x55f6396b1360 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8df5ffb640 10 client.25706 handle_command_reply: tid=0 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 client.25706 shutdown 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 msgr2=0x55f6396a5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e08004af0 tx=0x7f8e080039e0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 shutdown_connections 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f6396b1360 0x55f6396b37d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396a13b0 0x55f6396ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8df5ffb640 0 client.25706 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 --2- 172.21.15.17:0/4087526319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396a5d70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.325+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 >> 172.21.15.17:0/4087526319 conn(0x55f639696dc0 msgr2=0x55f639695fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.326+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 shutdown_connections 2024-03-16T10:52:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.326+0000 7f8e17651740 1 -- 172.21.15.17:0/4087526319 wait complete. 2024-03-16T10:52:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.326+0000 7f8e17651740 20 client.25706 trim_cache size 0 max 16384 2024-03-16T10:52:02.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.352+0000 7f8e17651740 1 Processor -- start 2024-03-16T10:52:02.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.352+0000 7f8e17651740 1 -- start start 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49742/0 (socket says 172.21.15.17:49742) 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/1583688714 learned_addr learned my addr 172.21.15.17:0/1583688714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f6396a13b0 0x55f6396a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101aac10 con 0x55f63969b850 2024-03-16T10:52:02.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101ac750 con 0x55f6396a13b0 2024-03-16T10:52:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.353+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101ab2e0 con 0x55f63969c240 2024-03-16T10:52:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f6396a13b0 0x55f6396a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/1583688714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f6396a13b0 msgr2=0x55f6396a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f6396a13b0 0x55f6396a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/1583688714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 msgr2=0x55f6396a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/1583688714 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6396ae090 con 0x55f63969c240 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396ad270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f639697d00 tx=0x7f8e04005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980a7574cd233a52 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.354+0000 7f8df7fff640 1 -- 172.21.15.17:0/1583688714 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04004020 con 0x55f63969c240 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8df7fff640 1 -- 172.21.15.17:0/1583688714 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e04024030 con 0x55f63969c240 2024-03-16T10:52:02.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8df7fff640 1 -- 172.21.15.17:0/1583688714 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400fbd0 con 0x55f63969c240 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 msgr2=0x55f6396ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8e17651740 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396ad270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f639697d00 tx=0x7f8e04005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 shutdown_connections 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.355+0000 7f8e17651740 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f6396a13b0 0x55f6396a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f63969c240 0x55f6396ad270 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f639697d00 tx=0x7f8e04005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 --2- 172.21.15.17:0/1583688714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f63969b850 0x55f6396a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 >> 172.21.15.17:0/1583688714 conn(0x55f639696dc0 msgr2=0x55f6396971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 shutdown_connections 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 -- 172.21.15.17:0/1583688714 wait complete. 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 -- start start 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.356+0000 7f8e17651740 1 Processor -- start 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396aad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 0x55f6396ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396b1360 0x55f6396ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101ac080 con 0x55f6396b1360 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101ab9b0 con 0x55f63969b850 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101a8c40 con 0x55f6396a13b0 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e17651740 10 client.0 _ll_register_callbacks cb 0x7f8e08009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 0x55f6396ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0ed9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36896/0 (socket says 172.21.15.17:36896) 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0ed9d640 1 -- 172.21.15.17:0/998528135 learned_addr learned my addr 172.21.15.17:0/998528135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396b1360 0x55f6396ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 msgr2=0x55f6396aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/998528135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396b1360 msgr2=0x55f6396ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396b1360 0x55f6396ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 -- 172.21.15.17:0/998528135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6393de7d0 con 0x55f6396a13b0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8e0dd9b640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 0x55f6396ab2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011000 tx=0x7f8e04012930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c9c2f25f173b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.357+0000 7f8df5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400fb50 con 0x55f6396a13b0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e04024030 con 0x55f6396a13b0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8e0400fcf0 con 0x55f6396a13b0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e04005020 con 0x55f6396a13b0 2024-03-16T10:52:02.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8e17651740 10 client.25663 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f639717870 con 0x55f6396a13b0 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e04024030 con 0x55f6396a13b0 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.358+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8e04020620 con 0x55f6396a13b0 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 10 client.25663 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 10 client.25663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 20 client.25663 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f639718110 0x55f63971a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 4 client.25663 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f63960d9d0 con 0x55f639718110 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f639718110 0x55f63971a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8df5ffb640 10 client.25663 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.359+0000 7f8e0ed9d640 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f639718110 0x55f63971a500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549419d5bc095737 server_cookie=f4a8750f6c9c9213 in_seq=0 out_seq=0 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8df5ffb640 1 -- 172.21.15.17:0/998528135 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f63960d9d0 con 0x55f639718110 2024-03-16T10:52:02.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8df5ffb640 10 client.25663 handle_command_reply: tid=0 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 client.25663 shutdown 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 msgr2=0x55f6396ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 0x55f6396ab2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011000 tx=0x7f8e04012930 comp rx=0 tx=0).stop 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 shutdown_connections 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55f639718110 0x55f63971a500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8df5ffb640 0 client.25663 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f6396b1360 0x55f6396ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6396a13b0 0x55f6396ab2d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 --2- 172.21.15.17:0/998528135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f63969b850 0x55f6396aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 >> 172.21.15.17:0/998528135 conn(0x55f639696dc0 msgr2=0x55f63969d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 shutdown_connections 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 1 -- 172.21.15.17:0/998528135 wait complete. 2024-03-16T10:52:02.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.360+0000 7f8e17651740 20 client.25663 trim_cache size 0 max 16384 2024-03-16T10:52:02.366 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:02.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 msgr2=0x7f8df80a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 0x7f8df80a4dd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55f63969ccb0 tx=0x7f8e000053b0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 msgr2=0x7f8e10199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10199d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009fd0 tx=0x7f8e0000ec20 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 shutdown_connections 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8df80a2910 0x7f8df80a4dd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10107580 0x7f8e101a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e10104c50 0x7f8e1019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 --2- 172.21.15.17:0/911042622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e10102320 0x7f8e10199d40 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009fd0 tx=0x7f8e0000ec20 comp rx=0 tx=0).stop 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 >> 172.21.15.17:0/911042622 conn(0x7f8e100fbc70 msgr2=0x7f8e101019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 shutdown_connections 2024-03-16T10:52:02.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:02.361+0000 7f8e14a61640 1 -- 172.21.15.17:0/911042622 wait complete. 2024-03-16T10:52:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:02 smithi017 ceph-mon[32078]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:02 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2348623406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:02 smithi111 ceph-mon[36315]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:02 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2348623406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:02.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:02 smithi174 ceph-mon[36202]: pgmap v387: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:02.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:02 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2348623406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:03.376 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T10:52:03.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:52:03.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T10:52:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/858418463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 msgr2=0x7fa7a8105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/858418463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a8105820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009be0 tx=0x7fa7a002bef0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/858418463 shutdown_connections 2024-03-16T10:52:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/858418463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a8105820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/858418463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a81029f0 0x7fa7a8104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/858418463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a8100080 0x7fa7a81024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/858418463 >> 172.21.15.17:0/858418463 conn(0x7fa7a80fbca0 msgr2=0x7fa7a80fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/858418463 shutdown_connections 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.494+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/858418463 wait complete. 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.495+0000 7fa7ae6b2640 1 Processor -- start 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.495+0000 7fa7ae6b2640 1 -- start start 2024-03-16T10:52:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 0x7fa7a810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49780/0 (socket says 172.21.15.17:49780) 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7a7fff640 1 -- 172.21.15.17:0/3173569992 learned_addr learned my addr 172.21.15.17:0/3173569992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a810d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 0x7fa7a810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8113ad0 con 0x7fa7a8100080 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8113950 con 0x7fa7a81053a0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8113c50 con 0x7fa7a81029f0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.496+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a810d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 -- 172.21.15.17:0/3173569992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 msgr2=0x7fa7a810d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a810d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 -- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 msgr2=0x7fa7a8110870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a81ae210 con 0x7fa7a81029f0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 0x7fa7a810d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa798005fd0 tx=0x7fa79800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.497+0000 7fa7a57fa640 1 -- 172.21.15.17:0/3173569992 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79800cd00 con 0x7fa7a81029f0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.498+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a81ae500 con 0x7fa7a81029f0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.498+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81aea70 con 0x7fa7a81029f0 2024-03-16T10:52:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.498+0000 7fa7a57fa640 1 -- 172.21.15.17:0/3173569992 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7980035f0 con 0x7fa7a81029f0 2024-03-16T10:52:03.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.498+0000 7fa7a57fa640 1 -- 172.21.15.17:0/3173569992 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798010690 con 0x7fa7a81029f0 2024-03-16T10:52:03.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.501+0000 7fa7a57fa640 1 -- 172.21.15.17:0/3173569992 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fa798004020 con 0x7fa7a81029f0 2024-03-16T10:52:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.501+0000 7fa7a57fa640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 0x7fa7900a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.502+0000 7fa7a57fa640 1 -- 172.21.15.17:0/3173569992 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa7980cec10 con 0x7fa7a81029f0 2024-03-16T10:52:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.502+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 0x7fa7900a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.505+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 0x7fa7900a4e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0104e0 tx=0x7fa79c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7b137f740 1 Processor -- start 2024-03-16T10:52:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7b137f740 1 -- start start 2024-03-16T10:52:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44772/0 (socket says 172.21.15.17:44772) 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49788/0 (socket says 172.21.15.17:49788) 2024-03-16T10:52:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1191646158 learned_addr learned my addr 172.21.15.17:0/1191646158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.510+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9dfe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572e9d5ba40 con 0x5572e9df6d30 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5572e9d04920 con 0x5572e9dfbea0 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572e9d57ae0 con 0x5572e9df6340 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9dfe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1191646158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 msgr2=0x5572e9dfe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9dfe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1191646158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 msgr2=0x5572e9dfb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1191646158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e9d1c460 con 0x5572e9df6340 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0118f0 tx=0x7fa79c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58868a1c6fcf2d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa78e7fc640 1 -- 172.21.15.17:0/1191646158 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01cac0 con 0x5572e9df6340 2024-03-16T10:52:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa78e7fc640 1 -- 172.21.15.17:0/1191646158 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa79c01cc60 con 0x5572e9df6340 2024-03-16T10:52:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.511+0000 7fa78e7fc640 1 -- 172.21.15.17:0/1191646158 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01d5d0 con 0x5572e9df6340 2024-03-16T10:52:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.512+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 msgr2=0x5572e9df6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.512+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0118f0 tx=0x7fa79c013000 comp rx=0 tx=0).stop 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 shutdown_connections 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9dfe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9dfb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1191646158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9df6760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 >> 172.21.15.17:0/1191646158 conn(0x5572e9df18b0 msgr2=0x5572e9df1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 shutdown_connections 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 -- 172.21.15.17:0/1191646158 wait complete. 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.513+0000 7fa7b137f740 1 -- start start 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7b137f740 1 Processor -- start 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6d30 0x5572e9e00b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7a7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36928/0 (socket says 172.21.15.17:36928) 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7acc4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7acc4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49794/0 (socket says 172.21.15.17:49794) 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.514+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6d30 0x5572e9e00b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1817640751 learned_addr learned my addr 172.21.15.17:0/1817640751 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5572e9dfee50 con 0x5572e9dfbea0 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5572e9d17d70 con 0x5572e9df6340 2024-03-16T10:52:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572e9dfefd0 con 0x5572e9df6d30 2024-03-16T10:52:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1817640751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6d30 msgr2=0x5572e9e00b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6d30 0x5572e9e00b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1817640751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 msgr2=0x5572e9e07b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e9a70210 con 0x5572e9df6340 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7b137f740 10 client.0 _ll_register_callbacks cb 0x5572e9a6fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.515+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01eb40 tx=0x7fa79c01ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728a3935573ca7b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa79c01cc60 con 0x5572e9df6340 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7877fe640 10 client.25724 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7877fe640 1 -- 172.21.15.17:0/1817640751 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c01e620 con 0x5572e9df6340 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7877fe640 1 -- 172.21.15.17:0/1817640751 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa79c01e7c0 con 0x5572e9df6340 2024-03-16T10:52:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7877fe640 1 -- 172.21.15.17:0/1817640751 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa79c027480 con 0x5572e9df6340 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7b137f740 10 client.25724 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5572e9b3c620 con 0x5572e9df6340 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.516+0000 7fa7877fe640 1 -- 172.21.15.17:0/1817640751 <== mon.2 v2:172.21.15.111:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa79c027620 con 0x5572e9df6340 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 10 client.25724 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 10 client.25724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 20 client.25724 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e0e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 4 client.25724 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa79c01cc60 con 0x5572e9e0bea0 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.517+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e0e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.518+0000 7fa7877fe640 10 client.25724 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.518+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e0e2f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5039c0a4be751e server_cookie=5c55c5d395081098 in_seq=0 out_seq=0 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.518+0000 7fa7877fe640 1 -- 172.21.15.17:0/1817640751 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fa79c01cc60 con 0x5572e9e0bea0 2024-03-16T10:52:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.518+0000 7fa7877fe640 10 client.25724 handle_command_reply: tid=0 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.519+0000 7fa7b137f740 1 client.25724 shutdown 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.519+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 msgr2=0x5572e9e005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.519+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01eb40 tx=0x7fa79c01ec10 comp rx=0 tx=0).stop 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.519+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 shutdown_connections 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.519+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e0e2f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7877fe640 0 client.25724 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9dfbea0 0x5572e9e07b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6d30 0x5572e9e00b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1817640751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e005e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 >> 172.21.15.17:0/1817640751 conn(0x5572e9df18b0 msgr2=0x5572e9df0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 shutdown_connections 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 1 -- 172.21.15.17:0/1817640751 wait complete. 2024-03-16T10:52:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.520+0000 7fa7b137f740 20 client.25724 trim_cache size 0 max 16384 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 -- 172.21.15.17:0/4277853767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 msgr2=0x7fb3b4110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/4277853767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b4110240 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009be0 tx=0x7fb3ac02bef0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 -- 172.21.15.17:0/4277853767 shutdown_connections 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/4277853767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b4110240 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/4277853767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/4277853767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b4108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 -- 172.21.15.17:0/4277853767 >> 172.21.15.17:0/4277853767 conn(0x7fb3b4076da0 msgr2=0x7fb3b40791e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 -- 172.21.15.17:0/4277853767 shutdown_connections 2024-03-16T10:52:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.545+0000 7fb3b9dab640 1 -- 172.21.15.17:0/4277853767 wait complete. 2024-03-16T10:52:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 Processor -- start 2024-03-16T10:52:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 -- start start 2024-03-16T10:52:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b41a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4113ab0 con 0x7fb3b41099b0 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4113930 con 0x7fb3b4108ff0 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b9dab640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b4113c30 con 0x7fb3b4107e00 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.546+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b41a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44794/0 (socket says 172.21.15.17:44794) 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b37fe640 1 -- 172.21.15.17:0/3448027787 learned_addr learned my addr 172.21.15.17:0/3448027787 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 -- 172.21.15.17:0/3448027787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 msgr2=0x7fb3b419e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 -- 172.21.15.17:0/3448027787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 msgr2=0x7fb3b419e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b419e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 -- 172.21.15.17:0/3448027787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b41a5c90 con 0x7fb3b41099b0 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b41a5620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac02c430 tx=0x7fb3ac0337b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.547+0000 7fb3b0ff9640 1 -- 172.21.15.17:0/3448027787 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac043020 con 0x7fb3b41099b0 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.548+0000 7fb3b0ff9640 1 -- 172.21.15.17:0/3448027787 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3ac003b80 con 0x7fb3b41099b0 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.548+0000 7fb3b0ff9640 1 -- 172.21.15.17:0/3448027787 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac034690 con 0x7fb3b41099b0 2024-03-16T10:52:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.548+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b41a5f20 con 0x7fb3b41099b0 2024-03-16T10:52:03.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.549+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b41a63e0 con 0x7fb3b41099b0 2024-03-16T10:52:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.551+0000 7fa7b137f740 1 Processor -- start 2024-03-16T10:52:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.551+0000 7fa7b137f740 1 -- start start 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.551+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e13c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.551+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49836/0 (socket says 172.21.15.17:49836) 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 -- 172.21.15.17:0/1585109097 learned_addr learned my addr 172.21.15.17:0/1585109097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9dfbea0 0x5572e9e001f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e13c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400e3e0 con 0x5572e9df6d30 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400ff20 con 0x5572e9df6340 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400eab0 con 0x5572e9dfbea0 2024-03-16T10:52:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9dfbea0 0x5572e9e001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fb3bc98a740 1 Processor -- start 2024-03-16T10:52:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fb3b0ff9640 1 -- 172.21.15.17:0/3448027787 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7fb3ac046020 con 0x7fb3b41099b0 2024-03-16T10:52:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 -- 172.21.15.17:0/1585109097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9dfbea0 msgr2=0x5572e9e001f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9dfbea0 0x5572e9e001f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fa7a77fe640 1 -- 172.21.15.17:0/1585109097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 msgr2=0x5572e9e13c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.552+0000 7fb3bc98a740 1 -- start start 2024-03-16T10:52:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e13c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fa7a77fe640 1 -- 172.21.15.17:0/1585109097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e9e01760 con 0x5572e9df6d30 2024-03-16T10:52:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e88990 0x55e650e88db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e8e4f0 0x55e650e90980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b2ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e88990 0x55e650e88db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa7980cc6f0 tx=0x7fa798097130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467309b3bb38f73f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44808/0 (socket says 172.21.15.17:44808) 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 -- 172.21.15.17:0/113197938 learned_addr learned my addr 172.21.15.17:0/113197938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e650ded0d0 con 0x55e650e8e4f0 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e650d95c70 con 0x55e650e88990 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e650de9170 con 0x55e650e89380 2024-03-16T10:52:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e8e4f0 0x55e650e90980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 -- 172.21.15.17:0/113197938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e88990 msgr2=0x55e650e88db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e88990 0x55e650e88db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 -- 172.21.15.17:0/113197938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e8e4f0 msgr2=0x55e650e90980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e8e4f0 0x55e650e90980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.553+0000 7fb3b37fe640 1 -- 172.21.15.17:0/113197938 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e650bc97e0 con 0x55e650e89380 2024-03-16T10:52:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800f470 tx=0x7fb3a800f930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f69dffbc23914b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fa78dffb640 1 -- 172.21.15.17:0/1585109097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798084070 con 0x5572e9df6d30 2024-03-16T10:52:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fa78dffb640 1 -- 172.21.15.17:0/1585109097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa798099850 con 0x5572e9df6d30 2024-03-16T10:52:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fa78dffb640 1 -- 172.21.15.17:0/1585109097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79809ac00 con 0x5572e9df6d30 2024-03-16T10:52:03.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fb399ffb640 1 -- 172.21.15.17:0/113197938 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8005220 con 0x55e650e89380 2024-03-16T10:52:03.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fb399ffb640 1 -- 172.21.15.17:0/113197938 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a80047a0 con 0x55e650e89380 2024-03-16T10:52:03.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.554+0000 7fb399ffb640 1 -- 172.21.15.17:0/113197938 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8010c60 con 0x55e650e89380 2024-03-16T10:52:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 msgr2=0x5572e9e07af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa7980cc6f0 tx=0x7fa798097130 comp rx=0 tx=0).stop 2024-03-16T10:52:03.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 msgr2=0x55e650e8de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800f470 tx=0x7fb3a800f930 comp rx=0 tx=0).stop 2024-03-16T10:52:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 shutdown_connections 2024-03-16T10:52:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9dfbea0 0x5572e9e001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e07af0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 --2- 172.21.15.17:0/1585109097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9df6340 0x5572e9e13c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 >> 172.21.15.17:0/1585109097 conn(0x5572e9df18b0 msgr2=0x5572e9df4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3b0ff9640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 0x7fb39c0a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 shutdown_connections 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e8e4f0 0x55e650e90980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e8de80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/113197938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e88990 0x55e650e88db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 >> 172.21.15.17:0/113197938 conn(0x55e650e50c50 msgr2=0x55e650e84300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 0x7fb39c0a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.555+0000 7fb3b0ff9640 1 -- 172.21.15.17:0/3448027787 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3ac0f03b0 con 0x7fb3b41099b0 2024-03-16T10:52:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 shutdown_connections 2024-03-16T10:52:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fa7b137f740 1 -- 172.21.15.17:0/1585109097 wait complete. 2024-03-16T10:52:03.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 0x7fb39c0a4cb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e650e89be0 tx=0x7fb3a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 shutdown_connections 2024-03-16T10:52:03.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fb3bc98a740 1 -- 172.21.15.17:0/113197938 wait complete. 2024-03-16T10:52:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fa7b137f740 1 -- start start 2024-03-16T10:52:03.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fb3bc98a740 1 -- start start 2024-03-16T10:52:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.556+0000 7fa7b137f740 1 Processor -- start 2024-03-16T10:52:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9e05220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fb3bc98a740 1 Processor -- start 2024-03-16T10:52:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400f850 con 0x5572e9df6d30 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400f180 con 0x5572e9dfbea0 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400c3c0 con 0x5572e9df6340 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7b137f740 10 client.0 _ll_register_callbacks cb 0x7fa7a0009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36964/0 (socket says 172.21.15.17:36964) 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 -- 172.21.15.17:0/2163131203 learned_addr learned my addr 172.21.15.17:0/2163131203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9e05220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 -- 172.21.15.17:0/2163131203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 msgr2=0x5572e9e05220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9e05220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 -- 172.21.15.17:0/2163131203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 msgr2=0x5572e9e05760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e05760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 -- 172.21.15.17:0/2163131203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e9e06d60 con 0x5572e9dfbea0 2024-03-16T10:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7a77fe640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e05760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7acc4f640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009be0 tx=0x7fa7a0003bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d413db6b77296b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.557+0000 7fa7877fe640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49866/0 (socket says 172.21.15.17:49866) 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 -- 172.21.15.17:0/4086860569 learned_addr learned my addr 172.21.15.17:0/4086860569 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e93460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e9a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e650e914a0 con 0x55e650e88990 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e650da90d0 con 0x55e650e8e4f0 2024-03-16T10:52:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e650e91620 con 0x55e650e89380 2024-03-16T10:52:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a002c890 con 0x5572e9dfbea0 2024-03-16T10:52:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa7a003a040 con 0x5572e9dfbea0 2024-03-16T10:52:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa798099850 con 0x5572e9dfbea0 2024-03-16T10:52:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e9a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e93460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 -- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 msgr2=0x55e650e93460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e93460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 -- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 msgr2=0x55e650e9a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e9a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7a002ca30 con 0x5572e9dfbea0 2024-03-16T10:52:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7b137f740 10 client.25739 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3bc98a740 10 client.0 _ll_register_callbacks cb 0x55e650d72760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572e9e72300 con 0x5572e9dfbea0 2024-03-16T10:52:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa798099850 con 0x5572e9dfbea0 2024-03-16T10:52:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b37fe640 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e650c29f70 con 0x55e650e88990 2024-03-16T10:52:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.558+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e93460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa7a00344c0 con 0x5572e9dfbea0 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 10 client.25739 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 20 client.25739 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e74d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 4 client.25739 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572e9d68f80 con 0x5572e9e0bea0 2024-03-16T10:52:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e74d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800fe30 tx=0x7fb3a800ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983fd9e62ef857d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fb392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a80047a0 con 0x55e650e88990 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fb392ffd640 1 -- 172.21.15.17:0/4086860569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8027030 con 0x55e650e88990 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.559+0000 7fb392ffd640 1 -- 172.21.15.17:0/4086860569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3a801e040 con 0x55e650e88990 2024-03-16T10:52:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb392ffd640 1 -- 172.21.15.17:0/4086860569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb3a8010bf0 con 0x55e650e88990 2024-03-16T10:52:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fa7a7fff640 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e74d60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a4bccb4c3bc4ca server_cookie=d75f4e110682b152 in_seq=0 out_seq=0 2024-03-16T10:52:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fa7877fe640 10 client.25739 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 10 client.15858 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e650ac1170 con 0x55e650e88990 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb392ffd640 1 -- 172.21.15.17:0/4086860569 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb3a8004020 con 0x55e650e88990 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 10 client.15858 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 20 client.15858 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650e9e4d0 0x55e650ea0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 4 client.15858 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e650dfa610 con 0x55e650e9e4d0 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.560+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650e9e4d0 0x55e650ea0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.561+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650e9e4d0 0x55e650ea0900 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a0678a6959cd272 server_cookie=32ddddf1bcb5b56e in_seq=0 out_seq=0 2024-03-16T10:52:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.561+0000 7fb392ffd640 10 client.15858 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fa7877fe640 1 -- 172.21.15.17:0/2163131203 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572e9d68f80 con 0x5572e9e0bea0 2024-03-16T10:52:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fa7877fe640 10 client.25739 handle_command_reply: tid=0 2024-03-16T10:52:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fa7b137f740 1 client.25739 shutdown 2024-03-16T10:52:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fb392ffd640 1 -- 172.21.15.17:0/4086860569 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e650dfa610 con 0x55e650e9e4d0 2024-03-16T10:52:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fb392ffd640 10 client.15858 handle_command_reply: tid=0 2024-03-16T10:52:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.563+0000 7fb3bc98a740 1 client.15858 shutdown 2024-03-16T10:52:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 msgr2=0x5572e9e06770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009be0 tx=0x7fa7a0003bf0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 shutdown_connections 2024-03-16T10:52:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5572e9e0bea0 0x5572e9e74d60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5572e9dfbea0 0x5572e9e06770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 msgr2=0x55e650e92f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800fe30 tx=0x7fb3a800ad90 comp rx=0 tx=0).stop 2024-03-16T10:52:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5572e9df6d30 0x5572e9e05760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 --2- 172.21.15.17:0/2163131203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572e9df6340 0x5572e9e05220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 >> 172.21.15.17:0/2163131203 conn(0x5572e9df18b0 msgr2=0x5572e9e00160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7877fe640 0 client.25739 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 shutdown_connections 2024-03-16T10:52:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650e9e4d0 0x55e650ea0900 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e9a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e93460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4086860569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e88990 0x55e650e92f20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 >> 172.21.15.17:0/4086860569 conn(0x55e650e50c50 msgr2=0x55e650e834e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb392ffd640 0 client.15858 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 shutdown_connections 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4086860569 wait complete. 2024-03-16T10:52:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 shutdown_connections 2024-03-16T10:52:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fb3bc98a740 20 client.15858 trim_cache size 0 max 16384 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 1 -- 172.21.15.17:0/2163131203 wait complete. 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.564+0000 7fa7b137f740 20 client.25739 trim_cache size 0 max 16384 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:52:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 msgr2=0x7fa7900a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 0x7fa7900a4e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0104e0 tx=0x7fa79c00b410 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 msgr2=0x7fa7a810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 0x7fa7a810d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa798005fd0 tx=0x7fa79800ee50 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 shutdown_connections 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.565+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa7900a29c0 0x7fa7900a4e80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7a81053a0 0x7fa7a810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7a81029f0 0x7fa7a810d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 --2- 172.21.15.17:0/3173569992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a8100080 0x7fa7a8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 >> 172.21.15.17:0/3173569992 conn(0x7fa7a80fbca0 msgr2=0x7fa7a80fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 shutdown_connections 2024-03-16T10:52:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:03.566+0000 7fa7ae6b2640 1 -- 172.21.15.17:0/3173569992 wait complete. 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.583+0000 7fb3bc98a740 1 Processor -- start 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.583+0000 7fb3bc98a740 1 -- start start 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.583+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 0x55e650e87c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 0x55e650e88190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41aef50 con 0x55e650e93580 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41b0a90 con 0x55e650e89380 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41af620 con 0x55e650e8e4f0 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49876/0 (socket says 172.21.15.17:49876) 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 -- 172.21.15.17:0/4210311882 learned_addr learned my addr 172.21.15.17:0/4210311882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 0x55e650e88190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 0x55e650e87c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 -- 172.21.15.17:0/4210311882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 msgr2=0x55e650e88190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 0x55e650e88190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 -- 172.21.15.17:0/4210311882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 msgr2=0x55e650e87c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 0x55e650e87c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 -- 172.21.15.17:0/4210311882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e650ea0f80 con 0x55e650e93580 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 0x55e650e88190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 0x55e650e87c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:03.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.584+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0bca90 tx=0x7fb3ac0333e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c84d39a16b6826 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3997fa640 1 -- 172.21.15.17:0/4210311882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0bd490 con 0x55e650e93580 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3997fa640 1 -- 172.21.15.17:0/4210311882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3ac0d3020 con 0x55e650e93580 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3997fa640 1 -- 172.21.15.17:0/4210311882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0c30e0 con 0x55e650e93580 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4210311882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 msgr2=0x55e650e9a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0bca90 tx=0x7fb3ac0333e0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4210311882 shutdown_connections 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e9a460 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e8e4f0 0x55e650e88190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/4210311882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e89380 0x55e650e87c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.585+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4210311882 >> 172.21.15.17:0/4210311882 conn(0x55e650e50c50 msgr2=0x55e650e87540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4210311882 shutdown_connections 2024-03-16T10:52:03.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 -- 172.21.15.17:0/4210311882 wait complete. 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 -- start start 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 Processor -- start 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e98a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.586+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3bc98a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e99510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41b03c0 con 0x55e650e93580 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41afcf0 con 0x55e650e8e4f0 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3bc98a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41acf30 con 0x55e650e89380 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3bc98a740 10 client.0 _ll_register_callbacks cb 0x7fb3a4009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e99510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:36980/0 (socket says 172.21.15.17:36980) 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 -- 172.21.15.17:0/2304084292 learned_addr learned my addr 172.21.15.17:0/2304084292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e98a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 -- 172.21.15.17:0/2304084292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 msgr2=0x55e650e98a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e98a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 -- 172.21.15.17:0/2304084292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 msgr2=0x55e650e99510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e99510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 -- 172.21.15.17:0/2304084292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e650f04840 con 0x55e650e8e4f0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b3fff640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb3b2ffd640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3b419f580 tx=0x7fb3a40096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3416b168ab8e130 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.587+0000 7fb392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a402c420 con 0x55e650e8e4f0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb3a402c5c0 con 0x55e650e8e4f0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3ac0d3020 con 0x55e650e8e4f0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb3a402c7c0 con 0x55e650e8e4f0 2024-03-16T10:52:03.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 10 client.25745 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e650f05a60 con 0x55e650e8e4f0 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3ac0d3020 con 0x55e650e8e4f0 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb3a4035420 con 0x55e650e8e4f0 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 10 client.25745 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 10 client.25745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 20 client.25745 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650f06490 0x55e650f088b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 4 client.25745 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.588+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e650df4960 con 0x55e650f06490 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.589+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650f06490 0x55e650f088b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.589+0000 7fb392ffd640 10 client.25745 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.589+0000 7fb3b37fe640 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650f06490 0x55e650f088b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a645a1af31e00154 server_cookie=8cb6804a10694f45 in_seq=0 out_seq=0 2024-03-16T10:52:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.590+0000 7fb392ffd640 1 -- 172.21.15.17:0/2304084292 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e650df4960 con 0x55e650f06490 2024-03-16T10:52:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.590+0000 7fb392ffd640 10 client.25745 handle_command_reply: tid=0 2024-03-16T10:52:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.590+0000 7fb3bc98a740 1 client.25745 shutdown 2024-03-16T10:52:03.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.590+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 msgr2=0x55e650e98fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.590+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3b419f580 tx=0x7fb3a40096c0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 shutdown_connections 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e650f06490 0x55e650f088b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e650e93580 0x55e650e99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb392ffd640 0 client.25745 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e650e8e4f0 0x55e650e98fd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 --2- 172.21.15.17:0/2304084292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e650e89380 0x55e650e98a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 >> 172.21.15.17:0/2304084292 conn(0x55e650e50c50 msgr2=0x55e650e92e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 shutdown_connections 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 1 -- 172.21.15.17:0/2304084292 wait complete. 2024-03-16T10:52:03.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3bc98a740 20 client.25745 trim_cache size 0 max 16384 2024-03-16T10:52:03.596 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-03-16T10:52:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "cf78f4ae-593c-401a-947c-ecb8594d38b9", 2024-03-16T10:52:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-03-16T10:52:03.596 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 msgr2=0x7fb39c0a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 0x7fb39c0a4cb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e650e89be0 tx=0x7fb3a4009260 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 msgr2=0x7fb3b41a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.591+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b41a5620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac02c430 tx=0x7fb3ac0337b0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 shutdown_connections 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb39c0a27f0 0x7fb39c0a4cb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b41099b0 0x7fb3b41a5620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb3b4108ff0 0x7fb3b419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 --2- 172.21.15.17:0/3448027787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3b4107e00 0x7fb3b419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 >> 172.21.15.17:0/3448027787 conn(0x7fb3b4076da0 msgr2=0x7fb3b410c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 shutdown_connections 2024-03-16T10:52:03.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.592+0000 7fb3b9dab640 1 -- 172.21.15.17:0/3448027787 wait complete. 2024-03-16T10:52:03.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:52:03.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:52:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 -- 172.21.15.17:0/2432842159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff040102290 msgr2=0x7ff040108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 --2- 172.21.15.17:0/2432842159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff040102290 0x7ff040108b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff038009be0 tx=0x7ff03802bef0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 -- 172.21.15.17:0/2432842159 shutdown_connections 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 --2- 172.21.15.17:0/2432842159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff040102290 0x7ff040108b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 --2- 172.21.15.17:0/2432842159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401018d0 0x7ff040101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 --2- 172.21.15.17:0/2432842159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0401006e0 0x7ff040100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.751+0000 7ff047953640 1 -- 172.21.15.17:0/2432842159 >> 172.21.15.17:0/2432842159 conn(0x7ff0400fbc70 msgr2=0x7ff0400fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 -- 172.21.15.17:0/2432842159 shutdown_connections 2024-03-16T10:52:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 -- 172.21.15.17:0/2432842159 wait complete. 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 Processor -- start 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 -- start start 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 0x7ff040197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.752+0000 7ff047953640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 0x7ff040198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff047953640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff040102290 0x7ff04019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff047953640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff04010c360 con 0x7ff0401006e0 2024-03-16T10:52:03.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff047953640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff04010c1e0 con 0x7ff0401018d0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff047953640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff04010c4e0 con 0x7ff040102290 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 0x7ff040197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 0x7ff040198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 0x7ff040197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49914/0 (socket says 172.21.15.17:49914) 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff0456ef640 1 -- 172.21.15.17:0/536543919 learned_addr learned my addr 172.21.15.17:0/536543919 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff045ef0640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff040102290 0x7ff04019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 -- 172.21.15.17:0/536543919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff040102290 msgr2=0x7ff04019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff040102290 0x7ff04019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 -- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 msgr2=0x7ff040197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 0x7ff040197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 -- 172.21.15.17:0/536543919 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04019f710 con 0x7ff0401018d0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.753+0000 7ff044eee640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 0x7ff040198030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e790 tx=0x7ff03000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.754+0000 7ff0367fc640 1 -- 172.21.15.17:0/536543919 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030020070 con 0x7ff0401018d0 2024-03-16T10:52:03.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.754+0000 7ff0367fc640 1 -- 172.21.15.17:0/536543919 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03000ccc0 con 0x7ff0401018d0 2024-03-16T10:52:03.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.754+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff040102b50 con 0x7ff0401018d0 2024-03-16T10:52:03.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.754+0000 7ff0367fc640 1 -- 172.21.15.17:0/536543919 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03001ba30 con 0x7ff0401018d0 2024-03-16T10:52:03.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.755+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0401030c0 con 0x7ff0401018d0 2024-03-16T10:52:03.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.757+0000 7ff0367fc640 1 -- 172.21.15.17:0/536543919 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 137341+0+0 (secure 0 0 0) 0x7ff03001bbd0 con 0x7ff0401018d0 2024-03-16T10:52:03.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 Processor -- start 2024-03-16T10:52:03.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 -- start start 2024-03-16T10:52:03.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 0x55b5ad40b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad410660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad413160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad370500 con 0x55b5ad40bb60 2024-03-16T10:52:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad318be0 con 0x55b5ad40b170 2024-03-16T10:52:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff0367fc640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 0x7ff02c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.758+0000 7ff04a61c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad36c5a0 con 0x55b5ad410cd0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff045ef0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 0x55b5ad40b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff045ef0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 0x55b5ad40b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37010/0 (socket says 172.21.15.17:37010) 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff045ef0640 1 -- 172.21.15.17:0/4247856124 learned_addr learned my addr 172.21.15.17:0/4247856124 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff0367fc640 1 -- 172.21.15.17:0/536543919 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff0300d2a90 con 0x7ff0401018d0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad413160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff045ef0640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 0x7ff02c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff0456ef640 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad410660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 -- 172.21.15.17:0/4247856124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 msgr2=0x55b5ad40b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 0x55b5ad40b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 -- 172.21.15.17:0/4247856124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 msgr2=0x55b5ad410660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad410660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.759+0000 7ff044eee640 1 -- 172.21.15.17:0/4247856124 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ad32c4b0 con 0x55b5ad410cd0 2024-03-16T10:52:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.760+0000 7ff044eee640 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad413160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0300d0650 tx=0x7ff03009b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5265549babcf085 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.760+0000 7ff045ef0640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 0x7ff02c0a4dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff038009370 tx=0x7ff0380092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.760+0000 7ff02b7fe640 1 -- 172.21.15.17:0/4247856124 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03009f590 con 0x55b5ad410cd0 2024-03-16T10:52:03.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.760+0000 7ff02b7fe640 1 -- 172.21.15.17:0/4247856124 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0300a3630 con 0x55b5ad410cd0 2024-03-16T10:52:03.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.760+0000 7ff02b7fe640 1 -- 172.21.15.17:0/4247856124 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03009f7f0 con 0x55b5ad410cd0 2024-03-16T10:52:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 -- 172.21.15.17:0/4247856124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 msgr2=0x55b5ad413160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad413160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0300d0650 tx=0x7ff03009b8f0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 -- 172.21.15.17:0/4247856124 shutdown_connections 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad413160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad410660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 --2- 172.21.15.17:0/4247856124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40b170 0x55b5ad40b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 -- 172.21.15.17:0/4247856124 >> 172.21.15.17:0/4247856124 conn(0x55b5ad4066e0 msgr2=0x55b5ad406ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 -- 172.21.15.17:0/4247856124 shutdown_connections 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.761+0000 7ff04a61c740 1 -- 172.21.15.17:0/4247856124 wait complete. 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.762+0000 7ff04a61c740 1 -- start start 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.762+0000 7ff04a61c740 1 Processor -- start 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad425410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff044eee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44886/0 (socket says 172.21.15.17:44886) 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff044eee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49934/0 (socket says 172.21.15.17:49934) 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff0456ef640 1 -- 172.21.15.17:0/2412654634 learned_addr learned my addr 172.21.15.17:0/2412654634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad41c430 con 0x55b5ad40bb60 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff045ef0640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad425410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad32c160 con 0x55b5ad410cd0 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.763+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5ad41c5b0 con 0x55b5ad40b170 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff04a61c740 10 client.0 _ll_register_callbacks cb 0x55b5ad310150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 -- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 msgr2=0x55b5ad425410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad425410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 -- 172.21.15.17:0/2412654634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 msgr2=0x55b5ad41e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ad14e7d0 con 0x55b5ad40b170 2024-03-16T10:52:03.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff044eee640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0300a3630 con 0x55b5ad40b170 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff0456ef640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0126d0 tx=0x7ff03c012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=803a323e588a8efe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff028ff9640 10 client.25705 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff028ff9640 1 -- 172.21.15.17:0/2412654634 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004050 con 0x55b5ad40b170 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.764+0000 7ff028ff9640 1 -- 172.21.15.17:0/2412654634 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff03c0041f0 con 0x55b5ad40b170 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff028ff9640 1 -- 172.21.15.17:0/2412654634 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff03c0043f0 con 0x55b5ad40b170 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 10 client.25705 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b5ad0843f0 con 0x55b5ad40b170 2024-03-16T10:52:03.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff028ff9640 1 -- 172.21.15.17:0/2412654634 <== mon.1 v2:172.21.15.174:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff03c00f8c0 con 0x55b5ad40b170 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 10 client.25705 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 10 client.25705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 20 client.25705 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad429700 0x55b5ad42bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 4 client.25705 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5ad37da40 con 0x55b5ad429700 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.765+0000 7ff044eee640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad429700 0x55b5ad42bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.766+0000 7ff028ff9640 10 client.25705 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.766+0000 7ff044eee640 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad429700 0x55b5ad42bbc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6693e4d158c74f server_cookie=da31a996fc26baf3 in_seq=0 out_seq=0 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.766+0000 7ff028ff9640 1 -- 172.21.15.17:0/2412654634 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b5ad37da40 con 0x55b5ad429700 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.766+0000 7ff028ff9640 10 client.25705 handle_command_reply: tid=0 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.766+0000 7ff04a61c740 1 client.25705 shutdown 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 msgr2=0x55b5ad41de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0126d0 tx=0x7ff03c012b90 comp rx=0 tx=0).stop 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 shutdown_connections 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad429700 0x55b5ad42bbc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff028ff9640 0 client.25705 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad425410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40bb60 0x55b5ad41e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 --2- 172.21.15.17:0/2412654634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad41de90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 >> 172.21.15.17:0/2412654634 conn(0x55b5ad4066e0 msgr2=0x55b5ad405900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 shutdown_connections 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 1 -- 172.21.15.17:0/2412654634 wait complete. 2024-03-16T10:52:03.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.767+0000 7ff04a61c740 20 client.25705 trim_cache size 0 max 16384 2024-03-16T10:52:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 Processor -- start 2024-03-16T10:52:03.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 -- start start 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40b170 0x55b5ad409fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad430480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a69a0 con 0x55b5ad40b170 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a84e0 con 0x55b5ad40bb60 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff04a61c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a7070 con 0x55b5ad410cd0 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff044eee640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40b170 0x55b5ad409fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff044eee640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37016/0 (socket says 172.21.15.17:37016) 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff044eee640 1 -- 172.21.15.17:0/99833687 learned_addr learned my addr 172.21.15.17:0/99833687 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.796+0000 7ff045ef0640 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad430480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 -- 172.21.15.17:0/99833687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 msgr2=0x55b5ad430480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad430480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 -- 172.21.15.17:0/99833687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40b170 msgr2=0x55b5ad409fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40b170 0x55b5ad409fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 -- 172.21.15.17:0/99833687 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ad0440f0 con 0x55b5ad40bb60 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff044eee640 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff03009b9f0 tx=0x7ff03008a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7845de0c8511611 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff02affd640 1 -- 172.21.15.17:0/99833687 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b8070 con 0x55b5ad40bb60 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff02affd640 1 -- 172.21.15.17:0/99833687 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03009bc00 con 0x55b5ad40bb60 2024-03-16T10:52:03.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.797+0000 7ff02affd640 1 -- 172.21.15.17:0/99833687 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0300a7a50 con 0x55b5ad40bb60 2024-03-16T10:52:03.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- 172.21.15.17:0/99833687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 msgr2=0x55b5ad4253d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff03009b9f0 tx=0x7ff03008a040 comp rx=0 tx=0).stop 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- 172.21.15.17:0/99833687 shutdown_connections 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad410cd0 0x55b5ad430480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad40bb60 0x55b5ad4253d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 --2- 172.21.15.17:0/99833687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad40b170 0x55b5ad409fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- 172.21.15.17:0/99833687 >> 172.21.15.17:0/99833687 conn(0x55b5ad4066e0 msgr2=0x55b5ad405900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- 172.21.15.17:0/99833687 shutdown_connections 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- 172.21.15.17:0/99833687 wait complete. 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.798+0000 7ff04a61c740 1 -- start start 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 Processor -- start 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad423690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 0x55b5ad424650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a7e10 con 0x55b5ad429700 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a7740 con 0x55b5ad410cd0 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401a49a0 con 0x55b5ad40b170 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff04a61c740 10 client.0 _ll_register_callbacks cb 0x7ff03c0096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff0456ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:44902/0 (socket says 172.21.15.17:44902) 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff0456ef640 1 -- 172.21.15.17:0/1450624944 learned_addr learned my addr 172.21.15.17:0/1450624944 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.799+0000 7ff045ef0640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 0x55b5ad424650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff044eee640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad423690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 -- 172.21.15.17:0/1450624944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 msgr2=0x55b5ad423150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 -- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 msgr2=0x55b5ad423690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad423690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 -- 172.21.15.17:0/1450624944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ad3379d0 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff0456ef640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff044eee640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad423690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff045ef0640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 0x55b5ad424650 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b5ad40c3c0 tx=0x7ff038005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51b5a9bd9490dc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff028ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038003e00 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff038004040 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03009bc00 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff038004240 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff04a61c740 10 client.15882 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.800+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5ad48ffa0 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff038034430 con 0x55b5ad429700 2024-03-16T10:52:03.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff03804a040 con 0x55b5ad429700 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 10 client.15882 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 20 client.15882 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad490940 0x55b5ad492d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 4 client.15882 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff03009bc00 con 0x55b5ad490940 2024-03-16T10:52:03.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.801+0000 7ff0456ef640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad490940 0x55b5ad492d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:03.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff028ff9640 10 client.15882 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff0456ef640 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad490940 0x55b5ad492d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4abc653a824385ab server_cookie=756fee13b930ce7d in_seq=0 out_seq=0 2024-03-16T10:52:03.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff028ff9640 1 -- 172.21.15.17:0/1450624944 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7ff03009bc00 con 0x55b5ad490940 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff028ff9640 10 client.15882 handle_command_reply: tid=0 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 client.15882 shutdown 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 msgr2=0x55b5ad424650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 0x55b5ad424650 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55b5ad40c3c0 tx=0x7ff038005e30 comp rx=0 tx=0).stop 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 shutdown_connections 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5ad490940 0x55b5ad492d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff028ff9640 0 client.15882 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5ad429700 0x55b5ad424650 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5ad410cd0 0x55b5ad423690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 --2- 172.21.15.17:0/1450624944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5ad40b170 0x55b5ad423150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 >> 172.21.15.17:0/1450624944 conn(0x55b5ad4066e0 msgr2=0x55b5ad41d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 shutdown_connections 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 1 -- 172.21.15.17:0/1450624944 wait complete. 2024-03-16T10:52:03.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.802+0000 7ff04a61c740 20 client.15882 trim_cache size 0 max 16384 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "cf78f4ae-593c-401a-947c-ecb8594d38b9": { 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "cf78f4ae-593c-401a-947c-ecb8594d38b9", 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:52:03.808 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 msgr2=0x7ff02c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 0x7ff02c0a4dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff038009370 tx=0x7ff0380092a0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 msgr2=0x7ff040198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 0x7ff040198030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e790 tx=0x7ff03000ec50 comp rx=0 tx=0).stop 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 shutdown_connections 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff02c0a2910 0x7ff02c0a4dd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff040102290 0x7ff04019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0401018d0 0x7ff040198030 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 --2- 172.21.15.17:0/536543919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0401006e0 0x7ff040197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 >> 172.21.15.17:0/536543919 conn(0x7ff0400fbc70 msgr2=0x7ff0400fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 shutdown_connections 2024-03-16T10:52:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:03.803+0000 7ff047953640 1 -- 172.21.15.17:0/536543919 wait complete. 2024-03-16T10:52:03.815 INFO:tasks.cephfs.filesystem:scrub status for tag:cf78f4ae-593c-401a-947c-ecb8594d38b9 - {'path': '/', 'tag': 'cf78f4ae-593c-401a-947c-ecb8594d38b9', 'options': 'recursive,force'} 2024-03-16T10:52:04.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:04 smithi017 ceph-mon[32078]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:04 smithi111 ceph-mon[36315]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:04.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:04 smithi174 ceph-mon[36202]: pgmap v388: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:05 smithi017 ceph-mon[32078]: scrub queued for path: / 2024-03-16T10:52:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:05 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:05 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:05 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:05 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:05.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:05 smithi111 ceph-mon[36315]: scrub queued for path: / 2024-03-16T10:52:05.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:05 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:05 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:05.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:05 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:05 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:05.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:05 smithi174 ceph-mon[36202]: scrub queued for path: / 2024-03-16T10:52:05.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:05 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:05 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:05.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:05 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:05.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:05 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:06.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:06 smithi017 ceph-mon[32078]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:52:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:06 smithi111 ceph-mon[36315]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:52:06.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:06 smithi174 ceph-mon[36202]: pgmap v389: 97 pgs: 97 active+clean; 671 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:52:08.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:08 smithi017 ceph-mon[32078]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-16T10:52:08.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:08 smithi111 ceph-mon[36315]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-16T10:52:08.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:08 smithi174 ceph-mon[36202]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 511 B/s wr, 13 op/s 2024-03-16T10:52:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:10 smithi017 ceph-mon[32078]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:10 smithi111 ceph-mon[36315]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:10.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:10 smithi174 ceph-mon[36202]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-16T10:52:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:11 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:52:11.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:11 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:52:11.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:11 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:52:12.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:12 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:52:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:12 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:12.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:52:12.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:52:12.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:12 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:52:13.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:13 smithi174 ceph-mon[36202]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-03-16T10:52:13.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:13 smithi017 ceph-mon[32078]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-03-16T10:52:13.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:13 smithi111 ceph-mon[36315]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-03-16T10:52:14.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:14 smithi174 ceph-mon[36202]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:14.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:14 smithi017 ceph-mon[32078]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:14.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:14 smithi111 ceph-mon[36315]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 -- 172.21.15.17:0/3686615861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 msgr2=0x7fcb88100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 --2- 172.21.15.17:0/3686615861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88100b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009860 tx=0x7fcb7802bb70 comp rx=0 tx=0).stop 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 -- 172.21.15.17:0/3686615861 shutdown_connections 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 --2- 172.21.15.17:0/3686615861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 0x7fcb88108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 --2- 172.21.15.17:0/3686615861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 --2- 172.21.15.17:0/3686615861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88100b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 -- 172.21.15.17:0/3686615861 >> 172.21.15.17:0/3686615861 conn(0x7fcb880fbc70 msgr2=0x7fcb880fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 -- 172.21.15.17:0/3686615861 shutdown_connections 2024-03-16T10:52:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.689+0000 7fcb8d812640 1 -- 172.21.15.17:0/3686615861 wait complete. 2024-03-16T10:52:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.690+0000 7fcb8d812640 1 Processor -- start 2024-03-16T10:52:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.690+0000 7fcb8d812640 1 -- start start 2024-03-16T10:52:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 0x7fcb8819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c350 con 0x7fcb881022b0 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43066/0 (socket says 172.21.15.17:43066) 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb867fc640 1 -- 172.21.15.17:0/1989843110 learned_addr learned my addr 172.21.15.17:0/1989843110 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb877fe640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 0x7fcb8819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c1d0 con 0x7fcb881018f0 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.691+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8810c4d0 con 0x7fcb88100700 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 -- 172.21.15.17:0/1989843110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 msgr2=0x7fcb88197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 -- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 msgr2=0x7fcb8819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 0x7fcb8819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 -- 172.21.15.17:0/1989843110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8819f690 con 0x7fcb881018f0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb867fc640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e9c0 tx=0x7fcb7c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb8c810640 1 -- 172.21.15.17:0/1989843110 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00cde0 con 0x7fcb881018f0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb8c810640 1 -- 172.21.15.17:0/1989843110 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb7c0137d0 con 0x7fcb881018f0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb8c810640 1 -- 172.21.15.17:0/1989843110 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0039b0 con 0x7fcb881018f0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.692+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb88102b70 con 0x7fcb881018f0 2024-03-16T10:52:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.693+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb88103070 con 0x7fcb881018f0 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.696+0000 7fcb8c810640 1 -- 172.21.15.17:0/1989843110 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fcb7c022020 con 0x7fcb881018f0 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.696+0000 7fcb90404740 1 Processor -- start 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.696+0000 7fcb90404740 1 -- start start 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.696+0000 7fcb90404740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb90404740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 0x5581b08cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb90404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb90404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5581b082fa40 con 0x5581b08cfea0 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb90404740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5581b07d8920 con 0x5581b08cad30 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb90404740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5581b082bae0 con 0x5581b08ca340 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb8c810640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 0x7fcb700a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 0x5581b08cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:43168/0 (socket says 172.21.15.17:43168) 2024-03-16T10:52:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb877fe640 1 -- 172.21.15.17:0/52119448 learned_addr learned my addr 172.21.15.17:0/52119448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb8c810640 1 -- 172.21.15.17:0/1989843110 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fcb7c0d2ac0 con 0x7fcb881018f0 2024-03-16T10:52:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.697+0000 7fcb867fc640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.698+0000 7fcb877fe640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 0x7fcb700a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.698+0000 7fcb86ffd640 1 -- 172.21.15.17:0/52119448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 msgr2=0x5581b08ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.698+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.699+0000 7fcb86ffd640 1 -- 172.21.15.17:0/52119448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 msgr2=0x5581b08d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.699+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.699+0000 7fcb86ffd640 1 -- 172.21.15.17:0/52119448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581b07f0460 con 0x5581b08cad30 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.699+0000 7fcb867fc640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.699+0000 7fcb877fe640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.700+0000 7fcb877fe640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 0x7fcb700a4e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5581b08cb590 tx=0x7fcb80004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.701+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 0x5581b08cf830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcb7802c0b0 tx=0x7fcb78034ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=468b3c2d240bbaf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.702+0000 7fcb6dffb640 1 -- 172.21.15.17:0/52119448 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78039040 con 0x5581b08cad30 2024-03-16T10:52:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.702+0000 7fcb6dffb640 1 -- 172.21.15.17:0/52119448 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb78032340 con 0x5581b08cad30 2024-03-16T10:52:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.703+0000 7fcb90404740 1 -- 172.21.15.17:0/52119448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 msgr2=0x5581b08cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.703+0000 7fcb90404740 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 0x5581b08cf830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcb7802c0b0 tx=0x7fcb78034ad0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 -- 172.21.15.17:0/52119448 shutdown_connections 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cad30 0x5581b08cf830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 --2- 172.21.15.17:0/52119448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 -- 172.21.15.17:0/52119448 >> 172.21.15.17:0/52119448 conn(0x5581b08c58b0 msgr2=0x5581b08c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 -- 172.21.15.17:0/52119448 shutdown_connections 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 -- 172.21.15.17:0/52119448 wait complete. 2024-03-16T10:52:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 -- start start 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.704+0000 7fcb90404740 1 Processor -- start 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08d9a70 0x5581b08dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5581b08d2e40 con 0x5581b08cfea0 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5581b07ebd70 con 0x5581b08d9a70 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5581b08d2fc0 con 0x5581b08ca340 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb90404740 10 client.0 _ll_register_callbacks cb 0x5581b0543a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50282/0 (socket says 172.21.15.17:50282) 2024-03-16T10:52:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb867fc640 1 -- 172.21.15.17:0/3790384552 learned_addr learned my addr 172.21.15.17:0/3790384552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb877fe640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08d9a70 0x5581b08dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08d9a70 msgr2=0x5581b08dbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08d9a70 0x5581b08dbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.705+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3790384552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 msgr2=0x5581b08d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3790384552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581b0544210 con 0x5581b08ca340 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08d4500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5581b08c6820 tx=0x7fcb78005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333224abf5435588 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78039040 con 0x5581b08ca340 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5581b083cf80 con 0x5581b08ca340 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fcb78041e00 con 0x5581b08ca340 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcb7802c510 con 0x5581b08ca340 2024-03-16T10:52:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb90404740 10 client.25723 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.706+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581b0610620 con 0x5581b08ca340 2024-03-16T10:52:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.707+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5581b083cf80 con 0x5581b08ca340 2024-03-16T10:52:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.707+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcb7805b050 con 0x5581b08ca340 2024-03-16T10:52:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 10 client.25723 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 10 client.25723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 20 client.25723 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b08e03e0 0x5581b08e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 4 client.25723 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581b08372d0 con 0x5581b08e03e0 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb867fc640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b08e03e0 0x5581b08e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb867fc640 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b08e03e0 0x5581b08e27d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c68d3479a708b7 server_cookie=93c4194a8fa2d226 in_seq=0 out_seq=0 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.708+0000 7fcb66ffd640 10 client.25723 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.709+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3790384552 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5581b08372d0 con 0x5581b08e03e0 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.709+0000 7fcb66ffd640 10 client.25723 handle_command_reply: tid=0 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.709+0000 7fcb90404740 1 client.25723 shutdown 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.709+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 msgr2=0x5581b08d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.709+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08d4500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5581b08c6820 tx=0x7fcb78005970 comp rx=0 tx=0).stop 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 shutdown_connections 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b08e03e0 0x5581b08e27d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08d9a70 0x5581b08dbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08cfea0 0x5581b08d4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 --2- 172.21.15.17:0/3790384552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08d4500 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 >> 172.21.15.17:0/3790384552 conn(0x5581b08c58b0 msgr2=0x5581b08c4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb66ffd640 0 client.25723 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 shutdown_connections 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 1 -- 172.21.15.17:0/3790384552 wait complete. 2024-03-16T10:52:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.710+0000 7fcb90404740 20 client.25723 trim_cache size 0 max 16384 2024-03-16T10:52:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.733+0000 7fcb90404740 1 Processor -- start 2024-03-16T10:52:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.733+0000 7fcb90404740 1 -- start start 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.733+0000 7fcb90404740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 0x5581b08c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.733+0000 7fcb90404740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 0x5581b08d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb90404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 0x5581b08c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 0x5581b08c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43108/0 (socket says 172.21.15.17:43108) 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 0x5581b08d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 0x5581b08d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:43178/0 (socket says 172.21.15.17:43178) 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50294/0 (socket says 172.21.15.17:50294) 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb877fe640 1 -- 172.21.15.17:0/3462160477 learned_addr learned my addr 172.21.15.17:0/3462160477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a6880 con 0x5581b08d9a70 2024-03-16T10:52:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a83c0 con 0x5581b08ca340 2024-03-16T10:52:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.734+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a6f50 con 0x5581b08cfea0 2024-03-16T10:52:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 -- 172.21.15.17:0/3462160477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 msgr2=0x5581b08d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 0x5581b08d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 -- 172.21.15.17:0/3462160477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 msgr2=0x5581b08c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 0x5581b08c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 -- 172.21.15.17:0/3462160477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581b08e2b40 con 0x5581b08d9a70 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb877fe640 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb80003dc0 tx=0x7fcb80009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840151cf5540e5c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb6d7fa640 1 -- 172.21.15.17:0/3462160477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80021970 con 0x5581b08d9a70 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb6d7fa640 1 -- 172.21.15.17:0/3462160477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb80010420 con 0x5581b08d9a70 2024-03-16T10:52:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.735+0000 7fcb6d7fa640 1 -- 172.21.15.17:0/3462160477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000f600 con 0x5581b08d9a70 2024-03-16T10:52:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.736+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 msgr2=0x5581b08d4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.736+0000 7fcb90404740 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb80003dc0 tx=0x7fcb80009c80 comp rx=0 tx=0).stop 2024-03-16T10:52:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 shutdown_connections 2024-03-16T10:52:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08d4060 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08cfea0 0x5581b08d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 --2- 172.21.15.17:0/3462160477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08ca340 0x5581b08c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 >> 172.21.15.17:0/3462160477 conn(0x5581b08c58b0 msgr2=0x5581b08c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 shutdown_connections 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 -- 172.21.15.17:0/3462160477 wait complete. 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.737+0000 7fcb90404740 1 -- start start 2024-03-16T10:52:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.738+0000 7fcb90404740 1 Processor -- start 2024-03-16T10:52:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.738+0000 7fcb90404740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.738+0000 7fcb90404740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 0x5581b08f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.738+0000 7fcb90404740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:43190/0 (socket says 172.21.15.17:43190) 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 0x5581b08f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb867fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 0x5581b08f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43122/0 (socket says 172.21.15.17:43122) 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50300/0 (socket says 172.21.15.17:50300) 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3489252418 learned_addr learned my addr 172.21.15.17:0/3489252418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a7cf0 con 0x5581b08d9a70 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a7620 con 0x5581b08cfea0 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcb881a4880 con 0x5581b08ca340 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb90404740 10 client.0 _ll_register_callbacks cb 0x7fcb7c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 msgr2=0x5581b08f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 0x5581b08f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3489252418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 msgr2=0x5581b08f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb86ffd640 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581b08f2c40 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.739+0000 7fcb877fe640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb86ffd640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb780057c0 tx=0x7fcb78005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd950fee146a42d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78061060 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fcb7802c6b0 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb80010420 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcb78039040 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb90404740 10 client.25729 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.740+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581b09461c0 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb80010420 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcb78066070 con 0x5581b08ca340 2024-03-16T10:52:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 10 client.25729 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 10 client.25729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 20 client.25729 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b0946b80 0x5581b0948fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 4 client.25729 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581b07b5770 con 0x5581b0946b80 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.741+0000 7fcb867fc640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b0946b80 0x5581b0948fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.742+0000 7fcb66ffd640 10 client.25729 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.742+0000 7fcb867fc640 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b0946b80 0x5581b0948fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26783f7ca777600 server_cookie=88a2f7fae4037741 in_seq=0 out_seq=0 2024-03-16T10:52:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.746+0000 7fcb66ffd640 1 -- 172.21.15.17:0/3489252418 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581b07b5770 con 0x5581b0946b80 2024-03-16T10:52:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.746+0000 7fcb66ffd640 10 client.25729 handle_command_reply: tid=0 2024-03-16T10:52:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.746+0000 7fcb90404740 1 client.25729 shutdown 2024-03-16T10:52:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 msgr2=0x5581b08f1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb780057c0 tx=0x7fcb78005f80 comp rx=0 tx=0).stop 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 shutdown_connections 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5581b0946b80 0x5581b0948fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb66ffd640 0 client.25729 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581b08d9a70 0x5581b08f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5581b08cfea0 0x5581b08f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 --2- 172.21.15.17:0/3489252418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b08ca340 0x5581b08f1150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 >> 172.21.15.17:0/3489252418 conn(0x5581b08c58b0 msgr2=0x5581b08c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 shutdown_connections 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.747+0000 7fcb90404740 1 -- 172.21.15.17:0/3489252418 wait complete. 2024-03-16T10:52:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.748+0000 7fcb90404740 20 client.25729 trim_cache size 0 max 16384 2024-03-16T10:52:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:52:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:52:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:52:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:52:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.748+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 msgr2=0x7fcb700a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.748+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 0x7fcb700a4e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5581b08cb590 tx=0x7fcb80004ab0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.748+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 msgr2=0x7fcb88198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.748+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00e9c0 tx=0x7fcb7c00ee80 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 shutdown_connections 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fcb700a29a0 0x7fcb700a4e60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb881022b0 0x7fcb8819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb881018f0 0x7fcb88198000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 --2- 172.21.15.17:0/1989843110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb88100700 0x7fcb88197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 >> 172.21.15.17:0/1989843110 conn(0x7fcb880fbc70 msgr2=0x7fcb880fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 shutdown_connections 2024-03-16T10:52:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:16.749+0000 7fcb8d812640 1 -- 172.21.15.17:0/1989843110 wait complete. 2024-03-16T10:52:16.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:16 smithi174 ceph-mon[36202]: pgmap v394: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:16.894 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:16 smithi017 ceph-mon[32078]: pgmap v394: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:16.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:16 smithi111 ceph-mon[36315]: pgmap v394: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:17.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:17 smithi174 ceph-mon[36202]: pgmap v395: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-16T10:52:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:17 smithi017 ceph-mon[32078]: pgmap v395: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-16T10:52:17.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:17 smithi111 ceph-mon[36315]: pgmap v395: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 597 B/s wr, 14 op/s 2024-03-16T10:52:19.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:19 smithi174 ceph-mon[36202]: pgmap v396: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:52:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:19 smithi017 ceph-mon[32078]: pgmap v396: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:52:19.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:19 smithi111 ceph-mon[36315]: pgmap v396: 97 pgs: 97 active+clean; 672 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:52:21.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:21 smithi174 ceph-mon[36202]: pgmap v397: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:21 smithi017 ceph-mon[32078]: pgmap v397: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:21.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:21 smithi111 ceph-mon[36315]: pgmap v397: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:23 smithi174 ceph-mon[36202]: pgmap v398: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:23 smithi017 ceph-mon[32078]: pgmap v398: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:23.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:23 smithi111 ceph-mon[36315]: pgmap v398: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:52:25.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:25 smithi174 ceph-mon[36202]: pgmap v399: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:52:25.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:25 smithi017 ceph-mon[32078]: pgmap v399: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:52:25.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:25 smithi111 ceph-mon[36315]: pgmap v399: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:52:27.412 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 93% (11534/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-16T10:52:27.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:27 smithi174 ceph-mon[36202]: pgmap v400: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:52:27.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:27 smithi017 ceph-mon[32078]: pgmap v400: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:52:27.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:27 smithi111 ceph-mon[36315]: pgmap v400: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'. 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-03-16T10:52:28.019 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-16T10:52:28.020 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 3d78f5ba07b Merge PR #54581 into wip-batrick-testing-20240314.183243 2024-03-16T10:52:28.026 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-16T10:52:28.058 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-16T10:52:28.060 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-16T10:52:28.060 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-16T10:52:28.792 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-16T10:52:28.874 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-16T10:52:28.914 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-16T10:52:28.915 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-16T10:52:28.915 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-16T10:52:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-16T10:52:28.957 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:52:28.958 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-16T10:52:29.012 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-16T10:52:29.013 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-16T10:52:29.014 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-16T10:52:29.072 INFO:tasks.workunit.client.0.smithi017.stderr:+ mkdir -p fsstress 2024-03-16T10:52:29.074 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd fsstress 2024-03-16T10:52:29.074 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-16T10:52:29.075 INFO:tasks.workunit.client.0.smithi017.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-16T10:52:29.754 INFO:tasks.workunit.client.0.smithi017.stderr:+ tar xzf ltp-full.tgz 2024-03-16T10:52:29.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:29 smithi174 ceph-mon[36202]: pgmap v401: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:29.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:29 smithi017 ceph-mon[32078]: pgmap v401: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 -- 172.21.15.17:0/3155748657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc101830 msgr2=0x7fc7cc101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 --2- 172.21.15.17:0/3155748657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc101830 0x7fc7cc101c50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009900 tx=0x7fc7c802bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 -- 172.21.15.17:0/3155748657 shutdown_connections 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 --2- 172.21.15.17:0/3155748657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc1033e0 0x7fc7cc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 --2- 172.21.15.17:0/3155748657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc102a20 0x7fc7cc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 --2- 172.21.15.17:0/3155748657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc101830 0x7fc7cc101c50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 -- 172.21.15.17:0/3155748657 >> 172.21.15.17:0/3155748657 conn(0x7fc7cc0fcda0 msgr2=0x7fc7cc0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 -- 172.21.15.17:0/3155748657 shutdown_connections 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.844+0000 7fc7d397e640 1 -- 172.21.15.17:0/3155748657 wait complete. 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 Processor -- start 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 -- start start 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc101830 0x7fc7cc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc1033e0 0x7fc7cc19f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc10d480 con 0x7fc7cc102a20 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc10d300 con 0x7fc7cc101830 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d397e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc10d600 con 0x7fc7cc1033e0 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d171a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc101830 0x7fc7cc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50572/0 (socket says 172.21.15.17:50572) 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 -- 172.21.15.17:0/2540419849 learned_addr learned my addr 172.21.15.17:0/2540419849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc1033e0 0x7fc7cc19f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 -- 172.21.15.17:0/2540419849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc1033e0 msgr2=0x7fc7cc19f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc1033e0 0x7fc7cc19f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 -- 172.21.15.17:0/2540419849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc101830 msgr2=0x7fc7cc197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc101830 0x7fc7cc197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 -- 172.21.15.17:0/2540419849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc19f6c0 con 0x7fc7cc102a20 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.845+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00d950 tx=0x7fc7bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.846+0000 7fc7c27fc640 1 -- 172.21.15.17:0/2540419849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc017030 con 0x7fc7cc102a20 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.846+0000 7fc7c27fc640 1 -- 172.21.15.17:0/2540419849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc004020 con 0x7fc7cc102a20 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.846+0000 7fc7c27fc640 1 -- 172.21.15.17:0/2540419849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0047a0 con 0x7fc7cc102a20 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.846+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc19f9b0 con 0x7fc7cc102a20 2024-03-16T10:52:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.846+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc19ff00 con 0x7fc7cc102a20 2024-03-16T10:52:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.848+0000 7fc7c27fc640 1 -- 172.21.15.17:0/2540419849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fc7bc0041d0 con 0x7fc7cc102a20 2024-03-16T10:52:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.848+0000 7fc7d656b740 1 Processor -- start 2024-03-16T10:52:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.848+0000 7fc7d656b740 1 -- start start 2024-03-16T10:52:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7c27fc640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 0x7fc7b80a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5439830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d543c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8d5399a40 con 0x55d8d5439ea0 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55d8d5342920 con 0x55d8d5434340 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d656b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8d5395ae0 con 0x55d8d5434d30 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 0x7fc7b80a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42766/0 (socket says 172.21.15.17:42766) 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2226801449 learned_addr learned my addr 172.21.15.17:0/2226801449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7c27fc640 1 -- 172.21.15.17:0/2540419849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc7bc0ce430 con 0x7fc7cc102a20 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d543c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5439830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2226801449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 msgr2=0x55d8d5439830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5439830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2226801449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 msgr2=0x55d8d543c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d543c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2226801449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8d535a460 con 0x55d8d5434340 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 0x7fc7b80a4d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8000c00 tx=0x7fc7c8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.849+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4012a20 tx=0x7fc7c40099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0c3655a758d4f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7b77fe640 1 -- 172.21.15.17:0/2226801449 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003970 con 0x55d8d5434340 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7b77fe640 1 -- 172.21.15.17:0/2226801449 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4010770 con 0x55d8d5434340 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7b77fe640 1 -- 172.21.15.17:0/2226801449 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4004430 con 0x55d8d5434340 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 -- 172.21.15.17:0/2226801449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 msgr2=0x55d8d5434760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4012a20 tx=0x7fc7c40099f0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 -- 172.21.15.17:0/2226801449 shutdown_connections 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d543c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5439830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2226801449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5434760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 -- 172.21.15.17:0/2226801449 >> 172.21.15.17:0/2226801449 conn(0x55d8d542f8b0 msgr2=0x55d8d542fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 -- 172.21.15.17:0/2226801449 shutdown_connections 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.850+0000 7fc7d656b740 1 -- 172.21.15.17:0/2226801449 wait complete. 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 -- start start 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 Processor -- start 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d543ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d5445c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8d543ce50 con 0x55d8d5434d30 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55d8d5355d70 con 0x55d8d5434340 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8d543cfd0 con 0x55d8d5439ea0 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d656b740 10 client.0 _ll_register_callbacks cb 0x55d8d50ada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d171a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d171a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42774/0 (socket says 172.21.15.17:42774) 2024-03-16T10:52:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d543ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d171a640 1 -- 172.21.15.17:0/2541785178 learned_addr learned my addr 172.21.15.17:0/2541785178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.851+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d5445c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 -- 172.21.15.17:0/2541785178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 msgr2=0x55d8d5445c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d5445c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 -- 172.21.15.17:0/2541785178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 msgr2=0x55d8d543ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d543ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 -- 172.21.15.17:0/2541785178 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8d50ae210 con 0x55d8d5434340 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d543ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802c710 tx=0x7fc7c8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c458ca2bb1220cf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c804c030 con 0x55d8d5434340 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c4010770 con 0x55d8d5434340 2024-03-16T10:52:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc7c8003ac0 con 0x55d8d5434340 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7c8003cc0 con 0x55d8d5434340 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d656b740 10 client.25790 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d8d517a620 con 0x55d8d5434340 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.852+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4010770 con 0x55d8d5434340 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc7c8004c30 con 0x55d8d5434340 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 10 client.25790 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 10 client.25790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 20 client.25790 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d544a510 0x55d8d544c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 4 client.25790 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8d53a6f80 con 0x55d8d544a510 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d544a510 0x55d8d544c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d544a510 0x55d8d544c920 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b66f06578ecf77 server_cookie=6eef0037de347239 in_seq=0 out_seq=0 2024-03-16T10:52:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.853+0000 7fc7b4ff9640 10 client.25790 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2541785178 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d8d53a6f80 con 0x55d8d544a510 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7b4ff9640 10 client.25790 handle_command_reply: tid=0 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 client.25790 shutdown 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 msgr2=0x55d8d543e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802c710 tx=0x7fc7c8009260 comp rx=0 tx=0).stop 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 shutdown_connections 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d544a510 0x55d8d544c920 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d5445c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7b4ff9640 0 client.25790 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d543ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2541785178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543e6a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 >> 172.21.15.17:0/2541785178 conn(0x55d8d542f8b0 msgr2=0x55d8d542ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 shutdown_connections 2024-03-16T10:52:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 1 -- 172.21.15.17:0/2541785178 wait complete. 2024-03-16T10:52:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.855+0000 7fc7d656b740 20 client.25790 trim_cache size 0 max 16384 2024-03-16T10:52:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 Processor -- start 2024-03-16T10:52:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 -- start start 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d542e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1a8c00 con 0x55d8d5434d30 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1aa740 con 0x55d8d5434340 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d656b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1a92d0 con 0x55d8d5439ea0 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50596/0 (socket says 172.21.15.17:50596) 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d171a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d0f19640 1 -- 172.21.15.17:0/1803065818 learned_addr learned my addr 172.21.15.17:0/1803065818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.872+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d542e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 -- 172.21.15.17:0/1803065818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 msgr2=0x55d8d542e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d542e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 -- 172.21.15.17:0/1803065818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 msgr2=0x55d8d543eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 -- 172.21.15.17:0/1803065818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8d5448ed0 con 0x55d8d5434d30 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d0f19640 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0cbf30 tx=0x7fc7bc0051b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be122d1c3e7f224 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7b6ffd640 1 -- 172.21.15.17:0/1803065818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc09e040 con 0x55d8d5434d30 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7b6ffd640 1 -- 172.21.15.17:0/1803065818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc014040 con 0x55d8d5434d30 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7b6ffd640 1 -- 172.21.15.17:0/1803065818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0a26a0 con 0x55d8d5434d30 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d656b740 1 -- 172.21.15.17:0/1803065818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 msgr2=0x55d8d5445be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.873+0000 7fc7d656b740 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0cbf30 tx=0x7fc7bc0051b0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- 172.21.15.17:0/1803065818 shutdown_connections 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5439ea0 0x55d8d542e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5434d30 0x55d8d5445be0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- 172.21.15.17:0/1803065818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d543eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- 172.21.15.17:0/1803065818 >> 172.21.15.17:0/1803065818 conn(0x55d8d542f8b0 msgr2=0x55d8d542fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- 172.21.15.17:0/1803065818 shutdown_connections 2024-03-16T10:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- 172.21.15.17:0/1803065818 wait complete. 2024-03-16T10:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- start start 2024-03-16T10:52:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 Processor -- start 2024-03-16T10:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5443600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5443b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1aa070 con 0x55d8d5439ea0 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1a99a0 con 0x55d8d5434340 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1a6c00 con 0x55d8d5434d30 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d656b740 10 client.0 _ll_register_callbacks cb 0x7fc7c8041050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.874+0000 7fc7d1f1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d0f19640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5443b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d171a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5443600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50610/0 (socket says 172.21.15.17:50610) 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2426380328 learned_addr learned my addr 172.21.15.17:0/2426380328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2426380328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 msgr2=0x55d8d5443b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5443b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 msgr2=0x55d8d5443600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5443600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 -- 172.21.15.17:0/2426380328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8d5445140 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d1f1b640 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55d8d5435590 tx=0x7fc7c4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3600dd0810bbeb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4010770 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fc7c4010910 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7bc014040 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7c4012630 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d656b740 10 client.15918 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.875+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d8d54b0b90 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7bc014040 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc7c400f040 con 0x55d8d5439ea0 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 10 client.15918 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 20 client.15918 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d54b13b0 0x55d8d54b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 4 client.15918 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:52:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8d53a12d0 con 0x55d8d54b13b0 2024-03-16T10:52:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d54b13b0 0x55d8d54b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7b4ff9640 10 client.15918 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:29.876+0000 7fc7d171a640 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d54b13b0 0x55d8d54b37d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc6031544d3617b server_cookie=3ed47ddb65d477b2 in_seq=0 out_seq=0 2024-03-16T10:52:29.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:29 smithi111 ceph-mon[36315]: pgmap v401: 97 pgs: 97 active+clean; 673 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7b4ff9640 1 -- 172.21.15.17:0/2426380328 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8d53a12d0 con 0x55d8d54b13b0 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7b4ff9640 10 client.15918 handle_command_reply: tid=0 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7d656b740 1 client.15918 shutdown 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 msgr2=0x55d8d5444b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55d8d5435590 tx=0x7fc7c4003ba0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 shutdown_connections 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.468+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55d8d54b13b0 0x55d8d54b37d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8d5439ea0 0x55d8d5444b50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7b4ff9640 0 client.15918 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8d5434d30 0x55d8d5443b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 --2- 172.21.15.17:0/2426380328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d8d5434340 0x55d8d5443600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 >> 172.21.15.17:0/2426380328 conn(0x55d8d542f8b0 msgr2=0x55d8d5432b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 shutdown_connections 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 1 -- 172.21.15.17:0/2426380328 wait complete. 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d656b740 20 client.15918 trim_cache size 0 max 16384 2024-03-16T10:52:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:52:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:52:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:52:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 msgr2=0x7fc7b80a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 0x7fc7b80a4d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8000c00 tx=0x7fc7c8005fd0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 msgr2=0x7fc7cc198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00d950 tx=0x7fc7bc00de10 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 shutdown_connections 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fc7b80a28a0 0x7fc7b80a4d60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7cc1033e0 0x7fc7cc19f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7cc102a20 0x7fc7cc198030 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 --2- 172.21.15.17:0/2540419849 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7cc101830 0x7fc7cc197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.469+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 >> 172.21.15.17:0/2540419849 conn(0x7fc7cc0fcda0 msgr2=0x7fc7cc105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.470+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 shutdown_connections 2024-03-16T10:52:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:31.470+0000 7fc7d397e640 1 -- 172.21.15.17:0/2540419849 wait complete. 2024-03-16T10:52:31.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:31 smithi174 ceph-mon[36202]: pgmap v402: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-03-16T10:52:31.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:31 smithi017 ceph-mon[32078]: pgmap v402: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-03-16T10:52:31.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:31 smithi111 ceph-mon[36315]: pgmap v402: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-03-16T10:52:33.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:33 smithi174 ceph-mon[36202]: pgmap v403: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-03-16T10:52:33.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:52:33.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:52:33.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:33 smithi017 ceph-mon[32078]: pgmap v403: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-03-16T10:52:33.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:33 smithi111 ceph-mon[36315]: pgmap v403: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-03-16T10:52:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 -- 172.21.15.17:0/1436818302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec1006e0 msgr2=0x7effec100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 --2- 172.21.15.17:0/1436818302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec1006e0 0x7effec100b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7effdc009ca0 tx=0x7effdc02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 -- 172.21.15.17:0/1436818302 shutdown_connections 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 --2- 172.21.15.17:0/1436818302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec102290 0x7effec108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 --2- 172.21.15.17:0/1436818302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1018d0 0x7effec101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 --2- 172.21.15.17:0/1436818302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec1006e0 0x7effec100b00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 -- 172.21.15.17:0/1436818302 >> 172.21.15.17:0/1436818302 conn(0x7effec0fbc70 msgr2=0x7effec0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 -- 172.21.15.17:0/1436818302 shutdown_connections 2024-03-16T10:52:33.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.922+0000 7efff104b640 1 -- 172.21.15.17:0/1436818302 wait complete. 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.923+0000 7efff104b640 1 Processor -- start 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.923+0000 7efff104b640 1 -- start start 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 0x7effec198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 0x7effec19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effec10c330 con 0x7effec102290 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effec10c1b0 con 0x7effec1018d0 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effec10c4b0 con 0x7effec1006e0 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effead9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 0x7effec19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effea59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 0x7effec198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effead9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55388/0 (socket says 172.21.15.17:55388) 2024-03-16T10:52:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effead9d640 1 -- 172.21.15.17:0/1469631998 learned_addr learned my addr 172.21.15.17:0/1469631998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 -- 172.21.15.17:0/1469631998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 msgr2=0x7effec197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 -- 172.21.15.17:0/1469631998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 msgr2=0x7effec198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 0x7effec198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 -- 172.21.15.17:0/1469631998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec19f750 con 0x7effec102290 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effead9d640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effea59c640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 0x7effec198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effeb59e640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 0x7effec19f0e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7effe400e970 tx=0x7effe400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effd3fff640 1 -- 172.21.15.17:0/1469631998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe400ccc0 con 0x7effec102290 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effd3fff640 1 -- 172.21.15.17:0/1469631998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe4005020 con 0x7effec102290 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec19fa40 con 0x7effec102290 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.924+0000 7effd3fff640 1 -- 172.21.15.17:0/1469631998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4004a00 con 0x7effec102290 2024-03-16T10:52:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.925+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec19ff40 con 0x7effec102290 2024-03-16T10:52:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7effd3fff640 1 -- 172.21.15.17:0/1469631998 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7effe40051d0 con 0x7effec102290 2024-03-16T10:52:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 Processor -- start 2024-03-16T10:52:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 -- start start 2024-03-16T10:52:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b41c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b424160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56444b381500 con 0x56444b41cb60 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56444b329be0 con 0x56444b421cd0 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7efff3c39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56444b37d5a0 con 0x56444b41c170 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7effead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7effead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50642/0 (socket says 172.21.15.17:50642) 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7effead9d640 1 -- 172.21.15.17:0/3833617800 learned_addr learned my addr 172.21.15.17:0/3833617800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.927+0000 7effea59c640 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b424160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effea59c640 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b41c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 -- 172.21.15.17:0/3833617800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 msgr2=0x56444b41c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b41c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 -- 172.21.15.17:0/3833617800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 msgr2=0x56444b424160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b424160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 -- 172.21.15.17:0/3833617800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56444b33d4b0 con 0x56444b41cb60 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effd3fff640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 0x7effd40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effea59c640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 0x7effd40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effead9d640 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7effdc037040 tx=0x7effdc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ca6d74d88842dd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effd3fff640 1 -- 172.21.15.17:0/1469631998 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7effe40ce930 con 0x7effec102290 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effd17fa640 1 -- 172.21.15.17:0/3833617800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc043070 con 0x56444b41cb60 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effd17fa640 1 -- 172.21.15.17:0/3833617800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc02cca0 con 0x56444b41cb60 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.928+0000 7effd17fa640 1 -- 172.21.15.17:0/3833617800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc039040 con 0x56444b41cb60 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- 172.21.15.17:0/3833617800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 msgr2=0x56444b421660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7effdc037040 tx=0x7effdc005ef0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7effea59c640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 0x7effd40a4cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x56444b41d3c0 tx=0x7effe0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- 172.21.15.17:0/3833617800 shutdown_connections 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b424160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b421660 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 --2- 172.21.15.17:0/3833617800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b41c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- 172.21.15.17:0/3833617800 >> 172.21.15.17:0/3833617800 conn(0x56444b4176e0 msgr2=0x56444b417ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- 172.21.15.17:0/3833617800 shutdown_connections 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- 172.21.15.17:0/3833617800 wait complete. 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 -- start start 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.929+0000 7efff3c39740 1 Processor -- start 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41cb60 0x56444b426b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 0x56444b42db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56444b424c20 con 0x56444b421cd0 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56444b33d160 con 0x56444b41c170 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56444b424da0 con 0x56444b41cb60 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 10 client.0 _ll_register_callbacks cb 0x56444b321150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 0x56444b42db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42838/0 (socket says 172.21.15.17:42838) 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effead9d640 1 -- 172.21.15.17:0/3596602362 learned_addr learned my addr 172.21.15.17:0/3596602362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:33.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effea59c640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41cb60 0x56444b426b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 -- 172.21.15.17:0/3596602362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41cb60 msgr2=0x56444b426b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41cb60 0x56444b426b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 -- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 msgr2=0x56444b426600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 -- 172.21.15.17:0/3596602362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56444b15f7d0 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effead9d640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effeb59e640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 0x56444b42db80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7effe40cc520 tx=0x7effe4005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55244f50b116be59 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effceff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40b4060 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7effe40a3680 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effdc02cca0 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7effe401c040 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 10 client.15930 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.930+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56444b0953f0 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc02cca0 con 0x56444b421cd0 2024-03-16T10:52:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7effe40bb100 con 0x56444b421cd0 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 10 client.15930 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 20 client.15930 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b432100 0x56444b4345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 4 client.15930 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56444b38ea40 con 0x56444b432100 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7effead9d640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b432100 0x56444b4345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7effceff5640 10 client.15930 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.931+0000 7effead9d640 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b432100 0x56444b4345c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbbcd163a3be24cb server_cookie=5ec7dcef2bd5d38d in_seq=0 out_seq=0 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7effceff5640 1 -- 172.21.15.17:0/3596602362 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56444b38ea40 con 0x56444b432100 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7effceff5640 10 client.15930 handle_command_reply: tid=0 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 client.15930 shutdown 2024-03-16T10:52:33.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 msgr2=0x56444b42db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 0x56444b42db80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7effe40cc520 tx=0x7effe4005650 comp rx=0 tx=0).stop 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 shutdown_connections 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b432100 0x56444b4345c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b421cd0 0x56444b42db80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41cb60 0x56444b426b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7effceff5640 0 client.15930 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 --2- 172.21.15.17:0/3596602362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41c170 0x56444b426600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 >> 172.21.15.17:0/3596602362 conn(0x56444b4176e0 msgr2=0x56444b416900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 shutdown_connections 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 1 -- 172.21.15.17:0/3596602362 wait complete. 2024-03-16T10:52:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.932+0000 7efff3c39740 20 client.15930 trim_cache size 0 max 16384 2024-03-16T10:52:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 Processor -- start 2024-03-16T10:52:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 -- start start 2024-03-16T10:52:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41cb60 0x56444b42db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 0x56444b416070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effec1a8bd0 con 0x56444b41c170 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effec1aa710 con 0x56444b41cb60 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7efff3c39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effec1a92a0 con 0x56444b421cd0 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50658/0 (socket says 172.21.15.17:50658) 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 -- 172.21.15.17:0/3272778483 learned_addr learned my addr 172.21.15.17:0/3272778483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effea59c640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41cb60 0x56444b42db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effeb59e640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 0x56444b416070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 -- 172.21.15.17:0/3272778483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 msgr2=0x56444b416070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 0x56444b416070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 -- 172.21.15.17:0/3272778483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41cb60 msgr2=0x56444b42db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41cb60 0x56444b42db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 -- 172.21.15.17:0/3272778483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56444b0550f0 con 0x56444b41c170 2024-03-16T10:52:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effeb59e640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 0x56444b416070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.960+0000 7effead9d640 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7effdc02c700 tx=0x7effdc02c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb7bc91c69c8f8c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7effd0ff9640 1 -- 172.21.15.17:0/3272778483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc057070 con 0x56444b41c170 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7effd0ff9640 1 -- 172.21.15.17:0/3272778483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc032d90 con 0x56444b41c170 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7effd0ff9640 1 -- 172.21.15.17:0/3272778483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc02de60 con 0x56444b41c170 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- 172.21.15.17:0/3272778483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 msgr2=0x56444b4128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7effdc02c700 tx=0x7effdc02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- 172.21.15.17:0/3272778483 shutdown_connections 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b421cd0 0x56444b416070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b41cb60 0x56444b42db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 --2- 172.21.15.17:0/3272778483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41c170 0x56444b4128e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- 172.21.15.17:0/3272778483 >> 172.21.15.17:0/3272778483 conn(0x56444b4176e0 msgr2=0x56444b41e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- 172.21.15.17:0/3272778483 shutdown_connections 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- 172.21.15.17:0/3272778483 wait complete. 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.961+0000 7efff3c39740 1 -- start start 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 Processor -- start 2024-03-16T10:52:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b42b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b42c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effec1aa040 con 0x56444b41cb60 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effec1a9970 con 0x56444b421cd0 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effec1a6bb0 con 0x56444b41c170 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7efff3c39740 10 client.0 _ll_register_callbacks cb 0x7effe4097610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50670/0 (socket says 172.21.15.17:50670) 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 -- 172.21.15.17:0/3980084159 learned_addr learned my addr 172.21.15.17:0/3980084159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effeb59e640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b42c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effead9d640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b42b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 -- 172.21.15.17:0/3980084159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 msgr2=0x56444b42b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b42b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 -- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 msgr2=0x56444b42c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b42c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 -- 172.21.15.17:0/3980084159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56444b3489d0 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effea59c640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe0004000 tx=0x7effe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d61607dd4dfd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.962+0000 7effceff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0030060 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7effe001a070 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56444b388d90 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7effe001f410 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 10 client.15936 fetch_fsmap learned FSMap version 27 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56444b42de80 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56444b388d90 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7effe0035070 con 0x56444b41cb60 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 10 client.15936 fetch_fsmap finished waiting for FSMap version 27 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 20 client.15936 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:33.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b498c30 0x56444b49b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 4 client.15936 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56444b306540 con 0x56444b498c30 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.963+0000 7effead9d640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b498c30 0x56444b49b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7effead9d640 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b498c30 0x56444b49b050 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d5c403f51b6960 server_cookie=681cf222e8479a28 in_seq=0 out_seq=0 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7effceff5640 10 client.15936 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7effceff5640 1 -- 172.21.15.17:0/3980084159 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56444b306540 con 0x56444b498c30 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7effceff5640 10 client.15936 handle_command_reply: tid=0 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 client.15936 shutdown 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 msgr2=0x56444b42b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe0004000 tx=0x7effe00046c0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 shutdown_connections 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56444b498c30 0x56444b49b050 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56444b421cd0 0x56444b42c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56444b41cb60 0x56444b42b6f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7effceff5640 0 client.15936 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 --2- 172.21.15.17:0/3980084159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56444b41c170 0x56444b42b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 >> 172.21.15.17:0/3980084159 conn(0x56444b4176e0 msgr2=0x56444b41a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 shutdown_connections 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 1 -- 172.21.15.17:0/3980084159 wait complete. 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.964+0000 7efff3c39740 20 client.15936 trim_cache size 0 max 16384 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-03-16T10:52:33.971 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 msgr2=0x7effd40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 0x7effd40a4cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x56444b41d3c0 tx=0x7effe0005850 comp rx=0 tx=0).stop 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 msgr2=0x7effec19f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 0x7effec19f0e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7effe400e970 tx=0x7effe400ee30 comp rx=0 tx=0).stop 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 shutdown_connections 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7effd40a2800 0x7effd40a4cc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effec102290 0x7effec19f0e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effec1018d0 0x7effec198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 --2- 172.21.15.17:0/1469631998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effec1006e0 0x7effec197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:33.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 >> 172.21.15.17:0/1469631998 conn(0x7effec0fbc70 msgr2=0x7effec068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:33.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 shutdown_connections 2024-03-16T10:52:33.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:33.965+0000 7efff104b640 1 -- 172.21.15.17:0/1469631998 wait complete. 2024-03-16T10:52:33.976 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T10:52:33.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 -- 172.21.15.17:0/900332305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 msgr2=0x7f6ca4109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 --2- 172.21.15.17:0/900332305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca4109c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009ca0 tx=0x7f6c9c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 -- 172.21.15.17:0/900332305 shutdown_connections 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 --2- 172.21.15.17:0/900332305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca4109c40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 --2- 172.21.15.17:0/900332305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca41029f0 0x7f6ca4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 --2- 172.21.15.17:0/900332305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca4101800 0x7f6ca4101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 -- 172.21.15.17:0/900332305 >> 172.21.15.17:0/900332305 conn(0x7f6ca40fcd90 msgr2=0x7f6ca40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 -- 172.21.15.17:0/900332305 shutdown_connections 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 -- 172.21.15.17:0/900332305 wait complete. 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.138+0000 7f6ca973b640 1 Processor -- start 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 -- start start 2024-03-16T10:52:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca41029f0 0x7f6ca419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca41a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410d480 con 0x7f6ca4101800 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410d300 con 0x7f6ca41033b0 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca973b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410d600 con 0x7f6ca41029f0 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50692/0 (socket says 172.21.15.17:50692) 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 -- 172.21.15.17:0/1340234488 learned_addr learned my addr 172.21.15.17:0/1340234488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca37fe640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca41a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca27fc640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca41029f0 0x7f6ca419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 -- 172.21.15.17:0/1340234488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca41029f0 msgr2=0x7f6ca419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca41029f0 0x7f6ca419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 -- 172.21.15.17:0/1340234488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 msgr2=0x7f6ca41a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca41a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 -- 172.21.15.17:0/1340234488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca41a1960 con 0x7f6ca4101800 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca37fe640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca41a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.139+0000 7f6ca2ffd640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9c0 tx=0x7f6c9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.140+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400cd80 con 0x7f6ca4101800 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.140+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca41a1c50 con 0x7f6ca4101800 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.140+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca41a21a0 con 0x7f6ca4101800 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.140+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c940035f0 con 0x7f6ca4101800 2024-03-16T10:52:34.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.140+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94010670 con 0x7f6ca4101800 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.141+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c90005290 con 0x7f6ca4101800 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.142+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f6c94004000 con 0x7f6ca4101800 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.142+0000 7f6c8bfff640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 0x7f6c8c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.143+0000 7f6ca27fc640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 0x7f6c8c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.143+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f6c940ceda0 con 0x7f6ca4101800 2024-03-16T10:52:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.143+0000 7f6ca27fc640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 0x7f6c8c0a4cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c980095f0 tx=0x7f6c98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.147+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f6c9409bee0 con 0x7f6ca4101800 2024-03-16T10:52:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.499+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c90005850 con 0x7f6ca4101800 2024-03-16T10:52:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.499+0000 7f6c8bfff640 1 -- 172.21.15.17:0/1340234488 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11935 (secure 0 0 0) 0x7f6c9409b7e0 con 0x7f6ca4101800 2024-03-16T10:52:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:52:34.500 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:50:51.056785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[14655,24497,24470,24493,24536]},"id":1}]} 2024-03-16T10:52:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-03-16T10:52:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.501+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 msgr2=0x7f6c8c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.501+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 0x7f6c8c0a4cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6c980095f0 tx=0x7f6c98005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.501+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 msgr2=0x7f6ca4199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.501+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9c0 tx=0x7f6c9400ee80 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 shutdown_connections 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f6c8c0a2800 0x7f6c8c0a4cc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ca41033b0 0x7f6ca41a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ca41029f0 0x7f6ca419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 --2- 172.21.15.17:0/1340234488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ca4101800 0x7f6ca4199d50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 >> 172.21.15.17:0/1340234488 conn(0x7f6ca40fcd90 msgr2=0x7f6ca4073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 shutdown_connections 2024-03-16T10:52:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.502+0000 7f6ca973b640 1 -- 172.21.15.17:0/1340234488 wait complete. 2024-03-16T10:52:34.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4206553048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81006e0 msgr2=0x7f9fa8100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4206553048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81006e0 0x7f9fa8100b00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009900 tx=0x7f9fa002bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4206553048 shutdown_connections 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4206553048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa8102290 0x7f9fa8108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4206553048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa81018d0 0x7f9fa8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4206553048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81006e0 0x7f9fa8100b00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4206553048 >> 172.21.15.17:0/4206553048 conn(0x7f9fa80fbc70 msgr2=0x7f9fa80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4206553048 shutdown_connections 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.621+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4206553048 wait complete. 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 Processor -- start 2024-03-16T10:52:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 -- start start 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa81006e0 0x7f9fa8197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa8102290 0x7f9fa819f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c3a0 con 0x7f9fa81018d0 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c220 con 0x7f9fa81006e0 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9faf9c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa810c520 con 0x7f9fa8102290 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9fad760640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa81006e0 0x7f9fa8197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50708/0 (socket says 172.21.15.17:50708) 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 -- 172.21.15.17:0/4075329344 learned_addr learned my addr 172.21.15.17:0/4075329344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9fadf61640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa8102290 0x7f9fa819f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 -- 172.21.15.17:0/4075329344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa8102290 msgr2=0x7f9fa819f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa8102290 0x7f9fa819f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 -- 172.21.15.17:0/4075329344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa81006e0 msgr2=0x7f9fa8197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa81006e0 0x7f9fa8197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 -- 172.21.15.17:0/4075329344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa819f7e0 con 0x7f9fa81018d0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.622+0000 7f9facf5f640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9f0 tx=0x7f9f9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.623+0000 7f9fa67fc640 1 -- 172.21.15.17:0/4075329344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00cd80 con 0x7f9fa81018d0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.623+0000 7f9fa67fc640 1 -- 172.21.15.17:0/4075329344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9c005500 con 0x7f9fa81018d0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.623+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa819fad0 con 0x7f9fa81018d0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.623+0000 7f9fa67fc640 1 -- 172.21.15.17:0/4075329344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c010690 con 0x7f9fa81018d0 2024-03-16T10:52:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.623+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81a0020 con 0x7f9fa81018d0 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 Processor -- start 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 -- start start 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b2fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b303c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55689b25c490 con 0x55689b2fc650 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.625+0000 7f9fb25af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55689b204c90 con 0x55689b3017c0 2024-03-16T10:52:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fb25af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55689b258530 con 0x55689b2fbc60 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50716/0 (socket says 172.21.15.17:50716) 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fadf61640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b2fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 -- 172.21.15.17:0/828090678 learned_addr learned my addr 172.21.15.17:0/828090678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 -- 172.21.15.17:0/828090678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 msgr2=0x55689b2fc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b2fc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 -- 172.21.15.17:0/828090678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 msgr2=0x55689b303c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b303c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fa67fc640 1 -- 172.21.15.17:0/4075329344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f9f9c0046c0 con 0x7f9fa81018d0 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 -- 172.21.15.17:0/828090678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55689b2bf500 con 0x55689b2fc650 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fadf61640 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b2fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fad760640 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000c00 tx=0x7f9fa0009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9383e9892811c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9f8f7fe640 1 -- 172.21.15.17:0/828090678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa002c980 con 0x55689b2fc650 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9f8f7fe640 1 -- 172.21.15.17:0/828090678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa002cb20 con 0x55689b2fc650 2024-03-16T10:52:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9f8f7fe640 1 -- 172.21.15.17:0/828090678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00046c0 con 0x55689b2fc650 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.626+0000 7f9fa67fc640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 0x7f9f900a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fadf61640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 0x7f9f900a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fa67fc640 1 -- 172.21.15.17:0/4075329344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9f9c0ced20 con 0x7f9fa81018d0 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fadf61640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 0x7f9f900a4d40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55689b2fceb0 tx=0x7f9f98009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- 172.21.15.17:0/828090678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 msgr2=0x55689b301150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000c00 tx=0x7f9fa0009560 comp rx=0 tx=0).stop 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- 172.21.15.17:0/828090678 shutdown_connections 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b303c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b301150 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 --2- 172.21.15.17:0/828090678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b2fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- 172.21.15.17:0/828090678 >> 172.21.15.17:0/828090678 conn(0x55689b2f2dc0 msgr2=0x55689b2f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- 172.21.15.17:0/828090678 shutdown_connections 2024-03-16T10:52:34.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- 172.21.15.17:0/828090678 wait complete. 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.627+0000 7f9fb25af740 1 -- start start 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 Processor -- start 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b306740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b30d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55689b304710 con 0x55689b2fc650 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55689b218230 con 0x55689b2fbc60 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55689b304890 con 0x55689b3017c0 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fb25af740 10 client.0 _ll_register_callbacks cb 0x55689b254010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fad760640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b306740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fad760640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42896/0 (socket says 172.21.15.17:42896) 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fad760640 1 -- 172.21.15.17:0/526638096 learned_addr learned my addr 172.21.15.17:0/526638096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fadf61640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b30d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 -- 172.21.15.17:0/526638096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 msgr2=0x55689b30d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b30d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 -- 172.21.15.17:0/526638096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 msgr2=0x55689b306200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9facf5f640 1 -- 172.21.15.17:0/526638096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55689b227100 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.628+0000 7f9fad760640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9facf5f640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b306740 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0cc910 tx=0x7f9f9c09b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21080085a4951c45 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0b4060 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9f9c097dd0 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa002cb20 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c09f8b0 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 10 client.15954 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55689af703f0 con 0x55689b2fc650 2024-03-16T10:52:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa002cb20 con 0x55689b2fc650 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9f9c0ccce0 con 0x55689b2fc650 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 10 client.15954 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 20 client.15954 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b314340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 4 client.15954 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.629+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55689b2699d0 con 0x55689b311f20 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9fad760640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b314340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9fad760640 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b314340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=17b34dd39aa81399 server_cookie=5c3e9e6db52d7b04 in_seq=0 out_seq=0 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9f8cff9640 10 client.15954 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9f8cff9640 1 -- 172.21.15.17:0/526638096 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55689b2699d0 con 0x55689b311f20 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9f8cff9640 10 client.15954 handle_command_reply: tid=0 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.630+0000 7f9fb25af740 1 client.15954 shutdown 2024-03-16T10:52:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 msgr2=0x55689b306740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b306740 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0cc910 tx=0x7f9f9c09b360 comp rx=0 tx=0).stop 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 shutdown_connections 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b314340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b30d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9f8cff9640 0 client.15954 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b306740 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 --2- 172.21.15.17:0/526638096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fbc60 0x55689b306200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 >> 172.21.15.17:0/526638096 conn(0x55689b2f2dc0 msgr2=0x55689b2f1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 shutdown_connections 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 1 -- 172.21.15.17:0/526638096 wait complete. 2024-03-16T10:52:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.631+0000 7f9fb25af740 20 client.15954 trim_cache size 0 max 16384 2024-03-16T10:52:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.652+0000 7f9fb25af740 1 Processor -- start 2024-03-16T10:52:34.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.652+0000 7f9fb25af740 1 -- start start 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fc650 0x55689b30d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b304c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a68e0 con 0x55689b2fbc60 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a84e0 con 0x55689b2fc650 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fb25af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a6fb0 con 0x55689b3017c0 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50742/0 (socket says 172.21.15.17:50742) 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 -- 172.21.15.17:0/1400600912 learned_addr learned my addr 172.21.15.17:0/1400600912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9facf5f640 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fc650 0x55689b30d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fadf61640 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b304c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 -- 172.21.15.17:0/1400600912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 msgr2=0x55689b304c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b304c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 -- 172.21.15.17:0/1400600912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fc650 msgr2=0x55689b30d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fc650 0x55689b30d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 -- 172.21.15.17:0/1400600912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55689b03a7d0 con 0x55689b2fbc60 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9fad760640 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9fa002c7b0 tx=0x7f9fa002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85e8d3dad9f5ed3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9f8effd640 1 -- 172.21.15.17:0/1400600912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0005d50 con 0x55689b2fbc60 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9f8effd640 1 -- 172.21.15.17:0/1400600912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa0051070 con 0x55689b2fbc60 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.653+0000 7f9f8effd640 1 -- 172.21.15.17:0/1400600912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa003fdc0 con 0x55689b2fbc60 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- 172.21.15.17:0/1400600912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 msgr2=0x55689b305820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9fa002c7b0 tx=0x7f9fa002bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- 172.21.15.17:0/1400600912 shutdown_connections 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b3017c0 0x55689b304c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b2fc650 0x55689b30d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 --2- 172.21.15.17:0/1400600912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fbc60 0x55689b305820 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- 172.21.15.17:0/1400600912 >> 172.21.15.17:0/1400600912 conn(0x55689b2f2dc0 msgr2=0x55689b2fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- 172.21.15.17:0/1400600912 shutdown_connections 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- 172.21.15.17:0/1400600912 wait complete. 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 -- start start 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.654+0000 7f9fb25af740 1 Processor -- start 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b30a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b30be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a7d50 con 0x55689b2fc650 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a7680 con 0x55689b3017c0 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a48e0 con 0x55689b2fbc60 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fb25af740 10 client.0 _ll_register_callbacks cb 0x7f9f9c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50758/0 (socket says 172.21.15.17:50758) 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 -- 172.21.15.17:0/2457716461 learned_addr learned my addr 172.21.15.17:0/2457716461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fad760640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b30a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fadf61640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b30be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 -- 172.21.15.17:0/2457716461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 msgr2=0x55689b30a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b30a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 -- 172.21.15.17:0/2457716461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 msgr2=0x55689b30be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b30be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 -- 172.21.15.17:0/2457716461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55689b30c410 con 0x55689b2fc650 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9fad760640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b30a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9facf5f640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0049d0 tx=0x7f9f9c0ba170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224c76700ab632db server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.655+0000 7f9f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c0a3f00 con 0x55689b2fc650 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9f9c0a3a70 con 0x55689b2fc650 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa0051070 con 0x55689b2fc650 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c0afe50 con 0x55689b2fc650 2024-03-16T10:52:34.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55689b30d710 con 0x55689b2fc650 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fa0051070 con 0x55689b2fc650 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9f9c0ccce0 con 0x55689b2fc650 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 10 client.15960 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 20 client.15960 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b37a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 4 client.15960 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55689b305ff0 con 0x55689b311f20 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.656+0000 7f9fad760640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b37a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fad760640 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b37a6b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b3c4fbea43dc96e0 server_cookie=b4ae1db1538a78a in_seq=0 out_seq=0 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9f8cff9640 10 client.15960 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9f8cff9640 1 -- 172.21.15.17:0/2457716461 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55689b305ff0 con 0x55689b311f20 2024-03-16T10:52:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9f8cff9640 10 client.15960 handle_command_reply: tid=0 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 client.15960 shutdown 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 msgr2=0x55689b30ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0049d0 tx=0x7f9f9c0ba170 comp rx=0 tx=0).stop 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 shutdown_connections 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55689b311f20 0x55689b37a6b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55689b3017c0 0x55689b30be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55689b2fc650 0x55689b30ae10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 --2- 172.21.15.17:0/2457716461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55689b2fbc60 0x55689b30a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9f8cff9640 0 client.15960 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 >> 172.21.15.17:0/2457716461 conn(0x55689b2f2dc0 msgr2=0x55689b2f6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 shutdown_connections 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 1 -- 172.21.15.17:0/2457716461 wait complete. 2024-03-16T10:52:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.657+0000 7f9fb25af740 20 client.15960 trim_cache size 0 max 16384 2024-03-16T10:52:34.665 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 msgr2=0x7f9f900a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 0x7f9f900a4d40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55689b2fceb0 tx=0x7f9f98009500 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 msgr2=0x7f9fa8198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9f0 tx=0x7f9f9c00edf0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 shutdown_connections 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9f900a2880 0x7f9f900a4d40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fa8102290 0x7f9fa819f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fa81018d0 0x7f9fa8198100 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 --2- 172.21.15.17:0/4075329344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fa81006e0 0x7f9fa8197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 >> 172.21.15.17:0/4075329344 conn(0x7f9fa80fbc70 msgr2=0x7f9fa80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 shutdown_connections 2024-03-16T10:52:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.658+0000 7f9faf9c4640 1 -- 172.21.15.17:0/4075329344 wait complete. 2024-03-16T10:52:34.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 -- 172.21.15.17:0/2738288577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b94102290 msgr2=0x7f5b94108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/2738288577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b94102290 0x7f5b94108b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009be0 tx=0x7f5b8c02bef0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 -- 172.21.15.17:0/2738288577 shutdown_connections 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/2738288577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b94102290 0x7f5b94108b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/2738288577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941018d0 0x7f5b94101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/2738288577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b941006e0 0x7f5b94100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 -- 172.21.15.17:0/2738288577 >> 172.21.15.17:0/2738288577 conn(0x7f5b940fbc70 msgr2=0x7f5b940fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 -- 172.21.15.17:0/2738288577 shutdown_connections 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.776+0000 7f5b9abdf640 1 -- 172.21.15.17:0/2738288577 wait complete. 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 Processor -- start 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 -- start start 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941006e0 0x7f5b94197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941018d0 0x7f5b94198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410c360 con 0x7f5b94102290 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410c1e0 con 0x7f5b941006e0 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9abdf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9410c4e0 con 0x7f5b941018d0 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50764/0 (socket says 172.21.15.17:50764) 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 -- 172.21.15.17:0/1951181184 learned_addr learned my addr 172.21.15.17:0/1951181184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9897b640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941006e0 0x7f5b94197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b93fff640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941018d0 0x7f5b94198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 -- 172.21.15.17:0/1951181184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941018d0 msgr2=0x7f5b94198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941018d0 0x7f5b94198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 -- 172.21.15.17:0/1951181184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941006e0 msgr2=0x7f5b94197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941006e0 0x7f5b94197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 -- 172.21.15.17:0/1951181184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9419f6e0 con 0x7f5b94102290 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.777+0000 7f5b9917c640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c036040 tx=0x7f5b8c0337b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.778+0000 7f5b91ffb640 1 -- 172.21.15.17:0/1951181184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c043020 con 0x7f5b94102290 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.778+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9419f970 con 0x7f5b94102290 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.778+0000 7f5b91ffb640 1 -- 172.21.15.17:0/1951181184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8c02ca60 con 0x7f5b94102290 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.778+0000 7f5b91ffb640 1 -- 172.21.15.17:0/1951181184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c034690 con 0x7f5b94102290 2024-03-16T10:52:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.778+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9419ff10 con 0x7f5b94102290 2024-03-16T10:52:34.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.780+0000 7f5b91ffb640 1 -- 172.21.15.17:0/1951181184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f5b8c046020 con 0x7f5b94102290 2024-03-16T10:52:34.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b91ffb640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 0x7f5b840a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 Processor -- start 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 -- start start 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b91ffb640 1 -- 172.21.15.17:0/1951181184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5b8c0f0fe0 con 0x7f5b94102290 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9897b640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 0x7f5b840a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb230080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb237c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb190490 con 0x55f5fb2357c0 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb138c90 con 0x55f5fb230650 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb18c530 con 0x55f5fb22fc60 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb237c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42946/0 (socket says 172.21.15.17:42946) 2024-03-16T10:52:34.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b93fff640 1 -- 172.21.15.17:0/1078068431 learned_addr learned my addr 172.21.15.17:0/1078068431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9897b640 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb230080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b9897b640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 0x7f5b840a4cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b94101730 tx=0x7f5b88011810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.781+0000 7f5b93fff640 1 -- 172.21.15.17:0/1078068431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 msgr2=0x55f5fb230080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b93fff640 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb230080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b93fff640 1 -- 172.21.15.17:0/1078068431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 msgr2=0x55f5fb237c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b93fff640 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb237c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b93fff640 1 -- 172.21.15.17:0/1078068431 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5fb1f3500 con 0x55f5fb230650 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b9897b640 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb230080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b93fff640 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009ca0 tx=0x7f5b80011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b573bc6aace8aa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b7effd640 1 -- 172.21.15.17:0/1078068431 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8001e070 con 0x55f5fb230650 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b7effd640 1 -- 172.21.15.17:0/1078068431 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b80019b10 con 0x55f5fb230650 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.782+0000 7f5b7effd640 1 -- 172.21.15.17:0/1078068431 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000ea30 con 0x55f5fb230650 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/1078068431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 msgr2=0x55f5fb235150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009ca0 tx=0x7f5b80011810 comp rx=0 tx=0).stop 2024-03-16T10:52:34.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/1078068431 shutdown_connections 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb237c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb230650 0x55f5fb235150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/1078068431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb230080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/1078068431 >> 172.21.15.17:0/1078068431 conn(0x55f5fb226dc0 msgr2=0x55f5fb2271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/1078068431 shutdown_connections 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/1078068431 wait complete. 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- start start 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 Processor -- start 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 0x55f5fb241730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb238770 con 0x55f5fb230650 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb14c230 con 0x55f5fb22fc60 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.783+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f5fb2388f0 con 0x55f5fb2357c0 2024-03-16T10:52:34.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9d7c6740 10 client.0 _ll_register_callbacks cb 0x55f5fb188010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9897b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 0x55f5fb241730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50788/0 (socket says 172.21.15.17:50788) 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 -- 172.21.15.17:0/3431669692 learned_addr learned my addr 172.21.15.17:0/3431669692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 -- 172.21.15.17:0/3431669692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 msgr2=0x55f5fb241730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 0x55f5fb241730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 -- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 msgr2=0x55f5fb23a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 -- 172.21.15.17:0/3431669692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5fb15b100 con 0x55f5fb230650 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9917c640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 0x55f5fb241730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b93fff640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009710 tx=0x7f5b80009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a738fe1580812b6f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b73fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:34.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80028030 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5b80019cc0 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b80019b10 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b8001e040 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9d7c6740 10 client.15972 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.784+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5faea43f0 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b80019b10 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5b8000ec60 con 0x55f5fb230650 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 10 client.15972 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 10 client.15972 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 20 client.15972 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb245e10 0x55f5fb248220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 4 client.15972 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5fb19d9d0 con 0x55f5fb245e10 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9897b640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb245e10 0x55f5fb248220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b73fff640 10 client.15972 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:34.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.785+0000 7f5b9897b640 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb245e10 0x55f5fb248220 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1ba95bb9a91a251 server_cookie=68fd4d72f7dbf02e in_seq=0 out_seq=0 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.786+0000 7f5b73fff640 1 -- 172.21.15.17:0/3431669692 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f5fb19d9d0 con 0x55f5fb245e10 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.786+0000 7f5b73fff640 10 client.15972 handle_command_reply: tid=0 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.786+0000 7f5b9d7c6740 1 client.15972 shutdown 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.786+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 msgr2=0x55f5fb23a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.786+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009710 tx=0x7f5b80009950 comp rx=0 tx=0).stop 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 shutdown_connections 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb245e10 0x55f5fb248220 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb2357c0 0x55f5fb241730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b73fff640 0 client.15972 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb23a6f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/3431669692 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 >> 172.21.15.17:0/3431669692 conn(0x55f5fb226dc0 msgr2=0x55f5fb225fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 shutdown_connections 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/3431669692 wait complete. 2024-03-16T10:52:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.787+0000 7f5b9d7c6740 20 client.15972 trim_cache size 0 max 16384 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 Processor -- start 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 -- start start 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb2357c0 0x55f5fb225c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a6930 con 0x55f5fb230650 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a8530 con 0x55f5fb2357c0 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a7000 con 0x55f5fb22fc60 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9897b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9897b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55520/0 (socket says 172.21.15.17:55520) 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9897b640 1 -- 172.21.15.17:0/2978217681 learned_addr learned my addr 172.21.15.17:0/2978217681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50802/0 (socket says 172.21.15.17:50802) 2024-03-16T10:52:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.800+0000 7f5b9917c640 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb2357c0 0x55f5fb225c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 -- 172.21.15.17:0/2978217681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb2357c0 msgr2=0x55f5fb225c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb2357c0 0x55f5fb225c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 -- 172.21.15.17:0/2978217681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 msgr2=0x55f5fb2416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 -- 172.21.15.17:0/2978217681 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5faf6e7d0 con 0x55f5fb22fc60 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b93fff640 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9897b640 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55f5fb230eb0 tx=0x7f5b8801c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbb9f7596d571a1f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b7e7fc640 1 -- 172.21.15.17:0/2978217681 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88017040 con 0x55f5fb22fc60 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b7e7fc640 1 -- 172.21.15.17:0/2978217681 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b88019050 con 0x55f5fb22fc60 2024-03-16T10:52:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b7e7fc640 1 -- 172.21.15.17:0/2978217681 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88003850 con 0x55f5fb22fc60 2024-03-16T10:52:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2978217681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 msgr2=0x55f5fb225750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.801+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55f5fb230eb0 tx=0x7f5b8801c000 comp rx=0 tx=0).stop 2024-03-16T10:52:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2978217681 shutdown_connections 2024-03-16T10:52:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb2357c0 0x55f5fb225c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb230650 0x55f5fb2416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2978217681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb22fc60 0x55f5fb225750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2978217681 >> 172.21.15.17:0/2978217681 conn(0x55f5fb226dc0 msgr2=0x55f5fb242180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2978217681 shutdown_connections 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2978217681 wait complete. 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- start start 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 Processor -- start 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb2aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a7da0 con 0x55f5fb2357c0 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a76d0 con 0x55f5fb22fc60 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941a4910 con 0x55f5fb230650 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9d7c6740 10 client.0 _ll_register_callbacks cb 0x7f5b8001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb2aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9897b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9897b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:42970/0 (socket says 172.21.15.17:42970) 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b93fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55528/0 (socket says 172.21.15.17:55528) 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9917c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb2aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50808/0 (socket says 172.21.15.17:50808) 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.802+0000 7f5b9897b640 1 -- 172.21.15.17:0/2426038980 learned_addr learned my addr 172.21.15.17:0/2426038980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 -- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 msgr2=0x55f5fb23e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 -- 172.21.15.17:0/2426038980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 msgr2=0x55f5fb2aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb2aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 -- 172.21.15.17:0/2426038980 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5fb2aa690 con 0x55f5fb230650 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b93fff640 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b80004710 tx=0x7f5b80009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d88859895d3eacd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b73fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80028040 con 0x55f5fb230650 2024-03-16T10:52:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5b80005bf0 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b88019050 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b80004040 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b9d7c6740 10 client.25807 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5fb2ab940 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.803+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b88019050 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5b80003cd0 con 0x55f5fb230650 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 10 client.25807 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 10 client.25807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 20 client.25807 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb2ac2c0 0x55f5fb2ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 4 client.25807 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5fb239fa0 con 0x55f5fb2ac2c0 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9897b640 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb2ac2c0 0x55f5fb2ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9897b640 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb2ac2c0 0x55f5fb2ae6e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=753a9bbae0a3758c server_cookie=ad14bc9824830aaa in_seq=0 out_seq=0 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b73fff640 10 client.25807 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b73fff640 1 -- 172.21.15.17:0/2426038980 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5fb239fa0 con 0x55f5fb2ac2c0 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b73fff640 10 client.25807 handle_command_reply: tid=0 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.804+0000 7f5b9d7c6740 1 client.25807 shutdown 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 msgr2=0x55f5fb23eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b80004710 tx=0x7f5b80009f40 comp rx=0 tx=0).stop 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 shutdown_connections 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55f5fb2ac2c0 0x55f5fb2ae6e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f5fb2357c0 0x55f5fb2aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f5fb230650 0x55f5fb23eb10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b73fff640 0 client.25807 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 --2- 172.21.15.17:0/2426038980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55f5fb22fc60 0x55f5fb23e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 >> 172.21.15.17:0/2426038980 conn(0x55f5fb226dc0 msgr2=0x55f5fb22a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 shutdown_connections 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 1 -- 172.21.15.17:0/2426038980 wait complete. 2024-03-16T10:52:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9d7c6740 20 client.25807 trim_cache size 0 max 16384 2024-03-16T10:52:34.812 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 msgr2=0x7f5b840a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 0x7f5b840a4cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b94101730 tx=0x7f5b88011810 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 msgr2=0x7f5b9419f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c036040 tx=0x7f5b8c0337b0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 shutdown_connections 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5b840a2800 0x7f5b840a4cc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b94102290 0x7f5b9419f070 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941018d0 0x7f5b94198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 --2- 172.21.15.17:0/1951181184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b941006e0 0x7f5b94197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 >> 172.21.15.17:0/1951181184 conn(0x7f5b940fbc70 msgr2=0x7f5b940fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 shutdown_connections 2024-03-16T10:52:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.805+0000 7f5b9abdf640 1 -- 172.21.15.17:0/1951181184 wait complete. 2024-03-16T10:52:34.816 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:34 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1340234488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:34.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T10:52:34.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:34 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1340234488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- 172.21.15.17:0/1675026508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01006e0 msgr2=0x7fb8a0100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/1675026508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01006e0 0x7fb8a0100b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb890009ca0 tx=0x7fb89002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- 172.21.15.17:0/1675026508 shutdown_connections 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/1675026508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a0108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/1675026508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01018d0 0x7fb8a0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/1675026508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01006e0 0x7fb8a0100b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- 172.21.15.17:0/1675026508 >> 172.21.15.17:0/1675026508 conn(0x7fb8a00fbc70 msgr2=0x7fb8a00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- 172.21.15.17:0/1675026508 shutdown_connections 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- 172.21.15.17:0/1675026508 wait complete. 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 Processor -- start 2024-03-16T10:52:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.926+0000 7fb8a5b16640 1 -- start start 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01006e0 0x7fb8a0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01018d0 0x7fb8a0198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010c350 con 0x7fb8a0102290 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010c1d0 con 0x7fb8a01006e0 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb8a5b16640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010c4d0 con 0x7fb8a01018d0 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50826/0 (socket says 172.21.15.17:50826) 2024-03-16T10:52:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 -- 172.21.15.17:0/2042048346 learned_addr learned my addr 172.21.15.17:0/2042048346 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01006e0 0x7fb8a0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89effd640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01018d0 0x7fb8a0198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 -- 172.21.15.17:0/2042048346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01018d0 msgr2=0x7fb8a0198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01018d0 0x7fb8a0198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 -- 172.21.15.17:0/2042048346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01006e0 msgr2=0x7fb8a0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01006e0 0x7fb8a0197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 -- 172.21.15.17:0/2042048346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a019f770 con 0x7fb8a0102290 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89ffff640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb89800e970 tx=0x7fb89800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.927+0000 7fb89cff9640 1 -- 172.21.15.17:0/2042048346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89800ccc0 con 0x7fb8a0102290 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.928+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a019fa60 con 0x7fb8a0102290 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.928+0000 7fb89cff9640 1 -- 172.21.15.17:0/2042048346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb89800ce60 con 0x7fb8a0102290 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.928+0000 7fb89cff9640 1 -- 172.21.15.17:0/2042048346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898010490 con 0x7fb8a0102290 2024-03-16T10:52:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.928+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a019ff60 con 0x7fb8a0102290 2024-03-16T10:52:34.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb89cff9640 1 -- 172.21.15.17:0/2042048346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fb898005020 con 0x7fb8a0102290 2024-03-16T10:52:34.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 Processor -- start 2024-03-16T10:52:34.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 -- start start 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 0x55e92791fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e927927840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e927884490 con 0x55e927920240 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e92782cc90 con 0x55e92791f850 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e927880530 con 0x55e9279253b0 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb89cff9640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 0x7fb8880a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb89effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 0x55e92791fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.930+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50834/0 (socket says 172.21.15.17:50834) 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89f7fe640 1 -- 172.21.15.17:0/941908060 learned_addr learned my addr 172.21.15.17:0/941908060 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e927927840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89ffff640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 0x7fb8880a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89cff9640 1 -- 172.21.15.17:0/2042048346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb8980cee40 con 0x7fb8a0102290 2024-03-16T10:52:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 -- 172.21.15.17:0/941908060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 msgr2=0x55e927927840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e927927840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 -- 172.21.15.17:0/941908060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 msgr2=0x55e927924d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 -- 172.21.15.17:0/941908060 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9278e7500 con 0x55e92791f850 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89ffff640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 0x7fb8880a4cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb89800d010 tx=0x7fb898086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb89effd640 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 0x55e92791fc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0199060 tx=0x7fb894004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97b798ef4e572ae6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb885ffb640 1 -- 172.21.15.17:0/941908060 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894004050 con 0x55e92791f850 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb885ffb640 1 -- 172.21.15.17:0/941908060 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb89400fca0 con 0x55e92791f850 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.931+0000 7fb885ffb640 1 -- 172.21.15.17:0/941908060 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894003950 con 0x55e92791f850 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- 172.21.15.17:0/941908060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 msgr2=0x55e92791fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 0x55e92791fc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0199060 tx=0x7fb894004730 comp rx=0 tx=0).stop 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- 172.21.15.17:0/941908060 shutdown_connections 2024-03-16T10:52:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e927927840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927924d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/941908060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92791f850 0x55e92791fc70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- 172.21.15.17:0/941908060 >> 172.21.15.17:0/941908060 conn(0x55e92791adc0 msgr2=0x55e92791b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- 172.21.15.17:0/941908060 shutdown_connections 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- 172.21.15.17:0/941908060 wait complete. 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.932+0000 7fb8a87d6740 1 -- start start 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 Processor -- start 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e927920240 0x55e92792a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e9279312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e927928360 con 0x55e92791f850 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e927840230 con 0x55e927920240 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e9279284e0 con 0x55e9279253b0 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb8a87d6740 10 client.0 _ll_register_callbacks cb 0x55e92787c010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50846/0 (socket says 172.21.15.17:50846) 2024-03-16T10:52:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 -- 172.21.15.17:0/3528719465 learned_addr learned my addr 172.21.15.17:0/3528719465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e927920240 0x55e92792a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e9279312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 -- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 msgr2=0x55e9279312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e9279312a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 -- 172.21.15.17:0/3528719465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e927920240 msgr2=0x55e92792a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e927920240 0x55e92792a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 -- 172.21.15.17:0/3528719465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92784f100 con 0x55e92791f850 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb89effd640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097a0 tx=0x7fb894005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea98b532f4e13c84 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.933+0000 7fb87effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89402c060 con 0x55e92791f850 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb89401f850 con 0x55e92791f850 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb89400fca0 con 0x55e92791f850 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb89401fa50 con 0x55e92791f850 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 10 client.15990 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9275983f0 con 0x55e92791f850 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb89400fca0 con 0x55e92791f850 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb894031070 con 0x55e92791f850 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 10 client.15990 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 10 client.15990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 20 client.15990 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e9279358c0 0x55e927937cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 4 client.15990 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9278919d0 con 0x55e9279358c0 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.934+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e9279358c0 0x55e927937cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.935+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e9279358c0 0x55e927937cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4375f41fdc05fb66 server_cookie=91bf39a27bc73184 in_seq=0 out_seq=0 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.935+0000 7fb87effd640 10 client.15990 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.935+0000 7fb87effd640 1 -- 172.21.15.17:0/3528719465 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e9278919d0 con 0x55e9279358c0 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.935+0000 7fb87effd640 10 client.15990 handle_command_reply: tid=0 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.935+0000 7fb8a87d6740 1 client.15990 shutdown 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 msgr2=0x55e927929d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097a0 tx=0x7fb894005fd0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 shutdown_connections 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e9279358c0 0x55e927937cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9279253b0 0x55e9279312a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e927920240 0x55e92792a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb87effd640 0 client.15990 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/3528719465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e927929d60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 >> 172.21.15.17:0/3528719465 conn(0x55e92791adc0 msgr2=0x55e927919fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 shutdown_connections 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 1 -- 172.21.15.17:0/3528719465 wait complete. 2024-03-16T10:52:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.936+0000 7fb8a87d6740 20 client.15990 trim_cache size 0 max 16384 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 Processor -- start 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 -- start start 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92791f850 0x55e927919750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927919c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01a8c10 con 0x55e927920240 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01aa810 con 0x55e9279253b0 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01a92e0 con 0x55e92791f850 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50854/0 (socket says 172.21.15.17:50854) 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 -- 172.21.15.17:0/4242465051 learned_addr learned my addr 172.21.15.17:0/4242465051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89effd640 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927919c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89effd640 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92791f850 0x55e927919750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 -- 172.21.15.17:0/4242465051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92791f850 msgr2=0x55e927919750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92791f850 0x55e927919750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 -- 172.21.15.17:0/4242465051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 msgr2=0x55e927919c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927919c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 -- 172.21.15.17:0/4242465051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9276627d0 con 0x55e927920240 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb890032420 tx=0x7fb890032590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5799ab6675225f95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8857fa640 1 -- 172.21.15.17:0/4242465051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89004d070 con 0x55e927920240 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8857fa640 1 -- 172.21.15.17:0/4242465051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb890003970 con 0x55e927920240 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.950+0000 7fb8857fa640 1 -- 172.21.15.17:0/4242465051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890039040 con 0x55e927920240 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- 172.21.15.17:0/4242465051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 msgr2=0x55e927931260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb890032420 tx=0x7fb890032590 comp rx=0 tx=0).stop 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- 172.21.15.17:0/4242465051 shutdown_connections 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927919c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e927920240 0x55e927931260 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/4242465051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92791f850 0x55e927919750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- 172.21.15.17:0/4242465051 >> 172.21.15.17:0/4242465051 conn(0x55e92791adc0 msgr2=0x55e92791b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- 172.21.15.17:0/4242465051 shutdown_connections 2024-03-16T10:52:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- 172.21.15.17:0/4242465051 wait complete. 2024-03-16T10:52:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.951+0000 7fb8a87d6740 1 -- start start 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 Processor -- start 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e927920240 0x55e92792f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927930170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01aa080 con 0x55e92791f850 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01a99b0 con 0x55e9279253b0 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01a6bf0 con 0x55e927920240 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb8a87d6740 10 client.0 _ll_register_callbacks cb 0x7fb898005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50856/0 (socket says 172.21.15.17:50856) 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 -- 172.21.15.17:0/919001122 learned_addr learned my addr 172.21.15.17:0/919001122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e927920240 0x55e92792f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927930170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 -- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e927920240 msgr2=0x55e92792f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e927920240 0x55e92792f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 -- 172.21.15.17:0/919001122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 msgr2=0x55e927930170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927930170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 -- 172.21.15.17:0/919001122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e927930760 con 0x55e92791f850 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb89effd640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb894032d10 tx=0x7fb894005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc99ae232890b21 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb87effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.952+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894037070 con 0x55e92791f850 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb894005070 con 0x55e92791f850 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb890003970 con 0x55e92791f850 2024-03-16T10:52:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb894023040 con 0x55e92791f850 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e92799be00 con 0x55e92791f850 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb890003970 con 0x55e92791f850 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb89403d030 con 0x55e92791f850 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 10 client.15996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 20 client.15996 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e92799c710 0x55e92799eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 4 client.15996 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e92788bd20 con 0x55e92799c710 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.953+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e92799c710 0x55e92799eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb87effd640 10 client.15996 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb89f7fe640 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e92799c710 0x55e92799eb30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51a6350f27335daf server_cookie=e99df5205c1c3eaa in_seq=0 out_seq=0 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb87effd640 1 -- 172.21.15.17:0/919001122 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e92788bd20 con 0x55e92799c710 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb87effd640 10 client.15996 handle_command_reply: tid=0 2024-03-16T10:52:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 client.15996 shutdown 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 msgr2=0x55e92792ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb894032d10 tx=0x7fb894005fd0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 shutdown_connections 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9279253b0 0x55e927930170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55e92799c710 0x55e92799eb30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e927920240 0x55e92792f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 --2- 172.21.15.17:0/919001122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92791f850 0x55e92792ec90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 >> 172.21.15.17:0/919001122 conn(0x55e92791adc0 msgr2=0x55e92791e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb87effd640 0 client.15996 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 shutdown_connections 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 1 -- 172.21.15.17:0/919001122 wait complete. 2024-03-16T10:52:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.954+0000 7fb8a87d6740 20 client.15996 trim_cache size 0 max 16384 2024-03-16T10:52:34.961 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 msgr2=0x7fb8880a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 0x7fb8880a4cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb89800d010 tx=0x7fb898086040 comp rx=0 tx=0).stop 2024-03-16T10:52:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 msgr2=0x7fb8a019f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb89800e970 tx=0x7fb89800ed70 comp rx=0 tx=0).stop 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 shutdown_connections 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb8880a2800 0x7fb8880a4cc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a0102290 0x7fb8a019f100 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8a01018d0 0x7fb8a0198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 --2- 172.21.15.17:0/2042048346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8a01006e0 0x7fb8a0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 >> 172.21.15.17:0/2042048346 conn(0x7fb8a00fbc70 msgr2=0x7fb8a0068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 shutdown_connections 2024-03-16T10:52:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:34.955+0000 7fb8a5b16640 1 -- 172.21.15.17:0/2042048346 wait complete. 2024-03-16T10:52:34.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T10:52:35.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:34 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1340234488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:52:35.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 -- 172.21.15.17:0/856638538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8341018d0 msgr2=0x7fd834101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 --2- 172.21.15.17:0/856638538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8341018d0 0x7fd834101d50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009900 tx=0x7fd81c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 -- 172.21.15.17:0/856638538 shutdown_connections 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 --2- 172.21.15.17:0/856638538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd834102290 0x7fd834108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 --2- 172.21.15.17:0/856638538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8341018d0 0x7fd834101d50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 --2- 172.21.15.17:0/856638538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341006e0 0x7fd834100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 -- 172.21.15.17:0/856638538 >> 172.21.15.17:0/856638538 conn(0x7fd8340fbc70 msgr2=0x7fd8340fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 -- 172.21.15.17:0/856638538 shutdown_connections 2024-03-16T10:52:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 -- 172.21.15.17:0/856638538 wait complete. 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.073+0000 7fd838fa9640 1 Processor -- start 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 -- start start 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 0x7fd834196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341018d0 0x7fd834196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410c360 con 0x7fd834102290 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410c1e0 con 0x7fd8341006e0 2024-03-16T10:52:35.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd838fa9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410c4e0 con 0x7fd8341018d0 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd83259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 0x7fd834196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50884/0 (socket says 172.21.15.17:50884) 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 -- 172.21.15.17:0/1620420065 learned_addr learned my addr 172.21.15.17:0/1620420065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd83259c640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 0x7fd834196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43038/0 (socket says 172.21.15.17:43038) 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd829d9b640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341018d0 0x7fd834196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 -- 172.21.15.17:0/1620420065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341018d0 msgr2=0x7fd834196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341018d0 0x7fd834196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 -- 172.21.15.17:0/1620420065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 msgr2=0x7fd834196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 0x7fd834196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.074+0000 7fd832d9d640 1 -- 172.21.15.17:0/1620420065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83419e640 con 0x7fd834102290 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd832d9d640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00eca0 tx=0x7fd82c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd82bfff640 1 -- 172.21.15.17:0/1620420065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004b20 con 0x7fd834102290 2024-03-16T10:52:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8340689a0 con 0x7fd834102290 2024-03-16T10:52:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd82bfff640 1 -- 172.21.15.17:0/1620420065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd82c004cc0 con 0x7fd834102290 2024-03-16T10:52:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd82bfff640 1 -- 172.21.15.17:0/1620420065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c017650 con 0x7fd834102290 2024-03-16T10:52:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.075+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd834068e70 con 0x7fd834102290 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.077+0000 7fd83bb93740 1 Processor -- start 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.077+0000 7fd82bfff640 1 -- 172.21.15.17:0/1620420065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fd82c005020 con 0x7fd834102290 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.077+0000 7fd83bb93740 1 -- start start 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b28c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b30840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0a8d490 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0a35c90 con 0x55d7e0b28850 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83bb93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0a89530 con 0x55d7e0b29240 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b28c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b30840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55604/0 (socket says 172.21.15.17:55604) 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b30840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50892/0 (socket says 172.21.15.17:50892) 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 -- 172.21.15.17:0/4205718641 learned_addr learned my addr 172.21.15.17:0/4205718641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd82bfff640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 0x7fd8200a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 -- 172.21.15.17:0/4205718641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 msgr2=0x55d7e0b28c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b28c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 -- 172.21.15.17:0/4205718641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 msgr2=0x55d7e0b30840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b30840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd832d9d640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 0x7fd8200a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 -- 172.21.15.17:0/4205718641 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e0af0500 con 0x55d7e0b29240 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd82bfff640 1 -- 172.21.15.17:0/1620420065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd82c0d0420 con 0x7fd834102290 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.078+0000 7fd83259c640 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd824009c80 tx=0x7fd824011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ec9d9d630d32355 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd828d99640 1 -- 172.21.15.17:0/4205718641 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824004220 con 0x55d7e0b29240 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd832d9d640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 0x7fd8200a4cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd82c099370 tx=0x7fd82c0099b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd828d99640 1 -- 172.21.15.17:0/4205718641 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8240043c0 con 0x55d7e0b29240 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd828d99640 1 -- 172.21.15.17:0/4205718641 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824019830 con 0x55d7e0b29240 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 -- 172.21.15.17:0/4205718641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 msgr2=0x55d7e0b2dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd824009c80 tx=0x7fd824011810 comp rx=0 tx=0).stop 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 -- 172.21.15.17:0/4205718641 shutdown_connections 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b30840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b2dd40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4205718641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b28c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.079+0000 7fd83bb93740 1 -- 172.21.15.17:0/4205718641 >> 172.21.15.17:0/4205718641 conn(0x55d7e0b23dc0 msgr2=0x55d7e0b241c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- 172.21.15.17:0/4205718641 shutdown_connections 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- 172.21.15.17:0/4205718641 wait complete. 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- start start 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 Processor -- start 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b28850 0x55d7e0b32d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0b31360 con 0x55d7e0b29240 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0a49230 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d7e0b314e0 con 0x55d7e0b28850 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83bb93740 10 client.0 _ll_register_callbacks cb 0x55d7e0a85010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50896/0 (socket says 172.21.15.17:50896) 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 -- 172.21.15.17:0/1133111842 learned_addr learned my addr 172.21.15.17:0/1133111842 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd829d9b640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b28850 0x55d7e0b32d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd829d9b640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 -- 172.21.15.17:0/1133111842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b28850 msgr2=0x55d7e0b32d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b28850 0x55d7e0b32d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 -- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 msgr2=0x55d7e0b3a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.080+0000 7fd83259c640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b3a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83259c640 1 -- 172.21.15.17:0/1133111842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e0a58100 con 0x55d7e0b29240 2024-03-16T10:52:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83259c640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd824005890 tx=0x7fd824003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f08c942d788ce09 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824028070 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd824003800 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8240043c0 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd824034050 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 10 client.16008 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7e07a13f0 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8240043c0 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd824004960 con 0x55d7e0b29240 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 10 client.16008 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 10 client.16008 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 20 client.16008 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0b3e950 0x55d7e0b40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 4 client.16008 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.081+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7e0a9a9d0 con 0x55d7e0b3e950 2024-03-16T10:52:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.082+0000 7fd829d9b640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0b3e950 0x55d7e0b40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.082+0000 7fd829d9b640 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0b3e950 0x55d7e0b40d90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b37760b1f6ffcebb server_cookie=a3ce7e6204606a3 in_seq=0 out_seq=0 2024-03-16T10:52:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.082+0000 7fd819ffb640 10 client.16008 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd819ffb640 1 -- 172.21.15.17:0/1133111842 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d7e0a9a9d0 con 0x55d7e0b3e950 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd819ffb640 10 client.16008 handle_command_reply: tid=0 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 client.16008 shutdown 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 msgr2=0x55d7e0b332d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd824005890 tx=0x7fd824003d60 comp rx=0 tx=0).stop 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 shutdown_connections 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0b3e950 0x55d7e0b40d90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b3a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b29240 0x55d7e0b332d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd819ffb640 0 client.16008 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 --2- 172.21.15.17:0/1133111842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b28850 0x55d7e0b32d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 >> 172.21.15.17:0/1133111842 conn(0x55d7e0b23dc0 msgr2=0x55d7e0b22fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 shutdown_connections 2024-03-16T10:52:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 1 -- 172.21.15.17:0/1133111842 wait complete. 2024-03-16T10:52:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.083+0000 7fd83bb93740 20 client.16008 trim_cache size 0 max 16384 2024-03-16T10:52:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 Processor -- start 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 -- start start 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b3a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b22750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a69c0 con 0x55d7e0b28850 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a85c0 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd83bb93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a7090 con 0x55d7e0b29240 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50912/0 (socket says 172.21.15.17:50912) 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.097+0000 7fd829d9b640 1 -- 172.21.15.17:0/4083148888 learned_addr learned my addr 172.21.15.17:0/4083148888 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd83259c640 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b3a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b22750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 -- 172.21.15.17:0/4083148888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 msgr2=0x55d7e0b3a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b3a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 -- 172.21.15.17:0/4083148888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 msgr2=0x55d7e0b22750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b22750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 -- 172.21.15.17:0/4083148888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7e0b1f640 con 0x55d7e0b28850 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd829d9b640 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c7b0 tx=0x7fd81c02c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637bb1218d670679 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd81bfff640 1 -- 172.21.15.17:0/4083148888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c054070 con 0x55d7e0b28850 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd81bfff640 1 -- 172.21.15.17:0/4083148888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81c004200 con 0x55d7e0b28850 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.098+0000 7fd81bfff640 1 -- 172.21.15.17:0/4083148888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c003830 con 0x55d7e0b28850 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- 172.21.15.17:0/4083148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 msgr2=0x55d7e0b1ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c7b0 tx=0x7fd81c02c690 comp rx=0 tx=0).stop 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- 172.21.15.17:0/4083148888 shutdown_connections 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b22750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b3a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- 172.21.15.17:0/4083148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b28850 0x55d7e0b1ee70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- 172.21.15.17:0/4083148888 >> 172.21.15.17:0/4083148888 conn(0x55d7e0b23dc0 msgr2=0x55d7e0b2a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- 172.21.15.17:0/4083148888 shutdown_connections 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- 172.21.15.17:0/4083148888 wait complete. 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- start start 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 Processor -- start 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b37ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a7e30 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a7760 con 0x55d7e0b28850 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a49a0 con 0x55d7e0b29240 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd83bb93740 10 client.0 _ll_register_callbacks cb 0x7fd824005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd829d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50922/0 (socket says 172.21.15.17:50922) 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd829d9b640 1 -- 172.21.15.17:0/3765509087 learned_addr learned my addr 172.21.15.17:0/3765509087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.099+0000 7fd829d9b640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd83259c640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b37ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 -- 172.21.15.17:0/3765509087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 msgr2=0x55d7e0b37ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b37ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 -- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 msgr2=0x55d7e0b377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 -- 172.21.15.17:0/3765509087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7e086b7d0 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd829d9b640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c170 tx=0x7fd81c043040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa514f8df764cbf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c062060 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd81c04f750 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81c004200 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd81c054070 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd83bb93740 10 client.16014 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7e0b3a3a0 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.100+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81c004200 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd81c0345e0 con 0x55d7e0b2e3b0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 10 client.16014 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 10 client.16014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 20 client.16014 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0ba5120 0x55d7e0ba7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 4 client.16014 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7e0b2e120 con 0x55d7e0ba5120 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83259c640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0ba5120 0x55d7e0ba7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83259c640 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0ba5120 0x55d7e0ba7540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34fe8cc4139db650 server_cookie=1b015227fb6c94ea in_seq=0 out_seq=0 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd819ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd819ffb640 1 -- 172.21.15.17:0/3765509087 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7e0b2e120 con 0x55d7e0ba5120 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd819ffb640 10 client.16014 handle_command_reply: tid=0 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.101+0000 7fd83bb93740 1 client.16014 shutdown 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 msgr2=0x55d7e0b38c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd81c02c170 tx=0x7fd81c043040 comp rx=0 tx=0).stop 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 shutdown_connections 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7e0b2e3b0 0x55d7e0b38c80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d7e0b29240 0x55d7e0b37ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55d7e0ba5120 0x55d7e0ba7540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 --2- 172.21.15.17:0/3765509087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55d7e0b28850 0x55d7e0b377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd819ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 >> 172.21.15.17:0/3765509087 conn(0x55d7e0b23dc0 msgr2=0x55d7e0b27020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 shutdown_connections 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 1 -- 172.21.15.17:0/3765509087 wait complete. 2024-03-16T10:52:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd83bb93740 20 client.16014 trim_cache size 0 max 16384 2024-03-16T10:52:35.110 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 msgr2=0x7fd8200a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 0x7fd8200a4cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd82c099370 tx=0x7fd82c0099b0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 msgr2=0x7fd83419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00eca0 tx=0x7fd82c00b690 comp rx=0 tx=0).stop 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 shutdown_connections 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd8200a2800 0x7fd8200a4cc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd834102290 0x7fd83419dfd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8341018d0 0x7fd834196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 --2- 172.21.15.17:0/1620420065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8341006e0 0x7fd834196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 >> 172.21.15.17:0/1620420065 conn(0x7fd8340fbc70 msgr2=0x7fd834104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 shutdown_connections 2024-03-16T10:52:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.102+0000 7fd838fa9640 1 -- 172.21.15.17:0/1620420065 wait complete. 2024-03-16T10:52:35.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T10:52:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 -- 172.21.15.17:0/1408240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e801016e0 msgr2=0x7f7e80101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1408240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e801016e0 0x7f7e80101b00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009900 tx=0x7f7e7002bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 -- 172.21.15.17:0/1408240232 shutdown_connections 2024-03-16T10:52:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1408240232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e80103290 0x7f7e80109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1408240232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 0x7f7e80102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1408240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e801016e0 0x7f7e80101b00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.220+0000 7f7e8579d640 1 -- 172.21.15.17:0/1408240232 >> 172.21.15.17:0/1408240232 conn(0x7f7e800fcc50 msgr2=0x7f7e800ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- 172.21.15.17:0/1408240232 shutdown_connections 2024-03-16T10:52:35.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- 172.21.15.17:0/1408240232 wait complete. 2024-03-16T10:52:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 Processor -- start 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- start start 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e801016e0 0x7f7e801979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 0x7f7e80197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010d360 con 0x7f7e80103290 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010d1e0 con 0x7f7e801028d0 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.221+0000 7f7e8579d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010d4e0 con 0x7f7e801016e0 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 0x7f7e80197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50936/0 (socket says 172.21.15.17:50936) 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 -- 172.21.15.17:0/1622713504 learned_addr learned my addr 172.21.15.17:0/1622713504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e801016e0 0x7f7e801979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 -- 172.21.15.17:0/1622713504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e801016e0 msgr2=0x7f7e801979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e801016e0 0x7f7e801979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 -- 172.21.15.17:0/1622713504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 msgr2=0x7f7e80197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 0x7f7e80197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 -- 172.21.15.17:0/1622713504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8019f5c0 con 0x7f7e80103290 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e84f9c640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800eb10 tx=0x7f7e7800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e7d7fa640 1 -- 172.21.15.17:0/1622713504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78004b20 con 0x7f7e80103290 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e7d7fa640 1 -- 172.21.15.17:0/1622713504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e78004cc0 con 0x7f7e80103290 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8019f8b0 con 0x7f7e80103290 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e7d7fa640 1 -- 172.21.15.17:0/1622713504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78010760 con 0x7f7e80103290 2024-03-16T10:52:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.222+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8019fe00 con 0x7f7e80103290 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e7d7fa640 1 -- 172.21.15.17:0/1622713504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f7e78005020 con 0x7f7e80103290 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 Processor -- start 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 -- start start 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69792a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a696ef490 con 0x562a6978aa40 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x562a69697c90 con 0x562a6978b430 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.225+0000 7f7e895eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562a696eb530 con 0x562a697905a0 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7d7fa640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 0x7f7e680a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50952/0 (socket says 172.21.15.17:50952) 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1252796114 learned_addr learned my addr 172.21.15.17:0/1252796114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43106/0 (socket says 172.21.15.17:43106) 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69792a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e84f9c640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 0x7f7e680a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7d7fa640 1 -- 172.21.15.17:0/1622713504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7e780cf0d0 con 0x7f7e80103290 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1252796114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 msgr2=0x562a69792a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69792a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1252796114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 msgr2=0x562a6978ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1252796114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a69752500 con 0x562a6978aa40 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e740117e0 tx=0x7f7e740097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b4258337489b8b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e84f9c640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 0x7f7e680a4cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806e810 tx=0x7f7e7806e840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e667fc640 1 -- 172.21.15.17:0/1252796114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004030 con 0x562a6978aa40 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e667fc640 1 -- 172.21.15.17:0/1252796114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e74005500 con 0x562a6978aa40 2024-03-16T10:52:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.226+0000 7f7e667fc640 1 -- 172.21.15.17:0/1252796114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004d70 con 0x562a6978aa40 2024-03-16T10:52:35.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- 172.21.15.17:0/1252796114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 msgr2=0x562a6978ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e740117e0 tx=0x7f7e740097a0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- 172.21.15.17:0/1252796114 shutdown_connections 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69792a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978b430 0x562a6978ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1252796114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a6978ae60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- 172.21.15.17:0/1252796114 >> 172.21.15.17:0/1252796114 conn(0x562a69785fb0 msgr2=0x562a697863b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- 172.21.15.17:0/1252796114 shutdown_connections 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- 172.21.15.17:0/1252796114 wait complete. 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.227+0000 7f7e895eb740 1 -- start start 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 Processor -- start 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6978b430 0x562a69795460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a697905a0 0x562a6979c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a697934f0 con 0x562a6978aa40 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x562a696ab230 con 0x562a697905a0 2024-03-16T10:52:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562a69793670 con 0x562a6978b430 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e895eb740 10 client.0 _ll_register_callbacks cb 0x562a696e7010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50964/0 (socket says 172.21.15.17:50964) 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1782462216 learned_addr learned my addr 172.21.15.17:0/1782462216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6978b430 0x562a69795460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a697905a0 0x562a6979c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1782462216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6978b430 msgr2=0x562a69795460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6978b430 0x562a69795460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a697905a0 msgr2=0x562a6979c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a697905a0 0x562a6979c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.228+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/1782462216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a696ba100 con 0x562a6978aa40 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009940 tx=0x7f7e74009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458a1bc6c623e8ce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:35.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74005c10 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7e74004d00 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e74005500 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e74004020 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 10 client.16026 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a694033f0 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e74005500 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7e740035f0 con 0x562a6978aa40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 10 client.16026 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 20 client.16026 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a697a0b40 0x562a697a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 4 client.16026 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.229+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a696fc9d0 con 0x562a697a0b40 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.230+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a697a0b40 0x562a697a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.230+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a697a0b40 0x562a697a2f80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f580cc93dfeeacbe server_cookie=aab40f5a7bea7bf3 in_seq=0 out_seq=0 2024-03-16T10:52:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.230+0000 7f7e5f7fe640 10 client.16026 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1782462216 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562a696fc9d0 con 0x562a697a0b40 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e5f7fe640 10 client.16026 handle_command_reply: tid=0 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 client.16026 shutdown 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 msgr2=0x562a69794f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009940 tx=0x7f7e74009c50 comp rx=0 tx=0).stop 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 shutdown_connections 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a697a0b40 0x562a697a2f80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a697905a0 0x562a6979c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a6978b430 0x562a69795460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 --2- 172.21.15.17:0/1782462216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978aa40 0x562a69794f20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e5f7fe640 0 client.16026 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 >> 172.21.15.17:0/1782462216 conn(0x562a69785fb0 msgr2=0x562a69785140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 shutdown_connections 2024-03-16T10:52:35.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 1 -- 172.21.15.17:0/1782462216 wait complete. 2024-03-16T10:52:35.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.233+0000 7f7e895eb740 20 client.16026 trim_cache size 0 max 16384 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 Processor -- start 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 -- start start 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a69795240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a697848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a8ac0 con 0x562a6978b430 2024-03-16T10:52:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801aa6c0 con 0x562a6978aa40 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e895eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9190 con 0x562a697905a0 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a69795240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50978/0 (socket says 172.21.15.17:50978) 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7ffff640 1 -- 172.21.15.17:0/3098128274 learned_addr learned my addr 172.21.15.17:0/3098128274 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a697848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/3098128274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 msgr2=0x562a697848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a697848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/3098128274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 msgr2=0x562a6979c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7f7fe640 1 -- 172.21.15.17:0/3098128274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a694cd7d0 con 0x562a6978aa40 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.247+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a69795240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e74003c80 tx=0x7f7e74004a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e5b04f5b9f17ad server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e65ffb640 1 -- 172.21.15.17:0/3098128274 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74023040 con 0x562a6978aa40 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e65ffb640 1 -- 172.21.15.17:0/3098128274 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e74003d00 con 0x562a6978aa40 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e65ffb640 1 -- 172.21.15.17:0/3098128274 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74005470 con 0x562a6978aa40 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 -- 172.21.15.17:0/3098128274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 msgr2=0x562a69795240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a69795240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e74003c80 tx=0x7f7e74004a80 comp rx=0 tx=0).stop 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 -- 172.21.15.17:0/3098128274 shutdown_connections 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a697848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a6979c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 --2- 172.21.15.17:0/3098128274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a69795240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 -- 172.21.15.17:0/3098128274 >> 172.21.15.17:0/3098128274 conn(0x562a69785fb0 msgr2=0x562a69794b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 -- 172.21.15.17:0/3098128274 shutdown_connections 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.248+0000 7f7e895eb740 1 -- 172.21.15.17:0/3098128274 wait complete. 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 -- start start 2024-03-16T10:52:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 Processor -- start 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a6979c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69799110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9f30 con 0x562a6978b430 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9860 con 0x562a6978aa40 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a6aa0 con 0x562a697905a0 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e895eb740 10 client.0 _ll_register_callbacks cb 0x7f7e780093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50990/0 (socket says 172.21.15.17:50990) 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 -- 172.21.15.17:0/191577756 learned_addr learned my addr 172.21.15.17:0/191577756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a6979c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69799110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 -- 172.21.15.17:0/191577756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 msgr2=0x562a69799110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69799110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 -- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 msgr2=0x562a6979c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a6979c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.249+0000 7f7e7ffff640 1 -- 172.21.15.17:0/191577756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a69799700 con 0x562a6978b430 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a6979c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e7ffff640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7e70036040 tx=0x7f7e70005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bf314a8b7fc221 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7004a020 con 0x562a6978b430 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7e70004240 con 0x562a6978b430 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e74003d00 con 0x562a6978b430 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e70004440 con 0x562a6978b430 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a69805f60 con 0x562a6978b430 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e74003d00 con 0x562a6978b430 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7e700046c0 con 0x562a6978b430 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 20 client.16032 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a69806a00 0x562a69808df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 4 client.16032 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.250+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a696f6d20 con 0x562a69806a00 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.251+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a69806a00 0x562a69808df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.251+0000 7f7e5f7fe640 10 client.16032 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.251+0000 7f7e7f7fe640 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a69806a00 0x562a69808df0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=251a3912a4c9a034 server_cookie=5a7e0490a4c4e856 in_seq=0 out_seq=0 2024-03-16T10:52:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/191577756 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a696f6d20 con 0x562a69806a00 2024-03-16T10:52:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e5f7fe640 10 client.16032 handle_command_reply: tid=0 2024-03-16T10:52:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 client.16032 shutdown 2024-03-16T10:52:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 msgr2=0x562a69798bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7e70036040 tx=0x7f7e70005fd0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 shutdown_connections 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x562a69806a00 0x562a69808df0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562a697905a0 0x562a69799110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a6978b430 0x562a69798bd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 --2- 172.21.15.17:0/191577756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a6978aa40 0x562a6979c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 >> 172.21.15.17:0/191577756 conn(0x562a69785fb0 msgr2=0x562a697848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.254+0000 7f7e5f7fe640 0 client.16032 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 shutdown_connections 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e895eb740 1 -- 172.21.15.17:0/191577756 wait complete. 2024-03-16T10:52:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e895eb740 20 client.16032 trim_cache size 0 max 16384 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 msgr2=0x7f7e680a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 0x7f7e680a4cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806e810 tx=0x7f7e7806e840 comp rx=0 tx=0).stop 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 msgr2=0x7f7e8019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800eb10 tx=0x7f7e7800c2d0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 shutdown_connections 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7e680a2800 0x7f7e680a4cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e80103290 0x7f7e8019ef50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e801028d0 0x7f7e80197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 --2- 172.21.15.17:0/1622713504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e801016e0 0x7f7e801979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 >> 172.21.15.17:0/1622713504 conn(0x7f7e800fcc50 msgr2=0x7f7e80105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 shutdown_connections 2024-03-16T10:52:35.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:35.255+0000 7f7e8579d640 1 -- 172.21.15.17:0/1622713504 wait complete. 2024-03-16T10:52:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:35 smithi017 ceph-mon[32078]: pgmap v404: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-03-16T10:52:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:35 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:35.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:35 smithi111 ceph-mon[36315]: pgmap v404: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-03-16T10:52:35.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:35 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:36.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:35 smithi174 ceph-mon[36202]: pgmap v404: 97 pgs: 97 active+clean; 917 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 32 KiB/s wr, 20 op/s 2024-03-16T10:52:36.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:35 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:36.269 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T10:52:36.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:52:36.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 -- 172.21.15.17:0/2666108219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41029e0 msgr2=0x7f45c4102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 --2- 172.21.15.17:0/2666108219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41029e0 0x7f45c4102e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009900 tx=0x7f45b802bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 -- 172.21.15.17:0/2666108219 shutdown_connections 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 --2- 172.21.15.17:0/2666108219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41033a0 0x7f45c4109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 --2- 172.21.15.17:0/2666108219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41029e0 0x7f45c4102e60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 --2- 172.21.15.17:0/2666108219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 0x7f45c4101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 -- 172.21.15.17:0/2666108219 >> 172.21.15.17:0/2666108219 conn(0x7f45c40fcd40 msgr2=0x7f45c40ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 -- 172.21.15.17:0/2666108219 shutdown_connections 2024-03-16T10:52:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.378+0000 7f45c9459640 1 -- 172.21.15.17:0/2666108219 wait complete. 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 Processor -- start 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 -- start start 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 0x7f45c4197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41033a0 0x7f45c419f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d450 con 0x7f45c41029e0 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d2d0 con 0x7f45c41033a0 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c9459640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410d5d0 con 0x7f45c41017f0 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51008/0 (socket says 172.21.15.17:51008) 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c27fc640 1 -- 172.21.15.17:0/3474776809 learned_addr learned my addr 172.21.15.17:0/3474776809 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 0x7f45c4197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.379+0000 7f45c37fe640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41033a0 0x7f45c419f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 -- 172.21.15.17:0/3474776809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 msgr2=0x7f45c4197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 0x7f45c4197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 -- 172.21.15.17:0/3474776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41033a0 msgr2=0x7f45c419f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41033a0 0x7f45c419f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 -- 172.21.15.17:0/3474776809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c419f780 con 0x7f45c41029e0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c27fc640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009230 tx=0x7f45b802c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45abfff640 1 -- 172.21.15.17:0/3474776809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8041070 con 0x7f45c41029e0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c419fa10 con 0x7f45c41029e0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45abfff640 1 -- 172.21.15.17:0/3474776809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b8004450 con 0x7f45c41029e0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c419ff50 con 0x7f45c41029e0 2024-03-16T10:52:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.380+0000 7f45abfff640 1 -- 172.21.15.17:0/3474776809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8003db0 con 0x7f45c41029e0 2024-03-16T10:52:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.382+0000 7f45abfff640 1 -- 172.21.15.17:0/3474776809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f45b8044070 con 0x7f45c41029e0 2024-03-16T10:52:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45abfff640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 0x7f45ac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 0x7f45ac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45abfff640 1 -- 172.21.15.17:0/3474776809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f45b80f0530 con 0x7f45c41029e0 2024-03-16T10:52:36.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 0x7f45ac0a4cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f45c4102840 tx=0x7f45b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45cc044740 1 Processor -- start 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.383+0000 7f45cc044740 1 -- start start 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b9380 0x5604e52bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5604e521d0d0 con 0x5604e52b9380 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5604e51c5c70 con 0x5604e52be4f0 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45cc044740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604e5219170 con 0x5604e52b8990 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b9380 0x5604e52bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55730/0 (socket says 172.21.15.17:55730) 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 -- 172.21.15.17:0/1080905825 learned_addr learned my addr 172.21.15.17:0/1080905825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 -- 172.21.15.17:0/1080905825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 msgr2=0x5604e52c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 -- 172.21.15.17:0/1080905825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b9380 msgr2=0x5604e52bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b9380 0x5604e52bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 -- 172.21.15.17:0/1080905825 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e4ff97e0 con 0x5604e52b8990 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e630 tx=0x7f45b4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d396a7f8418420dc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.384+0000 7f45a97fa640 1 -- 172.21.15.17:0/1080905825 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4026430 con 0x5604e52b8990 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45a97fa640 1 -- 172.21.15.17:0/1080905825 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b401c8f0 con 0x5604e52b8990 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45a97fa640 1 -- 172.21.15.17:0/1080905825 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b401d970 con 0x5604e52b8990 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 -- 172.21.15.17:0/1080905825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 msgr2=0x5604e52b8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e630 tx=0x7f45b4014000 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 -- 172.21.15.17:0/1080905825 shutdown_connections 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b9380 0x5604e52bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 --2- 172.21.15.17:0/1080905825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b8990 0x5604e52b8db0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 -- 172.21.15.17:0/1080905825 >> 172.21.15.17:0/1080905825 conn(0x5604e5280c50 msgr2=0x5604e52b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 -- 172.21.15.17:0/1080905825 shutdown_connections 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.385+0000 7f45cc044740 1 -- 172.21.15.17:0/1080905825 wait complete. 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 -- start start 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 Processor -- start 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5604e52c14a0 con 0x5604e52b8990 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5604e51d90d0 con 0x5604e52be4f0 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604e52c1620 con 0x5604e52b9380 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45cc044740 10 client.0 _ll_register_callbacks cb 0x5604e51a2760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51022/0 (socket says 172.21.15.17:51022) 2024-03-16T10:52:36.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c27fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 -- 172.21.15.17:0/196211743 learned_addr learned my addr 172.21.15.17:0/196211743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c37fe640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 -- 172.21.15.17:0/196211743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 msgr2=0x5604e52c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 -- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 msgr2=0x5604e52ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c2ffd640 1 -- 172.21.15.17:0/196211743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e5059f70 con 0x5604e52b8990 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.386+0000 7f45c27fc640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e600 tx=0x7f45b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c9ebec081ac1fb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b402b040 con 0x5604e52b8990 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f45b401caa0 con 0x5604e52b8990 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b401c8f0 con 0x5604e52b8990 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45b401cca0 con 0x5604e52b8990 2024-03-16T10:52:36.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 10 client.16044 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604e4ef1170 con 0x5604e52b8990 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b401c8f0 con 0x5604e52b8990 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f45b402e070 con 0x5604e52b8990 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 10 client.16044 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 20 client.16044 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e52ce660 0x5604e52d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 4 client.16044 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.387+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604e522a610 con 0x5604e52ce660 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.388+0000 7f45c27fc640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e52ce660 0x5604e52d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.388+0000 7f45c27fc640 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e52ce660 0x5604e52d0a90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33504cd96c8a3b4e server_cookie=95a0266c33f705f in_seq=0 out_seq=0 2024-03-16T10:52:36.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.388+0000 7f45a6ff5640 10 client.16044 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45a6ff5640 1 -- 172.21.15.17:0/196211743 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5604e522a610 con 0x5604e52ce660 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45a6ff5640 10 client.16044 handle_command_reply: tid=0 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 client.16044 shutdown 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 msgr2=0x5604e52c2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e600 tx=0x7f45b401c4a0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 shutdown_connections 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e52ce660 0x5604e52d0a90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45a6ff5640 0 client.16044 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 --2- 172.21.15.17:0/196211743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c2e20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 >> 172.21.15.17:0/196211743 conn(0x5604e5280c50 msgr2=0x5604e52b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 shutdown_connections 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 1 -- 172.21.15.17:0/196211743 wait complete. 2024-03-16T10:52:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.391+0000 7f45cc044740 20 client.16044 trim_cache size 0 max 16384 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 Processor -- start 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 -- start start 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52b8990 0x5604e52b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41a8c70 con 0x5604e52be4f0 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41aa870 con 0x5604e52b8990 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45cc044740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41a9340 con 0x5604e52b9380 2024-03-16T10:52:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.409+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51038/0 (socket says 172.21.15.17:51038) 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c37fe640 1 -- 172.21.15.17:0/1668065251 learned_addr learned my addr 172.21.15.17:0/1668065251 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52b8990 0x5604e52b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 -- 172.21.15.17:0/1668065251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52b8990 msgr2=0x5604e52b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52b8990 0x5604e52b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 -- 172.21.15.17:0/1668065251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 msgr2=0x5604e52ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 -- 172.21.15.17:0/1668065251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e52be2b0 con 0x5604e52b9380 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c37fe640 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45c27fc640 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52b38a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45b80ee120 tx=0x7f45b80edfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76896bf915fb62cf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45a8ff9640 1 -- 172.21.15.17:0/1668065251 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b804b040 con 0x5604e52b9380 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45a8ff9640 1 -- 172.21.15.17:0/1668065251 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b80c5710 con 0x5604e52b9380 2024-03-16T10:52:36.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.410+0000 7f45a8ff9640 1 -- 172.21.15.17:0/1668065251 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b80c5280 con 0x5604e52b9380 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- 172.21.15.17:0/1668065251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 msgr2=0x5604e52b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52b38a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f45b80ee120 tx=0x7f45b80edfa0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- 172.21.15.17:0/1668065251 shutdown_connections 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52be4f0 0x5604e52ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52b38a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- 172.21.15.17:0/1668065251 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52b8990 0x5604e52b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- 172.21.15.17:0/1668065251 >> 172.21.15.17:0/1668065251 conn(0x5604e5280c50 msgr2=0x5604e52b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- 172.21.15.17:0/1668065251 shutdown_connections 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- 172.21.15.17:0/1668065251 wait complete. 2024-03-16T10:52:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- start start 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 Processor -- start 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41aa0e0 con 0x5604e52b8990 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41a9a10 con 0x5604e52be4f0 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41a6c50 con 0x5604e52b9380 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.411+0000 7f45cc044740 10 client.0 _ll_register_callbacks cb 0x7f45b8005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51050/0 (socket says 172.21.15.17:51050) 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 -- 172.21.15.17:0/337966705 learned_addr learned my addr 172.21.15.17:0/337966705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c37fe640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c27fc640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 -- 172.21.15.17:0/337966705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 msgr2=0x5604e52c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 -- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 msgr2=0x5604e52c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 -- 172.21.15.17:0/337966705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e52c9d40 con 0x5604e52b8990 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45c2ffd640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f45b4016040 tx=0x7f45b4004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9636432b30fc7c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b401ce40 con 0x5604e52b8990 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f45b401c720 con 0x5604e52b8990 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b80c5710 con 0x5604e52b8990 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45b401c920 con 0x5604e52b8990 2024-03-16T10:52:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45cc044740 10 client.16050 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.412+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604e5335090 con 0x5604e52b8990 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b80c5710 con 0x5604e52b8990 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f45b402e040 con 0x5604e52b8990 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 20 client.16050 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e5335af0 0x5604e5337f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 4 client.16050 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5604e5224960 con 0x5604e5335af0 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45c27fc640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e5335af0 0x5604e5337f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45c27fc640 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e5335af0 0x5604e5337f10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8529f022f403a741 server_cookie=859b2a68058fcea7 in_seq=0 out_seq=0 2024-03-16T10:52:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.413+0000 7f45a6ff5640 10 client.16050 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45a6ff5640 1 -- 172.21.15.17:0/337966705 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5604e5224960 con 0x5604e5335af0 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45a6ff5640 10 client.16050 handle_command_reply: tid=0 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 client.16050 shutdown 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 msgr2=0x5604e52c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f45b4016040 tx=0x7f45b4004910 comp rx=0 tx=0).stop 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 shutdown_connections 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5604e5335af0 0x5604e5337f10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5604e52be4f0 0x5604e52c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45a6ff5640 0 client.16050 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5604e52b9380 0x5604e52c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 --2- 172.21.15.17:0/337966705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604e52b8990 0x5604e52c8250 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 >> 172.21.15.17:0/337966705 conn(0x5604e5280c50 msgr2=0x5604e52b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 shutdown_connections 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 1 -- 172.21.15.17:0/337966705 wait complete. 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.418+0000 7f45cc044740 20 client.16050 trim_cache size 0 max 16384 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "a27aaac0-221e-44e7-a6b1-dbff48833b15", 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-03-16T10:52:36.422 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 msgr2=0x7f45ac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 0x7f45ac0a4cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f45c4102840 tx=0x7f45b4005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 msgr2=0x7f45c41980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009230 tx=0x7f45b802c650 comp rx=0 tx=0).stop 2024-03-16T10:52:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 shutdown_connections 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f45ac0a2800 0x7f45ac0a4cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45c41033a0 0x7f45c419f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c41029e0 0x7f45c41980f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 --2- 172.21.15.17:0/3474776809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45c41017f0 0x7f45c4197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 >> 172.21.15.17:0/3474776809 conn(0x7f45c40fcd40 msgr2=0x7f45c4105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 shutdown_connections 2024-03-16T10:52:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.419+0000 7f45c9459640 1 -- 172.21.15.17:0/3474776809 wait complete. 2024-03-16T10:52:36.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:52:36.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:52:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3707549301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc103470 msgr2=0x7f24bc109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3707549301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc103470 0x7f24bc109d00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009cd0 tx=0x7f24b402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3707549301 shutdown_connections 2024-03-16T10:52:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3707549301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc103470 0x7f24bc109d00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3707549301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc102ab0 0x7f24bc102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3707549301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3707549301 >> 172.21.15.17:0/3707549301 conn(0x7f24bc0fb410 msgr2=0x7f24bc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3707549301 shutdown_connections 2024-03-16T10:52:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.542+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3707549301 wait complete. 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 Processor -- start 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 -- start start 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 0x7f24bc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc103470 0x7f24bc19f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10d490 con 0x7f24bc102ab0 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10d310 con 0x7f24bc0ffae0 2024-03-16T10:52:36.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24c0e0b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10d610 con 0x7f24bc103470 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.543+0000 7f24b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 0x7f24bc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43200/0 (socket says 172.21.15.17:43200) 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 -- 172.21.15.17:0/3869755645 learned_addr learned my addr 172.21.15.17:0/3869755645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24bad9d640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc103470 0x7f24bc19f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 -- 172.21.15.17:0/3869755645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc103470 msgr2=0x7f24bc19f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc103470 0x7f24bc19f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 -- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 msgr2=0x7f24bc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 0x7f24bc198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 -- 172.21.15.17:0/3869755645 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc19f6f0 con 0x7f24bc0ffae0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24b3fff640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 0x7f24bc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24ba59c640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00e9c0 tx=0x7f24ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24b37fe640 1 -- 172.21.15.17:0/3869755645 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00cd80 con 0x7f24bc0ffae0 2024-03-16T10:52:36.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24b37fe640 1 -- 172.21.15.17:0/3869755645 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24ac0035f0 con 0x7f24bc0ffae0 2024-03-16T10:52:36.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc19f9e0 con 0x7f24bc0ffae0 2024-03-16T10:52:36.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24b37fe640 1 -- 172.21.15.17:0/3869755645 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac010690 con 0x7f24bc0ffae0 2024-03-16T10:52:36.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.544+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc19ff30 con 0x7f24bc0ffae0 2024-03-16T10:52:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.547+0000 7f24c39fa740 1 Processor -- start 2024-03-16T10:52:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.547+0000 7f24c39fa740 1 -- start start 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.547+0000 7f24b37fe640 1 -- 172.21.15.17:0/3869755645 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f24ac0037a0 con 0x7f24bc0ffae0 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edb7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e5ed17500 con 0x557e5edb2170 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557e5ecbfbe0 con 0x557e5edb2b60 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24c39fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557e5ed135a0 con 0x557e5edb7cd0 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51070/0 (socket says 172.21.15.17:51070) 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 -- 172.21.15.17:0/3610741084 learned_addr learned my addr 172.21.15.17:0/3610741084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24ba59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edb7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24b3fff640 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 -- 172.21.15.17:0/3610741084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 msgr2=0x557e5edba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 -- 172.21.15.17:0/3610741084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 msgr2=0x557e5edb7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edb7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 -- 172.21.15.17:0/3610741084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5ecd34b0 con 0x557e5edb2170 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24b37fe640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 0x7f24a80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24bad9d640 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f24b402c700 tx=0x7f24b40323c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd90e1966f7e170 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24ba59c640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 0x7f24a80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24b37fe640 1 -- 172.21.15.17:0/3869755645 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f24ac0ced70 con 0x7f24bc0ffae0 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.548+0000 7f24b0ff9640 1 -- 172.21.15.17:0/3610741084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4043070 con 0x557e5edb2170 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24b0ff9640 1 -- 172.21.15.17:0/3610741084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4032c50 con 0x557e5edb2170 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24b0ff9640 1 -- 172.21.15.17:0/3610741084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4039040 con 0x557e5edb2170 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 -- 172.21.15.17:0/3610741084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 msgr2=0x557e5edb2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24ba59c640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 0x7f24a80a4cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x557e5edb2f60 tx=0x7f24ac0d2890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f24b402c700 tx=0x7f24b40323c0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 -- 172.21.15.17:0/3610741084 shutdown_connections 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edb7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 --2- 172.21.15.17:0/3610741084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edb2590 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 -- 172.21.15.17:0/3610741084 >> 172.21.15.17:0/3610741084 conn(0x557e5edad6e0 msgr2=0x557e5edadae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 -- 172.21.15.17:0/3610741084 shutdown_connections 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.549+0000 7f24c39fa740 1 -- 172.21.15.17:0/3610741084 wait complete. 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 -- start start 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 Processor -- start 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edbcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb7cd0 0x557e5edc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557e5edbac20 con 0x557e5edb7cd0 2024-03-16T10:52:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557e5ecd3160 con 0x557e5edb2b60 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557e5edbada0 con 0x557e5edb2170 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24c39fa740 10 client.0 _ll_register_callbacks cb 0x557e5ecb7150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb7cd0 0x557e5edc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:55812/0 (socket says 172.21.15.17:55812) 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 -- 172.21.15.17:0/1824129049 learned_addr learned my addr 172.21.15.17:0/1824129049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24b3fff640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edbcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 -- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 msgr2=0x557e5edbcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edbcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 -- 172.21.15.17:0/1824129049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb7cd0 msgr2=0x557e5edc3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb7cd0 0x557e5edc3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24bad9d640 1 -- 172.21.15.17:0/1824129049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5eaf57d0 con 0x557e5edb2170 2024-03-16T10:52:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.550+0000 7f24b3fff640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edbcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24bad9d640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24b402c630 tx=0x7f24b402c0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bb07d57b164513 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4039070 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f24b402cca0 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24b4032c50 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24b4043040 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24c39fa740 10 client.25891 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e5ea2b3f0 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b4032c50 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.551+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f24b40485f0 con 0x557e5edb2170 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 10 client.25891 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 10 client.25891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 20 client.25891 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5edc7d40 0x557e5edca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 4 client.25891 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e5ed24a40 con 0x557e5edc7d40 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24b3fff640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5edc7d40 0x557e5edca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24a1ffb640 10 client.25891 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.552+0000 7f24b3fff640 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5edc7d40 0x557e5edca130 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a472717e194ee52 server_cookie=c8d3c72bec267535 in_seq=0 out_seq=0 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24a1ffb640 1 -- 172.21.15.17:0/1824129049 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557e5ed24a40 con 0x557e5edc7d40 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24a1ffb640 10 client.25891 handle_command_reply: tid=0 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 client.25891 shutdown 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 msgr2=0x557e5edbc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24b402c630 tx=0x7f24b402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 shutdown_connections 2024-03-16T10:52:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5edc7d40 0x557e5edca130 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb7cd0 0x557e5edc3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24a1ffb640 0 client.25891 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2b60 0x557e5edbcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 --2- 172.21.15.17:0/1824129049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2170 0x557e5edbc660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 >> 172.21.15.17:0/1824129049 conn(0x557e5edad6e0 msgr2=0x557e5edac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 shutdown_connections 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 1 -- 172.21.15.17:0/1824129049 wait complete. 2024-03-16T10:52:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.555+0000 7f24c39fa740 20 client.25891 trim_cache size 0 max 16384 2024-03-16T10:52:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 Processor -- start 2024-03-16T10:52:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 -- start start 2024-03-16T10:52:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 0x557e5edbcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1a8b30 con 0x557e5edb2b60 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1aa730 con 0x557e5edb2170 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24c39fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1a9200 con 0x557e5edb7cd0 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 0x557e5edbcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51088/0 (socket says 172.21.15.17:51088) 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 0x557e5edbcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:43222/0 (socket says 172.21.15.17:43222) 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 -- 172.21.15.17:0/561207533 learned_addr learned my addr 172.21.15.17:0/561207533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24bad9d640 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 -- 172.21.15.17:0/561207533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 msgr2=0x557e5edac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 -- 172.21.15.17:0/561207533 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 msgr2=0x557e5edbcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 0x557e5edbcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.575+0000 7f24b3fff640 1 -- 172.21.15.17:0/561207533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5e9eb0f0 con 0x557e5edb2b60 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.576+0000 7f24b3fff640 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f24a4004700 tx=0x7f24a4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cff0b1fe4a6b6c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.576+0000 7f24a3fff640 1 -- 172.21.15.17:0/561207533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a400fc80 con 0x557e5edb2b60 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.576+0000 7f24a3fff640 1 -- 172.21.15.17:0/561207533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24a400fe20 con 0x557e5edb2b60 2024-03-16T10:52:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.576+0000 7f24a3fff640 1 -- 172.21.15.17:0/561207533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4022640 con 0x557e5edb2b60 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- 172.21.15.17:0/561207533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 msgr2=0x557e5edc3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f24a4004700 tx=0x7f24a4005f90 comp rx=0 tx=0).stop 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- 172.21.15.17:0/561207533 shutdown_connections 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb7cd0 0x557e5edac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2b60 0x557e5edc3ba0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- 172.21.15.17:0/561207533 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb2170 0x557e5edbcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- 172.21.15.17:0/561207533 >> 172.21.15.17:0/561207533 conn(0x557e5edad6e0 msgr2=0x557e5edadac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- 172.21.15.17:0/561207533 shutdown_connections 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- 172.21.15.17:0/561207533 wait complete. 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- start start 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 Processor -- start 2024-03-16T10:52:36.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edc1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 0x557e5edc1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb7cd0 0x557e5edc25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1a9fa0 con 0x557e5edb2170 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1a98d0 con 0x557e5edb7cd0 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1a6b10 con 0x557e5edb2b60 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24c39fa740 10 client.0 _ll_register_callbacks cb 0x7f24ac0d2760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edc1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edc1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51098/0 (socket says 172.21.15.17:51098) 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24bad9d640 1 -- 172.21.15.17:0/27311981 learned_addr learned my addr 172.21.15.17:0/27311981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24b3fff640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 0x557e5edc1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.577+0000 7f24bad9d640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb7cd0 0x557e5edc25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 -- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb7cd0 msgr2=0x557e5edc25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb7cd0 0x557e5edc25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 -- 172.21.15.17:0/27311981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 msgr2=0x557e5edc1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edc1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 -- 172.21.15.17:0/27311981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5ecde9d0 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24b3fff640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 0x557e5edc1650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24a4025040 tx=0x7f24a400ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ef5460395f42c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a400fc80 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a400fe20 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f24a40225c0 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a40227c0 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24c39fa740 10 client.25897 fetch_fsmap learned FSMap version 28 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.578+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e5edc3d20 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24a400fe20 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f24a402b410 con 0x557e5edb2b60 2024-03-16T10:52:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 10 client.25897 fetch_fsmap finished waiting for FSMap version 28 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 10 client.25897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 20 client.25897 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5ee2e5a0 0x557e5ee309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 4 client.25897 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e5ed1ed90 con 0x557e5ee2e5a0 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24bad9d640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5ee2e5a0 0x557e5ee309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24a1ffb640 10 client.25897 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.579+0000 7f24bad9d640 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5ee2e5a0 0x557e5ee309c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8503676d34caa7 server_cookie=ee4eb0aaa72a175d in_seq=0 out_seq=0 2024-03-16T10:52:36.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24a1ffb640 1 -- 172.21.15.17:0/27311981 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x557e5ed1ed90 con 0x557e5ee2e5a0 2024-03-16T10:52:36.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24a1ffb640 10 client.25897 handle_command_reply: tid=0 2024-03-16T10:52:36.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 client.25897 shutdown 2024-03-16T10:52:36.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 msgr2=0x557e5edc1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 0x557e5edc1650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f24a4025040 tx=0x7f24a400ffd0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 shutdown_connections 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557e5ee2e5a0 0x557e5ee309c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557e5edb7cd0 0x557e5edc25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24a1ffb640 0 client.25897 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557e5edb2b60 0x557e5edc1650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 --2- 172.21.15.17:0/27311981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e5edb2170 0x557e5edc1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 >> 172.21.15.17:0/27311981 conn(0x557e5edad6e0 msgr2=0x557e5edb0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 shutdown_connections 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 1 -- 172.21.15.17:0/27311981 wait complete. 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c39fa740 20 client.25897 trim_cache size 0 max 16384 2024-03-16T10:52:36.587 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (144 inodes in the stack)", 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "a27aaac0-221e-44e7-a6b1-dbff48833b15": { 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a27aaac0-221e-44e7-a6b1-dbff48833b15", 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:52:36.588 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 msgr2=0x7f24a80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 0x7f24a80a4cc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x557e5edb2f60 tx=0x7f24ac0d2890 comp rx=0 tx=0).stop 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 msgr2=0x7f24bc197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00e9c0 tx=0x7f24ac00ee80 comp rx=0 tx=0).stop 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 shutdown_connections 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f24a80a2800 0x7f24a80a4cc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24bc103470 0x7f24bc19f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24bc102ab0 0x7f24bc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 --2- 172.21.15.17:0/3869755645 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24bc0ffae0 0x7f24bc197ad0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:36.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.584+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 >> 172.21.15.17:0/3869755645 conn(0x7f24bc0fb410 msgr2=0x7f24bc105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:36.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.585+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 shutdown_connections 2024-03-16T10:52:36.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:52:36.585+0000 7f24c0e0b640 1 -- 172.21.15.17:0/3869755645 wait complete. 2024-03-16T10:52:36.597 INFO:tasks.cephfs.filesystem:scrub status for tag:a27aaac0-221e-44e7-a6b1-dbff48833b15 - {'path': '/', 'tag': 'a27aaac0-221e-44e7-a6b1-dbff48833b15', 'options': 'recursive,force'} 2024-03-16T10:52:37.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub queued for path: / 2024-03-16T10:52:37.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: pgmap v405: 97 pgs: 97 active+clean; 9.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 782 KiB/s wr, 89 op/s 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:37.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:37 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub queued for path: / 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: pgmap v405: 97 pgs: 97 active+clean; 9.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 782 KiB/s wr, 89 op/s 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:37.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:37 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub queued for path: / 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: pgmap v405: 97 pgs: 97 active+clean; 9.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 782 KiB/s wr, 89 op/s 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:38.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:37 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:38 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:38.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:38 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.064 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:38 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:52:39.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:39 smithi017 ceph-mon[32078]: pgmap v406: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-03-16T10:52:39.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:39 smithi111 ceph-mon[36315]: pgmap v406: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-03-16T10:52:40.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:39 smithi174 ceph-mon[36202]: pgmap v406: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-03-16T10:52:41.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:41 smithi017 ceph-mon[32078]: pgmap v407: 97 pgs: 97 active+clean; 25 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-03-16T10:52:41.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:41 smithi111 ceph-mon[36315]: pgmap v407: 97 pgs: 97 active+clean; 25 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-03-16T10:52:42.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:41 smithi174 ceph-mon[36202]: pgmap v407: 97 pgs: 97 active+clean; 25 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-03-16T10:52:42.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:42 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:42.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:42 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:43.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:42 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:43.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:43 smithi111 ceph-mon[36315]: pgmap v408: 97 pgs: 97 active+clean; 26 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 2.2 MiB/s wr, 183 op/s 2024-03-16T10:52:44.062 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:43 smithi174 ceph-mon[36202]: pgmap v408: 97 pgs: 97 active+clean; 26 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 2.2 MiB/s wr, 183 op/s 2024-03-16T10:52:44.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:43 smithi017 ceph-mon[32078]: pgmap v408: 97 pgs: 97 active+clean; 26 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 2.2 MiB/s wr, 183 op/s 2024-03-16T10:52:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.557+0000 7fac5899d640 1 -- 172.21.15.17:0/1730031399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 msgr2=0x7fac54108970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.557+0000 7fac5899d640 1 --2- 172.21.15.17:0/1730031399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac54108970 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009ca0 tx=0x7fac4c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- 172.21.15.17:0/1730031399 shutdown_connections 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- 172.21.15.17:0/1730031399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac54108970 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- 172.21.15.17:0/1730031399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54101720 0x7fac54101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- 172.21.15.17:0/1730031399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54100530 0x7fac54100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- 172.21.15.17:0/1730031399 >> 172.21.15.17:0/1730031399 conn(0x7fac540fbac0 msgr2=0x7fac540fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- 172.21.15.17:0/1730031399 shutdown_connections 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- 172.21.15.17:0/1730031399 wait complete. 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 Processor -- start 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- start start 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 0x7fac54197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410c190 con 0x7fac541020e0 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410c010 con 0x7fac54100530 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.558+0000 7fac5899d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac5410c310 con 0x7fac54101720 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac537fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 0x7fac54197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac537fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38898/0 (socket says 172.21.15.17:38898) 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac537fe640 1 -- 172.21.15.17:0/2919894501 learned_addr learned my addr 172.21.15.17:0/2919894501 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38622/0 (socket says 172.21.15.17:38622) 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 -- 172.21.15.17:0/2919894501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 msgr2=0x7fac54197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 -- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 msgr2=0x7fac5419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 -- 172.21.15.17:0/2919894501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5419f550 con 0x7fac54101720 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac537fe640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac53fff640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 0x7fac54197e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac4400e9f0 tx=0x7fac4400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac50ff9640 1 -- 172.21.15.17:0/2919894501 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4400ccc0 con 0x7fac54101720 2024-03-16T10:52:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5419f840 con 0x7fac54101720 2024-03-16T10:52:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac50ff9640 1 -- 172.21.15.17:0/2919894501 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44010910 con 0x7fac54101720 2024-03-16T10:52:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac50ff9640 1 -- 172.21.15.17:0/2919894501 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44018960 con 0x7fac54101720 2024-03-16T10:52:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.559+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5419fde0 con 0x7fac54101720 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac50ff9640 1 -- 172.21.15.17:0/2919894501 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fac44010ac0 con 0x7fac54101720 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 Processor -- start 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 -- start start 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4ba5a40 con 0x55e0f4c40ec0 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4b4e920 con 0x55e0f4c46030 2024-03-16T10:52:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4ba1ae0 con 0x55e0f4c404d0 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38624/0 (socket says 172.21.15.17:38624) 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac53fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 -- 172.21.15.17:0/321685086 learned_addr learned my addr 172.21.15.17:0/321685086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac52ffd640 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac50ff9640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 0x7fac400a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 -- 172.21.15.17:0/321685086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 msgr2=0x55e0f4c408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 -- 172.21.15.17:0/321685086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 msgr2=0x55e0f4c484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.562+0000 7fac537fe640 1 -- 172.21.15.17:0/321685086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0f4b66460 con 0x55e0f4c40ec0 2024-03-16T10:52:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac53fff640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 0x7fac400a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac50ff9640 1 -- 172.21.15.17:0/2919894501 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fac440cee10 con 0x7fac54101720 2024-03-16T10:52:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac537fe640 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0115f0 tx=0x7fac3c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad09b5897cb694ee server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac49ffb640 1 -- 172.21.15.17:0/321685086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00f6f0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac49ffb640 1 -- 172.21.15.17:0/321685086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3c00fd70 con 0x55e0f4c40ec0 2024-03-16T10:52:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.563+0000 7fac49ffb640 1 -- 172.21.15.17:0/321685086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0183b0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- 172.21.15.17:0/321685086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 msgr2=0x55e0f4c459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac53fff640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 0x7fac400a4cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac4c005e30 tx=0x7fac4c02e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0115f0 tx=0x7fac3c011ab0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- 172.21.15.17:0/321685086 shutdown_connections 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c459c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/321685086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- 172.21.15.17:0/321685086 >> 172.21.15.17:0/321685086 conn(0x55e0f4c3ba40 msgr2=0x55e0f4c3be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- 172.21.15.17:0/321685086 shutdown_connections 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- 172.21.15.17:0/321685086 wait complete. 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- start start 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 Processor -- start 2024-03-16T10:52:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 0x55e0f4c51da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4c48fe0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4b61d70 con 0x55e0f4c404d0 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e0f4c49160 con 0x55e0f4c46030 2024-03-16T10:52:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.564+0000 7fac5c7eb740 10 client.0 _ll_register_callbacks cb 0x55e0f48b9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac537fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38640/0 (socket says 172.21.15.17:38640) 2024-03-16T10:52:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 -- 172.21.15.17:0/2688475747 learned_addr learned my addr 172.21.15.17:0/2688475747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac53fff640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 0x55e0f4c51da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 -- 172.21.15.17:0/2688475747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 msgr2=0x55e0f4c51da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 0x55e0f4c51da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 -- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 msgr2=0x55e0f4c4a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 -- 172.21.15.17:0/2688475747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0f48ba210 con 0x55e0f4c40ec0 2024-03-16T10:52:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac53fff640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 0x55e0f4c51da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac537fe640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fac44097cc0 tx=0x7fac44097500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdc107cf20f7cb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4409b3a0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fac440860e0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac3c00fd70 con 0x55e0f4c40ec0 2024-03-16T10:52:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac4409b1c0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac5c7eb740 10 client.16080 fetch_fsmap learned FSMap version 30 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.565+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0f4986620 con 0x55e0f4c40ec0 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3c00fd70 con 0x55e0f4c40ec0 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fac44018b00 con 0x55e0f4c40ec0 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 10 client.16080 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:52:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 20 client.16080 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4c566d0 0x55e0f4c58b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 4 client.16080 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0f4bb2f80 con 0x55e0f4c566d0 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac537fe640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4c566d0 0x55e0f4c58b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac537fe640 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4c566d0 0x55e0f4c58b40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1564b979ba0762dd server_cookie=14e9e703bcd42a43 in_seq=0 out_seq=0 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.566+0000 7fac32ffd640 10 client.16080 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac32ffd640 1 -- 172.21.15.17:0/2688475747 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e0f4bb2f80 con 0x55e0f4c566d0 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac32ffd640 10 client.16080 handle_command_reply: tid=0 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 client.16080 shutdown 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 msgr2=0x55e0f4c4add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fac44097cc0 tx=0x7fac44097500 comp rx=0 tx=0).stop 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 shutdown_connections 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4c566d0 0x55e0f4c58b40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c46030 0x55e0f4c51da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4add0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac32ffd640 0 client.16080 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2688475747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 >> 172.21.15.17:0/2688475747 conn(0x55e0f4c3ba40 msgr2=0x55e0f4c3ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 shutdown_connections 2024-03-16T10:52:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2688475747 wait complete. 2024-03-16T10:52:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.569+0000 7fac5c7eb740 20 client.16080 trim_cache size 0 max 16384 2024-03-16T10:52:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 Processor -- start 2024-03-16T10:52:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 -- start start 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c42240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c51d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac541a8950 con 0x55e0f4c46030 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac541aa670 con 0x55e0f4c404d0 2024-03-16T10:52:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac541a9020 con 0x55e0f4c40ec0 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.584+0000 7fac53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38642/0 (socket says 172.21.15.17:38642) 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 -- 172.21.15.17:0/3680377012 learned_addr learned my addr 172.21.15.17:0/3680377012 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac52ffd640 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c51d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac537fe640 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c42240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 -- 172.21.15.17:0/3680377012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c40ec0 msgr2=0x55e0f4c51d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c51d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 -- 172.21.15.17:0/3680377012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 msgr2=0x55e0f4c42240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c42240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 -- 172.21.15.17:0/3680377012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0f4c3c7b0 con 0x55e0f4c46030 2024-03-16T10:52:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac53fff640 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009ca0 tx=0x7fac4c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaa322374dc1076 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac497fa640 1 -- 172.21.15.17:0/3680377012 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c039040 con 0x55e0f4c46030 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac497fa640 1 -- 172.21.15.17:0/3680377012 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c046030 con 0x55e0f4c46030 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.585+0000 7fac497fa640 1 -- 172.21.15.17:0/3680377012 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c04e680 con 0x55e0f4c46030 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- 172.21.15.17:0/3680377012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 msgr2=0x55e0f4c42780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009ca0 tx=0x7fac4c041000 comp rx=0 tx=0).stop 2024-03-16T10:52:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- 172.21.15.17:0/3680377012 shutdown_connections 2024-03-16T10:52:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c46030 0x55e0f4c42780 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c51d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/3680377012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c404d0 0x55e0f4c42240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- 172.21.15.17:0/3680377012 >> 172.21.15.17:0/3680377012 conn(0x55e0f4c3ba40 msgr2=0x55e0f4c3be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- 172.21.15.17:0/3680377012 shutdown_connections 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- 172.21.15.17:0/3680377012 wait complete. 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- start start 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 Processor -- start 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c504d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac541a9ee0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac541a97b0 con 0x55e0f4c46030 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.586+0000 7fac5c7eb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac541a6930 con 0x55e0f4c404d0 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac5c7eb740 10 client.0 _ll_register_callbacks cb 0x7fac440d2540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac537fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38650/0 (socket says 172.21.15.17:38650) 2024-03-16T10:52:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 -- 172.21.15.17:0/2849679472 learned_addr learned my addr 172.21.15.17:0/2849679472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac53fff640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 -- 172.21.15.17:0/2849679472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 msgr2=0x55e0f4c4efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 -- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 msgr2=0x55e0f4c504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 -- 172.21.15.17:0/2849679472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0f4c50ac0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac537fe640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac52ffd640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac4400e9c0 tx=0x7fac4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2588f88f70c9f1c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4409b3a0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fac440afd90 con 0x55e0f4c40ec0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac4c046030 con 0x55e0f4c40ec0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac440d2380 con 0x55e0f4c40ec0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac5c7eb740 10 client.16086 fetch_fsmap learned FSMap version 30 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.587+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0f4c51e40 con 0x55e0f4c40ec0 2024-03-16T10:52:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c046030 con 0x55e0f4c40ec0 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fac4409cae0 con 0x55e0f4c40ec0 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 10 client.16086 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 20 client.16086 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4cbd120 0x55e0f4cbf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 4 client.16086 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:52:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0f4bad2d0 con 0x55e0f4cbd120 2024-03-16T10:52:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac537fe640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4cbd120 0x55e0f4cbf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac32ffd640 10 client.16086 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:44.588+0000 7fac537fe640 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4cbd120 0x55e0f4cbf540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2a3288a61133c5 server_cookie=4580c8b77df1396f in_seq=0 out_seq=0 2024-03-16T10:52:44.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:44 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:45.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:44 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:45.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:44 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:52:45.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:45 smithi111 ceph-mon[36315]: pgmap v409: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 181 op/s 2024-03-16T10:52:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac32ffd640 1 -- 172.21.15.17:0/2849679472 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e0f4bad2d0 con 0x55e0f4cbd120 2024-03-16T10:52:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac32ffd640 10 client.16086 handle_command_reply: tid=0 2024-03-16T10:52:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 client.16086 shutdown 2024-03-16T10:52:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 msgr2=0x55e0f4c4f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fac4400e9c0 tx=0x7fac4400cf60 comp rx=0 tx=0).stop 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 shutdown_connections 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55e0f4cbd120 0x55e0f4cbf540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e0f4c46030 0x55e0f4c504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f4c40ec0 0x55e0f4c4f510 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 --2- 172.21.15.17:0/2849679472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e0f4c404d0 0x55e0f4c4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac32ffd640 0 client.16086 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 >> 172.21.15.17:0/2849679472 conn(0x55e0f4c3ba40 msgr2=0x55e0f4c4a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 shutdown_connections 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 1 -- 172.21.15.17:0/2849679472 wait complete. 2024-03-16T10:52:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.951+0000 7fac5c7eb740 20 client.16086 trim_cache size 0 max 16384 2024-03-16T10:52:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:52:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:52:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:52:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 msgr2=0x7fac400a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 0x7fac400a4cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac4c005e30 tx=0x7fac4c02e040 comp rx=0 tx=0).stop 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 msgr2=0x7fac54197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 0x7fac54197e70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac4400e9f0 tx=0x7fac4400eeb0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 shutdown_connections 2024-03-16T10:52:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fac400a27f0 0x7fac400a4cb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac541020e0 0x7fac5419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac54101720 0x7fac54197e70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 --2- 172.21.15.17:0/2919894501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac54100530 0x7fac54197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 >> 172.21.15.17:0/2919894501 conn(0x7fac540fbac0 msgr2=0x7fac540fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 shutdown_connections 2024-03-16T10:52:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:45.952+0000 7fac5899d640 1 -- 172.21.15.17:0/2919894501 wait complete. 2024-03-16T10:52:46.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:45 smithi174 ceph-mon[36202]: pgmap v409: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 181 op/s 2024-03-16T10:52:46.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:45 smithi017 ceph-mon[32078]: pgmap v409: 97 pgs: 97 active+clean; 29 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 181 op/s 2024-03-16T10:52:47.892 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:47 smithi017 ceph-mon[32078]: pgmap v410: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-03-16T10:52:47.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:47 smithi111 ceph-mon[36315]: pgmap v410: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-03-16T10:52:48.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:47 smithi174 ceph-mon[36202]: pgmap v410: 97 pgs: 97 active+clean; 33 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 380 op/s 2024-03-16T10:52:49.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:49 smithi111 ceph-mon[36315]: pgmap v411: 97 pgs: 97 active+clean; 34 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-03-16T10:52:49.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:49 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:49.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:49 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:49 smithi174 ceph-mon[36202]: pgmap v411: 97 pgs: 97 active+clean; 34 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-03-16T10:52:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:49 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:50.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:49 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:50.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:49 smithi017 ceph-mon[32078]: pgmap v411: 97 pgs: 97 active+clean; 34 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 602 op/s 2024-03-16T10:52:50.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:49 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:50.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:49 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:50.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:50 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:50.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:50 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:50.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:50 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:52:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:50 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:50 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:51.063 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:50 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:52:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:50 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:50 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:51.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:50 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:52:52.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:52 smithi174 ceph-mon[36202]: pgmap v412: 97 pgs: 97 active+clean; 26 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 754 op/s 2024-03-16T10:52:52.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:52 smithi017 ceph-mon[32078]: pgmap v412: 97 pgs: 97 active+clean; 26 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 754 op/s 2024-03-16T10:52:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:52 smithi111 ceph-mon[36315]: pgmap v412: 97 pgs: 97 active+clean; 26 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 754 op/s 2024-03-16T10:52:54.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:54 smithi174 ceph-mon[36202]: pgmap v413: 97 pgs: 97 active+clean; 32 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.9 MiB/s wr, 857 op/s 2024-03-16T10:52:54.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:54 smithi017 ceph-mon[32078]: pgmap v413: 97 pgs: 97 active+clean; 32 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.9 MiB/s wr, 857 op/s 2024-03-16T10:52:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:54 smithi111 ceph-mon[36315]: pgmap v413: 97 pgs: 97 active+clean; 32 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.9 MiB/s wr, 857 op/s 2024-03-16T10:52:56.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:56 smithi174 ceph-mon[36202]: pgmap v414: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 936 op/s 2024-03-16T10:52:56.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:56 smithi017 ceph-mon[32078]: pgmap v414: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 936 op/s 2024-03-16T10:52:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:56 smithi111 ceph-mon[36315]: pgmap v414: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 936 op/s 2024-03-16T10:52:58.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:52:58 smithi174 ceph-mon[36202]: pgmap v415: 97 pgs: 97 active+clean; 57 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 1.18k op/s 2024-03-16T10:52:58.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:52:58 smithi017 ceph-mon[32078]: pgmap v415: 97 pgs: 97 active+clean; 57 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 1.18k op/s 2024-03-16T10:52:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:52:58 smithi111 ceph-mon[36315]: pgmap v415: 97 pgs: 97 active+clean; 57 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 1.18k op/s 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 -- 172.21.15.17:0/2971165691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01018f0 msgr2=0x7f72a0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 --2- 172.21.15.17:0/2971165691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01018f0 0x7f72a0101d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7290009900 tx=0x7f729002bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 -- 172.21.15.17:0/2971165691 shutdown_connections 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 --2- 172.21.15.17:0/2971165691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a01022b0 0x7f72a0108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 --2- 172.21.15.17:0/2971165691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01018f0 0x7f72a0101d70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 --2- 172.21.15.17:0/2971165691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a0100700 0x7f72a0100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 -- 172.21.15.17:0/2971165691 >> 172.21.15.17:0/2971165691 conn(0x7f72a00fbc70 msgr2=0x7f72a00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 -- 172.21.15.17:0/2971165691 shutdown_connections 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.042+0000 7f72a6c85640 1 -- 172.21.15.17:0/2971165691 wait complete. 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 Processor -- start 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 -- start start 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a0100700 0x7f72a0104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a01018f0 0x7f72a0102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010c380 con 0x7f72a01022b0 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010c200 con 0x7f72a0100700 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a6c85640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010c500 con 0x7f72a01018f0 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56176/0 (socket says 172.21.15.17:56176) 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f729ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a01018f0 0x7f72a0102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 -- 172.21.15.17:0/3123654575 learned_addr learned my addr 172.21.15.17:0/3123654575 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a4a21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a0100700 0x7f72a0104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 -- 172.21.15.17:0/3123654575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a01018f0 msgr2=0x7f72a0102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a01018f0 0x7f72a0102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 -- 172.21.15.17:0/3123654575 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a0100700 msgr2=0x7f72a0104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a0100700 0x7f72a0104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 -- 172.21.15.17:0/3123654575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a0103c20 con 0x7f72a01022b0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.043+0000 7f72a5222640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f728800e970 tx=0x7f728800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.044+0000 7f729dffb640 1 -- 172.21.15.17:0/3123654575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728800ccc0 con 0x7f72a01022b0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.044+0000 7f729dffb640 1 -- 172.21.15.17:0/3123654575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f728800ce60 con 0x7f72a01022b0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.044+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a01a1c20 con 0x7f72a01022b0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.044+0000 7f729dffb640 1 -- 172.21.15.17:0/3123654575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288010490 con 0x7f72a01022b0 2024-03-16T10:52:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.044+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a01a20f0 con 0x7f72a01022b0 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f729dffb640 1 -- 172.21.15.17:0/3123654575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f7288005020 con 0x7f72a01022b0 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 Processor -- start 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 -- start start 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x557087645760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5570875aaa40 con 0x55708764aea0 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557087553920 con 0x557087645d30 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.046+0000 7f72a987b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5570875a6ae0 con 0x557087645340 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56186/0 (socket says 172.21.15.17:56186) 2024-03-16T10:52:59.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729ffff640 1 -- 172.21.15.17:0/2626701276 learned_addr learned my addr 172.21.15.17:0/2626701276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729ffff640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x557087645760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729dffb640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 0x7f728c0a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 -- 172.21.15.17:0/2626701276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 msgr2=0x557087645760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x557087645760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 -- 172.21.15.17:0/2626701276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 msgr2=0x55708764d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a5222640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 0x7f728c0a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 -- 172.21.15.17:0/2626701276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708756b460 con 0x557087645d30 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729ffff640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f729dffb640 1 -- 172.21.15.17:0/3123654575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f72880cee30 con 0x7f72a01022b0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764a830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7298005fd0 tx=0x7f72980118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a5dfc9e1785f82 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f72a5222640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 0x7f728c0a4d60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7288098240 tx=0x7f728806e5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f7296ffd640 1 -- 172.21.15.17:0/2626701276 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298004b20 con 0x557087645d30 2024-03-16T10:52:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f7296ffd640 1 -- 172.21.15.17:0/2626701276 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7298003e50 con 0x557087645d30 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.047+0000 7f7296ffd640 1 -- 172.21.15.17:0/2626701276 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298005020 con 0x557087645d30 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- 172.21.15.17:0/2626701276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 msgr2=0x55708764a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764a830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7298005fd0 tx=0x7f72980118d0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- 172.21.15.17:0/2626701276 shutdown_connections 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764a830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 --2- 172.21.15.17:0/2626701276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x557087645760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- 172.21.15.17:0/2626701276 >> 172.21.15.17:0/2626701276 conn(0x5570876408b0 msgr2=0x557087640cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- 172.21.15.17:0/2626701276 shutdown_connections 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- 172.21.15.17:0/2626701276 wait complete. 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 -- start start 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.048+0000 7f72a987b740 1 Processor -- start 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087656ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55708764de50 con 0x557087645340 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557087566d70 con 0x557087645d30 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55708764dfd0 con 0x55708764aea0 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a987b740 10 client.0 _ll_register_callbacks cb 0x5570872bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56194/0 (socket says 172.21.15.17:56194) 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 -- 172.21.15.17:0/2275048328 learned_addr learned my addr 172.21.15.17:0/2275048328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087656ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 -- 172.21.15.17:0/2275048328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 msgr2=0x557087656ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087656ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 -- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 msgr2=0x55708764fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 -- 172.21.15.17:0/2275048328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570872bf210 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f729ffff640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7290009230 tx=0x7f729002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab40e2ebb85d75 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.049+0000 7f727ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290003a00 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7290003ba0 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7298003e50 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7290003da0 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 10 client.16098 fetch_fsmap learned FSMap version 30 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55708738b620 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7298003e50 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f729004c060 con 0x557087645340 2024-03-16T10:52:59.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 10 client.16098 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 20 client.16098 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55708765b560 0x55708765d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 4 client.16098 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570875b7f80 con 0x55708765b560 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.050+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55708765b560 0x55708765d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.051+0000 7f72a4a21640 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55708765b560 0x55708765d9e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0dabc426d92e343 server_cookie=322599c13c8d2d2c in_seq=0 out_seq=0 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.051+0000 7f727ffff640 10 client.16098 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f727ffff640 1 -- 172.21.15.17:0/2275048328 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5570875b7f80 con 0x55708765b560 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f727ffff640 10 client.16098 handle_command_reply: tid=0 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 client.16098 shutdown 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 msgr2=0x55708764f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7290009230 tx=0x7f729002bc30 comp rx=0 tx=0).stop 2024-03-16T10:52:59.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 shutdown_connections 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55708765b560 0x55708765d9e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087656ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x55708764fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 --2- 172.21.15.17:0/2275048328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645340 0x55708764f620 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f727ffff640 0 client.16098 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 >> 172.21.15.17:0/2275048328 conn(0x5570876408b0 msgr2=0x55708763fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 shutdown_connections 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 1 -- 172.21.15.17:0/2275048328 wait complete. 2024-03-16T10:52:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.052+0000 7f72a987b740 20 client.16098 trim_cache size 0 max 16384 2024-03-16T10:52:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 Processor -- start 2024-03-16T10:52:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 -- start start 2024-03-16T10:52:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x55708764f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x557087656b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01aacb0 con 0x55708764aea0 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01ac9d0 con 0x557087645d30 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a987b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01ab380 con 0x557087645340 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56210/0 (socket says 172.21.15.17:56210) 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f72a4a21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x557087656b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 -- 172.21.15.17:0/1285213941 learned_addr learned my addr 172.21.15.17:0/1285213941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x55708764f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 -- 172.21.15.17:0/1285213941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 msgr2=0x55708764f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x55708764f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 -- 172.21.15.17:0/1285213941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 msgr2=0x557087656b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x557087656b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 -- 172.21.15.17:0/1285213941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557087641620 con 0x55708764aea0 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.067+0000 7f729ffff640 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f72900344a0 tx=0x7f7290005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8cd19a2ff9c6e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72967fc640 1 -- 172.21.15.17:0/1285213941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290034ae0 con 0x55708764aea0 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72967fc640 1 -- 172.21.15.17:0/1285213941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7290045030 con 0x55708764aea0 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72967fc640 1 -- 172.21.15.17:0/1285213941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729004e750 con 0x55708764aea0 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 -- 172.21.15.17:0/1285213941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 msgr2=0x55708764f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f72900344a0 tx=0x7f7290005fd0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 -- 172.21.15.17:0/1285213941 shutdown_connections 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55708764aea0 0x55708764f770 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645d30 0x557087656b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 --2- 172.21.15.17:0/1285213941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557087645340 0x55708764f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 -- 172.21.15.17:0/1285213941 >> 172.21.15.17:0/1285213941 conn(0x5570876408b0 msgr2=0x55708763ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 -- 172.21.15.17:0/1285213941 shutdown_connections 2024-03-16T10:52:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.068+0000 7f72a987b740 1 -- 172.21.15.17:0/1285213941 wait complete. 2024-03-16T10:52:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 -- start start 2024-03-16T10:52:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 Processor -- start 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645340 0x557087653e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087655370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01ac240 con 0x557087645d30 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01abb10 con 0x557087645340 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01a8c90 con 0x55708764aea0 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a987b740 10 client.0 _ll_register_callbacks cb 0x7f7290004130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a4a21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a4a21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56226/0 (socket says 172.21.15.17:56226) 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f72a4a21640 1 -- 172.21.15.17:0/479421650 learned_addr learned my addr 172.21.15.17:0/479421650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f729ffff640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645340 0x557087653e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.069+0000 7f729ffff640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087655370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 -- 172.21.15.17:0/479421650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 msgr2=0x557087655370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087655370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 -- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645340 msgr2=0x557087653e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645340 0x557087653e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 -- 172.21.15.17:0/479421650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557087655960 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a4a21640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7298014040 tx=0x7f7298009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a986b1726dbf9dae server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f727ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729802bd00 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7298016040 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7290045030 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f729803a050 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a987b740 10 client.16104 fetch_fsmap learned FSMap version 30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557087656d10 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.070+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7290045030 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f7298004900 con 0x557087645d30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 10 client.16104 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:52:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 20 client.16104 populate_metadata read hostname 'smithi017' 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5570876c1e50 0x5570876c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 4 client.16104 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570875b22d0 con 0x5570876c1e50 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f729ffff640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5570876c1e50 0x5570876c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f729ffff640 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5570876c1e50 0x5570876c4270 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23749470e7ff8e server_cookie=c51baca3a35aec6f in_seq=0 out_seq=0 2024-03-16T10:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:52:59.071+0000 7f727ffff640 10 client.16104 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:00.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:00 smithi174 ceph-mon[36202]: pgmap v416: 97 pgs: 97 active+clean; 62 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 3.8 MiB/s wr, 1.07k op/s 2024-03-16T10:53:00.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:00 smithi017 ceph-mon[32078]: pgmap v416: 97 pgs: 97 active+clean; 62 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 3.8 MiB/s wr, 1.07k op/s 2024-03-16T10:53:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:00 smithi111 ceph-mon[36315]: pgmap v416: 97 pgs: 97 active+clean; 62 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 3.8 MiB/s wr, 1.07k op/s 2024-03-16T10:53:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.920+0000 7f727ffff640 1 -- 172.21.15.17:0/479421650 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570875b22d0 con 0x5570876c1e50 2024-03-16T10:53:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.920+0000 7f727ffff640 10 client.16104 handle_command_reply: tid=0 2024-03-16T10:53:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.920+0000 7f72a987b740 1 client.16104 shutdown 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.920+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 msgr2=0x557087654360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.920+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7298014040 tx=0x7f7298009550 comp rx=0 tx=0).stop 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 shutdown_connections 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5570876c1e50 0x5570876c4270 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55708764aea0 0x557087655370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557087645d30 0x557087654360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f727ffff640 0 client.16104 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 --2- 172.21.15.17:0/479421650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557087645340 0x557087653e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 >> 172.21.15.17:0/479421650 conn(0x5570876408b0 msgr2=0x55708764f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 shutdown_connections 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 1 -- 172.21.15.17:0/479421650 wait complete. 2024-03-16T10:53:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a987b740 20 client.16104 trim_cache size 0 max 16384 2024-03-16T10:53:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:53:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:53:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:53:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 msgr2=0x7f728c0a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 0x7f728c0a4d60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7288098240 tx=0x7f728806e5a0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 msgr2=0x7f72a0103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f728800e970 tx=0x7f728800ed70 comp rx=0 tx=0).stop 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 shutdown_connections 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f728c0a28a0 0x7f728c0a4d60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a01022b0 0x7f72a0103360 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72a01018f0 0x7f72a0102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 --2- 172.21.15.17:0/3123654575 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72a0100700 0x7f72a0104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.921+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 >> 172.21.15.17:0/3123654575 conn(0x7f72a00fbc70 msgr2=0x7f72a0068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.922+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 shutdown_connections 2024-03-16T10:53:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:01.922+0000 7f72a6c85640 1 -- 172.21.15.17:0/3123654575 wait complete. 2024-03-16T10:53:02.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:02 smithi174 ceph-mon[36202]: pgmap v417: 97 pgs: 97 active+clean; 70 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 785 op/s 2024-03-16T10:53:02.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:02 smithi017 ceph-mon[32078]: pgmap v417: 97 pgs: 97 active+clean; 70 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 785 op/s 2024-03-16T10:53:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:02 smithi111 ceph-mon[36315]: pgmap v417: 97 pgs: 97 active+clean; 70 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 785 op/s 2024-03-16T10:53:04.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:04 smithi174 ceph-mon[36202]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 942 op/s 2024-03-16T10:53:04.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:04 smithi017 ceph-mon[32078]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 942 op/s 2024-03-16T10:53:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:04 smithi111 ceph-mon[36315]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 942 op/s 2024-03-16T10:53:05.448 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-16T10:53:05.448 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-16T10:53:05.448 INFO:tasks.workunit.client.0.smithi017.stderr:+ make 2024-03-16T10:53:05.631 INFO:tasks.workunit.client.0.smithi017.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-16T10:53:05.889 INFO:tasks.workunit.client.0.smithi017.stderr:++ readlink -f fsstress 2024-03-16T10:53:05.889 INFO:tasks.workunit.client.0.smithi017.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-16T10:53:05.889 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-03-16T10:53:05.890 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-16T10:53:05.890 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-03-16T10:53:05.890 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-16T10:53:05.891 INFO:tasks.workunit.client.0.smithi017.stderr:++ mktemp -d -p . 2024-03-16T10:53:05.891 INFO:tasks.workunit.client.0.smithi017.stderr:+ T=./tmp.ezvm3RUn75 2024-03-16T10:53:05.892 INFO:tasks.workunit.client.0.smithi017.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ezvm3RUn75 -l 1 -n 1000 -p 10 -v 2024-03-16T10:53:05.893 INFO:tasks.workunit.client.0.smithi017.stdout:seed = 1710807532 2024-03-16T10:53:05.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/0: dread - no filename 2024-03-16T10:53:05.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/0: creat f0 x:0 0 0 2024-03-16T10:53:05.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/1: write f0 [142209,6945] 0 2024-03-16T10:53:05.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/2: write f0 [1103997,68896] 0 2024-03-16T10:53:05.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/3: write f0 [728325,85407] 0 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/4: truncate f0 1335380 0 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/0: rename - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/1: write - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/2: write - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/3: link - no file 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/4: dread - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/5: read - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/6: dwrite - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/7: dread - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/8: chown . 0 1 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/9: rename - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/10: write - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/11: truncate - no filename 2024-03-16T10:53:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/12: dread - no filename 2024-03-16T10:53:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:2/13: rename - no filename 2024-03-16T10:53:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/1: creat f0 x:0 0 0 2024-03-16T10:53:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/2: stat f0 0 2024-03-16T10:53:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:0/5: mknod c1 0 2024-03-16T10:53:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:0/6: stat f0 0 2024-03-16T10:53:05.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/3: mkdir d1 0 2024-03-16T10:53:05.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/4: chown d1 48 1 2024-03-16T10:53:05.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/5: write f0 [197206,39361] 0 2024-03-16T10:53:05.903 INFO:tasks.workunit.client.0.smithi017.stdout:0/7: mkdir d2 0 2024-03-16T10:53:05.903 INFO:tasks.workunit.client.0.smithi017.stdout:4/0: fdatasync - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/1: fsync - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/2: dread - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/3: write - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/4: readlink - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/5: dwrite - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/6: chown . 79 1 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/7: fdatasync - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/8: fdatasync - no filename 2024-03-16T10:53:05.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/9: chown . 60 1 2024-03-16T10:53:05.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/0: mknod c0 0 2024-03-16T10:53:05.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/1: fdatasync - no filename 2024-03-16T10:53:05.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/2: write - no filename 2024-03-16T10:53:05.905 INFO:tasks.workunit.client.0.smithi017.stdout:1/6: mkdir d1/d2 0 2024-03-16T10:53:05.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/8: mknod d2/c3 0 2024-03-16T10:53:05.906 INFO:tasks.workunit.client.0.smithi017.stdout:5/0: unlink - no file 2024-03-16T10:53:05.906 INFO:tasks.workunit.client.0.smithi017.stdout:5/1: truncate - no filename 2024-03-16T10:53:05.906 INFO:tasks.workunit.client.0.smithi017.stdout:5/2: dread - no filename 2024-03-16T10:53:05.906 INFO:tasks.workunit.client.0.smithi017.stdout:5/3: write - no filename 2024-03-16T10:53:05.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/4: getdents . 0 2024-03-16T10:53:05.907 INFO:tasks.workunit.client.0.smithi017.stdout:4/10: symlink l0 0 2024-03-16T10:53:05.907 INFO:tasks.workunit.client.0.smithi017.stdout:4/11: dread - no filename 2024-03-16T10:53:05.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/3: mknod c1 0 2024-03-16T10:53:05.909 INFO:tasks.workunit.client.0.smithi017.stdout:3/4: dread - no filename 2024-03-16T10:53:05.909 INFO:tasks.workunit.client.0.smithi017.stdout:3/5: dwrite - no filename 2024-03-16T10:53:05.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/9: mkdir d2/d4 0 2024-03-16T10:53:05.912 INFO:tasks.workunit.client.0.smithi017.stdout:1/7: rename d1/d2 to d1/d3 0 2024-03-16T10:53:05.914 INFO:tasks.workunit.client.0.smithi017.stdout:6/0: readlink - no filename 2024-03-16T10:53:05.914 INFO:tasks.workunit.client.0.smithi017.stdout:6/1: dread - no filename 2024-03-16T10:53:05.914 INFO:tasks.workunit.client.0.smithi017.stdout:5/5: mkdir d0 0 2024-03-16T10:53:05.914 INFO:tasks.workunit.client.0.smithi017.stdout:5/6: write - no filename 2024-03-16T10:53:05.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/6: creat f2 x:0 0 0 2024-03-16T10:53:05.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/8: unlink f0 0 2024-03-16T10:53:05.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/9: dread - no filename 2024-03-16T10:53:05.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/10: fdatasync - no filename 2024-03-16T10:53:05.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/11: dwrite - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/12: dwrite - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/13: dread - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/14: readlink - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/15: link - no file 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/16: dwrite - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/17: fsync - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/18: dread - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/2: mkdir d0 0 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/3: dwrite - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/4: write - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/5: dread - no filename 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/6: getdents d0 0 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/7: creat f3 x:0 0 0 2024-03-16T10:53:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/8: chown c0 0 1 2024-03-16T10:53:05.929 INFO:tasks.workunit.client.0.smithi017.stdout:3/9: write f2 [380170,97690] 0 2024-03-16T10:53:05.929 INFO:tasks.workunit.client.0.smithi017.stdout:5/7: mkdir d0/d1 0 2024-03-16T10:53:05.929 INFO:tasks.workunit.client.0.smithi017.stdout:5/8: write - no filename 2024-03-16T10:53:05.929 INFO:tasks.workunit.client.0.smithi017.stdout:0/10: creat d2/f5 x:0 0 0 2024-03-16T10:53:05.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/19: creat d1/f4 x:0 0 0 2024-03-16T10:53:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/7: mknod d0/c1 0 2024-03-16T10:53:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/8: write - no filename 2024-03-16T10:53:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/9: write - no filename 2024-03-16T10:53:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/10: truncate - no filename 2024-03-16T10:53:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:3/10: symlink l4 0 2024-03-16T10:53:05.934 INFO:tasks.workunit.client.0.smithi017.stdout:5/9: mkdir d0/d1/d2 0 2024-03-16T10:53:05.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/0: write - no filename 2024-03-16T10:53:05.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/11: mknod d0/c2 0 2024-03-16T10:53:05.944 INFO:tasks.workunit.client.0.smithi017.stdout:5/10: symlink d0/l3 0 2024-03-16T10:53:05.944 INFO:tasks.workunit.client.0.smithi017.stdout:5/11: dwrite - no filename 2024-03-16T10:53:05.944 INFO:tasks.workunit.client.0.smithi017.stdout:5/12: dwrite - no filename 2024-03-16T10:53:05.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/11: symlink l5 0 2024-03-16T10:53:05.944 INFO:tasks.workunit.client.0.smithi017.stdout:1/20: mknod d1/d3/c5 0 2024-03-16T10:53:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:0/11: creat d2/d4/f6 x:0 0 0 2024-03-16T10:53:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:0/12: dread - d2/d4/f6 zero size 2024-03-16T10:53:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/0: creat f0 x:0 0 0 2024-03-16T10:53:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/1: truncate f0 68306 0 2024-03-16T10:53:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/2: write f0 [114777,15937] 0 2024-03-16T10:53:05.952 INFO:tasks.workunit.client.0.smithi017.stdout:8/1: symlink l0 0 2024-03-16T10:53:05.952 INFO:tasks.workunit.client.0.smithi017.stdout:8/2: stat l0 0 2024-03-16T10:53:05.953 INFO:tasks.workunit.client.0.smithi017.stdout:6/12: creat d0/f3 x:0 0 0 2024-03-16T10:53:05.955 INFO:tasks.workunit.client.0.smithi017.stdout:0/13: mkdir d2/d7 0 2024-03-16T10:53:05.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/21: mknod d1/d3/c6 0 2024-03-16T10:53:05.959 INFO:tasks.workunit.client.0.smithi017.stdout:7/3: creat f1 x:0 0 0 2024-03-16T10:53:05.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/3: symlink l1 0 2024-03-16T10:53:05.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/4: truncate - no filename 2024-03-16T10:53:05.963 INFO:tasks.workunit.client.0.smithi017.stdout:6/13: link d0/f3 d0/f4 0 2024-03-16T10:53:05.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/14: unlink c1 0 2024-03-16T10:53:05.970 INFO:tasks.workunit.client.0.smithi017.stdout:9/0: creat f0 x:0 0 0 2024-03-16T10:53:05.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/5: creat f2 x:0 0 0 2024-03-16T10:53:05.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/6: dread - f2 zero size 2024-03-16T10:53:05.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/15: symlink d2/d4/l8 0 2024-03-16T10:53:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/1: unlink f0 0 2024-03-16T10:53:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/2: read - no filename 2024-03-16T10:53:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/3: write - no filename 2024-03-16T10:53:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/4: chown . 40599 1 2024-03-16T10:53:05.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/7: rename l0 to l3 0 2024-03-16T10:53:05.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/8: fdatasync f2 0 2024-03-16T10:53:06.290 INFO:tasks.workunit.client.0.smithi017.stdout:3/12: dwrite f2 [0,4194304] 0 2024-03-16T10:53:06.421 INFO:tasks.workunit.client.0.smithi017.stdout:1/22: dwrite d1/f4 [0,4194304] 0 2024-03-16T10:53:06.430 INFO:tasks.workunit.client.0.smithi017.stdout:8/9: dwrite f2 [0,4194304] 0 2024-03-16T10:53:06.439 INFO:tasks.workunit.client.0.smithi017.stdout:8/10: write f2 [512503,37693] 0 2024-03-16T10:53:06.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/23: dwrite d1/f4 [0,4194304] 0 2024-03-16T10:53:06.535 INFO:tasks.workunit.client.0.smithi017.stdout:0/16: fsync d2/f5 0 2024-03-16T10:53:06.535 INFO:tasks.workunit.client.0.smithi017.stdout:0/17: dread - d2/d4/f6 zero size 2024-03-16T10:53:06.535 INFO:tasks.workunit.client.0.smithi017.stdout:0/18: write d2/d4/f6 [864806,24995] 0 2024-03-16T10:53:06.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/4: getdents . 0 2024-03-16T10:53:06.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:06 smithi174 ceph-mon[36202]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 914 op/s 2024-03-16T10:53:06.570 INFO:tasks.workunit.client.0.smithi017.stdout:9/5: getdents . 0 2024-03-16T10:53:06.570 INFO:tasks.workunit.client.0.smithi017.stdout:9/6: getdents . 0 2024-03-16T10:53:06.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:06 smithi017 ceph-mon[32078]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 914 op/s 2024-03-16T10:53:06.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:53:06.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:53:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:06 smithi111 ceph-mon[36315]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 914 op/s 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3541813791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 msgr2=0x7fbdb010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3541813791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb010bb50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009ca0 tx=0x7fbda802c180 comp rx=0 tx=0).stop 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3541813791 shutdown_connections 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3541813791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb010bb50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3541813791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3541813791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 0x7fbdb0073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3541813791 >> 172.21.15.17:0/3541813791 conn(0x7fbdb00fcd80 msgr2=0x7fbdb00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.714+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3541813791 shutdown_connections 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3541813791 wait complete. 2024-03-16T10:53:06.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 Processor -- start 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 -- start start 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 0x7fbdb019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010f6a0 con 0x7fbdb01096c0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010f520 con 0x7fbdb00741c0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdb4fd3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb010f820 con 0x7fbdb00757a0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.715+0000 7fbdaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32914/0 (socket says 172.21.15.17:32914) 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 -- 172.21.15.17:0/3036820667 learned_addr learned my addr 172.21.15.17:0/3036820667 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdae59c640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbda7fff640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 0x7fbdb019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 -- 172.21.15.17:0/3036820667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 msgr2=0x7fbdb019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 0x7fbdb019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 -- 172.21.15.17:0/3036820667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 msgr2=0x7fbdb0199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 -- 172.21.15.17:0/3036820667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb01a18f0 con 0x7fbdb01096c0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdae59c640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbda8037040 tx=0x7fbda8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbda77fe640 1 -- 172.21.15.17:0/3036820667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8039040 con 0x7fbdb01096c0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbda77fe640 1 -- 172.21.15.17:0/3036820667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda8044070 con 0x7fbdb01096c0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb01a1b80 con 0x7fbdb01096c0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbda77fe640 1 -- 172.21.15.17:0/3036820667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80043b0 con 0x7fbdb01096c0 2024-03-16T10:53:06.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.716+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb01a20c0 con 0x7fbdb01096c0 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.719+0000 7fbdb7bb7740 1 Processor -- start 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.719+0000 7fbda77fe640 1 -- 172.21.15.17:0/3036820667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fbda8004550 con 0x7fbdb01096c0 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.719+0000 7fbdb7bb7740 1 -- start start 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d54590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 0x563645d5c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563645cb9500 con 0x563645d54b60 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x563645c61be0 con 0x563645d54170 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563645cb55a0 con 0x563645d59cd0 2024-03-16T10:53:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32920/0 (socket says 172.21.15.17:32920) 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 -- 172.21.15.17:0/195069181 learned_addr learned my addr 172.21.15.17:0/195069181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda7fff640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d54590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda7fff640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 0x563645d5c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 -- 172.21.15.17:0/195069181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 msgr2=0x563645d5c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 0x563645d5c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 -- 172.21.15.17:0/195069181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 msgr2=0x563645d54590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d54590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 -- 172.21.15.17:0/195069181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563645c754b0 con 0x563645d54b60 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda77fe640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 0x7fbd9c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda7fff640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 0x563645d5c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbdae59c640 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbda00114c0 tx=0x7fbda0011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b929c7dde9e052 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda7fff640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 0x7fbd9c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda77fe640 1 -- 172.21.15.17:0/3036820667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbda80f0f10 con 0x7fbdb01096c0 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.720+0000 7fbda4ff9640 1 -- 172.21.15.17:0/195069181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0004020 con 0x563645d54b60 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbda4ff9640 1 -- 172.21.15.17:0/195069181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda00041c0 con 0x563645d54b60 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbda4ff9640 1 -- 172.21.15.17:0/195069181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda000f930 con 0x563645d54b60 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/195069181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 msgr2=0x563645d59660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbda00114c0 tx=0x7fbda0011980 comp rx=0 tx=0).stop 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbda7fff640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 0x7fbd9c0a4d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x563645d553c0 tx=0x7fbd980096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/195069181 shutdown_connections 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d59cd0 0x563645d5c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d59660 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/195069181 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d54590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.721+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/195069181 >> 172.21.15.17:0/195069181 conn(0x563645d4f6e0 msgr2=0x563645d4fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/195069181 shutdown_connections 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/195069181 wait complete. 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- start start 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 Processor -- start 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54b60 0x563645d5ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563645d5cc80 con 0x563645d59cd0 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x563645c75160 con 0x563645d54170 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563645d5ce00 con 0x563645d54b60 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdb7bb7740 10 client.0 _ll_register_callbacks cb 0x563645c59150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdae59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32936/0 (socket says 172.21.15.17:32936) 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbdaed9d640 1 -- 172.21.15.17:0/2151323828 learned_addr learned my addr 172.21.15.17:0/2151323828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.722+0000 7fbda7fff640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54b60 0x563645d5ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 -- 172.21.15.17:0/2151323828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54b60 msgr2=0x563645d5ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54b60 0x563645d5ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 -- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 msgr2=0x563645d5e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d5e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 -- 172.21.15.17:0/2151323828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563645a977d0 con 0x563645d59cd0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d5e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbda8005e30 tx=0x7fbda80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8e060018211226 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80bddb0 con 0x563645d59cd0 2024-03-16T10:53:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbda80c5c60 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda00041c0 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbda8003dc0 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdb7bb7740 10 client.16116 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5636459cd3f0 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda00041c0 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.723+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fbda803c030 con 0x563645d59cd0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 10 client.16116 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 20 client.16116 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645d6a340 0x563645d6c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 4 client.16116 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563645cc6a40 con 0x563645d6a340 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645d6a340 0x563645d6c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbd95ffb640 10 client.16116 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.724+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645d6a340 0x563645d6c800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff164553a1edde13 server_cookie=1dd9aa0f82f17740 in_seq=0 out_seq=0 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.725+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2151323828 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563645cc6a40 con 0x563645d6a340 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.725+0000 7fbd95ffb640 10 client.16116 handle_command_reply: tid=0 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 client.16116 shutdown 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 msgr2=0x563645d65c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbda8005e30 tx=0x7fbda80095c0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 shutdown_connections 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645d6a340 0x563645d6c800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d59cd0 0x563645d65c30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54b60 0x563645d5ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2151323828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d54170 0x563645d5e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbd95ffb640 0 client.16116 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 >> 172.21.15.17:0/2151323828 conn(0x563645d4f6e0 msgr2=0x563645d4e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 shutdown_connections 2024-03-16T10:53:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2151323828 wait complete. 2024-03-16T10:53:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.726+0000 7fbdb7bb7740 20 client.16116 trim_cache size 0 max 16384 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 Processor -- start 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 -- start start 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d56020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645d65bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01aace0 con 0x563645d54b60 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01aca00 con 0x563645d59cd0 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01ab3b0 con 0x563645d54170 2024-03-16T10:53:06.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32952/0 (socket says 172.21.15.17:32952) 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbda7fff640 1 -- 172.21.15.17:0/4155329926 learned_addr learned my addr 172.21.15.17:0/4155329926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645d65bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.745+0000 7fbdae59c640 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d56020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 -- 172.21.15.17:0/4155329926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 msgr2=0x563645d56020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d56020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 -- 172.21.15.17:0/4155329926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 msgr2=0x563645d65bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645d65bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 -- 172.21.15.17:0/4155329926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364598d0f0 con 0x563645d54b60 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbda7fff640 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd98004260 tx=0x7fbd980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bed5313841f699f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbd97fff640 1 -- 172.21.15.17:0/4155329926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98003d30 con 0x563645d54b60 2024-03-16T10:53:06.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbd97fff640 1 -- 172.21.15.17:0/4155329926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9801f920 con 0x563645d54b60 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.746+0000 7fbd97fff640 1 -- 172.21.15.17:0/4155329926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98022700 con 0x563645d54b60 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/4155329926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 msgr2=0x563645d56560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd98004260 tx=0x7fbd980046c0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/4155329926 shutdown_connections 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645d65bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d56560 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/4155329926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d56020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/4155329926 >> 172.21.15.17:0/4155329926 conn(0x563645d4f6e0 msgr2=0x563645d4fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/4155329926 shutdown_connections 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/4155329926 wait complete. 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- start start 2024-03-16T10:53:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 Processor -- start 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645dce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01ac270 con 0x563645d54b60 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01abb40 con 0x563645d59cd0 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb01a8ce0 con 0x563645d54170 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbdb7bb7740 10 client.0 _ll_register_callbacks cb 0x7fbda80b9cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32958/0 (socket says 172.21.15.17:32958) 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.747+0000 7fbda7fff640 1 -- 172.21.15.17:0/2900593170 learned_addr learned my addr 172.21.15.17:0/2900593170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbdaed9d640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645dce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 -- 172.21.15.17:0/2900593170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 msgr2=0x563645d62b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d62b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 -- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 msgr2=0x563645dce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645dce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 -- 172.21.15.17:0/2900593170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563645c809d0 con 0x563645d54b60 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbda7fff640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbd98003a80 tx=0x7fbd9801fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d8c3c2bed87613 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbd95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98003df0 con 0x563645d54b60 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbd9801f650 con 0x563645d54b60 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9801f920 con 0x563645d54b60 2024-03-16T10:53:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbd98005040 con 0x563645d54b60 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbdb7bb7740 10 client.16122 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.748+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563645dcfd30 con 0x563645d54b60 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd9801f920 con 0x563645d54b60 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fbd98022640 con 0x563645d54b60 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 10 client.16122 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 20 client.16122 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645dd0820 0x563645dd2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 4 client.16122 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563645cc0d90 con 0x563645dd0820 2024-03-16T10:53:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645dd0820 0x563645dd2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbd95ffb640 10 client.16122 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.749+0000 7fbdae59c640 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645dd0820 0x563645dd2c40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebcbadf5e2e8ef1d server_cookie=73c1fc98ba570e36 in_seq=0 out_seq=0 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbd95ffb640 1 -- 172.21.15.17:0/2900593170 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563645cc0d90 con 0x563645dd0820 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbd95ffb640 10 client.16122 handle_command_reply: tid=0 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 client.16122 shutdown 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 msgr2=0x563645d630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbd98003a80 tx=0x7fbd9801fe40 comp rx=0 tx=0).stop 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 shutdown_connections 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x563645dd0820 0x563645dd2c40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563645d59cd0 0x563645dce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbd95ffb640 0 client.16122 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563645d54b60 0x563645d630b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 --2- 172.21.15.17:0/2900593170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563645d54170 0x563645d62b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 >> 172.21.15.17:0/2900593170 conn(0x563645d4f6e0 msgr2=0x563645d5e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 shutdown_connections 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 1 -- 172.21.15.17:0/2900593170 wait complete. 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.751+0000 7fbdb7bb7740 20 client.16122 trim_cache size 0 max 16384 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-03-16T10:53:06.760 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:53:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 msgr2=0x7fbd9c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 0x7fbd9c0a4d40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x563645d553c0 tx=0x7fbd980096c0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 msgr2=0x7fbdb01a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbda8037040 tx=0x7fbda8009360 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 shutdown_connections 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbd9c0a2880 0x7fbd9c0a4d40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdb01096c0 0x7fbdb01a1250 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb00757a0 0x7fbdb019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 --2- 172.21.15.17:0/3036820667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdb00741c0 0x7fbdb0199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 >> 172.21.15.17:0/3036820667 conn(0x7fbdb00fcd80 msgr2=0x7fbdb0105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 shutdown_connections 2024-03-16T10:53:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.752+0000 7fbdb4fd3640 1 -- 172.21.15.17:0/3036820667 wait complete. 2024-03-16T10:53:06.764 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T10:53:06.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 -- 172.21.15.17:0/1712923139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c101830 msgr2=0x7f4b0c101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 --2- 172.21.15.17:0/1712923139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c101830 0x7f4b0c101c50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009900 tx=0x7f4afc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 -- 172.21.15.17:0/1712923139 shutdown_connections 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 --2- 172.21.15.17:0/1712923139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 --2- 172.21.15.17:0/1712923139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c102a20 0x7f4b0c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 --2- 172.21.15.17:0/1712923139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c101830 0x7f4b0c101c50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 -- 172.21.15.17:0/1712923139 >> 172.21.15.17:0/1712923139 conn(0x7f4b0c0fcd80 msgr2=0x7f4b0c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 -- 172.21.15.17:0/1712923139 shutdown_connections 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.865+0000 7f4b11f77640 1 -- 172.21.15.17:0/1712923139 wait complete. 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 Processor -- start 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 -- start start 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 0x7f4b0c197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 0x7f4b0c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c10d480 con 0x7f4b0c1033e0 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c10d300 con 0x7f4b0c102a20 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b11f77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c10d600 con 0x7f4b0c101830 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b0affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 0x7f4b0c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32990/0 (socket says 172.21.15.17:32990) 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b0bfff640 1 -- 172.21.15.17:0/3696440453 learned_addr learned my addr 172.21.15.17:0/3696440453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.866+0000 7f4b0b7fe640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 0x7f4b0c197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 -- 172.21.15.17:0/3696440453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 msgr2=0x7f4b0c197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 0x7f4b0c197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 -- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 msgr2=0x7f4b0c19f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 -- 172.21.15.17:0/3696440453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c19f7b0 con 0x7f4b0c102a20 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0b7fe640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 0x7f4b0c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0bfff640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b0affd640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 0x7f4b0c1980d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9f0 tx=0x7f4b0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000cd80 con 0x7f4b0c102a20 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c19faa0 con 0x7f4b0c102a20 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b000035f0 con 0x7f4b0c102a20 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00010670 con 0x7f4b0c102a20 2024-03-16T10:53:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.867+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c1a0040 con 0x7f4b0c102a20 2024-03-16T10:53:06.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.868+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c108bd0 con 0x7f4b0c102a20 2024-03-16T10:53:06.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.870+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f4b000037a0 con 0x7f4b0c102a20 2024-03-16T10:53:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.870+0000 7f4b08ff9640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 0x7f4af40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.870+0000 7f4b0b7fe640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 0x7f4af40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.870+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4b000cebe0 con 0x7f4b0c102a20 2024-03-16T10:53:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.871+0000 7f4b0b7fe640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 0x7f4af40a4cc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4afc000c00 tx=0x7f4afc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:06.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:06.877+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f4b0009bd20 con 0x7f4b0c102a20 2024-03-16T10:53:07.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.100+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b0c02d360 con 0x7f4b0c102a20 2024-03-16T10:53:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.101+0000 7f4b08ff9640 1 -- 172.21.15.17:0/3696440453 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11952 (secure 0 0 0) 0x7f4b0009b620 con 0x7f4b0c102a20 2024-03-16T10:53:07.102 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:53:07.102 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:52:42.815392+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":9,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24493,24536,24470,24497,14655]},"id":1}]} 2024-03-16T10:53:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-03-16T10:53:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 msgr2=0x7f4af40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 0x7f4af40a4cc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4afc000c00 tx=0x7f4afc005fd0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 msgr2=0x7f4b0c1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 0x7f4b0c1980d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9f0 tx=0x7f4b0000eeb0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 shutdown_connections 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f4af40a2800 0x7f4af40a4cc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b0c1033e0 0x7f4b0c19f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b0c102a20 0x7f4b0c1980d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 --2- 172.21.15.17:0/3696440453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b0c101830 0x7f4b0c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 >> 172.21.15.17:0/3696440453 conn(0x7f4b0c0fcd80 msgr2=0x7f4b0c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 shutdown_connections 2024-03-16T10:53:07.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.103+0000 7f4b11f77640 1 -- 172.21.15.17:0/3696440453 wait complete. 2024-03-16T10:53:07.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 -- 172.21.15.17:0/1178179832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0341019a0 msgr2=0x7ff0341082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 --2- 172.21.15.17:0/1178179832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0341019a0 0x7ff0341082c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009900 tx=0x7ff02c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 -- 172.21.15.17:0/1178179832 shutdown_connections 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 --2- 172.21.15.17:0/1178179832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0341019a0 0x7ff0341082c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 --2- 172.21.15.17:0/1178179832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff034100fe0 0x7ff034101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 --2- 172.21.15.17:0/1178179832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0340ffe90 0x7ff0341002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 -- 172.21.15.17:0/1178179832 >> 172.21.15.17:0/1178179832 conn(0x7ff0340fb3e0 msgr2=0x7ff0340fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 -- 172.21.15.17:0/1178179832 shutdown_connections 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.223+0000 7ff03ae34640 1 -- 172.21.15.17:0/1178179832 wait complete. 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 Processor -- start 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 -- start start 2024-03-16T10:53:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff034100fe0 0x7ff034197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341019a0 0x7ff03419f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff03410b2c0 con 0x7ff0340ffe90 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff03410b140 con 0x7ff034100fe0 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff03ae34640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff03410b440 con 0x7ff0341019a0 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33008/0 (socket says 172.21.15.17:33008) 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 -- 172.21.15.17:0/585861177 learned_addr learned my addr 172.21.15.17:0/585861177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff033fff640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff034100fe0 0x7ff034197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff0393d1640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341019a0 0x7ff03419f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 -- 172.21.15.17:0/585861177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341019a0 msgr2=0x7ff03419f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341019a0 0x7ff03419f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 -- 172.21.15.17:0/585861177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff034100fe0 msgr2=0x7ff034197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff034100fe0 0x7ff034197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 -- 172.21.15.17:0/585861177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03419f6a0 con 0x7ff0340ffe90 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.224+0000 7ff038bd0640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ebc0 tx=0x7ff02400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.225+0000 7ff031ffb640 1 -- 172.21.15.17:0/585861177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024010630 con 0x7ff0340ffe90 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.225+0000 7ff031ffb640 1 -- 172.21.15.17:0/585861177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff024010cb0 con 0x7ff0340ffe90 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.225+0000 7ff031ffb640 1 -- 172.21.15.17:0/585861177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024018bd0 con 0x7ff0340ffe90 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.225+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03419f990 con 0x7ff0340ffe90 2024-03-16T10:53:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.225+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03419fee0 con 0x7ff0340ffe90 2024-03-16T10:53:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.227+0000 7ff031ffb640 1 -- 172.21.15.17:0/585861177 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7ff0240107d0 con 0x7ff0340ffe90 2024-03-16T10:53:07.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.227+0000 7ff031ffb640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 0x7ff0200a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff033fff640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 0x7ff0200a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff031ffb640 1 -- 172.21.15.17:0/585861177 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff0240cefe0 con 0x7ff0340ffe90 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 Processor -- start 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff033fff640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 0x7ff0200a4cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff034198f90 tx=0x7ff01c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 -- start start 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105878d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1057d8490 con 0x55b105873850 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b105780c90 con 0x55b1058793b0 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff03da1a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b1057d4530 con 0x55b105874240 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33012/0 (socket says 172.21.15.17:33012) 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff038bd0640 1 -- 172.21.15.17:0/53880988 learned_addr learned my addr 172.21.15.17:0/53880988 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.228+0000 7ff0393d1640 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff033fff640 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105878d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 -- 172.21.15.17:0/53880988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 msgr2=0x55b105878d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105878d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 -- 172.21.15.17:0/53880988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 msgr2=0x55b10587b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 -- 172.21.15.17:0/53880988 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b10583b500 con 0x55b105873850 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff038bd0640 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff024097ef0 tx=0x7ff024018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398608e8374e4b03 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff02affd640 1 -- 172.21.15.17:0/53880988 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02409fb30 con 0x55b105873850 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff02affd640 1 -- 172.21.15.17:0/53880988 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0240a4180 con 0x55b105873850 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.229+0000 7ff02affd640 1 -- 172.21.15.17:0/53880988 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02409b140 con 0x55b105873850 2024-03-16T10:53:07.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- 172.21.15.17:0/53880988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 msgr2=0x55b105873c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff024097ef0 tx=0x7ff024018670 comp rx=0 tx=0).stop 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- 172.21.15.17:0/53880988 shutdown_connections 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105878d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 --2- 172.21.15.17:0/53880988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b105873c70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- 172.21.15.17:0/53880988 >> 172.21.15.17:0/53880988 conn(0x55b10586edc0 msgr2=0x55b10586f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- 172.21.15.17:0/53880988 shutdown_connections 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- 172.21.15.17:0/53880988 wait complete. 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 -- start start 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.230+0000 7ff03da1a740 1 Processor -- start 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b10587e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b1058851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b10587c2a0 con 0x55b1058793b0 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b105794230 con 0x55b105873850 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b10587c420 con 0x55b105874240 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff03da1a740 10 client.0 _ll_register_callbacks cb 0x55b1057d0010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff0393d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b1058851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37896/0 (socket says 172.21.15.17:37896) 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff033fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b10587e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 -- 172.21.15.17:0/3692495507 learned_addr learned my addr 172.21.15.17:0/3692495507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 -- 172.21.15.17:0/3692495507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 msgr2=0x55b10587e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b10587e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 -- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 msgr2=0x55b1058851d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b1058851d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff038bd0640 1 -- 172.21.15.17:0/3692495507 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1057a3100 con 0x55b105873850 2024-03-16T10:53:07.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff0393d1640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b1058851d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.231+0000 7ff033fff640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b10587e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.232+0000 7ff038bd0640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff02409ba20 tx=0x7ff02400cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a05f33f4931dd3de server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.232+0000 7ff013fff640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b8020 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff0240979f0 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0240a4180 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0240ba2c0 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff03da1a740 10 client.26015 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1054ec3f0 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.233+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0240a4180 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7ff0240a0a50 con 0x55b105873850 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 10 client.26015 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 10 client.26015 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 20 client.26015 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058896e0 0x55b10588bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 4 client.26015 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1057e59d0 con 0x55b1058896e0 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.234+0000 7ff033fff640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058896e0 0x55b10588bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff033fff640 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058896e0 0x55b10588bad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f7707fbd17e67394 server_cookie=66735ab0a4c239da in_seq=0 out_seq=0 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff013fff640 10 client.26015 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff013fff640 1 -- 172.21.15.17:0/3692495507 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b1057e59d0 con 0x55b1058896e0 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff013fff640 10 client.26015 handle_command_reply: tid=0 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 client.26015 shutdown 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 msgr2=0x55b10587dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff02409ba20 tx=0x7ff02400cd20 comp rx=0 tx=0).stop 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 shutdown_connections 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058896e0 0x55b10588bad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b1058851d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff013fff640 0 client.26015 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b10587e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 --2- 172.21.15.17:0/3692495507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b10587dc90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.235+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 >> 172.21.15.17:0/3692495507 conn(0x55b10586edc0 msgr2=0x55b10586dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.236+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 shutdown_connections 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.236+0000 7ff03da1a740 1 -- 172.21.15.17:0/3692495507 wait complete. 2024-03-16T10:53:07.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.236+0000 7ff03da1a740 20 client.26015 trim_cache size 0 max 16384 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.249+0000 7ff03da1a740 1 Processor -- start 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.249+0000 7ff03da1a740 1 -- start start 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105885190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341a8c30 con 0x55b105873850 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341aa950 con 0x55b1058793b0 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff03da1a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341a9300 con 0x55b105874240 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33026/0 (socket says 172.21.15.17:33026) 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 -- 172.21.15.17:0/2631966680 learned_addr learned my addr 172.21.15.17:0/2631966680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff033fff640 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105885190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff0393d1640 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 -- 172.21.15.17:0/2631966680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 msgr2=0x55b105885190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105885190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 -- 172.21.15.17:0/2631966680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 msgr2=0x55b10587e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 -- 172.21.15.17:0/2631966680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1055b67d0 con 0x55b105873850 2024-03-16T10:53:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff038bd0640 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff024098460 tx=0x7ff024018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2592a114e4d0b743 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff02a7fc640 1 -- 172.21.15.17:0/2631966680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b8030 con 0x55b105873850 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff02a7fc640 1 -- 172.21.15.17:0/2631966680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff02409fb30 con 0x55b105873850 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.250+0000 7ff02a7fc640 1 -- 172.21.15.17:0/2631966680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024097b10 con 0x55b105873850 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 -- 172.21.15.17:0/2631966680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 msgr2=0x55b10587dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff024098460 tx=0x7ff024018670 comp rx=0 tx=0).stop 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 -- 172.21.15.17:0/2631966680 shutdown_connections 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b1058793b0 0x55b10587e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b105885190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 --2- 172.21.15.17:0/2631966680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b105873850 0x55b10587dc30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 -- 172.21.15.17:0/2631966680 >> 172.21.15.17:0/2631966680 conn(0x55b10586edc0 msgr2=0x55b10586f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 -- 172.21.15.17:0/2631966680 shutdown_connections 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.251+0000 7ff03da1a740 1 -- 172.21.15.17:0/2631966680 wait complete. 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 -- start start 2024-03-16T10:53:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 Processor -- start 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b105882260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b1058827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341aa1c0 con 0x55b1058793b0 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341a9a90 con 0x55b105873850 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341a6c10 con 0x55b105874240 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff03da1a740 10 client.0 _ll_register_callbacks cb 0x7ff01c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff038bd0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b105882260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33030/0 (socket says 172.21.15.17:33030) 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 -- 172.21.15.17:0/4254542967 learned_addr learned my addr 172.21.15.17:0/4254542967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff033fff640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b1058827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 -- 172.21.15.17:0/4254542967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 msgr2=0x55b1058827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b1058827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 -- 172.21.15.17:0/4254542967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 msgr2=0x55b105882260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b105882260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.252+0000 7ff0393d1640 1 -- 172.21.15.17:0/4254542967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b105883d50 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff0393d1640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff02c02cfd0 tx=0x7ff02c004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a11ea43d40ef076 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c04d060 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff02c004260 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff02409fb30 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff02c004460 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 10 client.16146 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1058850c0 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff02409fb30 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7ff02c052070 con 0x55b1058793b0 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 10 client.16146 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 10 client.16146 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:53:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 20 client.16146 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058efd10 0x55b1058f2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 4 client.16146 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.253+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1057dfd20 con 0x55b1058efd10 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff038bd0640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058efd10 0x55b1058f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff013fff640 10 client.16146 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff038bd0640 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058efd10 0x55b1058f2130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=20753e1fe0aeb832 server_cookie=9c16ad0139183296 in_seq=0 out_seq=0 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff013fff640 1 -- 172.21.15.17:0/4254542967 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1057dfd20 con 0x55b1058efd10 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff013fff640 10 client.16146 handle_command_reply: tid=0 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 client.16146 shutdown 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 msgr2=0x55b105883760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff02c02cfd0 tx=0x7ff02c004c90 comp rx=0 tx=0).stop 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 shutdown_connections 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x55b1058efd10 0x55b1058f2130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1058793b0 0x55b105883760 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b105874240 0x55b1058827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff013fff640 0 client.16146 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 --2- 172.21.15.17:0/4254542967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b105873850 0x55b105882260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 >> 172.21.15.17:0/4254542967 conn(0x55b10586edc0 msgr2=0x55b10587dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 shutdown_connections 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.254+0000 7ff03da1a740 1 -- 172.21.15.17:0/4254542967 wait complete. 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03da1a740 20 client.16146 trim_cache size 0 max 16384 2024-03-16T10:53:07.261 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 msgr2=0x7ff0200a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 0x7ff0200a4cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff034198f90 tx=0x7ff01c010040 comp rx=0 tx=0).stop 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 msgr2=0x7ff034197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ebc0 tx=0x7ff02400c6a0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 shutdown_connections 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff0200a2800 0x7ff0200a4cc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341019a0 0x7ff03419f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff034100fe0 0x7ff034197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 --2- 172.21.15.17:0/585861177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0340ffe90 0x7ff034197a80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 >> 172.21.15.17:0/585861177 conn(0x7ff0340fb3e0 msgr2=0x7ff0341064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 shutdown_connections 2024-03-16T10:53:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.255+0000 7ff03ae34640 1 -- 172.21.15.17:0/585861177 wait complete. 2024-03-16T10:53:07.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 -- 172.21.15.17:0/894032315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d01022a0 msgr2=0x7f25d0104690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/894032315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d01022a0 0x7f25d0104690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009900 tx=0x7f25c002bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 -- 172.21.15.17:0/894032315 shutdown_connections 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/894032315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0107500 0x7f25d0109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/894032315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d0104bd0 0x7f25d0106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/894032315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d01022a0 0x7f25d0104690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 -- 172.21.15.17:0/894032315 >> 172.21.15.17:0/894032315 conn(0x7f25d00fbc70 msgr2=0x7f25d00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 -- 172.21.15.17:0/894032315 shutdown_connections 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.381+0000 7f25d5fe6640 1 -- 172.21.15.17:0/894032315 wait complete. 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 Processor -- start 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 -- start start 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d01022a0 0x7f25d0101c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 0x7f25d0100250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 0x7f25d0100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25d010d480 con 0x7f25d0107500 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25d010d300 con 0x7f25d0104bd0 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25d5fe6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25d010d600 con 0x7f25d01022a0 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 0x7f25d0100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 0x7f25d0100250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 0x7f25d0100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33054/0 (socket says 172.21.15.17:33054) 2024-03-16T10:53:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25cffff640 1 -- 172.21.15.17:0/3447736154 learned_addr learned my addr 172.21.15.17:0/3447736154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d01022a0 0x7f25d0101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 -- 172.21.15.17:0/3447736154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d01022a0 msgr2=0x7f25d0101c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d01022a0 0x7f25d0101c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 -- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 msgr2=0x7f25d0100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 0x7f25d0100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.382+0000 7f25ceffd640 1 -- 172.21.15.17:0/3447736154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d0101020 con 0x7f25d0104bd0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25ceffd640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 0x7f25d0100250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e9c0 tx=0x7f25c400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25ccff9640 1 -- 172.21.15.17:0/3447736154 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c400ccc0 con 0x7f25d0104bd0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d01a1cd0 con 0x7f25d0104bd0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25ccff9640 1 -- 172.21.15.17:0/3447736154 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c4005020 con 0x7f25d0104bd0 2024-03-16T10:53:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25ccff9640 1 -- 172.21.15.17:0/3447736154 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4004a00 con 0x7f25d0104bd0 2024-03-16T10:53:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.383+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d01a21d0 con 0x7f25d0104bd0 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.385+0000 7f25ccff9640 1 -- 172.21.15.17:0/3447736154 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f25c40051d0 con 0x7f25d0104bd0 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25ccff9640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 0x7f25b80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 0x7f25b80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 Processor -- start 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25ccff9640 1 -- 172.21.15.17:0/3447736154 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f25c40cea10 con 0x7f25d0104bd0 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 -- start start 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b32d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b35840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558bf6a92490 con 0x558bf6b2d850 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x558bf6a3ac90 con 0x558bf6b2e240 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558bf6a8e530 con 0x558bf6b333b0 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b32d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 0x7f25b80a4cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f25c002c7b0 tx=0x7f25c0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b35840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33060/0 (socket says 172.21.15.17:33060) 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2413729092 learned_addr learned my addr 172.21.15.17:0/2413729092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.386+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b32d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37948/0 (socket says 172.21.15.17:37948) 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2413729092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 msgr2=0x558bf6b35840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b35840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2413729092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 msgr2=0x558bf6b32d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b32d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2413729092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf6af5500 con 0x558bf6b2d850 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cffff640 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b35840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f25c0036040 tx=0x7f25c003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3721d2743fd219 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25b5ffb640 1 -- 172.21.15.17:0/2413729092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c004d070 con 0x558bf6b2d850 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25b5ffb640 1 -- 172.21.15.17:0/2413729092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0004400 con 0x558bf6b2d850 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.387+0000 7f25b5ffb640 1 -- 172.21.15.17:0/2413729092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c00035f0 con 0x558bf6b2d850 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2413729092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 msgr2=0x558bf6b2dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f25c0036040 tx=0x7f25c003e000 comp rx=0 tx=0).stop 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2413729092 shutdown_connections 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b35840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b32d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2413729092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b2dc70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2413729092 >> 172.21.15.17:0/2413729092 conn(0x558bf6b28dc0 msgr2=0x558bf6b291c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2413729092 shutdown_connections 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2413729092 wait complete. 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 -- start start 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.388+0000 7f25d8bd2740 1 Processor -- start 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558bf6b36300 con 0x558bf6b333b0 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x558bf6a4e230 con 0x558bf6b2d850 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558bf6b36480 con 0x558bf6b2e240 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25d8bd2740 10 client.0 _ll_register_callbacks cb 0x558bf6a8a010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33072/0 (socket says 172.21.15.17:33072) 2024-03-16T10:53:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 -- 172.21.15.17:0/2067914537 learned_addr learned my addr 172.21.15.17:0/2067914537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 -- 172.21.15.17:0/2067914537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 msgr2=0x558bf6b38290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 -- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 msgr2=0x558bf6b37d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 -- 172.21.15.17:0/2067914537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf6a5d100 con 0x558bf6b333b0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25cffff640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f25c8012d50 tx=0x7f25c800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbed3a9d3798f5b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c800fe60 con 0x558bf6b333b0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.389+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f25c8004b20 con 0x558bf6b333b0 2024-03-16T10:53:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25c0004400 con 0x558bf6b333b0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f25c8004d20 con 0x558bf6b333b0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 10 client.16158 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558bf67a63f0 con 0x558bf6b333b0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0004400 con 0x558bf6b333b0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f25c8010550 con 0x558bf6b333b0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 10 client.16158 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 10 client.16158 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 20 client.16158 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6b43b40 0x558bf6b45fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 4 client.16158 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bf6a9f9d0 con 0x558bf6b43b40 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.390+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6b43b40 0x558bf6b45fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.391+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6b43b40 0x558bf6b45fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cf547989289fa1c2 server_cookie=bb989b0b51768171 in_seq=0 out_seq=0 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.391+0000 7f25aeffd640 10 client.16158 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25aeffd640 1 -- 172.21.15.17:0/2067914537 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558bf6a9f9d0 con 0x558bf6b43b40 2024-03-16T10:53:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25aeffd640 10 client.16158 handle_command_reply: tid=0 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 client.16158 shutdown 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 msgr2=0x558bf6b3f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f25c8012d50 tx=0x7f25c800f790 comp rx=0 tx=0).stop 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 shutdown_connections 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6b43b40 0x558bf6b45fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f290 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25aeffd640 0 client.16158 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2067914537 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 >> 172.21.15.17:0/2067914537 conn(0x558bf6b28dc0 msgr2=0x558bf6b27fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 shutdown_connections 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2067914537 wait complete. 2024-03-16T10:53:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.392+0000 7f25d8bd2740 20 client.16158 trim_cache size 0 max 16384 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 Processor -- start 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 -- start start 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01aade0 con 0x558bf6b333b0 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01acb00 con 0x558bf6b2e240 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01ab4b0 con 0x558bf6b2d850 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.405+0000 7f25cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37960/0 (socket says 172.21.15.17:37960) 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25ceffd640 1 -- 172.21.15.17:0/3152604843 learned_addr learned my addr 172.21.15.17:0/3152604843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 -- 172.21.15.17:0/3152604843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 msgr2=0x558bf6b38290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 -- 172.21.15.17:0/3152604843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 msgr2=0x558bf6b3f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 -- 172.21.15.17:0/3152604843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf68707d0 con 0x558bf6b2d850 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25ceffd640 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cffff640 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25c002c710 tx=0x7f25c002c1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783b77d92f86b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25b57fa640 1 -- 172.21.15.17:0/3152604843 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0062070 con 0x558bf6b2d850 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25b57fa640 1 -- 172.21.15.17:0/3152604843 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0004400 con 0x558bf6b2d850 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.406+0000 7f25b57fa640 1 -- 172.21.15.17:0/3152604843 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0041030 con 0x558bf6b2d850 2024-03-16T10:53:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- 172.21.15.17:0/3152604843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 msgr2=0x558bf6b37d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25c002c710 tx=0x7f25c002c1f0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- 172.21.15.17:0/3152604843 shutdown_connections 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b333b0 0x558bf6b3f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/3152604843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b2d850 0x558bf6b37d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- 172.21.15.17:0/3152604843 >> 172.21.15.17:0/3152604843 conn(0x558bf6b28dc0 msgr2=0x558bf6b2f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- 172.21.15.17:0/3152604843 shutdown_connections 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- 172.21.15.17:0/3152604843 wait complete. 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 -- start start 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.407+0000 7f25d8bd2740 1 Processor -- start 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b3d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01ac370 con 0x558bf6b2d850 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01abc40 con 0x558bf6b2e240 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01a8de0 con 0x558bf6b333b0 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 10 client.0 _ll_register_callbacks cb 0x7f25c8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33098/0 (socket says 172.21.15.17:33098) 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37972/0 (socket says 172.21.15.17:37972) 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2370380781 learned_addr learned my addr 172.21.15.17:0/2370380781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cffff640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b3d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2370380781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 msgr2=0x558bf6b3d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b3d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 msgr2=0x558bf6b3c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 -- 172.21.15.17:0/2370380781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf6b3de00 con 0x558bf6b2d850 2024-03-16T10:53:07.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25cf7fe640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f25c0005ec0 tx=0x7f25c0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc026e5cb7309dfd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0062030 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25c0004400 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.408+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f25c0003c70 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f25c0041030 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 10 client.16164 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558bf6b3f100 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0004400 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f25c0052a30 con 0x558bf6b2d850 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 10 client.16164 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 10 client.16164 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 20 client.16164 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6ba9f00 0x558bf6bac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 4 client.16164 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558bf6a99d20 con 0x558bf6ba9f00 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.409+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6ba9f00 0x558bf6bac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25aeffd640 10 client.16164 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25ceffd640 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6ba9f00 0x558bf6bac2f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=39817629dee4646d server_cookie=825dffecc9245121 in_seq=0 out_seq=0 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25aeffd640 1 -- 172.21.15.17:0/2370380781 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558bf6a99d20 con 0x558bf6ba9f00 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25aeffd640 10 client.16164 handle_command_reply: tid=0 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 client.16164 shutdown 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 msgr2=0x558bf6b3c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f25c0005ec0 tx=0x7f25c0004360 comp rx=0 tx=0).stop 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 shutdown_connections 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x558bf6ba9f00 0x558bf6bac2f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558bf6b333b0 0x558bf6b3d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558bf6b2e240 0x558bf6b3c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25aeffd640 0 client.16164 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 --2- 172.21.15.17:0/2370380781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558bf6b2d850 0x558bf6b3c2c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 >> 172.21.15.17:0/2370380781 conn(0x558bf6b28dc0 msgr2=0x558bf6b37d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 shutdown_connections 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 1 -- 172.21.15.17:0/2370380781 wait complete. 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.410+0000 7f25d8bd2740 20 client.16164 trim_cache size 0 max 16384 2024-03-16T10:53:07.418 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:07.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 msgr2=0x7f25b80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 0x7f25b80a4cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f25c002c7b0 tx=0x7f25c0005fd0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 msgr2=0x7f25d0100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 0x7f25d0100250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e9c0 tx=0x7f25c400ee80 comp rx=0 tx=0).stop 2024-03-16T10:53:07.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 shutdown_connections 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f25b80a2800 0x7f25b80a4cc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d0107500 0x7f25d0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25d0104bd0 0x7f25d0100250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 --2- 172.21.15.17:0/3447736154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25d01022a0 0x7f25d0101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 >> 172.21.15.17:0/3447736154 conn(0x7f25d00fbc70 msgr2=0x7f25d0102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 shutdown_connections 2024-03-16T10:53:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.411+0000 7f25d5fe6640 1 -- 172.21.15.17:0/3447736154 wait complete. 2024-03-16T10:53:07.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:07 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3696440453' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:07.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 -- 172.21.15.17:0/575951670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1018d0 msgr2=0x7febfc101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 --2- 172.21.15.17:0/575951670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1018d0 0x7febfc101d50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7febe800d910 tx=0x7febe802b9a0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 -- 172.21.15.17:0/575951670 shutdown_connections 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 --2- 172.21.15.17:0/575951670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc102290 0x7febfc108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 --2- 172.21.15.17:0/575951670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1018d0 0x7febfc101d50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 --2- 172.21.15.17:0/575951670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc1006e0 0x7febfc100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 -- 172.21.15.17:0/575951670 >> 172.21.15.17:0/575951670 conn(0x7febfc0fbc70 msgr2=0x7febfc0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 -- 172.21.15.17:0/575951670 shutdown_connections 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.531+0000 7fec0324b640 1 -- 172.21.15.17:0/575951670 wait complete. 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 Processor -- start 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 -- start start 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc1018d0 0x7febfc195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc102290 0x7febfc19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7febfc10b260 con 0x7febfc1006e0 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7febfc10b0e0 con 0x7febfc102290 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec0324b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febfc10b3e0 con 0x7febfc1018d0 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33124/0 (socket says 172.21.15.17:33124) 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 -- 172.21.15.17:0/3533653253 learned_addr learned my addr 172.21.15.17:0/3533653253 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7febfbfff640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc1018d0 0x7febfc195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec017e8640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc102290 0x7febfc19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 -- 172.21.15.17:0/3533653253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc1018d0 msgr2=0x7febfc195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc1018d0 0x7febfc195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 -- 172.21.15.17:0/3533653253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc102290 msgr2=0x7febfc19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc102290 0x7febfc19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.532+0000 7fec00fe7640 1 -- 172.21.15.17:0/3533653253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc19d510 con 0x7febfc1006e0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7fec00fe7640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7febf0009be0 tx=0x7febf0007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7febf9ffb640 1 -- 172.21.15.17:0/3533653253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0007c40 con 0x7febfc1006e0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc19d800 con 0x7febfc1006e0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7febf9ffb640 1 -- 172.21.15.17:0/3533653253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0007de0 con 0x7febfc1006e0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7febf9ffb640 1 -- 172.21.15.17:0/3533653253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0019650 con 0x7febfc1006e0 2024-03-16T10:53:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.533+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc19dd20 con 0x7febfc1006e0 2024-03-16T10:53:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.535+0000 7febf9ffb640 1 -- 172.21.15.17:0/3533653253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7febf0020030 con 0x7febfc1006e0 2024-03-16T10:53:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.535+0000 7fec05e38740 1 Processor -- start 2024-03-16T10:53:07.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.535+0000 7fec05e38740 1 -- start start 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fcfba4d490 con 0x55fcfbaee3b0 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55fcfb9f5c90 con 0x55fcfbae9240 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec05e38740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fcfba49530 con 0x55fcfbae8850 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec017e8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec017e8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:56754/0 (socket says 172.21.15.17:56754) 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec017e8640 1 -- 172.21.15.17:0/1699344942 learned_addr learned my addr 172.21.15.17:0/1699344942 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37998/0 (socket says 172.21.15.17:37998) 2024-03-16T10:53:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febf9ffb640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 0x7febec0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 -- 172.21.15.17:0/1699344942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 msgr2=0x55fcfbae8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 -- 172.21.15.17:0/1699344942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 msgr2=0x55fcfbaedd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 -- 172.21.15.17:0/1699344942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcfbab0500 con 0x55fcfbaee3b0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec017e8640 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec00fe7640 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febf9ffb640 1 -- 172.21.15.17:0/3533653253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7febf00d1f20 con 0x7febfc1006e0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7fec017e8640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 0x7febec0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.536+0000 7febfbfff640 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf0840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7febe8000c00 tx=0x7febe8030470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26995fca245ab948 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7febe6ffd640 1 -- 172.21.15.17:0/1699344942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe800d110 con 0x55fcfbaee3b0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7febe6ffd640 1 -- 172.21.15.17:0/1699344942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe800d2b0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7febe6ffd640 1 -- 172.21.15.17:0/1699344942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8030e40 con 0x55fcfbaee3b0 2024-03-16T10:53:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 -- 172.21.15.17:0/1699344942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 msgr2=0x55fcfbaf0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec017e8640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 0x7febec0a4cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55fcfbae9aa0 tx=0x7febf4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf0840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7febe8000c00 tx=0x7febe8030470 comp rx=0 tx=0).stop 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 -- 172.21.15.17:0/1699344942 shutdown_connections 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf0840 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae9240 0x55fcfbaedd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 --2- 172.21.15.17:0/1699344942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbae8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 -- 172.21.15.17:0/1699344942 >> 172.21.15.17:0/1699344942 conn(0x55fcfbae3dc0 msgr2=0x55fcfbae41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 -- 172.21.15.17:0/1699344942 shutdown_connections 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.537+0000 7fec05e38740 1 -- 172.21.15.17:0/1699344942 wait complete. 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 -- start start 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 Processor -- start 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbaf2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbafa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fcfbaf1300 con 0x55fcfbae9240 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55fcfba09230 con 0x55fcfbaee3b0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fcfbaf1480 con 0x55fcfbae8850 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec05e38740 10 client.0 _ll_register_callbacks cb 0x55fcfba45010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7febfbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbaf2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7febfbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33134/0 (socket says 172.21.15.17:33134) 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7fec017e8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbafa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.538+0000 7febfbfff640 1 -- 172.21.15.17:0/185392747 learned_addr learned my addr 172.21.15.17:0/185392747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 -- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 msgr2=0x55fcfbaf2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbaf2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 -- 172.21.15.17:0/185392747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 msgr2=0x55fcfbaf3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 -- 172.21.15.17:0/185392747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcfba18100 con 0x55fcfbaee3b0 2024-03-16T10:53:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec00fe7640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbaf2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7febfbfff640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec017e8640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbafa290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febf4005fd0 tx=0x7febf4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c3fbb19472edc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7febdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4004b20 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe800d2b0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7febf4004cc0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febf401e580 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec05e38740 10 client.26051 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.539+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcfb7613f0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe800d2b0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7febf40053f0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 10 client.26051 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 10 client.26051 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 20 client.26051 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbafec40 0x55fcfbb010e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 4 client.26051 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcfba5a9d0 con 0x55fcfbafec40 2024-03-16T10:53:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec00fe7640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbafec40 0x55fcfbb010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7fec00fe7640 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbafec40 0x55fcfbb010e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=163f1644b6a2176b server_cookie=ad7008d876ec172d in_seq=0 out_seq=0 2024-03-16T10:53:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.540+0000 7febdbfff640 10 client.26051 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.541+0000 7febdbfff640 1 -- 172.21.15.17:0/185392747 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fcfba5a9d0 con 0x55fcfbafec40 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.541+0000 7febdbfff640 10 client.26051 handle_command_reply: tid=0 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.541+0000 7fec05e38740 1 client.26051 shutdown 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 msgr2=0x55fcfbafa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbafa290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febf4005fd0 tx=0x7febf4004ab0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 shutdown_connections 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbafa290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbafec40 0x55fcfbb010e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 --2- 172.21.15.17:0/185392747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbaf2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7febdbfff640 0 client.26051 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 >> 172.21.15.17:0/185392747 conn(0x55fcfbae3dc0 msgr2=0x55fcfbae2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 shutdown_connections 2024-03-16T10:53:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 1 -- 172.21.15.17:0/185392747 wait complete. 2024-03-16T10:53:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.542+0000 7fec05e38740 20 client.26051 trim_cache size 0 max 16384 2024-03-16T10:53:07.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:07 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3696440453' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 Processor -- start 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 -- start start 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 0x55fcfbaf1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae9240 0x55fcfbafa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a69c0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a86e0 con 0x55fcfbae8850 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec05e38740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a7090 con 0x55fcfbae9240 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec017e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 0x55fcfbaf1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7febfbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae9240 0x55fcfbafa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec017e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33140/0 (socket says 172.21.15.17:33140) 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 0x55fcfbaf1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38010/0 (socket says 172.21.15.17:38010) 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.564+0000 7fec017e8640 1 -- 172.21.15.17:0/3235588052 learned_addr learned my addr 172.21.15.17:0/3235588052 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 -- 172.21.15.17:0/3235588052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae9240 msgr2=0x55fcfbafa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae9240 0x55fcfbafa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 -- 172.21.15.17:0/3235588052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 msgr2=0x55fcfbaf1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 0x55fcfbaf1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 -- 172.21.15.17:0/3235588052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcfbaf28f0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7fec017e8640 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7febf4004940 tx=0x7febf4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c862407c336975e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7febe67fc640 1 -- 172.21.15.17:0/3235588052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4004b20 con 0x55fcfbaee3b0 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7febe67fc640 1 -- 172.21.15.17:0/3235588052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf4004cc0 con 0x55fcfbaee3b0 2024-03-16T10:53:07.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.565+0000 7febe67fc640 1 -- 172.21.15.17:0/3235588052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf401ed80 con 0x55fcfbaee3b0 2024-03-16T10:53:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- 172.21.15.17:0/3235588052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 msgr2=0x55fcfbaf1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7febf4004940 tx=0x7febf4005b00 comp rx=0 tx=0).stop 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- 172.21.15.17:0/3235588052 shutdown_connections 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf1d60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae9240 0x55fcfbafa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- 172.21.15.17:0/3235588052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbae8850 0x55fcfbaf1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- 172.21.15.17:0/3235588052 >> 172.21.15.17:0/3235588052 conn(0x55fcfbae3dc0 msgr2=0x55fcfbaf2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- 172.21.15.17:0/3235588052 shutdown_connections 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- 172.21.15.17:0/3235588052 wait complete. 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 -- start start 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 Processor -- start 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbafa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.566+0000 7fec05e38740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a7f50 con 0x55fcfbae9240 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a7820 con 0x55fcfbaee3b0 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febfc1a49a0 con 0x55fcfbae8850 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 10 client.0 _ll_register_callbacks cb 0x7febf4005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec00fe7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbafa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33144/0 (socket says 172.21.15.17:33144) 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 -- 172.21.15.17:0/1881954959 learned_addr learned my addr 172.21.15.17:0/1881954959 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec017e8640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 -- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 msgr2=0x55fcfbafa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbafa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 -- 172.21.15.17:0/1881954959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 msgr2=0x55fcfbaf7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 -- 172.21.15.17:0/1881954959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcfb82b7d0 con 0x55fcfbae9240 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec00fe7640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbafa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febfbfff640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7febe8006010 tx=0x7febe8005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c0ee8d6fd9c081 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8034070 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7febe8004050 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf4004cc0 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7febe8060050 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 10 client.16182 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.567+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcfbb64110 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf4004cc0 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7febe8003710 con 0x55fcfbae9240 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 10 client.16182 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 10 client.16182 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 20 client.16182 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbb64840 0x55fcfbb66c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 4 client.16182 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcfba54d20 con 0x55fcfbb64840 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec00fe7640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbb64840 0x55fcfbb66c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7febdbfff640 10 client.16182 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.568+0000 7fec00fe7640 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbb64840 0x55fcfbb66c60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6aaf9124ae0757ba server_cookie=d2980fe9b01c7e80 in_seq=0 out_seq=0 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7febdbfff640 1 -- 172.21.15.17:0/1881954959 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcfba54d20 con 0x55fcfbb64840 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7febdbfff640 10 client.16182 handle_command_reply: tid=0 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 client.16182 shutdown 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 msgr2=0x55fcfbaf6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7febe8006010 tx=0x7febe8005730 comp rx=0 tx=0).stop 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 shutdown_connections 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55fcfbaee3b0 0x55fcfbaf7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fcfbae9240 0x55fcfbaf6c00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x55fcfbb64840 0x55fcfbb66c60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 --2- 172.21.15.17:0/1881954959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcfbae8850 0x55fcfbafa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7febdbfff640 0 client.16182 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 >> 172.21.15.17:0/1881954959 conn(0x55fcfbae3dc0 msgr2=0x55fcfbaea7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 shutdown_connections 2024-03-16T10:53:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 1 -- 172.21.15.17:0/1881954959 wait complete. 2024-03-16T10:53:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.569+0000 7fec05e38740 20 client.16182 trim_cache size 0 max 16384 2024-03-16T10:53:07.576 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:07.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 msgr2=0x7febec0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 0x7febec0a4cc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55fcfbae9aa0 tx=0x7febf4004a40 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 msgr2=0x7febfc1958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7febf0009be0 tx=0x7febf0007590 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 shutdown_connections 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7febec0a2800 0x7febec0a4cc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febfc102290 0x7febfc19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febfc1018d0 0x7febfc195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 --2- 172.21.15.17:0/3533653253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febfc1006e0 0x7febfc1958f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 >> 172.21.15.17:0/3533653253 conn(0x7febfc0fbc70 msgr2=0x7febfc104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 shutdown_connections 2024-03-16T10:53:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.570+0000 7fec0324b640 1 -- 172.21.15.17:0/3533653253 wait complete. 2024-03-16T10:53:07.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T10:53:07.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:07 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3696440453' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 -- 172.21.15.17:0/3333156971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 msgr2=0x7f73c8100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 --2- 172.21.15.17:0/3333156971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8100b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009900 tx=0x7f73b802bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 -- 172.21.15.17:0/3333156971 shutdown_connections 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 --2- 172.21.15.17:0/3333156971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 0x7f73c8108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 --2- 172.21.15.17:0/3333156971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 0x7f73c8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 --2- 172.21.15.17:0/3333156971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8100b00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 -- 172.21.15.17:0/3333156971 >> 172.21.15.17:0/3333156971 conn(0x7f73c80fbc70 msgr2=0x7f73c80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 -- 172.21.15.17:0/3333156971 shutdown_connections 2024-03-16T10:53:07.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.687+0000 7f73ccf90640 1 -- 172.21.15.17:0/3333156971 wait complete. 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 Processor -- start 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 -- start start 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 0x7f73c8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 0x7f73c819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810c350 con 0x7f73c81006e0 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810c1d0 con 0x7f73c8102290 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73ccf90640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810c4d0 con 0x7f73c81018d0 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33158/0 (socket says 172.21.15.17:33158) 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.688+0000 7f73c659c640 1 -- 172.21.15.17:0/2097350072 learned_addr learned my addr 172.21.15.17:0/2097350072 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 0x7f73c819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 0x7f73c8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 -- 172.21.15.17:0/2097350072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 msgr2=0x7f73c8198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 0x7f73c8198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 -- 172.21.15.17:0/2097350072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 msgr2=0x7f73c819f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 0x7f73c819f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 -- 172.21.15.17:0/2097350072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819f770 con 0x7f73c81006e0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73c659c640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b802c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73bffff640 1 -- 172.21.15.17:0/2097350072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8041070 con 0x7f73c81006e0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73bffff640 1 -- 172.21.15.17:0/2097350072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8004450 con 0x7f73c81006e0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73bffff640 1 -- 172.21.15.17:0/2097350072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8034440 con 0x7f73c81006e0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819fa00 con 0x7f73c81006e0 2024-03-16T10:53:07.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.689+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c819fef0 con 0x7f73c81006e0 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.691+0000 7f73bffff640 1 -- 172.21.15.17:0/2097350072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f73b8044070 con 0x7f73c81006e0 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 Processor -- start 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 -- start start 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 0x55e92195ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921962840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e9218bf490 con 0x55e92195b240 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e921867c90 con 0x55e92195a850 2024-03-16T10:53:07.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73cfb76740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e9218bb530 con 0x55e9219603b0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33168/0 (socket says 172.21.15.17:33168) 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 0x55e92195ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73c659c640 1 -- 172.21.15.17:0/4046876345 learned_addr learned my addr 172.21.15.17:0/4046876345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921962840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73bffff640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 0x7f73b40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.692+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 0x7f73b40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 -- 172.21.15.17:0/4046876345 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 msgr2=0x55e92195ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 0x55e92195ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 -- 172.21.15.17:0/4046876345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 msgr2=0x55e92195fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 -- 172.21.15.17:0/4046876345 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e921922500 con 0x55e9219603b0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bffff640 1 -- 172.21.15.17:0/2097350072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f73b80f0520 con 0x7f73c81006e0 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73c659c640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 0x55e92195ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921962840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009bd0 tx=0x7f73b0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30cb6ae4b28088e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bcd99640 1 -- 172.21.15.17:0/4046876345 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0004230 con 0x55e9219603b0 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 0x7f73b40a4cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e92195baa0 tx=0x7f73c0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bcd99640 1 -- 172.21.15.17:0/4046876345 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b0009e40 con 0x55e9219603b0 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.693+0000 7f73bcd99640 1 -- 172.21.15.17:0/4046876345 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0004d70 con 0x55e9219603b0 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- 172.21.15.17:0/4046876345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 msgr2=0x55e921962840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921962840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009bd0 tx=0x7f73b0011810 comp rx=0 tx=0).stop 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- 172.21.15.17:0/4046876345 shutdown_connections 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921962840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195b240 0x55e92195fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4046876345 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195a850 0x55e92195ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- 172.21.15.17:0/4046876345 >> 172.21.15.17:0/4046876345 conn(0x55e921955dc0 msgr2=0x55e9219561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- 172.21.15.17:0/4046876345 shutdown_connections 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- 172.21.15.17:0/4046876345 wait complete. 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- start start 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 Processor -- start 2024-03-16T10:53:07.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195a850 0x55e921964d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e921965280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e921963360 con 0x55e9219603b0 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55e92187b230 con 0x55e92195b240 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e9219634e0 con 0x55e92195a850 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.694+0000 7f73cfb76740 10 client.0 _ll_register_callbacks cb 0x55e9218b7010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73bdd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e921965280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195a850 0x55e921964d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33172/0 (socket says 172.21.15.17:33172) 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 -- 172.21.15.17:0/553935223 learned_addr learned my addr 172.21.15.17:0/553935223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 -- 172.21.15.17:0/553935223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195a850 msgr2=0x55e921964d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195a850 0x55e921964d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 -- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 msgr2=0x55e921965280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e921965280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 -- 172.21.15.17:0/553935223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92188a100 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f73c0003cf0 tx=0x7f73c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f27648a09faec8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73adffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0025070 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f73c00047b0 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9218cc9d0 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73c0031050 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73cfb76740 10 client.16194 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.695+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e9215d33f0 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e9218cc9d0 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f73c001f040 con 0x55e9219603b0 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 10 client.16194 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 10 client.16194 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 20 client.16194 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e921970bd0 0x55e921973070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 4 client.16194 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9218c6d20 con 0x55e921970bd0 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73c659c640 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e921970bd0 0x55e921973070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73c659c640 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e921970bd0 0x55e921973070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b020f51dc70c7a7 server_cookie=99a29cb11f3288f2 in_seq=0 out_seq=0 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.696+0000 7f73adffb640 10 client.16194 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.697+0000 7f73adffb640 1 -- 172.21.15.17:0/553935223 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e9218c6d20 con 0x55e921970bd0 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.697+0000 7f73adffb640 10 client.16194 handle_command_reply: tid=0 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.697+0000 7f73cfb76740 1 client.16194 shutdown 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 msgr2=0x55e92196c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f73c0003cf0 tx=0x7f73c0004a40 comp rx=0 tx=0).stop 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 shutdown_connections 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9219603b0 0x55e92196c280 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e921970bd0 0x55e921973070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e921965280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 --2- 172.21.15.17:0/553935223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195a850 0x55e921964d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73adffb640 0 client.16194 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 >> 172.21.15.17:0/553935223 conn(0x55e921955dc0 msgr2=0x55e921954fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 shutdown_connections 2024-03-16T10:53:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 1 -- 172.21.15.17:0/553935223 wait complete. 2024-03-16T10:53:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.698+0000 7f73cfb76740 20 client.16194 trim_cache size 0 max 16384 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.719+0000 7f73cfb76740 1 Processor -- start 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.719+0000 7f73cfb76740 1 -- start start 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e92196c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921954c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81a8b80 con 0x55e92195a850 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81aa8a0 con 0x55e92195b240 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73cfb76740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81a9250 con 0x55e9219603b0 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33182/0 (socket says 172.21.15.17:33182) 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 -- 172.21.15.17:0/2445730344 learned_addr learned my addr 172.21.15.17:0/2445730344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e92196c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921954c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 -- 172.21.15.17:0/2445730344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 msgr2=0x55e921954c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921954c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 -- 172.21.15.17:0/2445730344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 msgr2=0x55e92196c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e92196c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 -- 172.21.15.17:0/2445730344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e921963e20 con 0x55e92195a850 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73c659c640 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f73b802c7b0 tx=0x7f73b80b93d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8ed49b8417d400 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73affff640 1 -- 172.21.15.17:0/2445730344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b804b040 con 0x55e92195a850 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73affff640 1 -- 172.21.15.17:0/2445730344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8004c80 con 0x55e92195a850 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.720+0000 7f73affff640 1 -- 172.21.15.17:0/2445730344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80c5660 con 0x55e92195a850 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- 172.21.15.17:0/2445730344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 msgr2=0x55e921954750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f73b802c7b0 tx=0x7f73b80b93d0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- 172.21.15.17:0/2445730344 shutdown_connections 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9219603b0 0x55e921954c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e92195b240 0x55e92196c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 --2- 172.21.15.17:0/2445730344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921954750 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- 172.21.15.17:0/2445730344 >> 172.21.15.17:0/2445730344 conn(0x55e921955dc0 msgr2=0x55e92195c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- 172.21.15.17:0/2445730344 shutdown_connections 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- 172.21.15.17:0/2445730344 wait complete. 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 -- start start 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.721+0000 7f73cfb76740 1 Processor -- start 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195b240 0x55e921969e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9219603b0 0x55e92196ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81aa110 con 0x55e92195a850 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81a99e0 con 0x55e9219603b0 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81a6b60 con 0x55e92195b240 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 10 client.0 _ll_register_callbacks cb 0x7f73c0013590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33186/0 (socket says 172.21.15.17:33186) 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 -- 172.21.15.17:0/4225291528 learned_addr learned my addr 172.21.15.17:0/4225291528 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195b240 0x55e921969e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c6d9d640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9219603b0 0x55e92196ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 -- 172.21.15.17:0/4225291528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195b240 msgr2=0x55e921969e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195b240 0x55e921969e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 -- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9219603b0 msgr2=0x55e92196ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9219603b0 0x55e92196ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 -- 172.21.15.17:0/4225291528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92169d7d0 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73c659c640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005c40 tx=0x7f73b80f0850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c2bae41bfa7e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73adffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b804b040 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f73b80b9670 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b8004c80 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f73b80bcdd0 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 10 client.16200 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.722+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e92196c590 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8004c80 con 0x55e92195a850 2024-03-16T10:53:07.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f73b80d3070 con 0x55e92195a850 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 10 client.16200 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 10 client.16200 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 20 client.16200 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e9219d74a0 0x55e9219d98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 4 client.16200 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9218446a0 con 0x55e9219d74a0 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e9219d74a0 0x55e9219d98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73adffb640 10 client.16200 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.723+0000 7f73bdd9b640 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e9219d74a0 0x55e9219d98c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9df08800bd2240d7 server_cookie=9599dce3fa84eae7 in_seq=0 out_seq=0 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73adffb640 1 -- 172.21.15.17:0/4225291528 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9218446a0 con 0x55e9219d74a0 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73adffb640 10 client.16200 handle_command_reply: tid=0 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 client.16200 shutdown 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 msgr2=0x55e921969920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005c40 tx=0x7f73b80f0850 comp rx=0 tx=0).stop 2024-03-16T10:53:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 shutdown_connections 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55e9219d74a0 0x55e9219d98c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9219603b0 0x55e92196ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e92195b240 0x55e921969e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73adffb640 0 client.16200 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 --2- 172.21.15.17:0/4225291528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e92195a850 0x55e921969920 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 >> 172.21.15.17:0/4225291528 conn(0x55e921955dc0 msgr2=0x55e921959020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 shutdown_connections 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 1 -- 172.21.15.17:0/4225291528 wait complete. 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73cfb76740 20 client.16200 trim_cache size 0 max 16384 2024-03-16T10:53:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 msgr2=0x7f73b40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 0x7f73b40a4cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e92195baa0 tx=0x7f73c0004ab0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 msgr2=0x7f73c8197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.724+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f73b8000c00 tx=0x7f73b802c640 comp rx=0 tx=0).stop 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 shutdown_connections 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f73b40a2800 0x7f73b40a4cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73c8102290 0x7f73c819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73c81018d0 0x7f73c8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 --2- 172.21.15.17:0/2097350072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73c81006e0 0x7f73c8197b50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 >> 172.21.15.17:0/2097350072 conn(0x7f73c80fbc70 msgr2=0x7f73c8068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 shutdown_connections 2024-03-16T10:53:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.725+0000 7f73ccf90640 1 -- 172.21.15.17:0/2097350072 wait complete. 2024-03-16T10:53:07.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- 172.21.15.17:0/1909336032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc102310 msgr2=0x7f8bfc104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/1909336032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc102310 0x7f8bfc104700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009900 tx=0x7f8bec02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- 172.21.15.17:0/1909336032 shutdown_connections 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/1909336032 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc107570 0x7f8bfc109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/1909336032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/1909336032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc102310 0x7f8bfc104700 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- 172.21.15.17:0/1909336032 >> 172.21.15.17:0/1909336032 conn(0x7f8bfc0fbc80 msgr2=0x7f8bfc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- 172.21.15.17:0/1909336032 shutdown_connections 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- 172.21.15.17:0/1909336032 wait complete. 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 Processor -- start 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- start start 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 0x7f8bfc19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10d460 con 0x7f8bfc107570 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10d2e0 con 0x7f8bfc102310 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.845+0000 7f8c02ba9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10d5e0 con 0x7f8bfc104c40 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c01146640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 0x7f8bfc19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:38098/0 (socket says 172.21.15.17:38098) 2024-03-16T10:53:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 -- 172.21.15.17:0/4042296411 learned_addr learned my addr 172.21.15.17:0/4042296411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 -- 172.21.15.17:0/4042296411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 msgr2=0x7f8bfc1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc1980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 -- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 msgr2=0x7f8bfc19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 0x7f8bfc19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 -- 172.21.15.17:0/4042296411 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc19f780 con 0x7f8bfc102310 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c01146640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 0x7f8bfc19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c00945640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009230 tx=0x7f8bec02c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8bf9ffb640 1 -- 172.21.15.17:0/4042296411 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec041070 con 0x7f8bfc102310 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc19fa10 con 0x7f8bfc102310 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.846+0000 7f8bf9ffb640 1 -- 172.21.15.17:0/4042296411 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec004450 con 0x7f8bfc102310 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.847+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc19ff50 con 0x7f8bfc102310 2024-03-16T10:53:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.847+0000 7f8bf9ffb640 1 -- 172.21.15.17:0/4042296411 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec04b060 con 0x7f8bfc102310 2024-03-16T10:53:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8bf9ffb640 1 -- 172.21.15.17:0/4042296411 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f8bec044070 con 0x7f8bfc102310 2024-03-16T10:53:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 Processor -- start 2024-03-16T10:53:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 -- start start 2024-03-16T10:53:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6d850 0x557d14f6dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f75840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d14ed2490 con 0x557d14f6e240 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557d14e7ac90 con 0x557d14f733b0 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c05794740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557d14ece530 con 0x557d14f6d850 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33206/0 (socket says 172.21.15.17:33206) 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c00945640 1 -- 172.21.15.17:0/7928837 learned_addr learned my addr 172.21.15.17:0/7928837 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f75840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8c01146640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6d850 0x557d14f6dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.849+0000 7f8bf9ffb640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 0x7f8be40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 -- 172.21.15.17:0/7928837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6d850 msgr2=0x557d14f6dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bf9ffb640 1 -- 172.21.15.17:0/4042296411 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8bec0f0880 con 0x7f8bfc102310 2024-03-16T10:53:07.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6d850 0x557d14f6dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 -- 172.21.15.17:0/7928837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 msgr2=0x557d14f72d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 -- 172.21.15.17:0/7928837 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d14f35500 con 0x557d14f733b0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8c00945640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8c01146640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 0x7f8be40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f75840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06a870 tx=0x7f8bf00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec9c2a824eedf71 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8be2ffd640 1 -- 172.21.15.17:0/7928837 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0004030 con 0x557d14f733b0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8c01146640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 0x7f8be40a4cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x557d14f6eaa0 tx=0x7f8bf4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8be2ffd640 1 -- 172.21.15.17:0/7928837 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf0005500 con 0x557d14f733b0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.850+0000 7f8be2ffd640 1 -- 172.21.15.17:0/7928837 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0004e10 con 0x557d14f733b0 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- 172.21.15.17:0/7928837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 msgr2=0x557d14f75840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f75840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06a870 tx=0x7f8bf00118d0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- 172.21.15.17:0/7928837 shutdown_connections 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f75840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6e240 0x557d14f72d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- 172.21.15.17:0/7928837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6d850 0x557d14f6dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- 172.21.15.17:0/7928837 >> 172.21.15.17:0/7928837 conn(0x557d14f68dc0 msgr2=0x557d14f691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- 172.21.15.17:0/7928837 shutdown_connections 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- 172.21.15.17:0/7928837 wait complete. 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 -- start start 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 Processor -- start 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 0x557d14f77d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f782d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.851+0000 7f8c05794740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c05794740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d14f76360 con 0x557d14f733b0 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c05794740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557d14e8e230 con 0x557d14f6d850 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c05794740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557d14f764e0 con 0x557d14f6e240 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c05794740 10 client.0 _ll_register_callbacks cb 0x557d14eca010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33220/0 (socket says 172.21.15.17:33220) 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c00945640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 0x557d14f77d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f782d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 -- 172.21.15.17:0/1986006314 learned_addr learned my addr 172.21.15.17:0/1986006314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 -- 172.21.15.17:0/1986006314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 msgr2=0x557d14f782d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f782d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 -- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 msgr2=0x557d14f77d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 0x557d14f77d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 -- 172.21.15.17:0/1986006314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d14e9d100 con 0x557d14f733b0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c00945640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 0x557d14f77d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c01146640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4012dc0 tx=0x7f8bf4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487db9beca657d85 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8bdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf401f070 con 0x557d14f733b0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8bf4019050 con 0x557d14f733b0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.852+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf0005500 con 0x557d14f733b0 2024-03-16T10:53:07.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8bf401f210 con 0x557d14f733b0 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 10 client.16212 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d14be63f0 con 0x557d14f733b0 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf0005500 con 0x557d14f733b0 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f8bf401b070 con 0x557d14f733b0 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 10 client.16212 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 20 client.16212 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14f83c30 0x557d14f860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 4 client.16212 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d14edf9d0 con 0x557d14f83c30 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.853+0000 7f8c00945640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14f83c30 0x557d14f860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.854+0000 7f8bdbfff640 10 client.16212 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:07.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.854+0000 7f8c00945640 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14f83c30 0x557d14f860f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa515194d86a074 server_cookie=afc7b2e78048eeea in_seq=0 out_seq=0 2024-03-16T10:53:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.855+0000 7f8bdbfff640 1 -- 172.21.15.17:0/1986006314 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557d14edf9d0 con 0x557d14f83c30 2024-03-16T10:53:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.855+0000 7f8bdbfff640 10 client.16212 handle_command_reply: tid=0 2024-03-16T10:53:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.855+0000 7f8c05794740 1 client.16212 shutdown 2024-03-16T10:53:07.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 msgr2=0x557d14f7f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4012dc0 tx=0x7f8bf4009500 comp rx=0 tx=0).stop 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 shutdown_connections 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14f83c30 0x557d14f860f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f733b0 0x557d14f7f310 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f782d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8bdbfff640 0 client.16212 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 --2- 172.21.15.17:0/1986006314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6d850 0x557d14f77d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 >> 172.21.15.17:0/1986006314 conn(0x557d14f68dc0 msgr2=0x557d14f67fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 shutdown_connections 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 1 -- 172.21.15.17:0/1986006314 wait complete. 2024-03-16T10:53:07.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.856+0000 7f8c05794740 20 client.16212 trim_cache size 0 max 16384 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 Processor -- start 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 -- start start 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f7f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f67c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1a8c10 con 0x557d14f6d850 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1aa930 con 0x557d14f733b0 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.874+0000 7f8c05794740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1a92e0 con 0x557d14f6e240 2024-03-16T10:53:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33224/0 (socket says 172.21.15.17:33224) 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 -- 172.21.15.17:0/2850506709 learned_addr learned my addr 172.21.15.17:0/2850506709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f7f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c01146640 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f67c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 -- 172.21.15.17:0/2850506709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 msgr2=0x557d14f7f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f7f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 -- 172.21.15.17:0/2850506709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 msgr2=0x557d14f67c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f67c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 -- 172.21.15.17:0/2850506709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d14cb07d0 con 0x557d14f6d850 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8c00945640 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8bec000c00 tx=0x7f8bec0dd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fe70ae053655f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8be27fc640 1 -- 172.21.15.17:0/2850506709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004c60 con 0x557d14f6d850 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8be27fc640 1 -- 172.21.15.17:0/2850506709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec0bd370 con 0x557d14f6d850 2024-03-16T10:53:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.875+0000 7f8be27fc640 1 -- 172.21.15.17:0/2850506709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0bb700 con 0x557d14f6d850 2024-03-16T10:53:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- 172.21.15.17:0/2850506709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 msgr2=0x557d14f67750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8bec000c00 tx=0x7f8bec0dd040 comp rx=0 tx=0).stop 2024-03-16T10:53:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- 172.21.15.17:0/2850506709 shutdown_connections 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f733b0 0x557d14f67c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f6e240 0x557d14f7f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 --2- 172.21.15.17:0/2850506709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f67750 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- 172.21.15.17:0/2850506709 >> 172.21.15.17:0/2850506709 conn(0x557d14f68dc0 msgr2=0x557d14f6f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- 172.21.15.17:0/2850506709 shutdown_connections 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- 172.21.15.17:0/2850506709 wait complete. 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 -- start start 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.876+0000 7f8c05794740 1 Processor -- start 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6e240 0x557d14f7cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f733b0 0x557d14f7db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1aa1a0 con 0x557d14f6d850 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1a9a70 con 0x557d14f6e240 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1a6bf0 con 0x557d14f733b0 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 10 client.0 _ll_register_callbacks cb 0x7f8bf40120d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33230/0 (socket says 172.21.15.17:33230) 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 -- 172.21.15.17:0/257790041 learned_addr learned my addr 172.21.15.17:0/257790041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6e240 0x557d14f7cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c01146640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f733b0 0x557d14f7db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 -- 172.21.15.17:0/257790041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f733b0 msgr2=0x557d14f7db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f733b0 0x557d14f7db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 -- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6e240 msgr2=0x557d14f7cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6e240 0x557d14f7cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 -- 172.21.15.17:0/257790041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d14f7e0f0 con 0x557d14f6d850 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c00945640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0b9d40 tx=0x7f8bec0bce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eebbaa6f0d9387 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8bdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0c5a60 con 0x557d14f6d850 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f8bec0c10d0 con 0x557d14f6d850 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bec0bd370 con 0x557d14f6d850 2024-03-16T10:53:07.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8bec0c1410 con 0x557d14f6d850 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 10 client.16218 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.877+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d14f7f3f0 con 0x557d14f6d850 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec0bd370 con 0x557d14f6d850 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7f8bec0a1080 con 0x557d14f6d850 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 10 client.16218 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 20 client.16218 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14fea630 0x557d14feca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 4 client.16218 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d14ed9d20 con 0x557d14fea630 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14fea630 0x557d14feca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8bfbfff640 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14fea630 0x557d14feca50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=246b83158b288d5f server_cookie=67a766ae1ff06add in_seq=0 out_seq=0 2024-03-16T10:53:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.878+0000 7f8bdbfff640 10 client.16218 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8bdbfff640 1 -- 172.21.15.17:0/257790041 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d14ed9d20 con 0x557d14fea630 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8bdbfff640 10 client.16218 handle_command_reply: tid=0 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 client.16218 shutdown 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 msgr2=0x557d14f7c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0b9d40 tx=0x7f8bec0bce00 comp rx=0 tx=0).stop 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 shutdown_connections 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557d14fea630 0x557d14feca50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557d14f733b0 0x557d14f7db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8bdbfff640 0 client.16218 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557d14f6e240 0x557d14f7cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 --2- 172.21.15.17:0/257790041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d14f6d850 0x557d14f7c650 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 >> 172.21.15.17:0/257790041 conn(0x557d14f68dc0 msgr2=0x557d14f6c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 shutdown_connections 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 1 -- 172.21.15.17:0/257790041 wait complete. 2024-03-16T10:53:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.882+0000 7f8c05794740 20 client.16218 trim_cache size 0 max 16384 2024-03-16T10:53:07.886 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:07.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 msgr2=0x7f8be40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 0x7f8be40a4cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x557d14f6eaa0 tx=0x7f8bf4004a40 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 msgr2=0x7f8bfc197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009230 tx=0x7f8bec02c650 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 shutdown_connections 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8be40a2800 0x7f8be40a4cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc107570 0x7f8bfc19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bfc104c40 0x7f8bfc1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 --2- 172.21.15.17:0/4042296411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bfc102310 0x7f8bfc197b60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 >> 172.21.15.17:0/4042296411 conn(0x7f8bfc0fbc80 msgr2=0x7f8bfc102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 shutdown_connections 2024-03-16T10:53:07.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:07.883+0000 7f8c02ba9640 1 -- 172.21.15.17:0/4042296411 wait complete. 2024-03-16T10:53:08.132 INFO:tasks.workunit.client.0.smithi017.stdout:8/11: mknod c4 0 2024-03-16T10:53:08.132 INFO:tasks.workunit.client.0.smithi017.stdout:8/12: write f2 [2780841,91166] 0 2024-03-16T10:53:08.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/24: creat d1/f7 x:0 0 0 2024-03-16T10:53:08.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/25: stat d1/f4 0 2024-03-16T10:53:08.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/19: creat d2/d7/f9 x:0 0 0 2024-03-16T10:53:08.272 INFO:tasks.workunit.client.0.smithi017.stdout:7/5: creat f2 x:0 0 0 2024-03-16T10:53:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:08 smithi174 ceph-mon[36202]: pgmap v420: 97 pgs: 97 active+clean; 59 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 945 op/s 2024-03-16T10:53:08.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:08 smithi017 ceph-mon[32078]: pgmap v420: 97 pgs: 97 active+clean; 59 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 945 op/s 2024-03-16T10:53:08.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:08 smithi111 ceph-mon[36315]: pgmap v420: 97 pgs: 97 active+clean; 59 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 945 op/s 2024-03-16T10:53:08.895 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-16T10:53:08.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:53:08.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 -- 172.21.15.17:0/4060001094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641018d0 msgr2=0x7fd664101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 --2- 172.21.15.17:0/4060001094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641018d0 0x7fd664101d50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009900 tx=0x7fd64c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 -- 172.21.15.17:0/4060001094 shutdown_connections 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 --2- 172.21.15.17:0/4060001094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd664102290 0x7fd664108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 --2- 172.21.15.17:0/4060001094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641018d0 0x7fd664101d50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 --2- 172.21.15.17:0/4060001094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6641006e0 0x7fd664100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 -- 172.21.15.17:0/4060001094 >> 172.21.15.17:0/4060001094 conn(0x7fd6640fbc70 msgr2=0x7fd6640fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 -- 172.21.15.17:0/4060001094 shutdown_connections 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.003+0000 7fd669bc4640 1 -- 172.21.15.17:0/4060001094 wait complete. 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 Processor -- start 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 -- start start 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6641018d0 0x7fd664102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd664102290 0x7fd6641031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd66410c360 con 0x7fd6641006e0 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd66410c1e0 con 0x7fd664102290 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd669bc4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd66410c4e0 con 0x7fd6641018d0 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33258/0 (socket says 172.21.15.17:33258) 2024-03-16T10:53:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 -- 172.21.15.17:0/1549701720 learned_addr learned my addr 172.21.15.17:0/1549701720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd663fff640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd664102290 0x7fd6641031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd65bfff640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6641018d0 0x7fd664102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 -- 172.21.15.17:0/1549701720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6641018d0 msgr2=0x7fd664102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6641018d0 0x7fd664102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 -- 172.21.15.17:0/1549701720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd664102290 msgr2=0x7fd6641031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd664102290 0x7fd6641031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.004+0000 7fd6637fe640 1 -- 172.21.15.17:0/1549701720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd664103a80 con 0x7fd6641006e0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd65400e9c0 tx=0x7fd65400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd6617fa640 1 -- 172.21.15.17:0/1549701720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65400cd80 con 0x7fd6641006e0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd6617fa640 1 -- 172.21.15.17:0/1549701720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6540035f0 con 0x7fd6641006e0 2024-03-16T10:53:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6641a1c50 con 0x7fd6641006e0 2024-03-16T10:53:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd6617fa640 1 -- 172.21.15.17:0/1549701720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654010690 con 0x7fd6641006e0 2024-03-16T10:53:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.005+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6641a2170 con 0x7fd6641006e0 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.007+0000 7fd6617fa640 1 -- 172.21.15.17:0/1549701720 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fd6540037a0 con 0x7fd6641006e0 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.007+0000 7fd66c7ad740 1 Processor -- start 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.007+0000 7fd66c7ad740 1 -- start start 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.007+0000 7fd6617fa640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 0x7fd6500a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.007+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a4187adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd663fff640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 0x7fd6500a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41882980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558a417df0d0 con 0x558a4187a990 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x558a41787c70 con 0x558a418804f0 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a417db170 con 0x558a4187b380 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd6617fa640 1 -- 172.21.15.17:0/1549701720 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd6540cedb0 con 0x7fd6641006e0 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a4187adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd663fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41882980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:56940/0 (socket says 172.21.15.17:56940) 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 -- 172.21.15.17:0/443433508 learned_addr learned my addr 172.21.15.17:0/443433508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 -- 172.21.15.17:0/443433508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 msgr2=0x558a41882980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41882980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 -- 172.21.15.17:0/443433508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 msgr2=0x558a4187adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a4187adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 -- 172.21.15.17:0/443433508 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a415bb7e0 con 0x558a4187b380 2024-03-16T10:53:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd663fff640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 0x7fd6500a4cc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009fd0 tx=0x7fd65c013b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd65bfff640 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009900 tx=0x7fd64c009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3af8dd946591978 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd659ffb640 1 -- 172.21.15.17:0/443433508 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c005d50 con 0x558a4187b380 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd659ffb640 1 -- 172.21.15.17:0/443433508 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c02cb80 con 0x558a4187b380 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.008+0000 7fd659ffb640 1 -- 172.21.15.17:0/443433508 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c004920 con 0x558a4187b380 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- 172.21.15.17:0/443433508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 msgr2=0x558a4187fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009900 tx=0x7fd64c009560 comp rx=0 tx=0).stop 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- 172.21.15.17:0/443433508 shutdown_connections 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41882980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4187fe80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/443433508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a4187adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- 172.21.15.17:0/443433508 >> 172.21.15.17:0/443433508 conn(0x558a41842c50 msgr2=0x558a41876300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- 172.21.15.17:0/443433508 shutdown_connections 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- 172.21.15.17:0/443433508 wait complete. 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.009+0000 7fd66c7ad740 1 -- start start 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 Processor -- start 2024-03-16T10:53:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187a990 0x558a41884e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a418804f0 0x558a4188c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558a41883440 con 0x558a4187b380 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x558a4179b0d0 con 0x558a4187a990 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a418835c0 con 0x558a418804f0 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd66c7ad740 10 client.0 _ll_register_callbacks cb 0x558a41764760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187a990 0x558a41884e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33284/0 (socket says 172.21.15.17:33284) 2024-03-16T10:53:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 -- 172.21.15.17:0/4093935411 learned_addr learned my addr 172.21.15.17:0/4093935411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd663fff640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a418804f0 0x558a4188c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 -- 172.21.15.17:0/4093935411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a418804f0 msgr2=0x558a4188c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a418804f0 0x558a4188c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 -- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187a990 msgr2=0x558a41884e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187a990 0x558a41884e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 -- 172.21.15.17:0/4093935411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a4161bf70 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd65bfff640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd64c036040 tx=0x7fd64c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8c2ffadd15ab44 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.010+0000 7fd642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c005d50 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd64c003800 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd64c02cb80 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd64c005160 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 10 client.16230 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a414b3170 con 0x558a4187b380 2024-03-16T10:53:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c02cb80 con 0x558a4187b380 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fd64c004d20 con 0x558a4187b380 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 10 client.16230 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 20 client.16230 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a41890530 0x558a41892920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 4 client.16230 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a417ec610 con 0x558a41890530 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.011+0000 7fd6637fe640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a41890530 0x558a41892920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.012+0000 7fd642ffd640 10 client.16230 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.012+0000 7fd6637fe640 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a41890530 0x558a41892920 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905b682480b927ab server_cookie=fc626be751ae7c70 in_seq=0 out_seq=0 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.014+0000 7fd642ffd640 1 -- 172.21.15.17:0/4093935411 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558a417ec610 con 0x558a41890530 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.014+0000 7fd642ffd640 10 client.16230 handle_command_reply: tid=0 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.014+0000 7fd66c7ad740 1 client.16230 shutdown 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 msgr2=0x558a41885390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd64c036040 tx=0x7fd64c005bd0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 shutdown_connections 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a41890530 0x558a41892920 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a418804f0 0x558a4188c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd642ffd640 0 client.16230 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187b380 0x558a41885390 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/4093935411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187a990 0x558a41884e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 >> 172.21.15.17:0/4093935411 conn(0x558a41842c50 msgr2=0x558a418754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 shutdown_connections 2024-03-16T10:53:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 1 -- 172.21.15.17:0/4093935411 wait complete. 2024-03-16T10:53:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.015+0000 7fd66c7ad740 20 client.16230 trim_cache size 0 max 16384 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.032+0000 7fd66c7ad740 1 Processor -- start 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.032+0000 7fd66c7ad740 1 -- start start 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4188c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41897180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641aad40 con 0x558a4187a990 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641aca60 con 0x558a418804f0 2024-03-16T10:53:09.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641ab410 con 0x558a4187b380 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33298/0 (socket says 172.21.15.17:33298) 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 -- 172.21.15.17:0/996479362 learned_addr learned my addr 172.21.15.17:0/996479362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd65bfff640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4188c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd663fff640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41897180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 -- 172.21.15.17:0/996479362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 msgr2=0x558a4188c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4188c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 -- 172.21.15.17:0/996479362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 msgr2=0x558a41897180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41897180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 -- 172.21.15.17:0/996479362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4187a190 con 0x558a4187a990 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd65bfff640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4188c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6637fe640 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd65409b780 tx=0x7fd6540ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7290e46549a60 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6597fa640 1 -- 172.21.15.17:0/996479362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6540b8020 con 0x558a4187a990 2024-03-16T10:53:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6597fa640 1 -- 172.21.15.17:0/996479362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6540a3f90 con 0x558a4187a990 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.033+0000 7fd6597fa640 1 -- 172.21.15.17:0/996479362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654097e60 con 0x558a4187a990 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- 172.21.15.17:0/996479362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 msgr2=0x558a41879c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd65409b780 tx=0x7fd6540ce040 comp rx=0 tx=0).stop 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- 172.21.15.17:0/996479362 shutdown_connections 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a418804f0 0x558a41897180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187b380 0x558a4188c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/996479362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a4187a990 0x558a41879c50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- 172.21.15.17:0/996479362 >> 172.21.15.17:0/996479362 conn(0x558a41842c50 msgr2=0x558a41879540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- 172.21.15.17:0/996479362 shutdown_connections 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- 172.21.15.17:0/996479362 wait complete. 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.034+0000 7fd66c7ad740 1 -- start start 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 Processor -- start 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187a990 0x558a4188c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187b380 0x558a4188a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641ac2d0 con 0x558a418804f0 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641abba0 con 0x558a4187b380 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641a8d20 con 0x558a4187a990 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd66c7ad740 10 client.0 _ll_register_callbacks cb 0x7fd654097370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33300/0 (socket says 172.21.15.17:33300) 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 -- 172.21.15.17:0/1350994479 learned_addr learned my addr 172.21.15.17:0/1350994479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd65bfff640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187b380 0x558a4188a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187a990 0x558a4188c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 -- 172.21.15.17:0/1350994479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187a990 msgr2=0x558a4188c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187a990 0x558a4188c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 -- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187b380 msgr2=0x558a4188a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187b380 0x558a4188a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 -- 172.21.15.17:0/1350994479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a4188b300 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd663fff640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00fe40 tx=0x7fd65c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66f0b1e2eccecb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.035+0000 7fd642ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c02f060 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd65c009040 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6540a3f90 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd65c003970 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 10 client.16236 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a418f76e0 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6540a3f90 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fd65c034070 con 0x558a418804f0 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 10 client.16236 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 20 client.16236 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a418f8180 0x558a418fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 4 client.16236 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-16T10:53:09.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558a417e6960 con 0x558a418f8180 2024-03-16T10:53:09.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.036+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a418f8180 0x558a418fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.037+0000 7fd6637fe640 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a418f8180 0x558a418fa5a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=691e3391d72010a0 server_cookie=550fb25c1ed00071 in_seq=0 out_seq=0 2024-03-16T10:53:09.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.037+0000 7fd642ffd640 10 client.16236 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.156+0000 7fd642ffd640 1 -- 172.21.15.17:0/1350994479 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558a417e6960 con 0x558a418f8180 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.156+0000 7fd642ffd640 10 client.16236 handle_command_reply: tid=0 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.156+0000 7fd66c7ad740 1 client.16236 shutdown 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 msgr2=0x558a4188acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00fe40 tx=0x7fd65c004ab0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 shutdown_connections 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x558a418f8180 0x558a418fa5a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a418804f0 0x558a4188acc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x558a4187b380 0x558a4188a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd642ffd640 0 client.16236 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 --2- 172.21.15.17:0/1350994479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a4187a990 0x558a4188c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 >> 172.21.15.17:0/1350994479 conn(0x558a41842c50 msgr2=0x558a41874c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 shutdown_connections 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 1 -- 172.21.15.17:0/1350994479 wait complete. 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd66c7ad740 20 client.16236 trim_cache size 0 max 16384 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "5597c5cb-86d2-4ca1-87cd-724a69c4fdac", 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-03-16T10:53:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:53:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 msgr2=0x7fd6500a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 0x7fd6500a4cc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009fd0 tx=0x7fd65c013b80 comp rx=0 tx=0).stop 2024-03-16T10:53:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 msgr2=0x7fd664104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.157+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd65400e9c0 tx=0x7fd65400ee80 comp rx=0 tx=0).stop 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 shutdown_connections 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6500a2800 0x7fd6500a4cc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd664102290 0x7fd6641031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6641018d0 0x7fd664102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 --2- 172.21.15.17:0/1549701720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6641006e0 0x7fd664104670 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 >> 172.21.15.17:0/1549701720 conn(0x7fd6640fbc70 msgr2=0x7fd6640fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 shutdown_connections 2024-03-16T10:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.158+0000 7fd669bc4640 1 -- 172.21.15.17:0/1549701720 wait complete. 2024-03-16T10:53:09.169 INFO:tasks.workunit.client.0.smithi017.stdout:8/13: dwrite f2 [4194304,4194304] 0 2024-03-16T10:53:09.169 INFO:tasks.workunit.client.0.smithi017.stdout:8/14: readlink l3 0 2024-03-16T10:53:09.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:53:09.170 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:53:09.196 INFO:tasks.workunit.client.0.smithi017.stdout:0/20: creat d2/fa x:0 0 0 2024-03-16T10:53:09.196 INFO:tasks.workunit.client.0.smithi017.stdout:0/21: rename d2 to d2/d7/db 22 2024-03-16T10:53:09.196 INFO:tasks.workunit.client.0.smithi017.stdout:7/6: stat f0 0 2024-03-16T10:53:09.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/22: write d2/d4/f6 [591562,107469] 0 2024-03-16T10:53:09.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/7: mknod c3 0 2024-03-16T10:53:09.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/15: getdents . 0 2024-03-16T10:53:09.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/16: chown l3 728280067 1 2024-03-16T10:53:09.218 INFO:tasks.workunit.client.0.smithi017.stdout:0/23: dwrite d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:09.218 INFO:tasks.workunit.client.0.smithi017.stdout:0/24: rename d2 to d2/d7/dc 22 2024-03-16T10:53:09.227 INFO:tasks.workunit.client.0.smithi017.stdout:8/17: dwrite f2 [4194304,4194304] 0 2024-03-16T10:53:09.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/18: dread f2 [0,4194304] 0 2024-03-16T10:53:09.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/19: rmdir - no directory 2024-03-16T10:53:09.234 INFO:tasks.workunit.client.0.smithi017.stdout:8/20: creat f5 x:0 0 0 2024-03-16T10:53:09.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/21: mkdir d6 0 2024-03-16T10:53:09.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/22: chown d6 148 1 2024-03-16T10:53:09.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/23: write f5 [505004,116670] 0 2024-03-16T10:53:09.237 INFO:tasks.workunit.client.0.smithi017.stdout:8/24: mkdir d6/d7 0 2024-03-16T10:53:09.237 INFO:tasks.workunit.client.0.smithi017.stdout:0/25: dwrite f0 [0,4194304] 0 2024-03-16T10:53:09.239 INFO:tasks.workunit.client.0.smithi017.stdout:8/25: rename c4 to d6/d7/c8 0 2024-03-16T10:53:09.241 INFO:tasks.workunit.client.0.smithi017.stdout:8/26: mknod d6/d7/c9 0 2024-03-16T10:53:09.241 INFO:tasks.workunit.client.0.smithi017.stdout:8/27: chown d6/d7 74919293 1 2024-03-16T10:53:09.242 INFO:tasks.workunit.client.0.smithi017.stdout:8/28: creat d6/d7/fa x:0 0 0 2024-03-16T10:53:09.242 INFO:tasks.workunit.client.0.smithi017.stdout:8/29: write f2 [3359,14189] 0 2024-03-16T10:53:09.242 INFO:tasks.workunit.client.0.smithi017.stdout:8/30: stat f2 0 2024-03-16T10:53:09.249 INFO:tasks.workunit.client.0.smithi017.stdout:0/26: dwrite d2/d7/f9 [0,4194304] 0 2024-03-16T10:53:09.257 INFO:tasks.workunit.client.0.smithi017.stdout:0/27: dread d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:09.258 INFO:tasks.workunit.client.0.smithi017.stdout:0/28: creat d2/d7/fd x:0 0 0 2024-03-16T10:53:09.259 INFO:tasks.workunit.client.0.smithi017.stdout:0/29: mkdir d2/d7/de 0 2024-03-16T10:53:09.264 INFO:tasks.workunit.client.0.smithi017.stdout:0/30: dread d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:09.266 INFO:tasks.workunit.client.0.smithi017.stdout:0/31: creat d2/d7/de/ff x:0 0 0 2024-03-16T10:53:09.267 INFO:tasks.workunit.client.0.smithi017.stdout:0/32: symlink d2/l10 0 2024-03-16T10:53:09.267 INFO:tasks.workunit.client.0.smithi017.stdout:0/33: chown d2/d7 6272 1 2024-03-16T10:53:09.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/34: creat d2/f11 x:0 0 0 2024-03-16T10:53:09.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/35: creat d2/f12 x:0 0 0 2024-03-16T10:53:09.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/36: symlink d2/d7/de/l13 0 2024-03-16T10:53:09.277 INFO:tasks.workunit.client.0.smithi017.stdout:0/37: rename d2/fa to d2/d4/f14 0 2024-03-16T10:53:09.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/38: dwrite d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:09.302 INFO:tasks.workunit.client.0.smithi017.stdout:0/39: dread d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:09.302 INFO:tasks.workunit.client.0.smithi017.stdout:3/13: truncate f2 59254 0 2024-03-16T10:53:09.305 INFO:tasks.workunit.client.0.smithi017.stdout:0/40: symlink d2/d4/l15 0 2024-03-16T10:53:09.313 INFO:tasks.workunit.client.0.smithi017.stdout:0/41: dread f0 [0,4194304] 0 2024-03-16T10:53:09.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 -- 172.21.15.17:0/656056765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81016e0 msgr2=0x7fbff8101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 --2- 172.21.15.17:0/656056765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81016e0 0x7fbff8101b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009900 tx=0x7fbff402bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:09.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 -- 172.21.15.17:0/656056765 shutdown_connections 2024-03-16T10:53:09.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 --2- 172.21.15.17:0/656056765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff8103290 0x7fbff8109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 --2- 172.21.15.17:0/656056765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 0x7fbff8102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 --2- 172.21.15.17:0/656056765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81016e0 0x7fbff8101b00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 -- 172.21.15.17:0/656056765 >> 172.21.15.17:0/656056765 conn(0x7fbff80fcc50 msgr2=0x7fbff80ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 -- 172.21.15.17:0/656056765 shutdown_connections 2024-03-16T10:53:09.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.314+0000 7fbffe39d640 1 -- 172.21.15.17:0/656056765 wait complete. 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 Processor -- start 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 -- start start 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 0x7fbff8075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 0x7fbff8073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbff810d380 con 0x7fbff8103290 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbff810d200 con 0x7fbff81016e0 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.315+0000 7fbffe39d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbff810d500 con 0x7fbff81028d0 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33310/0 (socket says 172.21.15.17:33310) 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1016161371 learned_addr learned my addr 172.21.15.17:0/1016161371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 0x7fbff8073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 0x7fbff8075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1016161371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 msgr2=0x7fbff8073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 0x7fbff8073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1016161371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 msgr2=0x7fbff8075590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 0x7fbff8075590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1016161371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff80749a0 con 0x7fbff8103290 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 0x7fbff8075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cad0 tx=0x7fbff000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbfee7fc640 1 -- 172.21.15.17:0/1016161371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000ae20 con 0x7fbff8103290 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81a1b10 con 0x7fbff8103290 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbfee7fc640 1 -- 172.21.15.17:0/1016161371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff0005020 con 0x7fbff8103290 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.316+0000 7fbfee7fc640 1 -- 172.21.15.17:0/1016161371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff000f6f0 con 0x7fbff8103290 2024-03-16T10:53:09.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.317+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81a2010 con 0x7fbff8103290 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.319+0000 7fbfee7fc640 1 -- 172.21.15.17:0/1016161371 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fbff00051d0 con 0x7fbff8103290 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.319+0000 7fc0021ed740 1 Processor -- start 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.319+0000 7fc0021ed740 1 -- start start 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbfee7fc640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 0x7fbfe40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1a5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa105500 con 0x55c8fa1a0d30 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa0adbe0 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fc0021ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa1015a0 con 0x55c8fa1a0340 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 0x7fbfe40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbfee7fc640 1 -- 172.21.15.17:0/1016161371 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbff00ceb70 con 0x7fbff8103290 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:56978/0 (socket says 172.21.15.17:56978) 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 -- 172.21.15.17:0/1308920950 learned_addr learned my addr 172.21.15.17:0/1308920950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 -- 172.21.15.17:0/1308920950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a5ea0 msgr2=0x55c8fa1a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 -- 172.21.15.17:0/1308920950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 msgr2=0x55c8fa1a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 -- 172.21.15.17:0/1308920950 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8fa0c14b0 con 0x55c8fa1a0340 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 0x7fbfe40a4cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80095f0 tx=0x7fbfe8009a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.320+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbff4036040 tx=0x7fbff40095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5637cdef7ab906c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.321+0000 7fbfe37fe640 1 -- 172.21.15.17:0/1308920950 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4043020 con 0x55c8fa1a0340 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.321+0000 7fbfe37fe640 1 -- 172.21.15.17:0/1308920950 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff402ca40 con 0x55c8fa1a0340 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.321+0000 7fbfe37fe640 1 -- 172.21.15.17:0/1308920950 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff40046c0 con 0x55c8fa1a0340 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.321+0000 7fc0021ed740 1 -- 172.21.15.17:0/1308920950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 msgr2=0x55c8fa1a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.321+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbff4036040 tx=0x7fbff40095e0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- 172.21.15.17:0/1308920950 shutdown_connections 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1308920950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa1a0760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- 172.21.15.17:0/1308920950 >> 172.21.15.17:0/1308920950 conn(0x55c8fa19b8b0 msgr2=0x55c8fa19bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- 172.21.15.17:0/1308920950 shutdown_connections 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- 172.21.15.17:0/1308920950 wait complete. 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- start start 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 Processor -- start 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa1a8df0 con 0x55c8fa1a0340 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa0c1160 con 0x55c8fa1a0d30 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa1a8f70 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fc0021ed740 10 client.0 _ll_register_callbacks cb 0x55c8fa0a5150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.322+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33316/0 (socket says 172.21.15.17:33316) 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 -- 172.21.15.17:0/3905197190 learned_addr learned my addr 172.21.15.17:0/3905197190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 -- 172.21.15.17:0/3905197190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 msgr2=0x55c8fa1b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 -- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 msgr2=0x55c8fa1aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 -- 172.21.15.17:0/3905197190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f9ee37d0 con 0x55c8fa1a0340 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbffd39b640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbff402c170 tx=0x7fbff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0df984f6bae894 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbfe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:09.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff404c070 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbff4004d80 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff402ca40 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbff4057050 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fc0021ed740 10 client.16248 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.323+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c8f9e193f0 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff402ca40 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fbff4048410 con 0x55c8fa1a0340 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 10 client.16248 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 20 client.16248 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa1b5ef0 0x55c8fa1b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 4 client.16248 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8fa112a40 con 0x55c8fa1b5ef0 2024-03-16T10:53:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa1b5ef0 0x55c8fa1b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fbfe0ff9640 10 client.16248 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.324+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa1b5ef0 0x55c8fa1b82e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c08f57e703d174 server_cookie=e79d2ebbe25d760f in_seq=0 out_seq=0 2024-03-16T10:53:09.333 INFO:tasks.workunit.client.0.smithi017.stdout:0/42: dwrite d2/f12 [0,4194304] 0 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.327+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/3905197190 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c8fa112a40 con 0x55c8fa1b5ef0 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fbfe0ff9640 10 client.16248 handle_command_reply: tid=0 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 client.16248 shutdown 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 msgr2=0x55c8fa1aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbff402c170 tx=0x7fbff40046c0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 shutdown_connections 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa1b5ef0 0x55c8fa1b82e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fbfe0ff9640 0 client.16248 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 --2- 172.21.15.17:0/3905197190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aa880 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 >> 172.21.15.17:0/3905197190 conn(0x55c8fa19b8b0 msgr2=0x55c8fa19aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 shutdown_connections 2024-03-16T10:53:09.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 1 -- 172.21.15.17:0/3905197190 wait complete. 2024-03-16T10:53:09.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.328+0000 7fc0021ed740 20 client.16248 trim_cache size 0 max 16384 2024-03-16T10:53:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 Processor -- start 2024-03-16T10:53:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 -- start start 2024-03-16T10:53:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81aac30 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81ac950 con 0x55c8fa1a0d30 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fc0021ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81ab300 con 0x55c8fa1a0340 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33326/0 (socket says 172.21.15.17:33326) 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffcb9a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1922863821 learned_addr learned my addr 172.21.15.17:0/1922863821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1922863821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 msgr2=0x55c8fa19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1922863821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 msgr2=0x55c8fa1b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 -- 172.21.15.17:0/1922863821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f9dd90f0 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.348+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005910 tx=0x7fbff009b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea82a913a64d9cd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fbfe2ffd640 1 -- 172.21.15.17:0/1922863821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff001d040 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fbfe2ffd640 1 -- 172.21.15.17:0/1922863821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff009b5b0 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fbfe2ffd640 1 -- 172.21.15.17:0/1922863821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00b4a30 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 -- 172.21.15.17:0/1922863821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 msgr2=0x55c8fa1a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005910 tx=0x7fbff009b040 comp rx=0 tx=0).stop 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 -- 172.21.15.17:0/1922863821 shutdown_connections 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1a9ea0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1922863821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a0340 0x55c8fa19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 -- 172.21.15.17:0/1922863821 >> 172.21.15.17:0/1922863821 conn(0x55c8fa19b8b0 msgr2=0x55c8fa19a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 -- 172.21.15.17:0/1922863821 shutdown_connections 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.349+0000 7fc0021ed740 1 -- 172.21.15.17:0/1922863821 wait complete. 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 -- start start 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 Processor -- start 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81ac1c0 con 0x55c8fa1a0d30 2024-03-16T10:53:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81aba90 con 0x55c8fa1a0340 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81a8c10 con 0x55c8fa1a5ea0 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fc0021ed740 10 client.0 _ll_register_callbacks cb 0x7fbfe8012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fbffcb9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fbffd39b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fbffcb9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33332/0 (socket says 172.21.15.17:33332) 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fbffcb9a640 1 -- 172.21.15.17:0/1809189046 learned_addr learned my addr 172.21.15.17:0/1809189046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.350+0000 7fbffdb9c640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 -- 172.21.15.17:0/1809189046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 msgr2=0x55c8fa1b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 -- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0340 msgr2=0x55c8fa1aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 -- 172.21.15.17:0/1809189046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8fa0cc9d0 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbffcb9a640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009fd0 tx=0x7fbfe8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5345d971d0778cf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbfe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe802ad90 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff009b5b0 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbfe802a460 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbfe803c050 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fc0021ed740 10 client.16254 fetch_fsmap learned FSMap version 30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c8fa1b1cd0 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.351+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff009b5b0 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 8394+0+0 (secure 0 0 0) 0x7fbfe801f050 con 0x55c8fa1a0d30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 10 client.16254 fetch_fsmap finished waiting for FSMap version 30 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 20 client.16254 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa21c690 0x55c8fa21eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 4 client.16254 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c8fa10cd90 con 0x55c8fa21c690 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa21c690 0x55c8fa21eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fbfe0ff9640 10 client.16254 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.352+0000 7fbffd39b640 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa21c690 0x55c8fa21eab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fce6390ee9db5d8 server_cookie=cead07cdc9061009 in_seq=0 out_seq=0 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.358+0000 7fbfe0ff9640 1 -- 172.21.15.17:0/1809189046 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55c8fa10cd90 con 0x55c8fa21c690 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.358+0000 7fbfe0ff9640 10 client.16254 handle_command_reply: tid=0 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.358+0000 7fc0021ed740 1 client.16254 shutdown 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 msgr2=0x55c8fa1af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009fd0 tx=0x7fbfe8005f90 comp rx=0 tx=0).stop 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 shutdown_connections 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c8fa21c690 0x55c8fa21eab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8fa1a5ea0 0x55c8fa1b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8fa1a0d30 0x55c8fa1af4f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 --2- 172.21.15.17:0/1809189046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c8fa1a0340 0x55c8fa1aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fbfe0ff9640 0 client.16254 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 >> 172.21.15.17:0/1809189046 conn(0x55c8fa19b8b0 msgr2=0x55c8fa19aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 shutdown_connections 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 1 -- 172.21.15.17:0/1809189046 wait complete. 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.359+0000 7fc0021ed740 20 client.16254 trim_cache size 0 max 16384 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:53:09.361 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: "5597c5cb-86d2-4ca1-87cd-724a69c4fdac": { 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "5597c5cb-86d2-4ca1-87cd-724a69c4fdac", 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 msgr2=0x7fbfe40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 0x7fbfe40a4cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80095f0 tx=0x7fbfe8009a80 comp rx=0 tx=0).stop 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 msgr2=0x7fbff8074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cad0 tx=0x7fbff000cf90 comp rx=0 tx=0).stop 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 shutdown_connections 2024-03-16T10:53:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbfe40a2800 0x7fbfe40a4cc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff8103290 0x7fbff8074110 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbff81028d0 0x7fbff8073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 --2- 172.21.15.17:0/1016161371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbff81016e0 0x7fbff8075590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 >> 172.21.15.17:0/1016161371 conn(0x7fbff80fcc50 msgr2=0x7fbff8105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 shutdown_connections 2024-03-16T10:53:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:09.360+0000 7fbffe39d640 1 -- 172.21.15.17:0/1016161371 wait complete. 2024-03-16T10:53:09.372 INFO:tasks.cephfs.filesystem:scrub status for tag:5597c5cb-86d2-4ca1-87cd-724a69c4fdac - {'path': '/', 'tag': '5597c5cb-86d2-4ca1-87cd-724a69c4fdac', 'options': 'recursive,force'} 2024-03-16T10:53:09.664 INFO:tasks.workunit.client.0.smithi017.stdout:8/31: fsync f5 0 2024-03-16T10:53:09.665 INFO:tasks.workunit.client.0.smithi017.stdout:8/32: symlink d6/lb 0 2024-03-16T10:53:09.668 INFO:tasks.workunit.client.0.smithi017.stdout:8/33: rename l3 to d6/d7/lc 0 2024-03-16T10:53:09.670 INFO:tasks.workunit.client.0.smithi017.stdout:8/34: rmdir d6 39 2024-03-16T10:53:09.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/14: write f2 [682328,80820] 0 2024-03-16T10:53:09.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/15: dread - f3 zero size 2024-03-16T10:53:09.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/16: write f3 [841630,45056] 0 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:5/13: sync 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/14: sync 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/12: sync 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/13: dwrite - no filename 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/14: write - no filename 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/7: sync 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/15: fdatasync d0/f4 0 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/8: getdents . 0 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/9: unlink - no file 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/10: dread - no filename 2024-03-16T10:53:09.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/11: dwrite - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/12: write - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/13: dwrite - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/14: dwrite - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/15: dread - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/16: dread - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/17: chown . 67808044 1 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/18: dwrite - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/19: dread - no filename 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:2/14: sync 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:1/26: sync 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:6/16: write d0/f4 [510656,103872] 0 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:1/27: write d1/f7 [452910,25784] 0 2024-03-16T10:53:09.685 INFO:tasks.workunit.client.0.smithi017.stdout:6/17: truncate d0/f4 1426955 0 2024-03-16T10:53:09.686 INFO:tasks.workunit.client.0.smithi017.stdout:4/15: link l0 l1 0 2024-03-16T10:53:09.686 INFO:tasks.workunit.client.0.smithi017.stdout:5/14: mknod d0/d1/c4 0 2024-03-16T10:53:09.687 INFO:tasks.workunit.client.0.smithi017.stdout:9/20: creat f1 x:0 0 0 2024-03-16T10:53:09.689 INFO:tasks.workunit.client.0.smithi017.stdout:2/15: symlink l0 0 2024-03-16T10:53:09.690 INFO:tasks.workunit.client.0.smithi017.stdout:6/18: rmdir d0 39 2024-03-16T10:53:09.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/16: unlink l1 0 2024-03-16T10:53:09.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/17: chown l0 25361225 1 2024-03-16T10:53:09.694 INFO:tasks.workunit.client.0.smithi017.stdout:5/15: unlink d0/d1/c4 0 2024-03-16T10:53:09.694 INFO:tasks.workunit.client.0.smithi017.stdout:5/16: rename d0/d1 to d0/d1/d2/d5 22 2024-03-16T10:53:09.696 INFO:tasks.workunit.client.0.smithi017.stdout:9/21: mknod c2 0 2024-03-16T10:53:09.698 INFO:tasks.workunit.client.0.smithi017.stdout:2/16: rename l0 to l1 0 2024-03-16T10:53:09.699 INFO:tasks.workunit.client.0.smithi017.stdout:4/18: creat f2 x:0 0 0 2024-03-16T10:53:09.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/17: creat d0/d1/d2/f6 x:0 0 0 2024-03-16T10:53:09.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/18: dread - d0/d1/d2/f6 zero size 2024-03-16T10:53:09.702 INFO:tasks.workunit.client.0.smithi017.stdout:5/19: chown d0/d1/d2 38540751 1 2024-03-16T10:53:09.702 INFO:tasks.workunit.client.0.smithi017.stdout:3/17: dwrite f2 [0,4194304] 0 2024-03-16T10:53:09.703 INFO:tasks.workunit.client.0.smithi017.stdout:2/17: creat f2 x:0 0 0 2024-03-16T10:53:09.705 INFO:tasks.workunit.client.0.smithi017.stdout:3/18: fsync f3 0 2024-03-16T10:53:09.707 INFO:tasks.workunit.client.0.smithi017.stdout:5/20: symlink d0/d1/d2/l7 0 2024-03-16T10:53:09.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/19: write f2 [2820526,113735] 0 2024-03-16T10:53:09.714 INFO:tasks.workunit.client.0.smithi017.stdout:6/19: dwrite d0/f3 [0,4194304] 0 2024-03-16T10:53:09.715 INFO:tasks.workunit.client.0.smithi017.stdout:3/20: creat f6 x:0 0 0 2024-03-16T10:53:09.717 INFO:tasks.workunit.client.0.smithi017.stdout:1/28: dwrite d1/f7 [0,4194304] 0 2024-03-16T10:53:09.721 INFO:tasks.workunit.client.0.smithi017.stdout:4/19: dwrite f2 [0,4194304] 0 2024-03-16T10:53:09.722 INFO:tasks.workunit.client.0.smithi017.stdout:3/21: rename f6 to f7 0 2024-03-16T10:53:09.722 INFO:tasks.workunit.client.0.smithi017.stdout:3/22: truncate f7 56949 0 2024-03-16T10:53:09.725 INFO:tasks.workunit.client.0.smithi017.stdout:1/29: creat d1/d3/f8 x:0 0 0 2024-03-16T10:53:09.729 INFO:tasks.workunit.client.0.smithi017.stdout:9/22: dwrite f1 [0,4194304] 0 2024-03-16T10:53:09.729 INFO:tasks.workunit.client.0.smithi017.stdout:9/23: chown f1 147 1 2024-03-16T10:53:09.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/23: mkdir d8 0 2024-03-16T10:53:09.731 INFO:tasks.workunit.client.0.smithi017.stdout:3/24: dread f7 [0,4194304] 0 2024-03-16T10:53:09.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/21: dwrite d0/d1/d2/f6 [0,4194304] 0 2024-03-16T10:53:09.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/30: getdents d1 0 2024-03-16T10:53:09.737 INFO:tasks.workunit.client.0.smithi017.stdout:4/20: dwrite f2 [0,4194304] 0 2024-03-16T10:53:09.738 INFO:tasks.workunit.client.0.smithi017.stdout:9/24: dread f1 [0,4194304] 0 2024-03-16T10:53:09.739 INFO:tasks.workunit.client.0.smithi017.stdout:3/25: creat d8/f9 x:0 0 0 2024-03-16T10:53:09.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/22: write d0/d1/d2/f6 [2993285,43532] 0 2024-03-16T10:53:09.742 INFO:tasks.workunit.client.0.smithi017.stdout:1/31: symlink d1/d3/l9 0 2024-03-16T10:53:09.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/23: truncate d0/d1/d2/f6 4994205 0 2024-03-16T10:53:09.744 INFO:tasks.workunit.client.0.smithi017.stdout:4/21: mknod c3 0 2024-03-16T10:53:09.745 INFO:tasks.workunit.client.0.smithi017.stdout:5/24: dread d0/d1/d2/f6 [4194304,4194304] 0 2024-03-16T10:53:09.745 INFO:tasks.workunit.client.0.smithi017.stdout:5/25: chown d0/d1/d2/f6 168 1 2024-03-16T10:53:09.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/25: unlink f1 0 2024-03-16T10:53:09.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/26: dread - no filename 2024-03-16T10:53:09.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/32: unlink d1/d3/c5 0 2024-03-16T10:53:09.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/33: fdatasync d1/f4 0 2024-03-16T10:53:09.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/34: fdatasync d1/f7 0 2024-03-16T10:53:09.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/35: rename d1 to d1/d3/da 22 2024-03-16T10:53:09.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/36: chown d1/d3/c6 244213 1 2024-03-16T10:53:09.752 INFO:tasks.workunit.client.0.smithi017.stdout:7/8: write f1 [789173,22091] 0 2024-03-16T10:53:09.752 INFO:tasks.workunit.client.0.smithi017.stdout:7/9: stat c3 0 2024-03-16T10:53:09.754 INFO:tasks.workunit.client.0.smithi017.stdout:4/22: rename f2 to f4 0 2024-03-16T10:53:09.758 INFO:tasks.workunit.client.0.smithi017.stdout:8/35: truncate f2 5714182 0 2024-03-16T10:53:09.759 INFO:tasks.workunit.client.0.smithi017.stdout:8/36: read - d6/d7/fa zero size 2024-03-16T10:53:09.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/27: creat f3 x:0 0 0 2024-03-16T10:53:09.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/28: write f3 [281023,88261] 0 2024-03-16T10:53:09.763 INFO:tasks.workunit.client.0.smithi017.stdout:1/37: dwrite d1/d3/f8 [0,4194304] 0 2024-03-16T10:53:09.763 INFO:tasks.workunit.client.0.smithi017.stdout:1/38: readlink d1/d3/l9 0 2024-03-16T10:53:09.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/23: creat f5 x:0 0 0 2024-03-16T10:53:09.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/24: dread - f5 zero size 2024-03-16T10:53:09.768 INFO:tasks.workunit.client.0.smithi017.stdout:9/29: dread f3 [0,4194304] 0 2024-03-16T10:53:09.769 INFO:tasks.workunit.client.0.smithi017.stdout:8/37: mkdir d6/dd 0 2024-03-16T10:53:09.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/18: unlink l1 0 2024-03-16T10:53:09.773 INFO:tasks.workunit.client.0.smithi017.stdout:3/26: dwrite d8/f9 [0,4194304] 0 2024-03-16T10:53:09.776 INFO:tasks.workunit.client.0.smithi017.stdout:1/39: creat d1/d3/fb x:0 0 0 2024-03-16T10:53:09.776 INFO:tasks.workunit.client.0.smithi017.stdout:1/40: rename d1 to d1/dc 22 2024-03-16T10:53:09.776 INFO:tasks.workunit.client.0.smithi017.stdout:1/41: chown d1/d3/f8 46932 1 2024-03-16T10:53:09.777 INFO:tasks.workunit.client.0.smithi017.stdout:7/10: symlink l4 0 2024-03-16T10:53:09.779 INFO:tasks.workunit.client.0.smithi017.stdout:7/11: read f1 [517938,16425] 0 2024-03-16T10:53:09.779 INFO:tasks.workunit.client.0.smithi017.stdout:7/12: write f2 [709472,82489] 0 2024-03-16T10:53:09.779 INFO:tasks.workunit.client.0.smithi017.stdout:8/38: getdents d6/d7 0 2024-03-16T10:53:09.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/25: dwrite f4 [0,4194304] 0 2024-03-16T10:53:09.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/26: fdatasync f4 0 2024-03-16T10:53:09.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/19: mknod c3 0 2024-03-16T10:53:09.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/20: stat c3 0 2024-03-16T10:53:09.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/21: chown c3 5828832 1 2024-03-16T10:53:09.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/22: write f2 [653509,105134] 0 2024-03-16T10:53:09.788 INFO:tasks.workunit.client.0.smithi017.stdout:1/42: mkdir d1/d3/dd 0 2024-03-16T10:53:09.790 INFO:tasks.workunit.client.0.smithi017.stdout:7/13: creat f5 x:0 0 0 2024-03-16T10:53:09.790 INFO:tasks.workunit.client.0.smithi017.stdout:7/14: fdatasync f1 0 2024-03-16T10:53:09.792 INFO:tasks.workunit.client.0.smithi017.stdout:8/39: creat d6/fe x:0 0 0 2024-03-16T10:53:09.796 INFO:tasks.workunit.client.0.smithi017.stdout:4/27: link f5 f6 0 2024-03-16T10:53:09.798 INFO:tasks.workunit.client.0.smithi017.stdout:2/23: mkdir d4 0 2024-03-16T10:53:09.798 INFO:tasks.workunit.client.0.smithi017.stdout:2/24: chown f2 10680344 1 2024-03-16T10:53:09.805 INFO:tasks.workunit.client.0.smithi017.stdout:1/43: dwrite d1/f4 [0,4194304] 0 2024-03-16T10:53:09.807 INFO:tasks.workunit.client.0.smithi017.stdout:7/15: creat f6 x:0 0 0 2024-03-16T10:53:09.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/16: dread f0 [0,4194304] 0 2024-03-16T10:53:09.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/17: write f6 [821377,99170] 0 2024-03-16T10:53:09.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/40: link d6/d7/lc d6/d7/lf 0 2024-03-16T10:53:09.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/41: dread - d6/fe zero size 2024-03-16T10:53:09.813 INFO:tasks.workunit.client.0.smithi017.stdout:2/25: link c3 d4/c5 0 2024-03-16T10:53:09.814 INFO:tasks.workunit.client.0.smithi017.stdout:2/26: write f2 [903596,103909] 0 2024-03-16T10:53:09.814 INFO:tasks.workunit.client.0.smithi017.stdout:1/44: mkdir d1/d3/de 0 2024-03-16T10:53:09.816 INFO:tasks.workunit.client.0.smithi017.stdout:8/42: symlink d6/l10 0 2024-03-16T10:53:09.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/27: fsync d8/f9 0 2024-03-16T10:53:09.818 INFO:tasks.workunit.client.0.smithi017.stdout:5/26: write d0/d1/d2/f6 [4613435,39020] 0 2024-03-16T10:53:09.818 INFO:tasks.workunit.client.0.smithi017.stdout:4/28: dwrite f6 [0,4194304] 0 2024-03-16T10:53:09.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/45: link d1/d3/l9 d1/d3/dd/lf 0 2024-03-16T10:53:09.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/18: mkdir d7 0 2024-03-16T10:53:09.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/19: chown l4 3715 1 2024-03-16T10:53:09.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/20: dread - f5 zero size 2024-03-16T10:53:09.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/43: mkdir d6/d7/d11 0 2024-03-16T10:53:09.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/44: truncate f5 919444 0 2024-03-16T10:53:09.823 INFO:tasks.workunit.client.0.smithi017.stdout:6/20: dwrite d0/f4 [4194304,4194304] 0 2024-03-16T10:53:09.824 INFO:tasks.workunit.client.0.smithi017.stdout:3/28: mkdir d8/da 0 2024-03-16T10:53:09.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/29: chown d8 52552 1 2024-03-16T10:53:09.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/21: dwrite f0 [0,4194304] 0 2024-03-16T10:53:09.837 INFO:tasks.workunit.client.0.smithi017.stdout:5/27: creat d0/f8 x:0 0 0 2024-03-16T10:53:09.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/28: fdatasync d0/d1/d2/f6 0 2024-03-16T10:53:09.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/29: stat l0 0 2024-03-16T10:53:09.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/30: chown l0 269374 1 2024-03-16T10:53:09.843 INFO:tasks.workunit.client.0.smithi017.stdout:4/31: chown f5 46 1 2024-03-16T10:53:09.845 INFO:tasks.workunit.client.0.smithi017.stdout:1/46: rmdir d1/d3 39 2024-03-16T10:53:09.847 INFO:tasks.workunit.client.0.smithi017.stdout:8/45: rename d6/l10 to d6/d7/l12 0 2024-03-16T10:53:09.851 INFO:tasks.workunit.client.0.smithi017.stdout:6/21: mknod d0/c5 0 2024-03-16T10:53:09.853 INFO:tasks.workunit.client.0.smithi017.stdout:3/30: mkdir d8/da/db 0 2024-03-16T10:53:09.854 INFO:tasks.workunit.client.0.smithi017.stdout:3/31: read f7 [37889,106796] 0 2024-03-16T10:53:09.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/47: read d1/f7 [337213,102376] 0 2024-03-16T10:53:09.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/32: dread f6 [0,4194304] 0 2024-03-16T10:53:09.858 INFO:tasks.workunit.client.0.smithi017.stdout:7/22: rename f6 to d7/f8 0 2024-03-16T10:53:09.858 INFO:tasks.workunit.client.0.smithi017.stdout:6/22: rename d0 to d0/d6 22 2024-03-16T10:53:09.858 INFO:tasks.workunit.client.0.smithi017.stdout:6/23: stat d0/f3 0 2024-03-16T10:53:09.859 INFO:tasks.workunit.client.0.smithi017.stdout:8/46: creat d6/f13 x:0 0 0 2024-03-16T10:53:09.859 INFO:tasks.workunit.client.0.smithi017.stdout:8/47: fdatasync d6/f13 0 2024-03-16T10:53:09.859 INFO:tasks.workunit.client.0.smithi017.stdout:8/48: getdents d6/dd 0 2024-03-16T10:53:09.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/48: dread d1/d3/f8 [0,4194304] 0 2024-03-16T10:53:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/32: creat d8/fc x:0 0 0 2024-03-16T10:53:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/33: chown c1 13799 1 2024-03-16T10:53:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:4/33: creat f7 x:0 0 0 2024-03-16T10:53:09.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/23: mknod d7/c9 0 2024-03-16T10:53:09.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/49: write d1/d3/f8 [2066305,111739] 0 2024-03-16T10:53:09.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/50: truncate d1/d3/fb 971945 0 2024-03-16T10:53:09.866 INFO:tasks.workunit.client.0.smithi017.stdout:3/34: creat d8/fd x:0 0 0 2024-03-16T10:53:09.867 INFO:tasks.workunit.client.0.smithi017.stdout:7/24: symlink d7/la 0 2024-03-16T10:53:09.869 INFO:tasks.workunit.client.0.smithi017.stdout:6/24: read d0/f3 [3990423,5318] 0 2024-03-16T10:53:09.869 INFO:tasks.workunit.client.0.smithi017.stdout:4/34: read f4 [3364163,129569] 0 2024-03-16T10:53:09.872 INFO:tasks.workunit.client.0.smithi017.stdout:8/49: dwrite f5 [0,4194304] 0 2024-03-16T10:53:09.874 INFO:tasks.workunit.client.0.smithi017.stdout:1/51: link d1/d3/dd/lf d1/d3/dd/l10 0 2024-03-16T10:53:09.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/35: creat d8/da/fe x:0 0 0 2024-03-16T10:53:09.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/25: rmdir d7 39 2024-03-16T10:53:09.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/26: chown l4 50484 1 2024-03-16T10:53:09.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/27: chown d7/c9 1627485491 1 2024-03-16T10:53:09.878 INFO:tasks.workunit.client.0.smithi017.stdout:6/25: symlink d0/l7 0 2024-03-16T10:53:09.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/50: mkdir d6/d14 0 2024-03-16T10:53:09.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/35: dwrite f4 [0,4194304] 0 2024-03-16T10:53:09.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/36: fdatasync f7 0 2024-03-16T10:53:09.883 INFO:tasks.workunit.client.0.smithi017.stdout:1/52: link d1/d3/dd/lf d1/d3/de/l11 0 2024-03-16T10:53:09.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/36: creat d8/da/ff x:0 0 0 2024-03-16T10:53:09.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/37: fsync f3 0 2024-03-16T10:53:09.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/51: write f2 [5616774,72618] 0 2024-03-16T10:53:09.887 INFO:tasks.workunit.client.0.smithi017.stdout:6/26: mknod d0/c8 0 2024-03-16T10:53:09.888 INFO:tasks.workunit.client.0.smithi017.stdout:4/37: read f6 [3718541,100074] 0 2024-03-16T10:53:09.888 INFO:tasks.workunit.client.0.smithi017.stdout:4/38: read - f7 zero size 2024-03-16T10:53:09.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/39: readlink l0 0 2024-03-16T10:53:09.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/40: write f5 [1960390,82135] 0 2024-03-16T10:53:09.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/53: creat d1/d3/dd/f12 x:0 0 0 2024-03-16T10:53:09.890 INFO:tasks.workunit.client.0.smithi017.stdout:6/27: dread d0/f4 [0,4194304] 0 2024-03-16T10:53:09.893 INFO:tasks.workunit.client.0.smithi017.stdout:3/38: symlink d8/l10 0 2024-03-16T10:53:09.895 INFO:tasks.workunit.client.0.smithi017.stdout:4/41: dread f4 [0,4194304] 0 2024-03-16T10:53:09.895 INFO:tasks.workunit.client.0.smithi017.stdout:4/42: write f7 [861313,42164] 0 2024-03-16T10:53:09.896 INFO:tasks.workunit.client.0.smithi017.stdout:8/52: creat d6/d7/f15 x:0 0 0 2024-03-16T10:53:09.896 INFO:tasks.workunit.client.0.smithi017.stdout:8/53: dread - d6/fe zero size 2024-03-16T10:53:09.899 INFO:tasks.workunit.client.0.smithi017.stdout:1/54: mkdir d1/d13 0 2024-03-16T10:53:09.900 INFO:tasks.workunit.client.0.smithi017.stdout:3/39: creat d8/da/db/f11 x:0 0 0 2024-03-16T10:53:09.901 INFO:tasks.workunit.client.0.smithi017.stdout:3/40: readlink d8/l10 0 2024-03-16T10:53:09.901 INFO:tasks.workunit.client.0.smithi017.stdout:3/41: dread - d8/da/db/f11 zero size 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:6/28: dwrite d0/f4 [8388608,4194304] 0 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/54: mkdir d6/d16 0 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:6/29: fdatasync d0/f4 0 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/55: dread - d6/fe zero size 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/56: dread - d6/fe zero size 2024-03-16T10:53:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/57: write d6/d7/fa [32995,12043] 0 2024-03-16T10:53:09.905 INFO:tasks.workunit.client.0.smithi017.stdout:1/55: rename d1/d3/dd/lf to d1/d3/l14 0 2024-03-16T10:53:09.905 INFO:tasks.workunit.client.0.smithi017.stdout:1/56: fdatasync d1/f7 0 2024-03-16T10:53:09.906 INFO:tasks.workunit.client.0.smithi017.stdout:3/42: truncate f2 3329182 0 2024-03-16T10:53:09.906 INFO:tasks.workunit.client.0.smithi017.stdout:3/43: write d8/fd [980374,31108] 0 2024-03-16T10:53:09.909 INFO:tasks.workunit.client.0.smithi017.stdout:4/43: fsync f5 0 2024-03-16T10:53:09.909 INFO:tasks.workunit.client.0.smithi017.stdout:4/44: write f6 [10033,73666] 0 2024-03-16T10:53:09.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/30: mkdir d0/d9 0 2024-03-16T10:53:09.914 INFO:tasks.workunit.client.0.smithi017.stdout:8/58: creat d6/d7/f17 x:0 0 0 2024-03-16T10:53:09.914 INFO:tasks.workunit.client.0.smithi017.stdout:3/44: mkdir d8/da/db/d12 0 2024-03-16T10:53:09.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/31: mkdir d0/d9/da 0 2024-03-16T10:53:09.921 INFO:tasks.workunit.client.0.smithi017.stdout:1/57: dwrite d1/d3/fb [0,4194304] 0 2024-03-16T10:53:09.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/45: dwrite f7 [0,4194304] 0 2024-03-16T10:53:09.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/46: truncate d8/da/fe 434753 0 2024-03-16T10:53:09.928 INFO:tasks.workunit.client.0.smithi017.stdout:8/59: write f5 [167416,1772] 0 2024-03-16T10:53:09.929 INFO:tasks.workunit.client.0.smithi017.stdout:3/47: dread d8/da/fe [0,4194304] 0 2024-03-16T10:53:09.929 INFO:tasks.workunit.client.0.smithi017.stdout:1/58: dread d1/f7 [0,4194304] 0 2024-03-16T10:53:09.934 INFO:tasks.workunit.client.0.smithi017.stdout:8/60: symlink d6/d7/d11/l18 0 2024-03-16T10:53:09.934 INFO:tasks.workunit.client.0.smithi017.stdout:8/61: write d6/d7/fa [922285,40299] 0 2024-03-16T10:53:09.935 INFO:tasks.workunit.client.0.smithi017.stdout:3/48: rmdir d8/da/db/d12 0 2024-03-16T10:53:09.937 INFO:tasks.workunit.client.0.smithi017.stdout:1/59: creat d1/d3/de/f15 x:0 0 0 2024-03-16T10:53:09.937 INFO:tasks.workunit.client.0.smithi017.stdout:5/29: fsync d0/f8 0 2024-03-16T10:53:09.937 INFO:tasks.workunit.client.0.smithi017.stdout:5/30: write d0/d1/d2/f6 [992123,58093] 0 2024-03-16T10:53:09.938 INFO:tasks.workunit.client.0.smithi017.stdout:8/62: creat d6/dd/f19 x:0 0 0 2024-03-16T10:53:09.940 INFO:tasks.workunit.client.0.smithi017.stdout:3/49: unlink d8/fd 0 2024-03-16T10:53:09.942 INFO:tasks.workunit.client.0.smithi017.stdout:1/60: rmdir d1/d13 0 2024-03-16T10:53:09.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/31: unlink d0/d1/d2/f6 0 2024-03-16T10:53:09.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/32: creat d0/f9 x:0 0 0 2024-03-16T10:53:09.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/33: read - d0/f8 zero size 2024-03-16T10:53:09.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/34: write d0/f9 [901568,16356] 0 2024-03-16T10:53:09.949 INFO:tasks.workunit.client.0.smithi017.stdout:5/35: symlink d0/d1/la 0 2024-03-16T10:53:09.951 INFO:tasks.workunit.client.0.smithi017.stdout:5/36: symlink d0/lb 0 2024-03-16T10:53:09.951 INFO:tasks.workunit.client.0.smithi017.stdout:7/28: truncate f0 1496405 0 2024-03-16T10:53:09.954 INFO:tasks.workunit.client.0.smithi017.stdout:7/29: mkdir d7/db 0 2024-03-16T10:53:09.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/45: getdents . 0 2024-03-16T10:53:09.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/61: dread d1/f4 [0,4194304] 0 2024-03-16T10:53:09.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/46: creat f8 x:0 0 0 2024-03-16T10:53:09.959 INFO:tasks.workunit.client.0.smithi017.stdout:4/47: creat f9 x:0 0 0 2024-03-16T10:53:09.960 INFO:tasks.workunit.client.0.smithi017.stdout:5/37: dread d0/f9 [0,4194304] 0 2024-03-16T10:53:09.960 INFO:tasks.workunit.client.0.smithi017.stdout:5/38: chown d0/d1/d2 0 1 2024-03-16T10:53:09.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/50: dwrite d8/da/fe [0,4194304] 0 2024-03-16T10:53:09.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/51: chown d8/f9 6790 1 2024-03-16T10:53:09.963 INFO:tasks.workunit.client.0.smithi017.stdout:5/39: write d0/f9 [837166,115962] 0 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/40: mkdir d0/d1/d2/dc 0 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/41: write d0/f9 [1503601,58337] 0 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/42: write d0/f8 [270674,111824] 0 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/43: chown d0/d1/d2/dc 34100125 1 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:1/62: write d1/d3/fb [2676201,73408] 0 2024-03-16T10:53:09.966 INFO:tasks.workunit.client.0.smithi017.stdout:8/63: dwrite f2 [0,4194304] 0 2024-03-16T10:53:09.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/48: dread f7 [0,4194304] 0 2024-03-16T10:53:09.968 INFO:tasks.workunit.client.0.smithi017.stdout:1/63: mkdir d1/d3/d16 0 2024-03-16T10:53:09.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/52: dread f7 [0,4194304] 0 2024-03-16T10:53:09.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/53: dread - d8/da/db/f11 zero size 2024-03-16T10:53:09.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/54: chown d8/da/db 2690 1 2024-03-16T10:53:09.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/55: chown f3 7 1 2024-03-16T10:53:09.969 INFO:tasks.workunit.client.0.smithi017.stdout:8/64: rename d6/d7/c9 to d6/d7/c1a 0 2024-03-16T10:53:09.971 INFO:tasks.workunit.client.0.smithi017.stdout:1/64: symlink d1/d3/dd/l17 0 2024-03-16T10:53:09.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/44: dread d0/f9 [0,4194304] 0 2024-03-16T10:53:09.974 INFO:tasks.workunit.client.0.smithi017.stdout:8/65: unlink d6/lb 0 2024-03-16T10:53:09.974 INFO:tasks.workunit.client.0.smithi017.stdout:8/66: write d6/f13 [1029965,14446] 0 2024-03-16T10:53:09.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/49: rename f9 to fa 0 2024-03-16T10:53:09.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/50: truncate fa 667285 0 2024-03-16T10:53:09.977 INFO:tasks.workunit.client.0.smithi017.stdout:1/65: creat d1/f18 x:0 0 0 2024-03-16T10:53:09.979 INFO:tasks.workunit.client.0.smithi017.stdout:8/67: mknod d6/dd/c1b 0 2024-03-16T10:53:09.979 INFO:tasks.workunit.client.0.smithi017.stdout:8/68: truncate d6/fe 997387 0 2024-03-16T10:53:09.981 INFO:tasks.workunit.client.0.smithi017.stdout:1/66: mknod d1/d3/dd/c19 0 2024-03-16T10:53:09.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/69: symlink d6/dd/l1c 0 2024-03-16T10:53:09.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/70: fsync f2 0 2024-03-16T10:53:09.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/71: chown l1 2 1 2024-03-16T10:53:09.987 INFO:tasks.workunit.client.0.smithi017.stdout:8/72: mknod d6/d14/c1d 0 2024-03-16T10:53:09.987 INFO:tasks.workunit.client.0.smithi017.stdout:8/73: write d6/f13 [1884964,49533] 0 2024-03-16T10:53:09.987 INFO:tasks.workunit.client.0.smithi017.stdout:8/74: stat d6/dd/l1c 0 2024-03-16T10:53:09.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/51: dread f5 [0,4194304] 0 2024-03-16T10:53:09.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/52: write f5 [4612497,64279] 0 2024-03-16T10:53:09.992 INFO:tasks.workunit.client.0.smithi017.stdout:0/43: readlink d2/d4/l8 0 2024-03-16T10:53:09.992 INFO:tasks.workunit.client.0.smithi017.stdout:0/44: write d2/d7/de/ff [426092,10827] 0 2024-03-16T10:53:09.995 INFO:tasks.workunit.client.0.smithi017.stdout:4/53: read f4 [1840074,88726] 0 2024-03-16T10:53:09.998 INFO:tasks.workunit.client.0.smithi017.stdout:4/54: write f6 [102702,129207] 0 2024-03-16T10:53:10.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/67: dwrite d1/d3/de/f15 [0,4194304] 0 2024-03-16T10:53:10.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/32: getdents d0 0 2024-03-16T10:53:10.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/55: dread f4 [0,4194304] 0 2024-03-16T10:53:10.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/56: truncate fa 1390833 0 2024-03-16T10:53:10.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/75: dwrite d6/dd/f19 [0,4194304] 0 2024-03-16T10:53:10.009 INFO:tasks.workunit.client.0.smithi017.stdout:0/45: creat d2/d7/de/f16 x:0 0 0 2024-03-16T10:53:10.013 INFO:tasks.workunit.client.0.smithi017.stdout:6/33: write d0/f4 [5437838,122022] 0 2024-03-16T10:53:10.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/56: truncate f7 392625 0 2024-03-16T10:53:10.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/57: stat d8 0 2024-03-16T10:53:10.016 INFO:tasks.workunit.client.0.smithi017.stdout:6/34: symlink d0/d9/lb 0 2024-03-16T10:53:10.016 INFO:tasks.workunit.client.0.smithi017.stdout:0/46: dread f0 [0,4194304] 0 2024-03-16T10:53:10.017 INFO:tasks.workunit.client.0.smithi017.stdout:0/47: write d2/f5 [340474,111513] 0 2024-03-16T10:53:10.017 INFO:tasks.workunit.client.0.smithi017.stdout:8/76: dwrite d6/f13 [0,4194304] 0 2024-03-16T10:53:10.017 INFO:tasks.workunit.client.0.smithi017.stdout:3/58: mknod d8/da/db/c13 0 2024-03-16T10:53:10.020 INFO:tasks.workunit.client.0.smithi017.stdout:6/35: mkdir d0/dc 0 2024-03-16T10:53:10.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/68: dwrite d1/d3/de/f15 [0,4194304] 0 2024-03-16T10:53:10.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/69: write d1/d3/fb [4916915,89203] 0 2024-03-16T10:53:10.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/70: chown d1/d3/d16 2 1 2024-03-16T10:53:10.024 INFO:tasks.workunit.client.0.smithi017.stdout:8/77: creat d6/d14/f1e x:0 0 0 2024-03-16T10:53:10.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/36: dread d0/f4 [8388608,4194304] 0 2024-03-16T10:53:10.030 INFO:tasks.workunit.client.0.smithi017.stdout:8/78: creat d6/dd/f1f x:0 0 0 2024-03-16T10:53:10.030 INFO:tasks.workunit.client.0.smithi017.stdout:8/79: chown d6/f13 819304 1 2024-03-16T10:53:10.030 INFO:tasks.workunit.client.0.smithi017.stdout:3/59: dwrite d8/da/ff [0,4194304] 0 2024-03-16T10:53:10.031 INFO:tasks.workunit.client.0.smithi017.stdout:3/60: write f3 [1271067,48716] 0 2024-03-16T10:53:10.031 INFO:tasks.workunit.client.0.smithi017.stdout:3/61: fdatasync d8/da/ff 0 2024-03-16T10:53:10.032 INFO:tasks.workunit.client.0.smithi017.stdout:6/37: mknod d0/cd 0 2024-03-16T10:53:10.036 INFO:tasks.workunit.client.0.smithi017.stdout:8/80: write d6/f13 [618166,48058] 0 2024-03-16T10:53:10.038 INFO:tasks.workunit.client.0.smithi017.stdout:3/62: rename d8/da/ff to d8/da/f14 0 2024-03-16T10:53:10.038 INFO:tasks.workunit.client.0.smithi017.stdout:7/30: dread f0 [0,4194304] 0 2024-03-16T10:53:10.038 INFO:tasks.workunit.client.0.smithi017.stdout:7/31: stat d7/db 0 2024-03-16T10:53:10.039 INFO:tasks.workunit.client.0.smithi017.stdout:6/38: mknod d0/ce 0 2024-03-16T10:53:10.041 INFO:tasks.workunit.client.0.smithi017.stdout:8/81: link d6/d7/lf d6/d16/l20 0 2024-03-16T10:53:10.041 INFO:tasks.workunit.client.0.smithi017.stdout:3/63: getdents d8 0 2024-03-16T10:53:10.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/32: mkdir d7/db/dc 0 2024-03-16T10:53:10.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/33: write f0 [2178790,113316] 0 2024-03-16T10:53:10.049 INFO:tasks.workunit.client.0.smithi017.stdout:8/82: creat d6/d7/d11/f21 x:0 0 0 2024-03-16T10:53:10.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/83: write d6/fe [442327,104750] 0 2024-03-16T10:53:10.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/84: read - d6/d7/f17 zero size 2024-03-16T10:53:10.053 INFO:tasks.workunit.client.0.smithi017.stdout:6/39: dwrite d0/f4 [8388608,4194304] 0 2024-03-16T10:53:10.057 INFO:tasks.workunit.client.0.smithi017.stdout:7/34: rmdir d7 39 2024-03-16T10:53:10.059 INFO:tasks.workunit.client.0.smithi017.stdout:1/71: getdents d1 0 2024-03-16T10:53:10.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/85: dwrite d6/d14/f1e [0,4194304] 0 2024-03-16T10:53:10.060 INFO:tasks.workunit.client.0.smithi017.stdout:6/40: dread d0/f4 [8388608,4194304] 0 2024-03-16T10:53:10.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/45: truncate d0/f9 1185654 0 2024-03-16T10:53:10.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/46: readlink d0/l3 0 2024-03-16T10:53:10.065 INFO:tasks.workunit.client.0.smithi017.stdout:7/35: mknod d7/db/dc/cd 0 2024-03-16T10:53:10.065 INFO:tasks.workunit.client.0.smithi017.stdout:6/41: dread d0/f3 [4194304,4194304] 0 2024-03-16T10:53:10.068 INFO:tasks.workunit.client.0.smithi017.stdout:1/72: rename d1/f7 to d1/d3/d16/f1a 0 2024-03-16T10:53:10.068 INFO:tasks.workunit.client.0.smithi017.stdout:6/42: rename d0/d9/da to d0/d9/da/df 22 2024-03-16T10:53:10.068 INFO:tasks.workunit.client.0.smithi017.stdout:6/43: write d0/f3 [13137365,36379] 0 2024-03-16T10:53:10.071 INFO:tasks.workunit.client.0.smithi017.stdout:8/86: symlink d6/d7/d11/l22 0 2024-03-16T10:53:10.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/47: mknod d0/d1/d2/cd 0 2024-03-16T10:53:10.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/48: write d0/f8 [517543,117288] 0 2024-03-16T10:53:10.073 INFO:tasks.workunit.client.0.smithi017.stdout:7/36: mknod d7/db/ce 0 2024-03-16T10:53:10.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/73: fdatasync d1/d3/de/f15 0 2024-03-16T10:53:10.077 INFO:tasks.workunit.client.0.smithi017.stdout:8/87: mknod d6/d16/c23 0 2024-03-16T10:53:10.077 INFO:tasks.workunit.client.0.smithi017.stdout:8/88: dread - d6/d7/d11/f21 zero size 2024-03-16T10:53:10.078 INFO:tasks.workunit.client.0.smithi017.stdout:4/57: truncate f5 2782691 0 2024-03-16T10:53:10.078 INFO:tasks.workunit.client.0.smithi017.stdout:4/58: write f4 [4377775,89061] 0 2024-03-16T10:53:10.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/37: creat d7/db/dc/ff x:0 0 0 2024-03-16T10:53:10.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/38: read - f5 zero size 2024-03-16T10:53:10.082 INFO:tasks.workunit.client.0.smithi017.stdout:1/74: mknod d1/d3/de/c1b 0 2024-03-16T10:53:10.082 INFO:tasks.workunit.client.0.smithi017.stdout:7/39: dread f2 [0,4194304] 0 2024-03-16T10:53:10.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/89: mknod d6/d7/d11/c24 0 2024-03-16T10:53:10.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/40: creat d7/db/dc/f10 x:0 0 0 2024-03-16T10:53:10.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/41: stat d7/db/dc/f10 0 2024-03-16T10:53:10.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/42: fdatasync d7/db/dc/f10 0 2024-03-16T10:53:10.091 INFO:tasks.workunit.client.0.smithi017.stdout:5/49: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:10.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/50: fdatasync d0/f8 0 2024-03-16T10:53:10.092 INFO:tasks.workunit.client.0.smithi017.stdout:6/44: dwrite d0/f3 [12582912,4194304] 0 2024-03-16T10:53:10.093 INFO:tasks.workunit.client.0.smithi017.stdout:8/90: link d6/d16/c23 d6/d16/c25 0 2024-03-16T10:53:10.095 INFO:tasks.workunit.client.0.smithi017.stdout:7/43: dread f0 [0,4194304] 0 2024-03-16T10:53:10.096 INFO:tasks.workunit.client.0.smithi017.stdout:6/45: dread d0/f4 [8388608,4194304] 0 2024-03-16T10:53:10.096 INFO:tasks.workunit.client.0.smithi017.stdout:6/46: write d0/f4 [8019576,32739] 0 2024-03-16T10:53:10.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/51: mknod d0/d1/ce 0 2024-03-16T10:53:10.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/52: chown d0/d1/d2 31 1 2024-03-16T10:53:10.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/44: rename d7/c9 to d7/db/c11 0 2024-03-16T10:53:10.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/45: chown d7/db 0 1 2024-03-16T10:53:10.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/46: write f5 [760097,88593] 0 2024-03-16T10:53:10.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/53: creat d0/d1/d2/ff x:0 0 0 2024-03-16T10:53:10.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/47: rmdir d7 39 2024-03-16T10:53:10.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/48: dread f1 [0,4194304] 0 2024-03-16T10:53:10.104 INFO:tasks.workunit.client.0.smithi017.stdout:5/54: getdents d0 0 2024-03-16T10:53:10.105 INFO:tasks.workunit.client.0.smithi017.stdout:5/55: rmdir d0/d1 39 2024-03-16T10:53:10.108 INFO:tasks.workunit.client.0.smithi017.stdout:1/75: dwrite d1/f18 [0,4194304] 0 2024-03-16T10:53:10.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/91: dwrite d6/dd/f1f [0,4194304] 0 2024-03-16T10:53:10.116 INFO:tasks.workunit.client.0.smithi017.stdout:6/47: dwrite d0/f4 [4194304,4194304] 0 2024-03-16T10:53:10.116 INFO:tasks.workunit.client.0.smithi017.stdout:6/48: fdatasync d0/f3 0 2024-03-16T10:53:10.116 INFO:tasks.workunit.client.0.smithi017.stdout:6/49: readlink d0/d9/lb 0 2024-03-16T10:53:10.118 INFO:tasks.workunit.client.0.smithi017.stdout:8/92: truncate f2 3325965 0 2024-03-16T10:53:10.118 INFO:tasks.workunit.client.0.smithi017.stdout:8/93: readlink d6/dd/l1c 0 2024-03-16T10:53:10.120 INFO:tasks.workunit.client.0.smithi017.stdout:6/50: dread d0/f3 [8388608,4194304] 0 2024-03-16T10:53:10.120 INFO:tasks.workunit.client.0.smithi017.stdout:8/94: creat d6/d7/d11/f26 x:0 0 0 2024-03-16T10:53:10.120 INFO:tasks.workunit.client.0.smithi017.stdout:8/95: dread - d6/d7/f17 zero size 2024-03-16T10:53:10.122 INFO:tasks.workunit.client.0.smithi017.stdout:1/76: dwrite d1/d3/dd/f12 [0,4194304] 0 2024-03-16T10:53:10.124 INFO:tasks.workunit.client.0.smithi017.stdout:8/96: mknod d6/c27 0 2024-03-16T10:53:10.127 INFO:tasks.workunit.client.0.smithi017.stdout:0/48: symlink d2/d7/de/l17 0 2024-03-16T10:53:10.130 INFO:tasks.workunit.client.0.smithi017.stdout:8/97: unlink d6/d7/l12 0 2024-03-16T10:53:10.134 INFO:tasks.workunit.client.0.smithi017.stdout:6/51: dwrite d0/f3 [8388608,4194304] 0 2024-03-16T10:53:10.136 INFO:tasks.workunit.client.0.smithi017.stdout:6/52: rename d0/l7 to d0/dc/l10 0 2024-03-16T10:53:10.136 INFO:tasks.workunit.client.0.smithi017.stdout:7/49: dwrite d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.140 INFO:tasks.workunit.client.0.smithi017.stdout:6/53: creat d0/d9/f11 x:0 0 0 2024-03-16T10:53:10.140 INFO:tasks.workunit.client.0.smithi017.stdout:2/27: sync 2024-03-16T10:53:10.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/30: sync 2024-03-16T10:53:10.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/50: mkdir d7/db/d12 0 2024-03-16T10:53:10.146 INFO:tasks.workunit.client.0.smithi017.stdout:1/77: dwrite d1/d3/f8 [4194304,4194304] 0 2024-03-16T10:53:10.146 INFO:tasks.workunit.client.0.smithi017.stdout:4/59: rename f5 to fb 0 2024-03-16T10:53:10.148 INFO:tasks.workunit.client.0.smithi017.stdout:7/51: dread f2 [0,4194304] 0 2024-03-16T10:53:10.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/52: dread - d7/db/dc/f10 zero size 2024-03-16T10:53:10.149 INFO:tasks.workunit.client.0.smithi017.stdout:6/54: symlink d0/d9/l12 0 2024-03-16T10:53:10.149 INFO:tasks.workunit.client.0.smithi017.stdout:9/31: dread f3 [0,4194304] 0 2024-03-16T10:53:10.149 INFO:tasks.workunit.client.0.smithi017.stdout:9/32: write f3 [912437,32198] 0 2024-03-16T10:53:10.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/98: dwrite d6/dd/f19 [0,4194304] 0 2024-03-16T10:53:10.150 INFO:tasks.workunit.client.0.smithi017.stdout:4/60: write fa [589961,70042] 0 2024-03-16T10:53:10.152 INFO:tasks.workunit.client.0.smithi017.stdout:0/49: dwrite d2/d7/de/ff [0,4194304] 0 2024-03-16T10:53:10.153 INFO:tasks.workunit.client.0.smithi017.stdout:7/53: creat d7/db/f13 x:0 0 0 2024-03-16T10:53:10.154 INFO:tasks.workunit.client.0.smithi017.stdout:6/55: creat d0/d9/f13 x:0 0 0 2024-03-16T10:53:10.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/50: creat d2/d7/f18 x:0 0 0 2024-03-16T10:53:10.156 INFO:tasks.workunit.client.0.smithi017.stdout:9/33: symlink l4 0 2024-03-16T10:53:10.156 INFO:tasks.workunit.client.0.smithi017.stdout:9/34: readlink l4 0 2024-03-16T10:53:10.159 INFO:tasks.workunit.client.0.smithi017.stdout:2/28: dwrite f2 [0,4194304] 0 2024-03-16T10:53:10.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/78: mkdir d1/d1c 0 2024-03-16T10:53:10.163 INFO:tasks.workunit.client.0.smithi017.stdout:4/61: creat fc x:0 0 0 2024-03-16T10:53:10.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/54: rename f5 to d7/db/f14 0 2024-03-16T10:53:10.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/56: write d0/f8 [4496331,70064] 0 2024-03-16T10:53:10.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/56: creat d0/dc/f14 x:0 0 0 2024-03-16T10:53:10.172 INFO:tasks.workunit.client.0.smithi017.stdout:2/29: stat d4/c5 0 2024-03-16T10:53:10.175 INFO:tasks.workunit.client.0.smithi017.stdout:1/79: rmdir d1/d1c 0 2024-03-16T10:53:10.175 INFO:tasks.workunit.client.0.smithi017.stdout:1/80: fsync d1/d3/fb 0 2024-03-16T10:53:10.179 INFO:tasks.workunit.client.0.smithi017.stdout:4/62: dwrite f4 [0,4194304] 0 2024-03-16T10:53:10.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/57: mkdir d0/d15 0 2024-03-16T10:53:10.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/58: truncate d0/d9/f13 203029 0 2024-03-16T10:53:10.183 INFO:tasks.workunit.client.0.smithi017.stdout:2/30: dread f2 [0,4194304] 0 2024-03-16T10:53:10.183 INFO:tasks.workunit.client.0.smithi017.stdout:2/31: fsync f2 0 2024-03-16T10:53:10.186 INFO:tasks.workunit.client.0.smithi017.stdout:7/55: dwrite d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.186 INFO:tasks.workunit.client.0.smithi017.stdout:7/56: readlink l4 0 2024-03-16T10:53:10.187 INFO:tasks.workunit.client.0.smithi017.stdout:7/57: write f1 [978920,101860] 0 2024-03-16T10:53:10.187 INFO:tasks.workunit.client.0.smithi017.stdout:0/51: mkdir d2/d7/de/d19 0 2024-03-16T10:53:10.188 INFO:tasks.workunit.client.0.smithi017.stdout:8/99: write f2 [3292976,81900] 0 2024-03-16T10:53:10.188 INFO:tasks.workunit.client.0.smithi017.stdout:6/59: mkdir d0/dc/d16 0 2024-03-16T10:53:10.188 INFO:tasks.workunit.client.0.smithi017.stdout:6/60: stat d0/ce 0 2024-03-16T10:53:10.193 INFO:tasks.workunit.client.0.smithi017.stdout:2/32: write f2 [941927,20799] 0 2024-03-16T10:53:10.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/100: write d6/d7/fa [106569,18258] 0 2024-03-16T10:53:10.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/57: dwrite d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:10.201 INFO:tasks.workunit.client.0.smithi017.stdout:4/63: mknod cd 0 2024-03-16T10:53:10.203 INFO:tasks.workunit.client.0.smithi017.stdout:6/61: dwrite d0/d9/f11 [0,4194304] 0 2024-03-16T10:53:10.205 INFO:tasks.workunit.client.0.smithi017.stdout:7/58: mkdir d7/db/dc/d15 0 2024-03-16T10:53:10.206 INFO:tasks.workunit.client.0.smithi017.stdout:0/52: stat d2/d7/de/l13 0 2024-03-16T10:53:10.206 INFO:tasks.workunit.client.0.smithi017.stdout:0/53: write d2/d7/de/f16 [1018825,108359] 0 2024-03-16T10:53:10.211 INFO:tasks.workunit.client.0.smithi017.stdout:2/33: mkdir d4/d6 0 2024-03-16T10:53:10.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/101: truncate d6/f13 4141627 0 2024-03-16T10:53:10.216 INFO:tasks.workunit.client.0.smithi017.stdout:5/58: symlink d0/d1/d2/l10 0 2024-03-16T10:53:10.217 INFO:tasks.workunit.client.0.smithi017.stdout:5/59: truncate d0/d1/d2/ff 4941043 0 2024-03-16T10:53:10.221 INFO:tasks.workunit.client.0.smithi017.stdout:6/62: creat d0/d15/f17 x:0 0 0 2024-03-16T10:53:10.222 INFO:tasks.workunit.client.0.smithi017.stdout:7/59: dwrite d7/db/f14 [0,4194304] 0 2024-03-16T10:53:10.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/34: symlink d4/l7 0 2024-03-16T10:53:10.225 INFO:tasks.workunit.client.0.smithi017.stdout:5/60: write d0/f8 [2474315,2858] 0 2024-03-16T10:53:10.226 INFO:tasks.workunit.client.0.smithi017.stdout:2/35: fdatasync f2 0 2024-03-16T10:53:10.226 INFO:tasks.workunit.client.0.smithi017.stdout:2/36: readlink d4/l7 0 2024-03-16T10:53:10.226 INFO:tasks.workunit.client.0.smithi017.stdout:2/37: write f2 [208199,18952] 0 2024-03-16T10:53:10.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/64: rename f8 to fe 0 2024-03-16T10:53:10.229 INFO:tasks.workunit.client.0.smithi017.stdout:7/60: symlink d7/db/dc/l16 0 2024-03-16T10:53:10.231 INFO:tasks.workunit.client.0.smithi017.stdout:0/54: dwrite d2/d7/de/f16 [0,4194304] 0 2024-03-16T10:53:10.231 INFO:tasks.workunit.client.0.smithi017.stdout:0/55: write d2/f5 [1069667,75919] 0 2024-03-16T10:53:10.231 INFO:tasks.workunit.client.0.smithi017.stdout:8/102: dwrite d6/dd/f1f [0,4194304] 0 2024-03-16T10:53:10.232 INFO:tasks.workunit.client.0.smithi017.stdout:0/56: creat d2/d7/f1a x:0 0 0 2024-03-16T10:53:10.234 INFO:tasks.workunit.client.0.smithi017.stdout:0/57: creat d2/d7/f1b x:0 0 0 2024-03-16T10:53:10.235 INFO:tasks.workunit.client.0.smithi017.stdout:2/38: dread f2 [0,4194304] 0 2024-03-16T10:53:10.235 INFO:tasks.workunit.client.0.smithi017.stdout:5/61: creat d0/d1/f11 x:0 0 0 2024-03-16T10:53:10.235 INFO:tasks.workunit.client.0.smithi017.stdout:2/39: chown f2 124997799 1 2024-03-16T10:53:10.237 INFO:tasks.workunit.client.0.smithi017.stdout:6/63: dwrite d0/d9/f13 [0,4194304] 0 2024-03-16T10:53:10.237 INFO:tasks.workunit.client.0.smithi017.stdout:7/61: creat d7/db/dc/f17 x:0 0 0 2024-03-16T10:53:10.243 INFO:tasks.workunit.client.0.smithi017.stdout:2/40: creat d4/f8 x:0 0 0 2024-03-16T10:53:10.243 INFO:tasks.workunit.client.0.smithi017.stdout:2/41: truncate d4/f8 445452 0 2024-03-16T10:53:10.245 INFO:tasks.workunit.client.0.smithi017.stdout:0/58: link d2/d4/f14 d2/d4/f1c 0 2024-03-16T10:53:10.245 INFO:tasks.workunit.client.0.smithi017.stdout:0/59: write d2/d4/f1c [955866,75730] 0 2024-03-16T10:53:10.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/62: creat d0/d1/d2/f12 x:0 0 0 2024-03-16T10:53:10.246 INFO:tasks.workunit.client.0.smithi017.stdout:0/60: creat d2/d4/f1d x:0 0 0 2024-03-16T10:53:10.247 INFO:tasks.workunit.client.0.smithi017.stdout:8/103: dwrite d6/d7/f17 [0,4194304] 0 2024-03-16T10:53:10.247 INFO:tasks.workunit.client.0.smithi017.stdout:4/65: symlink lf 0 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/66: fsync f6 0 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/67: chown fc 20113 1 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/68: chown lf 188472853 1 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/69: write fc [291649,36403] 0 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/70: chown fb 0 1 2024-03-16T10:53:10.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/71: write fe [145981,78142] 0 2024-03-16T10:53:10.251 INFO:tasks.workunit.client.0.smithi017.stdout:5/63: write d0/d1/d2/ff [262809,107283] 0 2024-03-16T10:53:10.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/64: creat d0/d9/f18 x:0 0 0 2024-03-16T10:53:10.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/65: dread - d0/dc/f14 zero size 2024-03-16T10:53:10.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/66: dread - d0/d15/f17 zero size 2024-03-16T10:53:10.253 INFO:tasks.workunit.client.0.smithi017.stdout:6/67: stat d0/dc 0 2024-03-16T10:53:10.253 INFO:tasks.workunit.client.0.smithi017.stdout:2/42: rmdir d4 39 2024-03-16T10:53:10.255 INFO:tasks.workunit.client.0.smithi017.stdout:4/72: dread f6 [0,4194304] 0 2024-03-16T10:53:10.257 INFO:tasks.workunit.client.0.smithi017.stdout:8/104: mkdir d6/d14/d28 0 2024-03-16T10:53:10.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/64: dread d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:10.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/65: write d0/d1/d2/f12 [187472,77464] 0 2024-03-16T10:53:10.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/66: fdatasync d0/d1/f11 0 2024-03-16T10:53:10.259 INFO:tasks.workunit.client.0.smithi017.stdout:7/62: dwrite f2 [0,4194304] 0 2024-03-16T10:53:10.260 INFO:tasks.workunit.client.0.smithi017.stdout:2/43: rename f2 to d4/d6/f9 0 2024-03-16T10:53:10.262 INFO:tasks.workunit.client.0.smithi017.stdout:5/67: chown d0/f9 23017189 1 2024-03-16T10:53:10.262 INFO:tasks.workunit.client.0.smithi017.stdout:5/68: readlink d0/d1/d2/l7 0 2024-03-16T10:53:10.263 INFO:tasks.workunit.client.0.smithi017.stdout:1/81: truncate d1/d3/f8 6586191 0 2024-03-16T10:53:10.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/68: dread d0/f4 [4194304,4194304] 0 2024-03-16T10:53:10.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/69: readlink d0/d9/l12 0 2024-03-16T10:53:10.266 INFO:tasks.workunit.client.0.smithi017.stdout:4/73: symlink l10 0 2024-03-16T10:53:10.268 INFO:tasks.workunit.client.0.smithi017.stdout:5/69: mkdir d0/d1/d13 0 2024-03-16T10:53:10.268 INFO:tasks.workunit.client.0.smithi017.stdout:5/70: write d0/d1/d2/f12 [582544,38226] 0 2024-03-16T10:53:10.268 INFO:tasks.workunit.client.0.smithi017.stdout:5/71: write d0/d1/d2/f12 [1176003,110615] 0 2024-03-16T10:53:10.269 INFO:tasks.workunit.client.0.smithi017.stdout:4/74: write fe [30386,1922] 0 2024-03-16T10:53:10.269 INFO:tasks.workunit.client.0.smithi017.stdout:8/105: dread f5 [0,4194304] 0 2024-03-16T10:53:10.270 INFO:tasks.workunit.client.0.smithi017.stdout:1/82: mknod d1/d3/de/c1d 0 2024-03-16T10:53:10.270 INFO:tasks.workunit.client.0.smithi017.stdout:1/83: read d1/d3/d16/f1a [2985947,56667] 0 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/84: chown d1/d3/de/c1d 71 1 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/85: chown d1/d3/l14 62842010 1 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/86: read d1/d3/d16/f1a [2012745,12717] 0 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/61: dwrite d2/d4/f14 [0,4194304] 0 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/62: dread - d2/d7/fd zero size 2024-03-16T10:53:10.271 INFO:tasks.workunit.client.0.smithi017.stdout:6/70: creat d0/dc/f19 x:0 0 0 2024-03-16T10:53:10.272 INFO:tasks.workunit.client.0.smithi017.stdout:6/71: fdatasync d0/d15/f17 0 2024-03-16T10:53:10.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/72: readlink d0/l3 0 2024-03-16T10:53:10.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/73: fdatasync d0/f9 0 2024-03-16T10:53:10.276 INFO:tasks.workunit.client.0.smithi017.stdout:8/106: creat d6/f29 x:0 0 0 2024-03-16T10:53:10.276 INFO:tasks.workunit.client.0.smithi017.stdout:8/107: dread - d6/d7/d11/f21 zero size 2024-03-16T10:53:10.277 INFO:tasks.workunit.client.0.smithi017.stdout:1/87: creat d1/f1e x:0 0 0 2024-03-16T10:53:10.277 INFO:tasks.workunit.client.0.smithi017.stdout:1/88: read d1/d3/fb [1631623,55219] 0 2024-03-16T10:53:10.284 INFO:tasks.workunit.client.0.smithi017.stdout:4/75: rename cd to c11 0 2024-03-16T10:53:10.284 INFO:tasks.workunit.client.0.smithi017.stdout:7/63: dwrite d7/db/dc/f17 [0,4194304] 0 2024-03-16T10:53:10.284 INFO:tasks.workunit.client.0.smithi017.stdout:7/64: fdatasync d7/db/f14 0 2024-03-16T10:53:10.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/108: symlink d6/d7/d11/l2a 0 2024-03-16T10:53:10.287 INFO:tasks.workunit.client.0.smithi017.stdout:2/44: dwrite d4/d6/f9 [0,4194304] 0 2024-03-16T10:53:10.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/109: readlink d6/d7/d11/l2a 0 2024-03-16T10:53:10.287 INFO:tasks.workunit.client.0.smithi017.stdout:2/45: fdatasync d4/f8 0 2024-03-16T10:53:10.288 INFO:tasks.workunit.client.0.smithi017.stdout:1/89: creat d1/d3/dd/f1f x:0 0 0 2024-03-16T10:53:10.289 INFO:tasks.workunit.client.0.smithi017.stdout:6/72: dwrite d0/f3 [4194304,4194304] 0 2024-03-16T10:53:10.291 INFO:tasks.workunit.client.0.smithi017.stdout:4/76: chown l0 469 1 2024-03-16T10:53:10.291 INFO:tasks.workunit.client.0.smithi017.stdout:4/77: readlink lf 0 2024-03-16T10:53:10.292 INFO:tasks.workunit.client.0.smithi017.stdout:0/63: mkdir d2/d7/de/d1e 0 2024-03-16T10:53:10.294 INFO:tasks.workunit.client.0.smithi017.stdout:7/65: write d7/db/dc/f17 [3747892,92327] 0 2024-03-16T10:53:10.297 INFO:tasks.workunit.client.0.smithi017.stdout:1/90: symlink d1/d3/de/l20 0 2024-03-16T10:53:10.299 INFO:tasks.workunit.client.0.smithi017.stdout:7/66: creat d7/db/f18 x:0 0 0 2024-03-16T10:53:10.301 INFO:tasks.workunit.client.0.smithi017.stdout:8/110: dwrite d6/d7/f15 [0,4194304] 0 2024-03-16T10:53:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:5/74: truncate d0/f8 3864564 0 2024-03-16T10:53:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:0/64: dread d2/d7/de/ff [0,4194304] 0 2024-03-16T10:53:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:4/78: dread f7 [0,4194304] 0 2024-03-16T10:53:10.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/67: mknod d7/db/dc/c19 0 2024-03-16T10:53:10.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/68: chown d7/db 1 1 2024-03-16T10:53:10.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/69: fsync d7/db/f14 0 2024-03-16T10:53:10.309 INFO:tasks.workunit.client.0.smithi017.stdout:2/46: dwrite d4/d6/f9 [0,4194304] 0 2024-03-16T10:53:10.309 INFO:tasks.workunit.client.0.smithi017.stdout:2/47: chown c3 73291 1 2024-03-16T10:53:10.311 INFO:tasks.workunit.client.0.smithi017.stdout:8/111: rename d6/f29 to d6/d14/d28/f2b 0 2024-03-16T10:53:10.314 INFO:tasks.workunit.client.0.smithi017.stdout:5/75: creat d0/d1/d2/dc/f14 x:0 0 0 2024-03-16T10:53:10.317 INFO:tasks.workunit.client.0.smithi017.stdout:0/65: unlink d2/d4/f14 0 2024-03-16T10:53:10.324 INFO:tasks.workunit.client.0.smithi017.stdout:2/48: creat d4/d6/fa x:0 0 0 2024-03-16T10:53:10.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/112: rmdir d6/d7/d11 39 2024-03-16T10:53:10.327 INFO:tasks.workunit.client.0.smithi017.stdout:7/70: write f2 [4619369,70125] 0 2024-03-16T10:53:10.329 INFO:tasks.workunit.client.0.smithi017.stdout:4/79: rename fb to f12 0 2024-03-16T10:53:10.329 INFO:tasks.workunit.client.0.smithi017.stdout:0/66: symlink d2/l1f 0 2024-03-16T10:53:10.330 INFO:tasks.workunit.client.0.smithi017.stdout:8/113: dread f2 [0,4194304] 0 2024-03-16T10:53:10.330 INFO:tasks.workunit.client.0.smithi017.stdout:2/49: rmdir d4/d6 39 2024-03-16T10:53:10.333 INFO:tasks.workunit.client.0.smithi017.stdout:5/76: mknod d0/c15 0 2024-03-16T10:53:10.333 INFO:tasks.workunit.client.0.smithi017.stdout:5/77: dread - d0/d1/d2/dc/f14 zero size 2024-03-16T10:53:10.334 INFO:tasks.workunit.client.0.smithi017.stdout:4/80: truncate f4 2398641 0 2024-03-16T10:53:10.336 INFO:tasks.workunit.client.0.smithi017.stdout:8/114: mknod d6/d16/c2c 0 2024-03-16T10:53:10.339 INFO:tasks.workunit.client.0.smithi017.stdout:5/78: creat d0/d1/f16 x:0 0 0 2024-03-16T10:53:10.342 INFO:tasks.workunit.client.0.smithi017.stdout:5/79: symlink d0/d1/d13/l17 0 2024-03-16T10:53:10.342 INFO:tasks.workunit.client.0.smithi017.stdout:5/80: write d0/d1/d2/ff [72172,62838] 0 2024-03-16T10:53:10.343 INFO:tasks.workunit.client.0.smithi017.stdout:5/81: truncate d0/d1/d2/dc/f14 967635 0 2024-03-16T10:53:10.345 INFO:tasks.workunit.client.0.smithi017.stdout:4/81: symlink l13 0 2024-03-16T10:53:10.345 INFO:tasks.workunit.client.0.smithi017.stdout:1/91: fsync d1/f1e 0 2024-03-16T10:53:10.345 INFO:tasks.workunit.client.0.smithi017.stdout:1/92: rename d1 to d1/d3/d16/d21 22 2024-03-16T10:53:10.345 INFO:tasks.workunit.client.0.smithi017.stdout:1/93: truncate d1/d3/dd/f1f 257278 0 2024-03-16T10:53:10.349 INFO:tasks.workunit.client.0.smithi017.stdout:0/67: write d2/f12 [20676,10075] 0 2024-03-16T10:53:10.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/94: mknod d1/d3/de/c22 0 2024-03-16T10:53:10.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/95: stat d1/d3/de/c22 0 2024-03-16T10:53:10.351 INFO:tasks.workunit.client.0.smithi017.stdout:0/68: symlink d2/d4/l20 0 2024-03-16T10:53:10.351 INFO:tasks.workunit.client.0.smithi017.stdout:4/82: link fa f14 0 2024-03-16T10:53:10.351 INFO:tasks.workunit.client.0.smithi017.stdout:4/83: readlink l0 0 2024-03-16T10:53:10.352 INFO:tasks.workunit.client.0.smithi017.stdout:1/96: link d1/d3/fb d1/d3/f23 0 2024-03-16T10:53:10.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/71: dwrite d7/db/dc/f17 [0,4194304] 0 2024-03-16T10:53:10.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/72: truncate d7/db/f13 297212 0 2024-03-16T10:53:10.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/73: truncate d7/db/dc/f10 898942 0 2024-03-16T10:53:10.354 INFO:tasks.workunit.client.0.smithi017.stdout:0/69: mknod d2/d7/de/d19/c21 0 2024-03-16T10:53:10.354 INFO:tasks.workunit.client.0.smithi017.stdout:2/50: dwrite d4/d6/fa [0,4194304] 0 2024-03-16T10:53:10.355 INFO:tasks.workunit.client.0.smithi017.stdout:1/97: truncate d1/d3/de/f15 1785376 0 2024-03-16T10:53:10.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/74: mknod d7/db/dc/c1a 0 2024-03-16T10:53:10.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/75: chown d7/db/c11 237164 1 2024-03-16T10:53:10.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/70: dread d2/d7/de/f16 [0,4194304] 0 2024-03-16T10:53:10.360 INFO:tasks.workunit.client.0.smithi017.stdout:4/84: mkdir d15 0 2024-03-16T10:53:10.360 INFO:tasks.workunit.client.0.smithi017.stdout:4/85: chown f4 2529573 1 2024-03-16T10:53:10.367 INFO:tasks.workunit.client.0.smithi017.stdout:2/51: mkdir d4/d6/db 0 2024-03-16T10:53:10.369 INFO:tasks.workunit.client.0.smithi017.stdout:7/76: write d7/db/f14 [3112177,19238] 0 2024-03-16T10:53:10.369 INFO:tasks.workunit.client.0.smithi017.stdout:7/77: chown d7/db/f18 610729455 1 2024-03-16T10:53:10.370 INFO:tasks.workunit.client.0.smithi017.stdout:4/86: symlink d15/l16 0 2024-03-16T10:53:10.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/78: write f0 [1269974,39569] 0 2024-03-16T10:53:10.370 INFO:tasks.workunit.client.0.smithi017.stdout:1/98: mkdir d1/d24 0 2024-03-16T10:53:10.374 INFO:tasks.workunit.client.0.smithi017.stdout:4/87: creat d15/f17 x:0 0 0 2024-03-16T10:53:10.375 INFO:tasks.workunit.client.0.smithi017.stdout:5/82: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:10.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/52: dread d4/d6/f9 [0,4194304] 0 2024-03-16T10:53:10.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/79: creat d7/db/dc/d15/f1b x:0 0 0 2024-03-16T10:53:10.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/80: chown d7/db/f13 45074809 1 2024-03-16T10:53:10.377 INFO:tasks.workunit.client.0.smithi017.stdout:1/99: creat d1/d3/dd/f25 x:0 0 0 2024-03-16T10:53:10.377 INFO:tasks.workunit.client.0.smithi017.stdout:2/53: dread d4/f8 [0,4194304] 0 2024-03-16T10:53:10.378 INFO:tasks.workunit.client.0.smithi017.stdout:4/88: dread f6 [0,4194304] 0 2024-03-16T10:53:10.380 INFO:tasks.workunit.client.0.smithi017.stdout:7/81: mkdir d7/db/d12/d1c 0 2024-03-16T10:53:10.380 INFO:tasks.workunit.client.0.smithi017.stdout:7/82: chown d7/db/dc/ff 24551 1 2024-03-16T10:53:10.381 INFO:tasks.workunit.client.0.smithi017.stdout:1/100: stat d1/d3/de/l11 0 2024-03-16T10:53:10.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/54: link c3 d4/d6/db/cc 0 2024-03-16T10:53:10.386 INFO:tasks.workunit.client.0.smithi017.stdout:4/89: symlink d15/l18 0 2024-03-16T10:53:10.389 INFO:tasks.workunit.client.0.smithi017.stdout:1/101: rename d1/d3/dd/f25 to d1/d3/d16/f26 0 2024-03-16T10:53:10.389 INFO:tasks.workunit.client.0.smithi017.stdout:1/102: chown d1/d3/dd/c19 2919965 1 2024-03-16T10:53:10.391 INFO:tasks.workunit.client.0.smithi017.stdout:1/103: symlink d1/d24/l27 0 2024-03-16T10:53:10.391 INFO:tasks.workunit.client.0.smithi017.stdout:1/104: read - d1/d3/d16/f26 zero size 2024-03-16T10:53:10.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/83: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:10.400 INFO:tasks.workunit.client.0.smithi017.stdout:5/84: write d0/d1/d2/f12 [8592,122765] 0 2024-03-16T10:53:10.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/83: dwrite d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.406 INFO:tasks.workunit.client.0.smithi017.stdout:5/85: creat d0/d1/d2/f18 x:0 0 0 2024-03-16T10:53:10.408 INFO:tasks.workunit.client.0.smithi017.stdout:7/84: rename d7/db/dc/d15/f1b to d7/db/dc/f1d 0 2024-03-16T10:53:10.408 INFO:tasks.workunit.client.0.smithi017.stdout:1/105: dread d1/f18 [0,4194304] 0 2024-03-16T10:53:10.410 INFO:tasks.workunit.client.0.smithi017.stdout:7/85: symlink d7/db/dc/l1e 0 2024-03-16T10:53:10.411 INFO:tasks.workunit.client.0.smithi017.stdout:2/55: dwrite d4/d6/fa [0,4194304] 0 2024-03-16T10:53:10.412 INFO:tasks.workunit.client.0.smithi017.stdout:1/106: link d1/d24/l27 d1/d3/d16/l28 0 2024-03-16T10:53:10.413 INFO:tasks.workunit.client.0.smithi017.stdout:4/90: dwrite f7 [0,4194304] 0 2024-03-16T10:53:10.413 INFO:tasks.workunit.client.0.smithi017.stdout:7/86: symlink d7/db/d12/l1f 0 2024-03-16T10:53:10.414 INFO:tasks.workunit.client.0.smithi017.stdout:1/107: truncate d1/d3/f23 4117442 0 2024-03-16T10:53:10.417 INFO:tasks.workunit.client.0.smithi017.stdout:2/56: write d4/d6/f9 [3403000,17459] 0 2024-03-16T10:53:10.417 INFO:tasks.workunit.client.0.smithi017.stdout:2/57: readlink d4/l7 0 2024-03-16T10:53:10.421 INFO:tasks.workunit.client.0.smithi017.stdout:5/86: dwrite d0/d1/f16 [0,4194304] 0 2024-03-16T10:53:10.421 INFO:tasks.workunit.client.0.smithi017.stdout:5/87: write d0/f9 [245103,107935] 0 2024-03-16T10:53:10.427 INFO:tasks.workunit.client.0.smithi017.stdout:5/88: write d0/f8 [959865,106811] 0 2024-03-16T10:53:10.427 INFO:tasks.workunit.client.0.smithi017.stdout:5/89: dread - d0/d1/f11 zero size 2024-03-16T10:53:10.435 INFO:tasks.workunit.client.0.smithi017.stdout:4/91: rename f12 to d15/f19 0 2024-03-16T10:53:10.436 INFO:tasks.workunit.client.0.smithi017.stdout:7/87: link d7/db/ce d7/db/d12/d1c/c20 0 2024-03-16T10:53:10.439 INFO:tasks.workunit.client.0.smithi017.stdout:2/58: mkdir d4/dd 0 2024-03-16T10:53:10.449 INFO:tasks.workunit.client.0.smithi017.stdout:5/90: mknod d0/d1/d2/dc/c19 0 2024-03-16T10:53:10.449 INFO:tasks.workunit.client.0.smithi017.stdout:5/91: fsync d0/f9 0 2024-03-16T10:53:10.452 INFO:tasks.workunit.client.0.smithi017.stdout:1/108: dwrite d1/f4 [0,4194304] 0 2024-03-16T10:53:10.454 INFO:tasks.workunit.client.0.smithi017.stdout:7/88: mkdir d7/db/d21 0 2024-03-16T10:53:10.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/59: creat d4/d6/fe x:0 0 0 2024-03-16T10:53:10.459 INFO:tasks.workunit.client.0.smithi017.stdout:1/109: dread d1/d3/f23 [0,4194304] 0 2024-03-16T10:53:10.459 INFO:tasks.workunit.client.0.smithi017.stdout:1/110: dread - d1/f1e zero size 2024-03-16T10:53:10.459 INFO:tasks.workunit.client.0.smithi017.stdout:1/111: chown d1/d3/dd/l17 60 1 2024-03-16T10:53:10.459 INFO:tasks.workunit.client.0.smithi017.stdout:1/112: truncate d1/d3/d16/f26 816455 0 2024-03-16T10:53:10.460 INFO:tasks.workunit.client.0.smithi017.stdout:7/89: dread d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.460 INFO:tasks.workunit.client.0.smithi017.stdout:7/90: chown d7/db/ce 359687525 1 2024-03-16T10:53:10.460 INFO:tasks.workunit.client.0.smithi017.stdout:5/92: mknod d0/d1/c1a 0 2024-03-16T10:53:10.460 INFO:tasks.workunit.client.0.smithi017.stdout:5/93: chown d0/d1/d2/cd 1167473969 1 2024-03-16T10:53:10.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/113: creat d1/d3/f29 x:0 0 0 2024-03-16T10:53:10.465 INFO:tasks.workunit.client.0.smithi017.stdout:5/94: rename d0/d1/d2/l7 to d0/d1/d2/dc/l1b 0 2024-03-16T10:53:10.466 INFO:tasks.workunit.client.0.smithi017.stdout:1/114: creat d1/d3/d16/f2a x:0 0 0 2024-03-16T10:53:10.468 INFO:tasks.workunit.client.0.smithi017.stdout:5/95: mknod d0/d1/c1c 0 2024-03-16T10:53:10.470 INFO:tasks.workunit.client.0.smithi017.stdout:1/115: rename d1/d3/dd/l17 to d1/d3/dd/l2b 0 2024-03-16T10:53:10.470 INFO:tasks.workunit.client.0.smithi017.stdout:5/96: dread d0/f9 [0,4194304] 0 2024-03-16T10:53:10.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/97: chown d0/d1/c1a 5 1 2024-03-16T10:53:10.471 INFO:tasks.workunit.client.0.smithi017.stdout:1/116: mkdir d1/d3/d2c 0 2024-03-16T10:53:10.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/91: dwrite d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/92: truncate f1 1862575 0 2024-03-16T10:53:10.473 INFO:tasks.workunit.client.0.smithi017.stdout:5/98: creat d0/d1/d2/dc/f1d x:0 0 0 2024-03-16T10:53:10.473 INFO:tasks.workunit.client.0.smithi017.stdout:7/93: dread d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:10.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/92: getdents d15 0 2024-03-16T10:53:10.475 INFO:tasks.workunit.client.0.smithi017.stdout:1/117: symlink d1/d3/dd/l2d 0 2024-03-16T10:53:10.475 INFO:tasks.workunit.client.0.smithi017.stdout:1/118: chown d1/d3/l9 76 1 2024-03-16T10:53:10.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/60: getdents d4 0 2024-03-16T10:53:10.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/61: stat d4/c5 0 2024-03-16T10:53:10.479 INFO:tasks.workunit.client.0.smithi017.stdout:7/94: symlink d7/db/d21/l22 0 2024-03-16T10:53:10.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/93: mknod d15/c1a 0 2024-03-16T10:53:10.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/94: fdatasync f7 0 2024-03-16T10:53:10.486 INFO:tasks.workunit.client.0.smithi017.stdout:7/95: dread d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.486 INFO:tasks.workunit.client.0.smithi017.stdout:7/96: chown d7/db/dc/f1d 4345 1 2024-03-16T10:53:10.488 INFO:tasks.workunit.client.0.smithi017.stdout:5/99: truncate d0/f8 1337356 0 2024-03-16T10:53:10.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/95: write f7 [3235436,77008] 0 2024-03-16T10:53:10.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/96: truncate fc 1121686 0 2024-03-16T10:53:10.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/97: write f4 [2920734,37745] 0 2024-03-16T10:53:10.493 INFO:tasks.workunit.client.0.smithi017.stdout:2/62: dwrite d4/d6/fa [0,4194304] 0 2024-03-16T10:53:10.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/98: rmdir d15 39 2024-03-16T10:53:10.497 INFO:tasks.workunit.client.0.smithi017.stdout:7/97: dwrite f1 [0,4194304] 0 2024-03-16T10:53:10.498 INFO:tasks.workunit.client.0.smithi017.stdout:2/63: mkdir d4/dd/df 0 2024-03-16T10:53:10.503 INFO:tasks.workunit.client.0.smithi017.stdout:7/98: symlink d7/db/dc/l23 0 2024-03-16T10:53:10.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/64: dread d4/d6/f9 [0,4194304] 0 2024-03-16T10:53:10.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/65: write d4/d6/fe [26901,79026] 0 2024-03-16T10:53:10.505 INFO:tasks.workunit.client.0.smithi017.stdout:4/99: link f14 d15/f1b 0 2024-03-16T10:53:10.507 INFO:tasks.workunit.client.0.smithi017.stdout:2/66: creat d4/d6/f10 x:0 0 0 2024-03-16T10:53:10.507 INFO:tasks.workunit.client.0.smithi017.stdout:2/67: chown d4/d6/fa 7 1 2024-03-16T10:53:10.508 INFO:tasks.workunit.client.0.smithi017.stdout:7/99: dread d7/db/f14 [0,4194304] 0 2024-03-16T10:53:10.510 INFO:tasks.workunit.client.0.smithi017.stdout:2/68: creat d4/d6/db/f11 x:0 0 0 2024-03-16T10:53:10.529 INFO:tasks.workunit.client.0.smithi017.stdout:3/64: sync 2024-03-16T10:53:10.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/35: sync 2024-03-16T10:53:10.531 INFO:tasks.workunit.client.0.smithi017.stdout:9/36: unlink l4 0 2024-03-16T10:53:10.533 INFO:tasks.workunit.client.0.smithi017.stdout:3/65: creat d8/da/db/f15 x:0 0 0 2024-03-16T10:53:10.533 INFO:tasks.workunit.client.0.smithi017.stdout:7/100: dwrite d7/db/f14 [4194304,4194304] 0 2024-03-16T10:53:10.533 INFO:tasks.workunit.client.0.smithi017.stdout:9/37: creat f5 x:0 0 0 2024-03-16T10:53:10.535 INFO:tasks.workunit.client.0.smithi017.stdout:2/69: dwrite d4/d6/db/f11 [0,4194304] 0 2024-03-16T10:53:10.535 INFO:tasks.workunit.client.0.smithi017.stdout:4/100: dwrite d15/f19 [0,4194304] 0 2024-03-16T10:53:10.535 INFO:tasks.workunit.client.0.smithi017.stdout:4/101: write fa [2085780,61531] 0 2024-03-16T10:53:10.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/66: rename c0 to d8/da/db/c16 0 2024-03-16T10:53:10.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/101: symlink d7/l24 0 2024-03-16T10:53:10.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/102: fsync d7/db/dc/ff 0 2024-03-16T10:53:10.538 INFO:tasks.workunit.client.0.smithi017.stdout:7/103: chown d7/db/dc/ff 37203 1 2024-03-16T10:53:10.538 INFO:tasks.workunit.client.0.smithi017.stdout:7/104: dread - d7/db/dc/f1d zero size 2024-03-16T10:53:10.539 INFO:tasks.workunit.client.0.smithi017.stdout:9/38: unlink f5 0 2024-03-16T10:53:10.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/102: dread f4 [0,4194304] 0 2024-03-16T10:53:10.542 INFO:tasks.workunit.client.0.smithi017.stdout:2/70: symlink d4/d6/db/l12 0 2024-03-16T10:53:10.546 INFO:tasks.workunit.client.0.smithi017.stdout:7/105: unlink d7/db/dc/cd 0 2024-03-16T10:53:10.547 INFO:tasks.workunit.client.0.smithi017.stdout:9/39: symlink l6 0 2024-03-16T10:53:10.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/71: creat d4/d6/db/f13 x:0 0 0 2024-03-16T10:53:10.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/67: dwrite d8/da/f14 [0,4194304] 0 2024-03-16T10:53:10.551 INFO:tasks.workunit.client.0.smithi017.stdout:9/40: rename f3 to f7 0 2024-03-16T10:53:10.553 INFO:tasks.workunit.client.0.smithi017.stdout:9/41: mkdir d8 0 2024-03-16T10:53:10.553 INFO:tasks.workunit.client.0.smithi017.stdout:9/42: truncate f7 1472087 0 2024-03-16T10:53:10.553 INFO:tasks.workunit.client.0.smithi017.stdout:9/43: chown c2 6937 1 2024-03-16T10:53:10.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/44: mknod d8/c9 0 2024-03-16T10:53:10.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/45: chown f7 14 1 2024-03-16T10:53:10.557 INFO:tasks.workunit.client.0.smithi017.stdout:9/46: creat d8/fa x:0 0 0 2024-03-16T10:53:10.559 INFO:tasks.workunit.client.0.smithi017.stdout:9/47: mknod d8/cb 0 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 810 op/s 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: scrub queued for path: / 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:10.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:10 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.565 INFO:tasks.workunit.client.0.smithi017.stdout:7/106: write d7/db/dc/f17 [3978216,104714] 0 2024-03-16T10:53:10.565 INFO:tasks.workunit.client.0.smithi017.stdout:4/103: dwrite fa [0,4194304] 0 2024-03-16T10:53:10.565 INFO:tasks.workunit.client.0.smithi017.stdout:7/107: chown d7/la 54 1 2024-03-16T10:53:10.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/68: write d8/da/fe [1418335,44002] 0 2024-03-16T10:53:10.570 INFO:tasks.workunit.client.0.smithi017.stdout:2/72: dwrite d4/d6/db/f11 [0,4194304] 0 2024-03-16T10:53:10.570 INFO:tasks.workunit.client.0.smithi017.stdout:2/73: truncate d4/d6/f10 461151 0 2024-03-16T10:53:10.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/48: dwrite d8/fa [0,4194304] 0 2024-03-16T10:53:10.572 INFO:tasks.workunit.client.0.smithi017.stdout:3/69: unlink d8/da/db/f11 0 2024-03-16T10:53:10.572 INFO:tasks.workunit.client.0.smithi017.stdout:3/70: truncate d8/da/db/f15 599510 0 2024-03-16T10:53:10.574 INFO:tasks.workunit.client.0.smithi017.stdout:4/104: write d15/f19 [881084,14232] 0 2024-03-16T10:53:10.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/74: creat d4/dd/f14 x:0 0 0 2024-03-16T10:53:10.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/75: fdatasync d4/d6/fe 0 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 810 op/s 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: scrub queued for path: / 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:10.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:10 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.590 INFO:tasks.workunit.client.0.smithi017.stdout:3/71: creat d8/f17 x:0 0 0 2024-03-16T10:53:10.590 INFO:tasks.workunit.client.0.smithi017.stdout:3/72: chown d8 137199 1 2024-03-16T10:53:10.592 INFO:tasks.workunit.client.0.smithi017.stdout:7/108: rmdir d7/db/dc/d15 0 2024-03-16T10:53:10.597 INFO:tasks.workunit.client.0.smithi017.stdout:2/76: creat d4/dd/df/f15 x:0 0 0 2024-03-16T10:53:10.599 INFO:tasks.workunit.client.0.smithi017.stdout:3/73: write d8/da/f14 [161070,76081] 0 2024-03-16T10:53:10.599 INFO:tasks.workunit.client.0.smithi017.stdout:3/74: dread - d8/fc zero size 2024-03-16T10:53:10.601 INFO:tasks.workunit.client.0.smithi017.stdout:7/109: rename d7/db/dc/f1d to d7/db/dc/f25 0 2024-03-16T10:53:10.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/105: mkdir d15/d1c 0 2024-03-16T10:53:10.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/77: creat d4/d6/f16 x:0 0 0 2024-03-16T10:53:10.607 INFO:tasks.workunit.client.0.smithi017.stdout:3/75: mknod d8/da/c18 0 2024-03-16T10:53:10.609 INFO:tasks.workunit.client.0.smithi017.stdout:2/78: symlink d4/d6/l17 0 2024-03-16T10:53:10.609 INFO:tasks.workunit.client.0.smithi017.stdout:2/79: chown d4/d6/db/f11 1 1 2024-03-16T10:53:10.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/76: rename d8/f9 to d8/da/db/f19 0 2024-03-16T10:53:10.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/106: mkdir d15/d1d 0 2024-03-16T10:53:10.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/107: chown l10 11964 1 2024-03-16T10:53:10.614 INFO:tasks.workunit.client.0.smithi017.stdout:7/110: dwrite d7/db/dc/ff [0,4194304] 0 2024-03-16T10:53:10.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/111: fsync d7/db/f13 0 2024-03-16T10:53:10.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/112: fsync f2 0 2024-03-16T10:53:10.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/113: readlink d7/db/d12/l1f 0 2024-03-16T10:53:10.615 INFO:tasks.workunit.client.0.smithi017.stdout:4/108: rmdir d15/d1c 0 2024-03-16T10:53:10.616 INFO:tasks.workunit.client.0.smithi017.stdout:9/49: truncate f7 872173 0 2024-03-16T10:53:10.619 INFO:tasks.workunit.client.0.smithi017.stdout:2/80: dwrite d4/f8 [0,4194304] 0 2024-03-16T10:53:10.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/109: creat d15/d1d/f1e x:0 0 0 2024-03-16T10:53:10.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/110: stat fa 0 2024-03-16T10:53:10.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/111: truncate fe 118019 0 2024-03-16T10:53:10.625 INFO:tasks.workunit.client.0.smithi017.stdout:7/114: dread f2 [0,4194304] 0 2024-03-16T10:53:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:7/115: chown d7/db/d12/d1c/c20 26665 1 2024-03-16T10:53:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:4/112: creat d15/f1f x:0 0 0 2024-03-16T10:53:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:4/113: chown d15/d1d 49 1 2024-03-16T10:53:10.627 INFO:tasks.workunit.client.0.smithi017.stdout:7/116: creat d7/db/d12/f26 x:0 0 0 2024-03-16T10:53:10.627 INFO:tasks.workunit.client.0.smithi017.stdout:9/50: dread d8/fa [0,4194304] 0 2024-03-16T10:53:10.628 INFO:tasks.workunit.client.0.smithi017.stdout:7/117: creat d7/f27 x:0 0 0 2024-03-16T10:53:10.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/118: creat d7/db/f28 x:0 0 0 2024-03-16T10:53:10.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/119: dread - d7/db/f18 zero size 2024-03-16T10:53:10.631 INFO:tasks.workunit.client.0.smithi017.stdout:3/77: dwrite f2 [0,4194304] 0 2024-03-16T10:53:10.634 INFO:tasks.workunit.client.0.smithi017.stdout:0/71: sync 2024-03-16T10:53:10.634 INFO:tasks.workunit.client.0.smithi017.stdout:8/115: sync 2024-03-16T10:53:10.634 INFO:tasks.workunit.client.0.smithi017.stdout:6/73: sync 2024-03-16T10:53:10.634 INFO:tasks.workunit.client.0.smithi017.stdout:6/74: dread - d0/dc/f19 zero size 2024-03-16T10:53:10.634 INFO:tasks.workunit.client.0.smithi017.stdout:6/75: dread - d0/d15/f17 zero size 2024-03-16T10:53:10.636 INFO:tasks.workunit.client.0.smithi017.stdout:7/120: rename d7/db/f13 to d7/db/d21/f29 0 2024-03-16T10:53:10.636 INFO:tasks.workunit.client.0.smithi017.stdout:7/121: stat f0 0 2024-03-16T10:53:10.636 INFO:tasks.workunit.client.0.smithi017.stdout:2/81: dwrite d4/dd/f14 [0,4194304] 0 2024-03-16T10:53:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/78: unlink d8/da/c18 0 2024-03-16T10:53:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/79: fsync d8/f17 0 2024-03-16T10:53:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/80: read d8/da/db/f15 [400817,71289] 0 2024-03-16T10:53:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/81: write d8/da/fe [193697,116787] 0 2024-03-16T10:53:10.641 INFO:tasks.workunit.client.0.smithi017.stdout:0/72: symlink d2/l22 0 2024-03-16T10:53:10.641 INFO:tasks.workunit.client.0.smithi017.stdout:0/73: stat d2/d7/fd 0 2024-03-16T10:53:10.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/116: creat d6/d16/f2d x:0 0 0 2024-03-16T10:53:10.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/117: readlink d6/d7/lc 0 2024-03-16T10:53:10.643 INFO:tasks.workunit.client.0.smithi017.stdout:0/74: creat d2/f23 x:0 0 0 2024-03-16T10:53:10.643 INFO:tasks.workunit.client.0.smithi017.stdout:6/76: rmdir d0/d9 39 2024-03-16T10:53:10.645 INFO:tasks.workunit.client.0.smithi017.stdout:9/51: dwrite d8/fa [0,4194304] 0 2024-03-16T10:53:10.651 INFO:tasks.workunit.client.0.smithi017.stdout:3/82: rename c1 to d8/c1a 0 2024-03-16T10:53:10.651 INFO:tasks.workunit.client.0.smithi017.stdout:3/83: write d8/da/f14 [4201106,92378] 0 2024-03-16T10:53:10.653 INFO:tasks.workunit.client.0.smithi017.stdout:8/118: truncate d6/dd/f19 1969524 0 2024-03-16T10:53:10.654 INFO:tasks.workunit.client.0.smithi017.stdout:6/77: mknod d0/dc/c1a 0 2024-03-16T10:53:10.654 INFO:tasks.workunit.client.0.smithi017.stdout:6/78: rename d0/dc to d0/dc/d16/d1b 22 2024-03-16T10:53:10.657 INFO:tasks.workunit.client.0.smithi017.stdout:9/52: mkdir d8/dc 0 2024-03-16T10:53:10.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/100: sync 2024-03-16T10:53:10.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/101: fsync d0/d1/f11 0 2024-03-16T10:53:10.658 INFO:tasks.workunit.client.0.smithi017.stdout:2/82: dwrite d4/d6/fe [0,4194304] 0 2024-03-16T10:53:10.658 INFO:tasks.workunit.client.0.smithi017.stdout:2/83: stat d4/c5 0 2024-03-16T10:53:10.658 INFO:tasks.workunit.client.0.smithi017.stdout:1/119: sync 2024-03-16T10:53:10.658 INFO:tasks.workunit.client.0.smithi017.stdout:1/120: write d1/d3/d16/f1a [4661957,38683] 0 2024-03-16T10:53:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 810 op/s 2024-03-16T10:53:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: scrub queued for path: / 2024-03-16T10:53:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:10.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:10 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:10.662 INFO:tasks.workunit.client.0.smithi017.stdout:8/119: dread d6/d7/f15 [0,4194304] 0 2024-03-16T10:53:10.663 INFO:tasks.workunit.client.0.smithi017.stdout:5/102: symlink d0/d1/l1e 0 2024-03-16T10:53:10.668 INFO:tasks.workunit.client.0.smithi017.stdout:8/120: creat d6/d7/d11/f2e x:0 0 0 2024-03-16T10:53:10.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/103: mkdir d0/d1/d1f 0 2024-03-16T10:53:10.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/104: read d0/f8 [142584,77340] 0 2024-03-16T10:53:10.671 INFO:tasks.workunit.client.0.smithi017.stdout:3/84: dwrite d8/da/db/f15 [0,4194304] 0 2024-03-16T10:53:10.671 INFO:tasks.workunit.client.0.smithi017.stdout:3/85: truncate f3 2142324 0 2024-03-16T10:53:10.671 INFO:tasks.workunit.client.0.smithi017.stdout:3/86: read f3 [1402054,97386] 0 2024-03-16T10:53:10.672 INFO:tasks.workunit.client.0.smithi017.stdout:3/87: chown f3 64763572 1 2024-03-16T10:53:10.672 INFO:tasks.workunit.client.0.smithi017.stdout:1/121: symlink d1/l2e 0 2024-03-16T10:53:10.675 INFO:tasks.workunit.client.0.smithi017.stdout:8/121: mkdir d6/d16/d2f 0 2024-03-16T10:53:10.676 INFO:tasks.workunit.client.0.smithi017.stdout:5/105: creat d0/d1/d13/f20 x:0 0 0 2024-03-16T10:53:10.680 INFO:tasks.workunit.client.0.smithi017.stdout:2/84: dwrite d4/d6/f10 [0,4194304] 0 2024-03-16T10:53:10.680 INFO:tasks.workunit.client.0.smithi017.stdout:6/79: dwrite d0/f3 [8388608,4194304] 0 2024-03-16T10:53:10.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/88: dread d8/da/fe [0,4194304] 0 2024-03-16T10:53:10.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/89: chown d8/c1a 349834 1 2024-03-16T10:53:10.682 INFO:tasks.workunit.client.0.smithi017.stdout:8/122: link d6/d7/fa d6/d16/d2f/f30 0 2024-03-16T10:53:10.683 INFO:tasks.workunit.client.0.smithi017.stdout:7/122: fsync d7/f27 0 2024-03-16T10:53:10.683 INFO:tasks.workunit.client.0.smithi017.stdout:7/123: write d7/f27 [718827,71762] 0 2024-03-16T10:53:10.685 INFO:tasks.workunit.client.0.smithi017.stdout:5/106: mknod d0/d1/d13/c21 0 2024-03-16T10:53:10.686 INFO:tasks.workunit.client.0.smithi017.stdout:4/114: dwrite fe [0,4194304] 0 2024-03-16T10:53:10.686 INFO:tasks.workunit.client.0.smithi017.stdout:5/107: write d0/f9 [1000323,112890] 0 2024-03-16T10:53:10.686 INFO:tasks.workunit.client.0.smithi017.stdout:1/122: dwrite d1/d3/f29 [0,4194304] 0 2024-03-16T10:53:10.691 INFO:tasks.workunit.client.0.smithi017.stdout:2/85: creat d4/dd/f18 x:0 0 0 2024-03-16T10:53:10.691 INFO:tasks.workunit.client.0.smithi017.stdout:2/86: write d4/d6/f9 [2630511,95080] 0 2024-03-16T10:53:10.695 INFO:tasks.workunit.client.0.smithi017.stdout:3/90: truncate d8/da/db/f19 1866673 0 2024-03-16T10:53:10.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/80: dwrite d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:10.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/123: creat d6/d14/d28/f31 x:0 0 0 2024-03-16T10:53:10.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/124: write d6/d7/d11/f26 [626657,72506] 0 2024-03-16T10:53:10.698 INFO:tasks.workunit.client.0.smithi017.stdout:7/124: symlink d7/db/l2a 0 2024-03-16T10:53:10.701 INFO:tasks.workunit.client.0.smithi017.stdout:3/91: dread d8/da/f14 [0,4194304] 0 2024-03-16T10:53:10.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/115: link lf d15/d1d/l20 0 2024-03-16T10:53:10.704 INFO:tasks.workunit.client.0.smithi017.stdout:5/108: creat d0/f22 x:0 0 0 2024-03-16T10:53:10.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/92: dread d8/da/fe [0,4194304] 0 2024-03-16T10:53:10.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/93: dread - d8/f17 zero size 2024-03-16T10:53:10.707 INFO:tasks.workunit.client.0.smithi017.stdout:8/125: dread d6/d14/f1e [0,4194304] 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/123: rename d1/d3/l14 to d1/d3/l2f 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/124: write d1/d3/d16/f1a [4079252,96437] 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/125: write d1/d3/d16/f1a [3484710,111933] 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/126: fdatasync d1/d3/fb 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/127: stat d1/d3/d16/f26 0 2024-03-16T10:53:10.708 INFO:tasks.workunit.client.0.smithi017.stdout:9/53: truncate d8/fa 1238450 0 2024-03-16T10:53:10.714 INFO:tasks.workunit.client.0.smithi017.stdout:6/81: rmdir d0/dc/d16 0 2024-03-16T10:53:10.717 INFO:tasks.workunit.client.0.smithi017.stdout:7/125: link d7/db/dc/c19 d7/c2b 0 2024-03-16T10:53:10.717 INFO:tasks.workunit.client.0.smithi017.stdout:1/128: dread d1/f4 [0,4194304] 0 2024-03-16T10:53:10.718 INFO:tasks.workunit.client.0.smithi017.stdout:4/116: mkdir d15/d1d/d21 0 2024-03-16T10:53:10.718 INFO:tasks.workunit.client.0.smithi017.stdout:4/117: write f6 [1667344,60705] 0 2024-03-16T10:53:10.719 INFO:tasks.workunit.client.0.smithi017.stdout:4/118: chown d15/d1d/f1e 1815244 1 2024-03-16T10:53:10.719 INFO:tasks.workunit.client.0.smithi017.stdout:5/109: rmdir d0/d1/d2 39 2024-03-16T10:53:10.719 INFO:tasks.workunit.client.0.smithi017.stdout:5/110: readlink d0/d1/la 0 2024-03-16T10:53:10.721 INFO:tasks.workunit.client.0.smithi017.stdout:3/94: dwrite d8/da/fe [0,4194304] 0 2024-03-16T10:53:10.722 INFO:tasks.workunit.client.0.smithi017.stdout:8/126: rename d6/dd/f19 to d6/d16/d2f/f32 0 2024-03-16T10:53:10.723 INFO:tasks.workunit.client.0.smithi017.stdout:9/54: symlink d8/dc/ld 0 2024-03-16T10:53:10.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/55: write f7 [1088270,122746] 0 2024-03-16T10:53:10.724 INFO:tasks.workunit.client.0.smithi017.stdout:6/82: getdents d0/d15 0 2024-03-16T10:53:10.724 INFO:tasks.workunit.client.0.smithi017.stdout:6/83: chown d0/f4 1 1 2024-03-16T10:53:10.726 INFO:tasks.workunit.client.0.smithi017.stdout:1/129: rmdir d1/d3/de 39 2024-03-16T10:53:10.727 INFO:tasks.workunit.client.0.smithi017.stdout:4/119: mknod d15/d1d/d21/c22 0 2024-03-16T10:53:10.728 INFO:tasks.workunit.client.0.smithi017.stdout:5/111: rmdir d0/d1 39 2024-03-16T10:53:10.729 INFO:tasks.workunit.client.0.smithi017.stdout:4/120: dread - d15/f17 zero size 2024-03-16T10:53:10.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/127: dread f5 [0,4194304] 0 2024-03-16T10:53:10.732 INFO:tasks.workunit.client.0.smithi017.stdout:6/84: write d0/f4 [15647276,6183] 0 2024-03-16T10:53:10.732 INFO:tasks.workunit.client.0.smithi017.stdout:6/85: write d0/f3 [3179117,19268] 0 2024-03-16T10:53:10.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/112: rename d0/d1/d2/dc/f14 to d0/d1/d1f/f23 0 2024-03-16T10:53:10.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/113: readlink d0/d1/d2/dc/l1b 0 2024-03-16T10:53:10.733 INFO:tasks.workunit.client.0.smithi017.stdout:6/86: fdatasync d0/f3 0 2024-03-16T10:53:10.734 INFO:tasks.workunit.client.0.smithi017.stdout:4/121: symlink d15/d1d/d21/l23 0 2024-03-16T10:53:10.734 INFO:tasks.workunit.client.0.smithi017.stdout:4/122: write d15/d1d/f1e [810688,73638] 0 2024-03-16T10:53:10.734 INFO:tasks.workunit.client.0.smithi017.stdout:7/126: dwrite d7/f8 [0,4194304] 0 2024-03-16T10:53:10.737 INFO:tasks.workunit.client.0.smithi017.stdout:5/114: mkdir d0/d1/d2/d24 0 2024-03-16T10:53:10.737 INFO:tasks.workunit.client.0.smithi017.stdout:5/115: chown d0/f22 109248660 1 2024-03-16T10:53:10.738 INFO:tasks.workunit.client.0.smithi017.stdout:5/116: dread - d0/d1/d2/dc/f1d zero size 2024-03-16T10:53:10.739 INFO:tasks.workunit.client.0.smithi017.stdout:4/123: creat d15/d1d/f24 x:0 0 0 2024-03-16T10:53:10.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/117: link d0/d1/d2/dc/l1b d0/d1/d2/d24/l25 0 2024-03-16T10:53:10.745 INFO:tasks.workunit.client.0.smithi017.stdout:3/95: dwrite d8/da/f14 [0,4194304] 0 2024-03-16T10:53:10.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/124: creat d15/d1d/f25 x:0 0 0 2024-03-16T10:53:10.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/125: truncate d15/f19 4958414 0 2024-03-16T10:53:10.746 INFO:tasks.workunit.client.0.smithi017.stdout:7/127: dread d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:10.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/126: read d15/d1d/f1e [606779,7727] 0 2024-03-16T10:53:10.748 INFO:tasks.workunit.client.0.smithi017.stdout:7/128: dread d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:10.749 INFO:tasks.workunit.client.0.smithi017.stdout:3/96: dread f3 [0,4194304] 0 2024-03-16T10:53:10.749 INFO:tasks.workunit.client.0.smithi017.stdout:3/97: truncate f7 840257 0 2024-03-16T10:53:10.749 INFO:tasks.workunit.client.0.smithi017.stdout:5/118: symlink d0/d1/d1f/l26 0 2024-03-16T10:53:10.749 INFO:tasks.workunit.client.0.smithi017.stdout:5/119: fsync d0/d1/d2/dc/f1d 0 2024-03-16T10:53:10.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/129: rename d7/db/c11 to d7/db/d12/d1c/c2c 0 2024-03-16T10:53:10.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/130: chown d7/db/f14 88 1 2024-03-16T10:53:10.754 INFO:tasks.workunit.client.0.smithi017.stdout:3/98: mkdir d8/d1b 0 2024-03-16T10:53:10.756 INFO:tasks.workunit.client.0.smithi017.stdout:5/120: creat d0/f27 x:0 0 0 2024-03-16T10:53:10.756 INFO:tasks.workunit.client.0.smithi017.stdout:5/121: stat d0/d1/d1f/l26 0 2024-03-16T10:53:10.758 INFO:tasks.workunit.client.0.smithi017.stdout:7/131: symlink d7/db/l2d 0 2024-03-16T10:53:10.758 INFO:tasks.workunit.client.0.smithi017.stdout:7/132: dread - d7/db/f28 zero size 2024-03-16T10:53:10.759 INFO:tasks.workunit.client.0.smithi017.stdout:5/122: rmdir d0/d1 39 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:6/87: dwrite d0/f3 [4194304,4194304] 0 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:6/88: read d0/f3 [14664346,112598] 0 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/123: mknod d0/d1/c28 0 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/124: truncate d0/d1/f11 293169 0 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:4/127: write d15/f1b [3101038,23494] 0 2024-03-16T10:53:10.761 INFO:tasks.workunit.client.0.smithi017.stdout:1/130: dwrite d1/d3/fb [0,4194304] 0 2024-03-16T10:53:10.764 INFO:tasks.workunit.client.0.smithi017.stdout:5/125: mkdir d0/d1/d1f/d29 0 2024-03-16T10:53:10.764 INFO:tasks.workunit.client.0.smithi017.stdout:5/126: chown d0/d1/d2/cd 13635 1 2024-03-16T10:53:10.764 INFO:tasks.workunit.client.0.smithi017.stdout:5/127: getdents d0/d1/d1f/d29 0 2024-03-16T10:53:10.764 INFO:tasks.workunit.client.0.smithi017.stdout:8/128: dwrite d6/d7/fa [0,4194304] 0 2024-03-16T10:53:10.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/128: unlink l10 0 2024-03-16T10:53:10.768 INFO:tasks.workunit.client.0.smithi017.stdout:5/128: creat d0/d1/d1f/d29/f2a x:0 0 0 2024-03-16T10:53:10.772 INFO:tasks.workunit.client.0.smithi017.stdout:8/129: creat d6/dd/f33 x:0 0 0 2024-03-16T10:53:10.773 INFO:tasks.workunit.client.0.smithi017.stdout:6/89: write d0/f3 [6833497,93506] 0 2024-03-16T10:53:10.773 INFO:tasks.workunit.client.0.smithi017.stdout:6/90: fsync d0/d15/f17 0 2024-03-16T10:53:10.774 INFO:tasks.workunit.client.0.smithi017.stdout:5/129: creat d0/d1/d2/d24/f2b x:0 0 0 2024-03-16T10:53:10.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/56: write d8/fa [1255219,121498] 0 2024-03-16T10:53:10.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/99: dwrite d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:10.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/133: dwrite f0 [0,4194304] 0 2024-03-16T10:53:10.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/134: truncate d7/db/dc/f25 195242 0 2024-03-16T10:53:10.784 INFO:tasks.workunit.client.0.smithi017.stdout:6/91: getdents d0 0 2024-03-16T10:53:10.786 INFO:tasks.workunit.client.0.smithi017.stdout:5/130: mkdir d0/d1/d2/d2c 0 2024-03-16T10:53:10.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/131: chown d0/l3 2249649 1 2024-03-16T10:53:10.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/132: read d0/d1/d2/ff [1957801,4769] 0 2024-03-16T10:53:10.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/133: write d0/f9 [2091891,68075] 0 2024-03-16T10:53:10.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/134: write d0/f9 [1647475,66913] 0 2024-03-16T10:53:10.788 INFO:tasks.workunit.client.0.smithi017.stdout:9/57: rename c2 to d8/dc/ce 0 2024-03-16T10:53:10.794 INFO:tasks.workunit.client.0.smithi017.stdout:1/131: dwrite d1/d3/dd/f12 [4194304,4194304] 0 2024-03-16T10:53:10.795 INFO:tasks.workunit.client.0.smithi017.stdout:8/130: dwrite d6/d14/d28/f2b [0,4194304] 0 2024-03-16T10:53:10.797 INFO:tasks.workunit.client.0.smithi017.stdout:7/135: creat d7/db/d12/d1c/f2e x:0 0 0 2024-03-16T10:53:10.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/100: dwrite d8/da/f14 [0,4194304] 0 2024-03-16T10:53:10.801 INFO:tasks.workunit.client.0.smithi017.stdout:6/92: creat d0/d15/f1c x:0 0 0 2024-03-16T10:53:10.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/135: mknod d0/d1/d2/d24/c2d 0 2024-03-16T10:53:10.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/136: readlink d0/l3 0 2024-03-16T10:53:10.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/137: read - d0/d1/d2/dc/f1d zero size 2024-03-16T10:53:10.807 INFO:tasks.workunit.client.0.smithi017.stdout:1/132: creat d1/d3/d16/f30 x:0 0 0 2024-03-16T10:53:10.820 INFO:tasks.workunit.client.0.smithi017.stdout:7/136: symlink d7/db/d12/d1c/l2f 0 2024-03-16T10:53:10.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/137: write d7/db/dc/f10 [1146971,62879] 0 2024-03-16T10:53:10.823 INFO:tasks.workunit.client.0.smithi017.stdout:3/101: mkdir d8/d1b/d1c 0 2024-03-16T10:53:10.824 INFO:tasks.workunit.client.0.smithi017.stdout:6/93: mkdir d0/d9/da/d1d 0 2024-03-16T10:53:10.824 INFO:tasks.workunit.client.0.smithi017.stdout:6/94: readlink d0/d9/lb 0 2024-03-16T10:53:10.825 INFO:tasks.workunit.client.0.smithi017.stdout:5/138: creat d0/d1/d2/d24/f2e x:0 0 0 2024-03-16T10:53:10.827 INFO:tasks.workunit.client.0.smithi017.stdout:1/133: unlink d1/d3/de/f15 0 2024-03-16T10:53:10.827 INFO:tasks.workunit.client.0.smithi017.stdout:1/134: truncate d1/d3/dd/f1f 666536 0 2024-03-16T10:53:10.828 INFO:tasks.workunit.client.0.smithi017.stdout:7/138: mkdir d7/db/d12/d1c/d30 0 2024-03-16T10:53:10.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/95: symlink d0/l1e 0 2024-03-16T10:53:10.833 INFO:tasks.workunit.client.0.smithi017.stdout:1/135: read d1/f4 [335169,65601] 0 2024-03-16T10:53:10.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/139: mkdir d0/d1/d2/dc/d2f 0 2024-03-16T10:53:10.838 INFO:tasks.workunit.client.0.smithi017.stdout:6/96: getdents d0/d9 0 2024-03-16T10:53:10.838 INFO:tasks.workunit.client.0.smithi017.stdout:6/97: dread - d0/dc/f14 zero size 2024-03-16T10:53:10.839 INFO:tasks.workunit.client.0.smithi017.stdout:1/136: rmdir d1/d3/de 39 2024-03-16T10:53:10.842 INFO:tasks.workunit.client.0.smithi017.stdout:5/140: mkdir d0/d1/d30 0 2024-03-16T10:53:10.843 INFO:tasks.workunit.client.0.smithi017.stdout:7/139: dwrite d7/db/f28 [0,4194304] 0 2024-03-16T10:53:10.844 INFO:tasks.workunit.client.0.smithi017.stdout:6/98: rename d0/d9/da/d1d to d0/d15/d1f 0 2024-03-16T10:53:10.845 INFO:tasks.workunit.client.0.smithi017.stdout:6/99: stat d0/dc 0 2024-03-16T10:53:10.845 INFO:tasks.workunit.client.0.smithi017.stdout:1/137: dread d1/d3/d16/f1a [0,4194304] 0 2024-03-16T10:53:10.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/141: mknod d0/d1/d2/c31 0 2024-03-16T10:53:10.853 INFO:tasks.workunit.client.0.smithi017.stdout:7/140: unlink d7/db/dc/f25 0 2024-03-16T10:53:10.853 INFO:tasks.workunit.client.0.smithi017.stdout:7/141: write d7/db/f18 [730892,10068] 0 2024-03-16T10:53:10.854 INFO:tasks.workunit.client.0.smithi017.stdout:6/100: symlink d0/d15/l20 0 2024-03-16T10:53:10.856 INFO:tasks.workunit.client.0.smithi017.stdout:7/142: symlink d7/db/d12/d1c/l31 0 2024-03-16T10:53:10.861 INFO:tasks.workunit.client.0.smithi017.stdout:9/58: rename d8/dc to d8/df 0 2024-03-16T10:53:10.866 INFO:tasks.workunit.client.0.smithi017.stdout:9/59: write f7 [718335,4380] 0 2024-03-16T10:53:10.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/143: read d7/db/f14 [7941826,37532] 0 2024-03-16T10:53:10.872 INFO:tasks.workunit.client.0.smithi017.stdout:1/138: dwrite d1/d3/dd/f12 [4194304,4194304] 0 2024-03-16T10:53:10.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/139: write d1/d3/d16/f30 [268757,69895] 0 2024-03-16T10:53:10.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/140: write d1/d3/f8 [1991466,23325] 0 2024-03-16T10:53:10.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/144: mkdir d7/db/d32 0 2024-03-16T10:53:10.876 INFO:tasks.workunit.client.0.smithi017.stdout:3/102: getdents d8/d1b 0 2024-03-16T10:53:10.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/101: dwrite d0/d9/f11 [0,4194304] 0 2024-03-16T10:53:10.877 INFO:tasks.workunit.client.0.smithi017.stdout:5/142: dwrite d0/f9 [0,4194304] 0 2024-03-16T10:53:10.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/145: mkdir d7/db/d21/d33 0 2024-03-16T10:53:10.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/146: readlink d7/db/d12/d1c/l2f 0 2024-03-16T10:53:10.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/147: chown d7/db/ce 76 1 2024-03-16T10:53:10.883 INFO:tasks.workunit.client.0.smithi017.stdout:3/103: mkdir d8/d1d 0 2024-03-16T10:53:10.887 INFO:tasks.workunit.client.0.smithi017.stdout:5/143: truncate d0/d1/d2/f12 747171 0 2024-03-16T10:53:10.887 INFO:tasks.workunit.client.0.smithi017.stdout:5/144: fdatasync d0/f22 0 2024-03-16T10:53:10.892 INFO:tasks.workunit.client.0.smithi017.stdout:1/141: dwrite d1/d3/f8 [4194304,4194304] 0 2024-03-16T10:53:10.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/104: write d8/da/fe [3980244,84013] 0 2024-03-16T10:53:10.895 INFO:tasks.workunit.client.0.smithi017.stdout:1/142: mkdir d1/d3/dd/d31 0 2024-03-16T10:53:10.895 INFO:tasks.workunit.client.0.smithi017.stdout:1/143: fdatasync d1/d3/d16/f26 0 2024-03-16T10:53:10.896 INFO:tasks.workunit.client.0.smithi017.stdout:6/102: dwrite d0/d9/f11 [0,4194304] 0 2024-03-16T10:53:10.897 INFO:tasks.workunit.client.0.smithi017.stdout:3/105: symlink d8/l1e 0 2024-03-16T10:53:10.898 INFO:tasks.workunit.client.0.smithi017.stdout:3/106: readlink l4 0 2024-03-16T10:53:10.899 INFO:tasks.workunit.client.0.smithi017.stdout:7/148: dwrite d7/f8 [0,4194304] 0 2024-03-16T10:53:10.900 INFO:tasks.workunit.client.0.smithi017.stdout:1/144: unlink d1/f4 0 2024-03-16T10:53:10.900 INFO:tasks.workunit.client.0.smithi017.stdout:1/145: getdents d1/d3/dd/d31 0 2024-03-16T10:53:10.900 INFO:tasks.workunit.client.0.smithi017.stdout:1/146: write d1/f1e [32565,114433] 0 2024-03-16T10:53:10.901 INFO:tasks.workunit.client.0.smithi017.stdout:6/103: mkdir d0/d21 0 2024-03-16T10:53:10.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/104: fsync d0/d9/f18 0 2024-03-16T10:53:10.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/105: stat d0/c5 0 2024-03-16T10:53:10.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/106: chown d0/c8 112 1 2024-03-16T10:53:10.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/107: write d0/f3 [1629183,39123] 0 2024-03-16T10:53:10.903 INFO:tasks.workunit.client.0.smithi017.stdout:3/107: creat d8/d1d/f1f x:0 0 0 2024-03-16T10:53:10.903 INFO:tasks.workunit.client.0.smithi017.stdout:5/145: dwrite d0/d1/f16 [0,4194304] 0 2024-03-16T10:53:10.903 INFO:tasks.workunit.client.0.smithi017.stdout:5/146: chown d0/f8 220944823 1 2024-03-16T10:53:10.904 INFO:tasks.workunit.client.0.smithi017.stdout:7/149: mkdir d7/db/d21/d33/d34 0 2024-03-16T10:53:10.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/108: mkdir d0/d22 0 2024-03-16T10:53:10.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/147: symlink d0/d1/d2/l32 0 2024-03-16T10:53:10.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/148: readlink d0/d1/d2/l10 0 2024-03-16T10:53:10.909 INFO:tasks.workunit.client.0.smithi017.stdout:7/150: symlink d7/db/d21/d33/d34/l35 0 2024-03-16T10:53:10.909 INFO:tasks.workunit.client.0.smithi017.stdout:7/151: fsync f0 0 2024-03-16T10:53:10.909 INFO:tasks.workunit.client.0.smithi017.stdout:7/152: chown d7/db/dc/c1a 122040540 1 2024-03-16T10:53:10.909 INFO:tasks.workunit.client.0.smithi017.stdout:1/147: dread d1/d3/fb [0,4194304] 0 2024-03-16T10:53:10.909 INFO:tasks.workunit.client.0.smithi017.stdout:6/109: symlink d0/d15/d1f/l23 0 2024-03-16T10:53:10.910 INFO:tasks.workunit.client.0.smithi017.stdout:3/108: write d8/da/db/f15 [3833755,88683] 0 2024-03-16T10:53:10.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/153: link d7/db/dc/ff d7/db/d12/d1c/f36 0 2024-03-16T10:53:10.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/154: fdatasync d7/db/d12/d1c/f2e 0 2024-03-16T10:53:10.914 INFO:tasks.workunit.client.0.smithi017.stdout:1/148: creat d1/d3/de/f32 x:0 0 0 2024-03-16T10:53:10.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/149: dread d0/f9 [0,4194304] 0 2024-03-16T10:53:10.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/150: chown d0/d1/d2 55971 1 2024-03-16T10:53:10.917 INFO:tasks.workunit.client.0.smithi017.stdout:3/109: symlink d8/l20 0 2024-03-16T10:53:10.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/110: dread d0/f3 [8388608,4194304] 0 2024-03-16T10:53:10.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/111: readlink d0/d9/lb 0 2024-03-16T10:53:10.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/112: truncate d0/dc/f14 521982 0 2024-03-16T10:53:10.921 INFO:tasks.workunit.client.0.smithi017.stdout:1/149: rename d1/d3/de/c22 to d1/d3/dd/c33 0 2024-03-16T10:53:10.922 INFO:tasks.workunit.client.0.smithi017.stdout:6/113: mknod d0/d15/d1f/c24 0 2024-03-16T10:53:10.924 INFO:tasks.workunit.client.0.smithi017.stdout:5/151: rename d0/d1/ce to d0/d1/d1f/c33 0 2024-03-16T10:53:10.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/150: creat d1/f34 x:0 0 0 2024-03-16T10:53:10.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/151: chown d1/d3/dd/f1f 5 1 2024-03-16T10:53:10.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/152: truncate d1/d3/dd/f1f 1319251 0 2024-03-16T10:53:10.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/114: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:10.928 INFO:tasks.workunit.client.0.smithi017.stdout:5/152: mknod d0/d1/d2/d24/c34 0 2024-03-16T10:53:10.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/153: mkdir d1/d3/dd/d31/d35 0 2024-03-16T10:53:10.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/154: write d1/d3/f8 [1907790,53008] 0 2024-03-16T10:53:10.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/155: stat d1/d3/de/f32 0 2024-03-16T10:53:10.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/156: readlink d1/d3/de/l20 0 2024-03-16T10:53:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/115: creat d0/d9/da/f25 x:0 0 0 2024-03-16T10:53:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/116: stat d0/d21 0 2024-03-16T10:53:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/117: fsync d0/d15/f17 0 2024-03-16T10:53:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/118: dread - d0/d9/f18 zero size 2024-03-16T10:53:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/119: write d0/d15/f1c [566461,112682] 0 2024-03-16T10:53:10.933 INFO:tasks.workunit.client.0.smithi017.stdout:1/157: mkdir d1/d3/de/d36 0 2024-03-16T10:53:10.933 INFO:tasks.workunit.client.0.smithi017.stdout:1/158: chown d1/d3/de/l11 111 1 2024-03-16T10:53:10.937 INFO:tasks.workunit.client.0.smithi017.stdout:6/120: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:10.937 INFO:tasks.workunit.client.0.smithi017.stdout:6/121: chown d0/d15/d1f/c24 848935 1 2024-03-16T10:53:10.938 INFO:tasks.workunit.client.0.smithi017.stdout:6/122: dread d0/dc/f14 [0,4194304] 0 2024-03-16T10:53:10.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/153: dwrite d0/d1/f11 [0,4194304] 0 2024-03-16T10:53:10.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/154: fdatasync d0/f27 0 2024-03-16T10:53:10.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/155: truncate d0/d1/d1f/f23 1644835 0 2024-03-16T10:53:10.940 INFO:tasks.workunit.client.0.smithi017.stdout:6/123: unlink d0/d9/f11 0 2024-03-16T10:53:10.944 INFO:tasks.workunit.client.0.smithi017.stdout:1/159: dwrite d1/d3/d16/f30 [0,4194304] 0 2024-03-16T10:53:10.946 INFO:tasks.workunit.client.0.smithi017.stdout:5/156: link d0/d1/d13/f20 d0/d1/d2/f35 0 2024-03-16T10:53:10.947 INFO:tasks.workunit.client.0.smithi017.stdout:6/124: symlink d0/d15/l26 0 2024-03-16T10:53:10.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/160: dread d1/f18 [0,4194304] 0 2024-03-16T10:53:10.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/161: readlink d1/d3/l9 0 2024-03-16T10:53:10.950 INFO:tasks.workunit.client.0.smithi017.stdout:5/157: mkdir d0/d1/d2/d2c/d36 0 2024-03-16T10:53:10.953 INFO:tasks.workunit.client.0.smithi017.stdout:1/162: link d1/d3/de/c1d d1/d3/de/c37 0 2024-03-16T10:53:10.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/163: creat d1/d3/dd/d31/d35/f38 x:0 0 0 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/87: sync 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:0/75: sync 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:0/76: readlink d2/l10 0 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/88: dread - d4/d6/f16 zero size 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/89: fsync d4/dd/df/f15 0 2024-03-16T10:53:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/90: truncate d4/dd/f14 4809725 0 2024-03-16T10:53:10.959 INFO:tasks.workunit.client.0.smithi017.stdout:2/91: creat d4/dd/df/f19 x:0 0 0 2024-03-16T10:53:10.962 INFO:tasks.workunit.client.0.smithi017.stdout:2/92: unlink d4/d6/f9 0 2024-03-16T10:53:10.963 INFO:tasks.workunit.client.0.smithi017.stdout:1/164: dread d1/d3/f29 [0,4194304] 0 2024-03-16T10:53:10.964 INFO:tasks.workunit.client.0.smithi017.stdout:2/93: link d4/d6/l17 d4/l1a 0 2024-03-16T10:53:10.964 INFO:tasks.workunit.client.0.smithi017.stdout:2/94: dread - d4/d6/f16 zero size 2024-03-16T10:53:10.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/165: unlink d1/d3/dd/c19 0 2024-03-16T10:53:10.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/158: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:10.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/159: dread - d0/d1/d1f/d29/f2a zero size 2024-03-16T10:53:10.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/160: dread - d0/d1/d2/dc/f1d zero size 2024-03-16T10:53:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:5/161: stat d0/d1/d2/ff 0 2024-03-16T10:53:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/77: write d2/d4/f1c [3904203,18318] 0 2024-03-16T10:53:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/78: getdents d2/d7/de/d1e 0 2024-03-16T10:53:10.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/162: mkdir d0/d1/d2/dc/d2f/d37 0 2024-03-16T10:53:10.971 INFO:tasks.workunit.client.0.smithi017.stdout:6/125: dwrite d0/d9/f18 [0,4194304] 0 2024-03-16T10:53:10.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/79: mkdir d2/d7/d24 0 2024-03-16T10:53:10.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/80: fsync f0 0 2024-03-16T10:53:10.972 INFO:tasks.workunit.client.0.smithi017.stdout:5/163: mkdir d0/d1/d2/d2c/d38 0 2024-03-16T10:53:10.975 INFO:tasks.workunit.client.0.smithi017.stdout:1/166: dread d1/d3/f23 [0,4194304] 0 2024-03-16T10:53:10.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/126: creat d0/d22/f27 x:0 0 0 2024-03-16T10:53:10.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/127: write d0/f4 [16172669,125573] 0 2024-03-16T10:53:10.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/164: creat d0/d1/d2/dc/d2f/d37/f39 x:0 0 0 2024-03-16T10:53:10.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/165: fdatasync d0/f9 0 2024-03-16T10:53:10.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/166: read - d0/f22 zero size 2024-03-16T10:53:10.978 INFO:tasks.workunit.client.0.smithi017.stdout:0/81: mkdir d2/d25 0 2024-03-16T10:53:10.978 INFO:tasks.workunit.client.0.smithi017.stdout:2/95: dwrite d4/dd/f18 [0,4194304] 0 2024-03-16T10:53:10.978 INFO:tasks.workunit.client.0.smithi017.stdout:6/128: mkdir d0/d21/d28 0 2024-03-16T10:53:10.979 INFO:tasks.workunit.client.0.smithi017.stdout:5/167: symlink d0/d1/d2/d2c/d36/l3a 0 2024-03-16T10:53:10.980 INFO:tasks.workunit.client.0.smithi017.stdout:0/82: mknod d2/d7/de/d1e/c26 0 2024-03-16T10:53:10.984 INFO:tasks.workunit.client.0.smithi017.stdout:2/96: creat d4/dd/df/f1b x:0 0 0 2024-03-16T10:53:10.985 INFO:tasks.workunit.client.0.smithi017.stdout:1/167: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:10.985 INFO:tasks.workunit.client.0.smithi017.stdout:1/168: write d1/d3/dd/f1f [2035740,48819] 0 2024-03-16T10:53:10.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/168: getdents d0/d1/d1f/d29 0 2024-03-16T10:53:10.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/169: chown d0/d1/d1f/l26 7 1 2024-03-16T10:53:10.988 INFO:tasks.workunit.client.0.smithi017.stdout:2/97: rename d4/l7 to d4/l1c 0 2024-03-16T10:53:10.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/129: dwrite d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:10.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/130: stat d0/d9 0 2024-03-16T10:53:10.995 INFO:tasks.workunit.client.0.smithi017.stdout:1/169: creat d1/d3/de/d36/f39 x:0 0 0 2024-03-16T10:53:10.997 INFO:tasks.workunit.client.0.smithi017.stdout:5/170: creat d0/d1/d2/d2c/d38/f3b x:0 0 0 2024-03-16T10:53:10.998 INFO:tasks.workunit.client.0.smithi017.stdout:5/171: stat d0/d1/d2/f35 0 2024-03-16T10:53:11.004 INFO:tasks.workunit.client.0.smithi017.stdout:6/131: rmdir d0/d9/da 39 2024-03-16T10:53:11.004 INFO:tasks.workunit.client.0.smithi017.stdout:6/132: dread - d0/d22/f27 zero size 2024-03-16T10:53:11.005 INFO:tasks.workunit.client.0.smithi017.stdout:1/170: creat d1/d3/f3a x:0 0 0 2024-03-16T10:53:11.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/133: mknod d0/d21/c29 0 2024-03-16T10:53:11.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/134: fsync d0/d15/f17 0 2024-03-16T10:53:11.008 INFO:tasks.workunit.client.0.smithi017.stdout:5/172: dwrite d0/f9 [4194304,4194304] 0 2024-03-16T10:53:11.009 INFO:tasks.workunit.client.0.smithi017.stdout:1/171: stat d1/d3/l2f 0 2024-03-16T10:53:11.021 INFO:tasks.workunit.client.0.smithi017.stdout:6/135: dwrite d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:11.021 INFO:tasks.workunit.client.0.smithi017.stdout:5/173: symlink d0/d1/d2/l3c 0 2024-03-16T10:53:11.022 INFO:tasks.workunit.client.0.smithi017.stdout:5/174: chown d0/d1 80514743 1 2024-03-16T10:53:11.023 INFO:tasks.workunit.client.0.smithi017.stdout:1/172: mknod d1/d3/d2c/c3b 0 2024-03-16T10:53:11.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/136: write d0/d9/f13 [3870994,52115] 0 2024-03-16T10:53:11.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/137: readlink d0/l1e 0 2024-03-16T10:53:11.030 INFO:tasks.workunit.client.0.smithi017.stdout:5/175: unlink d0/d1/d2/c31 0 2024-03-16T10:53:11.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/173: symlink d1/d3/d2c/l3c 0 2024-03-16T10:53:11.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/83: rename d2/d7/fd to d2/d7/de/f27 0 2024-03-16T10:53:11.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/84: getdents d2 0 2024-03-16T10:53:11.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/85: chown d2/d7/f9 19103464 1 2024-03-16T10:53:11.047 INFO:tasks.workunit.client.0.smithi017.stdout:2/98: rename d4/d6/fe to d4/dd/f1d 0 2024-03-16T10:53:11.047 INFO:tasks.workunit.client.0.smithi017.stdout:2/99: truncate d4/d6/f16 45168 0 2024-03-16T10:53:11.048 INFO:tasks.workunit.client.0.smithi017.stdout:0/86: mkdir d2/d25/d28 0 2024-03-16T10:53:11.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/87: mkdir d2/d7/d24/d29 0 2024-03-16T10:53:11.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/88: dread - d2/d7/f18 zero size 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/129: sync 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/131: sync 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/132: fdatasync d6/fe 0 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/133: chown d6/dd 1277481 1 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/134: write d6/d7/d11/f21 [631689,59442] 0 2024-03-16T10:53:11.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/135: fdatasync f5 0 2024-03-16T10:53:11.051 INFO:tasks.workunit.client.0.smithi017.stdout:2/100: mkdir d4/dd/d1e 0 2024-03-16T10:53:11.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/176: dwrite d0/d1/d1f/d29/f2a [0,4194304] 0 2024-03-16T10:53:11.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/177: chown d0/d1/d13/f20 12781 1 2024-03-16T10:53:11.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/178: write d0/d1/d2/dc/d2f/d37/f39 [726353,123023] 0 2024-03-16T10:53:11.052 INFO:tasks.workunit.client.0.smithi017.stdout:5/179: dread - d0/d1/d2/d2c/d38/f3b zero size 2024-03-16T10:53:11.052 INFO:tasks.workunit.client.0.smithi017.stdout:0/89: creat d2/d7/f2a x:0 0 0 2024-03-16T10:53:11.052 INFO:tasks.workunit.client.0.smithi017.stdout:0/90: getdents d2/d25/d28 0 2024-03-16T10:53:11.052 INFO:tasks.workunit.client.0.smithi017.stdout:4/130: mkdir d15/d1d/d21/d26 0 2024-03-16T10:53:11.053 INFO:tasks.workunit.client.0.smithi017.stdout:0/91: mkdir d2/d25/d2b 0 2024-03-16T10:53:11.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/136: rmdir d6/d14/d28 39 2024-03-16T10:53:11.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/137: chown d6/dd/f33 15317 1 2024-03-16T10:53:11.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/92: rmdir d2/d7/d24 39 2024-03-16T10:53:11.055 INFO:tasks.workunit.client.0.smithi017.stdout:0/93: rename d2/d7/f2a to d2/d7/d24/d29/f2c 0 2024-03-16T10:53:11.056 INFO:tasks.workunit.client.0.smithi017.stdout:0/94: chown d2/f23 33255059 1 2024-03-16T10:53:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/138: dwrite d0/d9/f13 [0,4194304] 0 2024-03-16T10:53:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/174: dwrite d1/d3/f23 [0,4194304] 0 2024-03-16T10:53:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/139: fsync d0/d9/da/f25 0 2024-03-16T10:53:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/95: link d2/d7/f18 d2/d25/f2d 0 2024-03-16T10:53:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:5/180: mkdir d0/d1/d3d 0 2024-03-16T10:53:11.059 INFO:tasks.workunit.client.0.smithi017.stdout:5/181: dread - d0/d1/d2/f35 zero size 2024-03-16T10:53:11.059 INFO:tasks.workunit.client.0.smithi017.stdout:5/182: stat d0/d1/d2/f12 0 2024-03-16T10:53:11.061 INFO:tasks.workunit.client.0.smithi017.stdout:4/131: truncate fc 1031177 0 2024-03-16T10:53:11.061 INFO:tasks.workunit.client.0.smithi017.stdout:4/132: dread - d15/d1d/f25 zero size 2024-03-16T10:53:11.062 INFO:tasks.workunit.client.0.smithi017.stdout:8/138: getdents d6 0 2024-03-16T10:53:11.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/96: rmdir d2/d25/d28 0 2024-03-16T10:53:11.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/97: readlink d2/d7/de/l17 0 2024-03-16T10:53:11.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/98: dread - d2/d7/f1a zero size 2024-03-16T10:53:11.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/99: dread - d2/d7/f1a zero size 2024-03-16T10:53:11.066 INFO:tasks.workunit.client.0.smithi017.stdout:2/101: getdents d4/d6 0 2024-03-16T10:53:11.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/175: rename d1/d3/de/f32 to d1/d3/f3d 0 2024-03-16T10:53:11.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/140: truncate d0/f3 5389300 0 2024-03-16T10:53:11.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/183: symlink d0/d1/d2/dc/d2f/d37/l3e 0 2024-03-16T10:53:11.074 INFO:tasks.workunit.client.0.smithi017.stdout:4/133: mkdir d15/d1d/d27 0 2024-03-16T10:53:11.075 INFO:tasks.workunit.client.0.smithi017.stdout:6/141: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.076 INFO:tasks.workunit.client.0.smithi017.stdout:8/139: mkdir d6/d7/d34 0 2024-03-16T10:53:11.076 INFO:tasks.workunit.client.0.smithi017.stdout:8/140: dread - d6/d16/f2d zero size 2024-03-16T10:53:11.077 INFO:tasks.workunit.client.0.smithi017.stdout:2/102: dread d4/d6/fa [0,4194304] 0 2024-03-16T10:53:11.077 INFO:tasks.workunit.client.0.smithi017.stdout:2/103: chown d4/dd/d1e 4001914 1 2024-03-16T10:53:11.077 INFO:tasks.workunit.client.0.smithi017.stdout:2/104: chown d4/d6/f10 5 1 2024-03-16T10:53:11.078 INFO:tasks.workunit.client.0.smithi017.stdout:2/105: chown d4/d6/f10 8399 1 2024-03-16T10:53:11.078 INFO:tasks.workunit.client.0.smithi017.stdout:2/106: fdatasync d4/d6/db/f11 0 2024-03-16T10:53:11.078 INFO:tasks.workunit.client.0.smithi017.stdout:2/107: chown d4/d6 1 1 2024-03-16T10:53:11.078 INFO:tasks.workunit.client.0.smithi017.stdout:0/100: mkdir d2/d7/de/d19/d2e 0 2024-03-16T10:53:11.079 INFO:tasks.workunit.client.0.smithi017.stdout:5/184: symlink d0/d1/d2/d2c/l3f 0 2024-03-16T10:53:11.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/141: write d6/d7/f15 [1554685,27755] 0 2024-03-16T10:53:11.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/142: chown d6/dd 4 1 2024-03-16T10:53:11.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/143: stat d6/dd/c1b 0 2024-03-16T10:53:11.081 INFO:tasks.workunit.client.0.smithi017.stdout:6/142: unlink d0/dc/c1a 0 2024-03-16T10:53:11.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/144: dread d6/d7/d11/f26 [0,4194304] 0 2024-03-16T10:53:11.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/145: chown d6/d16/d2f 972 1 2024-03-16T10:53:11.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/108: rename d4/d6/l17 to d4/l1f 0 2024-03-16T10:53:11.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/109: readlink d4/l1f 0 2024-03-16T10:53:11.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/110: fsync d4/dd/f1d 0 2024-03-16T10:53:11.089 INFO:tasks.workunit.client.0.smithi017.stdout:6/143: write d0/d9/f13 [1154337,96049] 0 2024-03-16T10:53:11.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/185: rmdir d0/d1/d3d 0 2024-03-16T10:53:11.092 INFO:tasks.workunit.client.0.smithi017.stdout:1/176: dwrite d1/d3/d16/f1a [0,4194304] 0 2024-03-16T10:53:11.092 INFO:tasks.workunit.client.0.smithi017.stdout:2/111: creat d4/d6/f20 x:0 0 0 2024-03-16T10:53:11.094 INFO:tasks.workunit.client.0.smithi017.stdout:5/186: symlink d0/d1/d2/dc/d2f/l40 0 2024-03-16T10:53:11.094 INFO:tasks.workunit.client.0.smithi017.stdout:1/177: unlink d1/d3/de/c1b 0 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/187: readlink d0/d1/la 0 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:1/178: readlink d1/d3/d16/l28 0 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/188: chown d0/c15 0 1 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/60: sync 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/189: write d0/d1/d1f/d29/f2a [5084209,108478] 0 2024-03-16T10:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:8/146: dread d6/d14/d28/f2b [0,4194304] 0 2024-03-16T10:53:11.097 INFO:tasks.workunit.client.0.smithi017.stdout:1/179: creat d1/d3/dd/d31/d35/f3e x:0 0 0 2024-03-16T10:53:11.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/61: creat d8/df/f10 x:0 0 0 2024-03-16T10:53:11.101 INFO:tasks.workunit.client.0.smithi017.stdout:4/134: dwrite d15/f19 [0,4194304] 0 2024-03-16T10:53:11.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/190: mkdir d0/d1/d2/d2c/d36/d41 0 2024-03-16T10:53:11.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/191: write d0/d1/d2/d24/f2b [493713,10176] 0 2024-03-16T10:53:11.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/192: write d0/d1/d2/f12 [6681,65697] 0 2024-03-16T10:53:11.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/147: rename d6/d7/d11 to d6/d16/d2f/d35 0 2024-03-16T10:53:11.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/148: write d6/d16/d2f/d35/f2e [81986,117646] 0 2024-03-16T10:53:11.104 INFO:tasks.workunit.client.0.smithi017.stdout:1/180: symlink d1/d3/d16/l3f 0 2024-03-16T10:53:11.105 INFO:tasks.workunit.client.0.smithi017.stdout:9/62: rmdir d8 39 2024-03-16T10:53:11.105 INFO:tasks.workunit.client.0.smithi017.stdout:9/63: chown d8/fa 723963 1 2024-03-16T10:53:11.106 INFO:tasks.workunit.client.0.smithi017.stdout:4/135: mkdir d15/d1d/d27/d28 0 2024-03-16T10:53:11.106 INFO:tasks.workunit.client.0.smithi017.stdout:5/193: write d0/d1/f16 [2907529,5642] 0 2024-03-16T10:53:11.110 INFO:tasks.workunit.client.0.smithi017.stdout:8/149: rename d6/d16/c23 to d6/c36 0 2024-03-16T10:53:11.111 INFO:tasks.workunit.client.0.smithi017.stdout:6/144: dwrite d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.112 INFO:tasks.workunit.client.0.smithi017.stdout:1/181: mknod d1/d24/c40 0 2024-03-16T10:53:11.112 INFO:tasks.workunit.client.0.smithi017.stdout:8/150: fsync d6/d7/f15 0 2024-03-16T10:53:11.112 INFO:tasks.workunit.client.0.smithi017.stdout:8/151: write d6/d7/f15 [2457385,63272] 0 2024-03-16T10:53:11.113 INFO:tasks.workunit.client.0.smithi017.stdout:9/64: creat d8/df/f11 x:0 0 0 2024-03-16T10:53:11.118 INFO:tasks.workunit.client.0.smithi017.stdout:6/145: write d0/dc/f19 [3047077,127513] 0 2024-03-16T10:53:11.118 INFO:tasks.workunit.client.0.smithi017.stdout:5/194: rename d0/d1/d13 to d0/d1/d2/dc/d2f/d37/d42 0 2024-03-16T10:53:11.118 INFO:tasks.workunit.client.0.smithi017.stdout:4/136: dwrite fc [0,4194304] 0 2024-03-16T10:53:11.121 INFO:tasks.workunit.client.0.smithi017.stdout:2/112: dwrite d4/dd/df/f19 [0,4194304] 0 2024-03-16T10:53:11.123 INFO:tasks.workunit.client.0.smithi017.stdout:1/182: creat d1/f41 x:0 0 0 2024-03-16T10:53:11.126 INFO:tasks.workunit.client.0.smithi017.stdout:8/152: rename d6/d7/c8 to d6/d7/c37 0 2024-03-16T10:53:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/153: chown f2 26673996 1 2024-03-16T10:53:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/154: chown d6/d7 1289847 1 2024-03-16T10:53:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/155: write d6/dd/f33 [664311,41622] 0 2024-03-16T10:53:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/156: readlink d6/dd/l1c 0 2024-03-16T10:53:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:5/195: dwrite d0/f9 [4194304,4194304] 0 2024-03-16T10:53:11.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/65: rename d8/cb to d8/df/c12 0 2024-03-16T10:53:11.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/66: readlink l6 0 2024-03-16T10:53:11.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/67: chown d8/fa 18559 1 2024-03-16T10:53:11.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/68: truncate d8/df/f10 236827 0 2024-03-16T10:53:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/146: getdents d0/d15 0 2024-03-16T10:53:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/147: fsync d0/d15/f1c 0 2024-03-16T10:53:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/148: dread - d0/d22/f27 zero size 2024-03-16T10:53:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/149: fsync d0/f3 0 2024-03-16T10:53:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/150: chown d0/d9/f18 143246 1 2024-03-16T10:53:11.135 INFO:tasks.workunit.client.0.smithi017.stdout:6/151: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.135 INFO:tasks.workunit.client.0.smithi017.stdout:6/152: dread - d0/d22/f27 zero size 2024-03-16T10:53:11.147 INFO:tasks.workunit.client.0.smithi017.stdout:5/196: readlink d0/lb 0 2024-03-16T10:53:11.147 INFO:tasks.workunit.client.0.smithi017.stdout:5/197: chown d0/d1/d2/ff 2237 1 2024-03-16T10:53:11.148 INFO:tasks.workunit.client.0.smithi017.stdout:9/69: rmdir d8 39 2024-03-16T10:53:11.148 INFO:tasks.workunit.client.0.smithi017.stdout:9/70: fsync f7 0 2024-03-16T10:53:11.150 INFO:tasks.workunit.client.0.smithi017.stdout:4/137: unlink d15/l18 0 2024-03-16T10:53:11.152 INFO:tasks.workunit.client.0.smithi017.stdout:6/153: mknod d0/dc/c2a 0 2024-03-16T10:53:11.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/101: rmdir d2/d7/de 39 2024-03-16T10:53:11.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/102: dread - d2/d25/f2d zero size 2024-03-16T10:53:11.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/103: mknod d2/d25/c2f 0 2024-03-16T10:53:11.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/104: chown d2/d7/f1b 0 1 2024-03-16T10:53:11.155 INFO:tasks.workunit.client.0.smithi017.stdout:5/198: mknod d0/d1/d1f/c43 0 2024-03-16T10:53:11.156 INFO:tasks.workunit.client.0.smithi017.stdout:0/105: symlink d2/d7/d24/l30 0 2024-03-16T10:53:11.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/106: readlink d2/d4/l8 0 2024-03-16T10:53:11.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/107: read d2/d4/f1c [4073298,4520] 0 2024-03-16T10:53:11.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/108: fsync d2/d4/f1d 0 2024-03-16T10:53:11.158 INFO:tasks.workunit.client.0.smithi017.stdout:1/183: rename d1/d24/c40 to d1/c42 0 2024-03-16T10:53:11.160 INFO:tasks.workunit.client.0.smithi017.stdout:6/154: dread d0/d9/f13 [0,4194304] 0 2024-03-16T10:53:11.160 INFO:tasks.workunit.client.0.smithi017.stdout:9/71: creat d8/df/f13 x:0 0 0 2024-03-16T10:53:11.165 INFO:tasks.workunit.client.0.smithi017.stdout:4/138: link f6 d15/d1d/f29 0 2024-03-16T10:53:11.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/157: rename d6/d7/f15 to d6/d16/d2f/f38 0 2024-03-16T10:53:11.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/158: chown d6/d7/lf 26 1 2024-03-16T10:53:11.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/184: creat d1/d3/de/f43 x:0 0 0 2024-03-16T10:53:11.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/185: readlink d1/l2e 0 2024-03-16T10:53:11.173 INFO:tasks.workunit.client.0.smithi017.stdout:6/155: symlink d0/d21/l2b 0 2024-03-16T10:53:11.174 INFO:tasks.workunit.client.0.smithi017.stdout:0/109: dwrite d2/d4/f6 [0,4194304] 0 2024-03-16T10:53:11.174 INFO:tasks.workunit.client.0.smithi017.stdout:4/139: creat d15/d1d/d27/f2a x:0 0 0 2024-03-16T10:53:11.176 INFO:tasks.workunit.client.0.smithi017.stdout:0/110: creat d2/d25/f31 x:0 0 0 2024-03-16T10:53:11.176 INFO:tasks.workunit.client.0.smithi017.stdout:0/111: chown d2/d7/de 190643355 1 2024-03-16T10:53:11.177 INFO:tasks.workunit.client.0.smithi017.stdout:5/199: rename d0/d1/d2/l3c to d0/d1/d2/d24/l44 0 2024-03-16T10:53:11.177 INFO:tasks.workunit.client.0.smithi017.stdout:0/112: mkdir d2/d32 0 2024-03-16T10:53:11.177 INFO:tasks.workunit.client.0.smithi017.stdout:0/113: chown d2/d7/de 14118539 1 2024-03-16T10:53:11.178 INFO:tasks.workunit.client.0.smithi017.stdout:8/159: rmdir d6/d16/d2f 39 2024-03-16T10:53:11.178 INFO:tasks.workunit.client.0.smithi017.stdout:8/160: chown d6/dd/c1b 5941312 1 2024-03-16T10:53:11.179 INFO:tasks.workunit.client.0.smithi017.stdout:0/114: creat d2/d25/f33 x:0 0 0 2024-03-16T10:53:11.181 INFO:tasks.workunit.client.0.smithi017.stdout:1/186: rename d1/d3/de/l20 to d1/d3/de/l44 0 2024-03-16T10:53:11.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/156: mkdir d0/d9/da/d2c 0 2024-03-16T10:53:11.183 INFO:tasks.workunit.client.0.smithi017.stdout:2/113: write d4/dd/df/f19 [4548076,62473] 0 2024-03-16T10:53:11.183 INFO:tasks.workunit.client.0.smithi017.stdout:4/140: symlink d15/d1d/d21/d26/l2b 0 2024-03-16T10:53:11.183 INFO:tasks.workunit.client.0.smithi017.stdout:4/141: chown d15/f1b 949 1 2024-03-16T10:53:11.183 INFO:tasks.workunit.client.0.smithi017.stdout:4/142: chown fe 22458741 1 2024-03-16T10:53:11.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/200: link d0/d1/d2/f18 d0/d1/d2/dc/f45 0 2024-03-16T10:53:11.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/201: write d0/f27 [380694,121987] 0 2024-03-16T10:53:11.190 INFO:tasks.workunit.client.0.smithi017.stdout:9/72: rename d8/c9 to d8/df/c14 0 2024-03-16T10:53:11.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/157: truncate d0/d15/f17 362561 0 2024-03-16T10:53:11.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/158: readlink d0/d15/d1f/l23 0 2024-03-16T10:53:11.193 INFO:tasks.workunit.client.0.smithi017.stdout:2/114: rmdir d4/dd 39 2024-03-16T10:53:11.193 INFO:tasks.workunit.client.0.smithi017.stdout:2/115: truncate d4/dd/df/f1b 67562 0 2024-03-16T10:53:11.196 INFO:tasks.workunit.client.0.smithi017.stdout:9/73: symlink d8/df/l15 0 2024-03-16T10:53:11.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/161: dwrite f5 [4194304,4194304] 0 2024-03-16T10:53:11.196 INFO:tasks.workunit.client.0.smithi017.stdout:7/155: sync 2024-03-16T10:53:11.196 INFO:tasks.workunit.client.0.smithi017.stdout:3/110: sync 2024-03-16T10:53:11.197 INFO:tasks.workunit.client.0.smithi017.stdout:4/143: read d15/d1d/f29 [3992892,129882] 0 2024-03-16T10:53:11.198 INFO:tasks.workunit.client.0.smithi017.stdout:6/159: mknod d0/d15/d1f/c2d 0 2024-03-16T10:53:11.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/74: symlink d8/df/l16 0 2024-03-16T10:53:11.205 INFO:tasks.workunit.client.0.smithi017.stdout:3/111: creat d8/d1b/f21 x:0 0 0 2024-03-16T10:53:11.205 INFO:tasks.workunit.client.0.smithi017.stdout:3/112: chown f7 126387 1 2024-03-16T10:53:11.205 INFO:tasks.workunit.client.0.smithi017.stdout:3/113: read - d8/f17 zero size 2024-03-16T10:53:11.206 INFO:tasks.workunit.client.0.smithi017.stdout:3/114: chown f3 1 1 2024-03-16T10:53:11.208 INFO:tasks.workunit.client.0.smithi017.stdout:4/144: creat d15/d1d/d21/f2c x:0 0 0 2024-03-16T10:53:11.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/75: dread d8/fa [0,4194304] 0 2024-03-16T10:53:11.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/76: fdatasync f7 0 2024-03-16T10:53:11.209 INFO:tasks.workunit.client.0.smithi017.stdout:1/187: dwrite d1/f18 [0,4194304] 0 2024-03-16T10:53:11.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/188: fsync d1/d3/d16/f26 0 2024-03-16T10:53:11.210 INFO:tasks.workunit.client.0.smithi017.stdout:3/115: getdents d8/da 0 2024-03-16T10:53:11.210 INFO:tasks.workunit.client.0.smithi017.stdout:3/116: fsync d8/da/db/f15 0 2024-03-16T10:53:11.212 INFO:tasks.workunit.client.0.smithi017.stdout:7/156: dwrite d7/db/d21/f29 [0,4194304] 0 2024-03-16T10:53:11.215 INFO:tasks.workunit.client.0.smithi017.stdout:1/189: mkdir d1/d3/de/d36/d45 0 2024-03-16T10:53:11.217 INFO:tasks.workunit.client.0.smithi017.stdout:3/117: mknod d8/d1b/c22 0 2024-03-16T10:53:11.219 INFO:tasks.workunit.client.0.smithi017.stdout:7/157: dread d7/db/f28 [0,4194304] 0 2024-03-16T10:53:11.219 INFO:tasks.workunit.client.0.smithi017.stdout:1/190: dread d1/f1e [0,4194304] 0 2024-03-16T10:53:11.222 INFO:tasks.workunit.client.0.smithi017.stdout:7/158: link d7/db/l2d d7/db/l37 0 2024-03-16T10:53:11.224 INFO:tasks.workunit.client.0.smithi017.stdout:1/191: symlink d1/d3/de/d36/l46 0 2024-03-16T10:53:11.226 INFO:tasks.workunit.client.0.smithi017.stdout:1/192: creat d1/f47 x:0 0 0 2024-03-16T10:53:11.226 INFO:tasks.workunit.client.0.smithi017.stdout:0/115: dwrite d2/d7/de/f27 [0,4194304] 0 2024-03-16T10:53:11.227 INFO:tasks.workunit.client.0.smithi017.stdout:1/193: unlink d1/f18 0 2024-03-16T10:53:11.231 INFO:tasks.workunit.client.0.smithi017.stdout:8/162: rename d6/d16/d2f to d6/d39 0 2024-03-16T10:53:11.232 INFO:tasks.workunit.client.0.smithi017.stdout:0/116: mknod d2/d7/de/d19/c34 0 2024-03-16T10:53:11.237 INFO:tasks.workunit.client.0.smithi017.stdout:1/194: link d1/d3/de/l11 d1/l48 0 2024-03-16T10:53:11.241 INFO:tasks.workunit.client.0.smithi017.stdout:4/145: rename l0 to d15/l2d 0 2024-03-16T10:53:11.246 INFO:tasks.workunit.client.0.smithi017.stdout:0/117: dread d2/d7/de/f27 [0,4194304] 0 2024-03-16T10:53:11.248 INFO:tasks.workunit.client.0.smithi017.stdout:0/118: creat d2/d25/d2b/f35 x:0 0 0 2024-03-16T10:53:11.248 INFO:tasks.workunit.client.0.smithi017.stdout:0/119: chown d2/d25 55 1 2024-03-16T10:53:11.248 INFO:tasks.workunit.client.0.smithi017.stdout:0/120: chown d2/d25/f2d 2007 1 2024-03-16T10:53:11.249 INFO:tasks.workunit.client.0.smithi017.stdout:8/163: dwrite d6/d14/d28/f2b [0,4194304] 0 2024-03-16T10:53:11.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/77: rename f7 to d8/f17 0 2024-03-16T10:53:11.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/78: chown d8/df/c12 3918500 1 2024-03-16T10:53:11.252 INFO:tasks.workunit.client.0.smithi017.stdout:1/195: dwrite d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:11.253 INFO:tasks.workunit.client.0.smithi017.stdout:0/121: unlink d2/d7/de/d1e/c26 0 2024-03-16T10:53:11.258 INFO:tasks.workunit.client.0.smithi017.stdout:3/118: rename d8/da/f14 to d8/da/db/f23 0 2024-03-16T10:53:11.258 INFO:tasks.workunit.client.0.smithi017.stdout:4/146: dwrite d15/f1b [0,4194304] 0 2024-03-16T10:53:11.260 INFO:tasks.workunit.client.0.smithi017.stdout:9/79: mknod d8/df/c18 0 2024-03-16T10:53:11.264 INFO:tasks.workunit.client.0.smithi017.stdout:0/122: creat d2/d7/de/d1e/f36 x:0 0 0 2024-03-16T10:53:11.264 INFO:tasks.workunit.client.0.smithi017.stdout:0/123: read - d2/f11 zero size 2024-03-16T10:53:11.266 INFO:tasks.workunit.client.0.smithi017.stdout:0/124: creat d2/d32/f37 x:0 0 0 2024-03-16T10:53:11.266 INFO:tasks.workunit.client.0.smithi017.stdout:3/119: mknod d8/d1d/c24 0 2024-03-16T10:53:11.269 INFO:tasks.workunit.client.0.smithi017.stdout:7/159: rename d7/la to d7/db/d12/l38 0 2024-03-16T10:53:11.269 INFO:tasks.workunit.client.0.smithi017.stdout:4/147: rename d15/d1d/d27/d28 to d15/d1d/d27/d28/d2e 22 2024-03-16T10:53:11.269 INFO:tasks.workunit.client.0.smithi017.stdout:0/125: rename d2/d7/d24 to d2/d7/d24/d38 22 2024-03-16T10:53:11.270 INFO:tasks.workunit.client.0.smithi017.stdout:6/160: dwrite d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:11.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/80: mknod d8/df/c19 0 2024-03-16T10:53:11.273 INFO:tasks.workunit.client.0.smithi017.stdout:3/120: symlink d8/d1d/l25 0 2024-03-16T10:53:11.273 INFO:tasks.workunit.client.0.smithi017.stdout:3/121: dread - d8/d1b/f21 zero size 2024-03-16T10:53:11.273 INFO:tasks.workunit.client.0.smithi017.stdout:3/122: fsync d8/fc 0 2024-03-16T10:53:11.273 INFO:tasks.workunit.client.0.smithi017.stdout:3/123: read d8/da/db/f15 [354056,92737] 0 2024-03-16T10:53:11.275 INFO:tasks.workunit.client.0.smithi017.stdout:7/160: unlink d7/f27 0 2024-03-16T10:53:11.277 INFO:tasks.workunit.client.0.smithi017.stdout:4/148: link d15/d1d/d21/d26/l2b d15/d1d/d27/d28/l2f 0 2024-03-16T10:53:11.277 INFO:tasks.workunit.client.0.smithi017.stdout:8/164: dwrite d6/d39/d35/f21 [0,4194304] 0 2024-03-16T10:53:11.278 INFO:tasks.workunit.client.0.smithi017.stdout:6/161: mkdir d0/d9/da/d2e 0 2024-03-16T10:53:11.279 INFO:tasks.workunit.client.0.smithi017.stdout:3/124: rename d8/d1b/f21 to d8/d1b/d1c/f26 0 2024-03-16T10:53:11.279 INFO:tasks.workunit.client.0.smithi017.stdout:1/196: dwrite d1/d3/f8 [8388608,4194304] 0 2024-03-16T10:53:11.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/197: dread d1/f1e [0,4194304] 0 2024-03-16T10:53:11.280 INFO:tasks.workunit.client.0.smithi017.stdout:7/161: creat d7/db/d21/f39 x:0 0 0 2024-03-16T10:53:11.282 INFO:tasks.workunit.client.0.smithi017.stdout:1/198: write d1/d3/dd/f1f [1691415,41497] 0 2024-03-16T10:53:11.284 INFO:tasks.workunit.client.0.smithi017.stdout:4/149: creat d15/d1d/d27/f30 x:0 0 0 2024-03-16T10:53:11.284 INFO:tasks.workunit.client.0.smithi017.stdout:4/150: fdatasync f6 0 2024-03-16T10:53:11.284 INFO:tasks.workunit.client.0.smithi017.stdout:4/151: chown fa 47669 1 2024-03-16T10:53:11.289 INFO:tasks.workunit.client.0.smithi017.stdout:6/162: rmdir d0/d21 39 2024-03-16T10:53:11.293 INFO:tasks.workunit.client.0.smithi017.stdout:8/165: dread d6/d39/d35/f21 [0,4194304] 0 2024-03-16T10:53:11.293 INFO:tasks.workunit.client.0.smithi017.stdout:7/162: creat d7/db/f3a x:0 0 0 2024-03-16T10:53:11.295 INFO:tasks.workunit.client.0.smithi017.stdout:4/152: symlink d15/d1d/d21/l31 0 2024-03-16T10:53:11.295 INFO:tasks.workunit.client.0.smithi017.stdout:4/153: fsync f7 0 2024-03-16T10:53:11.297 INFO:tasks.workunit.client.0.smithi017.stdout:0/126: dwrite d2/f23 [0,4194304] 0 2024-03-16T10:53:11.297 INFO:tasks.workunit.client.0.smithi017.stdout:6/163: creat d0/d21/d28/f2f x:0 0 0 2024-03-16T10:53:11.299 INFO:tasks.workunit.client.0.smithi017.stdout:1/199: dwrite d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:11.299 INFO:tasks.workunit.client.0.smithi017.stdout:3/125: dwrite d8/d1d/f1f [0,4194304] 0 2024-03-16T10:53:11.300 INFO:tasks.workunit.client.0.smithi017.stdout:7/163: mknod d7/c3b 0 2024-03-16T10:53:11.302 INFO:tasks.workunit.client.0.smithi017.stdout:0/127: mkdir d2/d7/de/d19/d2e/d39 0 2024-03-16T10:53:11.303 INFO:tasks.workunit.client.0.smithi017.stdout:0/128: fdatasync d2/d32/f37 0 2024-03-16T10:53:11.304 INFO:tasks.workunit.client.0.smithi017.stdout:4/154: dread fe [0,4194304] 0 2024-03-16T10:53:11.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/164: link d0/d9/f13 d0/d22/f30 0 2024-03-16T10:53:11.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/129: unlink d2/d7/d24/l30 0 2024-03-16T10:53:11.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/130: chown d2/d7/d24/d29/f2c 3595 1 2024-03-16T10:53:11.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/131: truncate d2/f23 2152650 0 2024-03-16T10:53:11.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/200: getdents d1 0 2024-03-16T10:53:11.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/201: readlink d1/d3/l2f 0 2024-03-16T10:53:11.314 INFO:tasks.workunit.client.0.smithi017.stdout:0/132: mkdir d2/d7/d24/d3a 0 2024-03-16T10:53:11.315 INFO:tasks.workunit.client.0.smithi017.stdout:7/164: rmdir d7/db/d21/d33 39 2024-03-16T10:53:11.317 INFO:tasks.workunit.client.0.smithi017.stdout:4/155: creat d15/d1d/d27/d28/f32 x:0 0 0 2024-03-16T10:53:11.317 INFO:tasks.workunit.client.0.smithi017.stdout:3/126: dwrite d8/d1b/d1c/f26 [0,4194304] 0 2024-03-16T10:53:11.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/165: link d0/cd d0/d15/c31 0 2024-03-16T10:53:11.319 INFO:tasks.workunit.client.0.smithi017.stdout:6/166: dread d0/dc/f14 [0,4194304] 0 2024-03-16T10:53:11.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/167: fsync d0/dc/f19 0 2024-03-16T10:53:11.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/168: read d0/f3 [3514050,84054] 0 2024-03-16T10:53:11.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/165: creat d7/db/d12/d1c/f3c x:0 0 0 2024-03-16T10:53:11.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/166: readlink d7/db/l2d 0 2024-03-16T10:53:11.321 INFO:tasks.workunit.client.0.smithi017.stdout:0/133: symlink d2/d4/l3b 0 2024-03-16T10:53:11.321 INFO:tasks.workunit.client.0.smithi017.stdout:1/202: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:11.321 INFO:tasks.workunit.client.0.smithi017.stdout:1/203: stat d1/d3/de 0 2024-03-16T10:53:11.322 INFO:tasks.workunit.client.0.smithi017.stdout:1/204: stat d1/d24 0 2024-03-16T10:53:11.322 INFO:tasks.workunit.client.0.smithi017.stdout:1/205: write d1/d3/f3d [358235,36672] 0 2024-03-16T10:53:11.327 INFO:tasks.workunit.client.0.smithi017.stdout:8/166: truncate d6/d14/d28/f2b 1341717 0 2024-03-16T10:53:11.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/156: stat d15/d1d/d21/d26/l2b 0 2024-03-16T10:53:11.334 INFO:tasks.workunit.client.0.smithi017.stdout:3/127: link d8/f17 d8/d1b/f27 0 2024-03-16T10:53:11.334 INFO:tasks.workunit.client.0.smithi017.stdout:0/134: dwrite d2/f12 [0,4194304] 0 2024-03-16T10:53:11.336 INFO:tasks.workunit.client.0.smithi017.stdout:6/169: creat d0/d15/d1f/f32 x:0 0 0 2024-03-16T10:53:11.336 INFO:tasks.workunit.client.0.smithi017.stdout:0/135: symlink d2/d25/d2b/l3c 0 2024-03-16T10:53:11.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/167: truncate d7/db/d12/d1c/f36 509881 0 2024-03-16T10:53:11.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/206: symlink d1/d3/d2c/l49 0 2024-03-16T10:53:11.342 INFO:tasks.workunit.client.0.smithi017.stdout:8/167: truncate d6/f13 967101 0 2024-03-16T10:53:11.343 INFO:tasks.workunit.client.0.smithi017.stdout:4/157: creat d15/d1d/d21/d26/f33 x:0 0 0 2024-03-16T10:53:11.345 INFO:tasks.workunit.client.0.smithi017.stdout:3/128: rmdir d8/d1b 39 2024-03-16T10:53:11.345 INFO:tasks.workunit.client.0.smithi017.stdout:3/129: fdatasync d8/da/fe 0 2024-03-16T10:53:11.345 INFO:tasks.workunit.client.0.smithi017.stdout:0/136: dread d2/f12 [0,4194304] 0 2024-03-16T10:53:11.348 INFO:tasks.workunit.client.0.smithi017.stdout:7/168: mknod d7/db/d12/d1c/d30/c3d 0 2024-03-16T10:53:11.349 INFO:tasks.workunit.client.0.smithi017.stdout:8/168: dread d6/d7/f17 [0,4194304] 0 2024-03-16T10:53:11.351 INFO:tasks.workunit.client.0.smithi017.stdout:1/207: rename d1/d3/l9 to d1/d3/dd/d31/d35/l4a 0 2024-03-16T10:53:11.351 INFO:tasks.workunit.client.0.smithi017.stdout:1/208: read - d1/d3/f3a zero size 2024-03-16T10:53:11.351 INFO:tasks.workunit.client.0.smithi017.stdout:1/209: write d1/d3/d16/f2a [748018,117062] 0 2024-03-16T10:53:11.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/169: mkdir d7/db/d12/d1c/d30/d3e 0 2024-03-16T10:53:11.356 INFO:tasks.workunit.client.0.smithi017.stdout:8/169: symlink d6/d14/d28/l3a 0 2024-03-16T10:53:11.358 INFO:tasks.workunit.client.0.smithi017.stdout:8/170: creat d6/f3b x:0 0 0 2024-03-16T10:53:11.359 INFO:tasks.workunit.client.0.smithi017.stdout:8/171: chown f5 4 1 2024-03-16T10:53:11.359 INFO:tasks.workunit.client.0.smithi017.stdout:8/172: chown d6/d14/f1e 662 1 2024-03-16T10:53:11.366 INFO:tasks.workunit.client.0.smithi017.stdout:3/130: dwrite d8/d1d/f1f [0,4194304] 0 2024-03-16T10:53:11.369 INFO:tasks.workunit.client.0.smithi017.stdout:3/131: symlink d8/d1d/l28 0 2024-03-16T10:53:11.370 INFO:tasks.workunit.client.0.smithi017.stdout:0/137: dwrite d2/d4/f1d [0,4194304] 0 2024-03-16T10:53:11.372 INFO:tasks.workunit.client.0.smithi017.stdout:8/173: dwrite d6/d39/f38 [0,4194304] 0 2024-03-16T10:53:11.373 INFO:tasks.workunit.client.0.smithi017.stdout:0/138: creat d2/f3d x:0 0 0 2024-03-16T10:53:11.379 INFO:tasks.workunit.client.0.smithi017.stdout:0/139: dread d2/f23 [0,4194304] 0 2024-03-16T10:53:11.379 INFO:tasks.workunit.client.0.smithi017.stdout:3/132: write d8/da/db/f23 [1880680,85766] 0 2024-03-16T10:53:11.381 INFO:tasks.workunit.client.0.smithi017.stdout:8/174: dread d6/d14/d28/f2b [0,4194304] 0 2024-03-16T10:53:11.382 INFO:tasks.workunit.client.0.smithi017.stdout:0/140: creat d2/d7/de/d19/d2e/f3e x:0 0 0 2024-03-16T10:53:11.382 INFO:tasks.workunit.client.0.smithi017.stdout:0/141: fsync d2/d7/de/f27 0 2024-03-16T10:53:11.383 INFO:tasks.workunit.client.0.smithi017.stdout:7/170: read d7/db/d12/d1c/f36 [294336,57953] 0 2024-03-16T10:53:11.385 INFO:tasks.workunit.client.0.smithi017.stdout:3/133: unlink d8/c1a 0 2024-03-16T10:53:11.385 INFO:tasks.workunit.client.0.smithi017.stdout:3/134: write d8/d1b/f27 [325659,115156] 0 2024-03-16T10:53:11.386 INFO:tasks.workunit.client.0.smithi017.stdout:1/210: dwrite d1/d3/f3a [0,4194304] 0 2024-03-16T10:53:11.388 INFO:tasks.workunit.client.0.smithi017.stdout:8/175: rename d6/d39/d35/f2e to d6/d14/d28/f3c 0 2024-03-16T10:53:11.392 INFO:tasks.workunit.client.0.smithi017.stdout:7/171: unlink d7/db/d12/f26 0 2024-03-16T10:53:11.399 INFO:tasks.workunit.client.0.smithi017.stdout:7/172: dread d7/db/dc/f17 [0,4194304] 0 2024-03-16T10:53:11.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/211: mknod d1/c4b 0 2024-03-16T10:53:11.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/212: truncate d1/f1e 1114659 0 2024-03-16T10:53:11.417 INFO:tasks.workunit.client.0.smithi017.stdout:8/176: rename d6/d39/d35/l18 to d6/d39/d35/l3d 0 2024-03-16T10:53:11.417 INFO:tasks.workunit.client.0.smithi017.stdout:8/177: chown d6/d39/f32 7480926 1 2024-03-16T10:53:11.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/135: rename f2 to d8/d1b/f29 0 2024-03-16T10:53:11.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/136: read d8/da/db/f15 [3519959,7259] 0 2024-03-16T10:53:11.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/173: creat d7/db/d12/f3f x:0 0 0 2024-03-16T10:53:11.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/174: truncate d7/db/f3a 822541 0 2024-03-16T10:53:11.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/175: chown d7/db/d32 13635866 1 2024-03-16T10:53:11.427 INFO:tasks.workunit.client.0.smithi017.stdout:1/213: getdents d1/d3/de 0 2024-03-16T10:53:11.428 INFO:tasks.workunit.client.0.smithi017.stdout:8/178: truncate f2 2429900 0 2024-03-16T10:53:11.430 INFO:tasks.workunit.client.0.smithi017.stdout:3/137: truncate d8/d1d/f1f 1549751 0 2024-03-16T10:53:11.430 INFO:tasks.workunit.client.0.smithi017.stdout:8/179: dread d6/dd/f33 [0,4194304] 0 2024-03-16T10:53:11.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/176: rename d7/db/dc/l16 to d7/db/l40 0 2024-03-16T10:53:11.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/177: write d7/db/dc/f17 [1606100,91102] 0 2024-03-16T10:53:11.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/178: fdatasync d7/db/f14 0 2024-03-16T10:53:11.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/138: link f7 d8/da/db/f2a 0 2024-03-16T10:53:11.434 INFO:tasks.workunit.client.0.smithi017.stdout:5/202: sync 2024-03-16T10:53:11.436 INFO:tasks.workunit.client.0.smithi017.stdout:8/180: unlink d6/f3b 0 2024-03-16T10:53:11.437 INFO:tasks.workunit.client.0.smithi017.stdout:8/181: fdatasync d6/d14/d28/f3c 0 2024-03-16T10:53:11.437 INFO:tasks.workunit.client.0.smithi017.stdout:8/182: write d6/d16/f2d [1022097,95893] 0 2024-03-16T10:53:11.438 INFO:tasks.workunit.client.0.smithi017.stdout:1/214: rename d1/d3/l2f to d1/d3/d16/l4c 0 2024-03-16T10:53:11.439 INFO:tasks.workunit.client.0.smithi017.stdout:3/139: symlink d8/da/l2b 0 2024-03-16T10:53:11.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/179: rename d7/db/f3a to d7/db/d12/d1c/f41 0 2024-03-16T10:53:11.446 INFO:tasks.workunit.client.0.smithi017.stdout:8/183: dread f5 [0,4194304] 0 2024-03-16T10:53:11.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/180: chown d7/db/f14 4348 1 2024-03-16T10:53:11.446 INFO:tasks.workunit.client.0.smithi017.stdout:5/203: mkdir d0/d1/d2/dc/d2f/d37/d42/d46 0 2024-03-16T10:53:11.447 INFO:tasks.workunit.client.0.smithi017.stdout:7/181: symlink d7/db/d21/d33/l42 0 2024-03-16T10:53:11.450 INFO:tasks.workunit.client.0.smithi017.stdout:7/182: creat d7/db/d21/d33/d34/f43 x:0 0 0 2024-03-16T10:53:11.450 INFO:tasks.workunit.client.0.smithi017.stdout:7/183: write f1 [4614806,24853] 0 2024-03-16T10:53:11.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/204: write d0/d1/f11 [3747035,110971] 0 2024-03-16T10:53:11.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/184: rmdir d7/db/d12/d1c/d30/d3e 0 2024-03-16T10:53:11.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/185: write d7/db/d21/f29 [4604520,88618] 0 2024-03-16T10:53:11.455 INFO:tasks.workunit.client.0.smithi017.stdout:0/142: link d2/d7/de/l13 d2/d4/l3f 0 2024-03-16T10:53:11.458 INFO:tasks.workunit.client.0.smithi017.stdout:8/184: write d6/dd/f1f [1679571,80593] 0 2024-03-16T10:53:11.458 INFO:tasks.workunit.client.0.smithi017.stdout:8/185: fdatasync d6/d14/d28/f31 0 2024-03-16T10:53:11.458 INFO:tasks.workunit.client.0.smithi017.stdout:8/186: fdatasync d6/d14/f1e 0 2024-03-16T10:53:11.459 INFO:tasks.workunit.client.0.smithi017.stdout:5/205: rename d0/d1/d2/dc/d2f/d37/d42/f20 to d0/d1/d2/d2c/d38/f47 0 2024-03-16T10:53:11.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/215: dwrite d1/d3/f29 [4194304,4194304] 0 2024-03-16T10:53:11.464 INFO:tasks.workunit.client.0.smithi017.stdout:3/140: dwrite d8/da/db/f15 [0,4194304] 0 2024-03-16T10:53:11.466 INFO:tasks.workunit.client.0.smithi017.stdout:1/216: mkdir d1/d3/de/d4d 0 2024-03-16T10:53:11.479 INFO:tasks.workunit.client.0.smithi017.stdout:0/143: dwrite d2/f12 [0,4194304] 0 2024-03-16T10:53:11.481 INFO:tasks.workunit.client.0.smithi017.stdout:0/144: creat d2/d7/d24/d29/f40 x:0 0 0 2024-03-16T10:53:11.484 INFO:tasks.workunit.client.0.smithi017.stdout:5/206: dwrite d0/d1/f16 [0,4194304] 0 2024-03-16T10:53:11.484 INFO:tasks.workunit.client.0.smithi017.stdout:5/207: write d0/d1/d2/f35 [640778,51014] 0 2024-03-16T10:53:11.486 INFO:tasks.workunit.client.0.smithi017.stdout:7/186: dwrite d7/db/dc/f17 [0,4194304] 0 2024-03-16T10:53:11.488 INFO:tasks.workunit.client.0.smithi017.stdout:8/187: dwrite d6/fe [0,4194304] 0 2024-03-16T10:53:11.488 INFO:tasks.workunit.client.0.smithi017.stdout:8/188: write d6/d14/f1e [4366781,38970] 0 2024-03-16T10:53:11.489 INFO:tasks.workunit.client.0.smithi017.stdout:5/208: rename d0/d1/d2/dc/d2f/d37/d42/c21 to d0/d1/c48 0 2024-03-16T10:53:11.490 INFO:tasks.workunit.client.0.smithi017.stdout:5/209: truncate d0/d1/d2/f35 1635245 0 2024-03-16T10:53:11.491 INFO:tasks.workunit.client.0.smithi017.stdout:8/189: fdatasync d6/dd/f1f 0 2024-03-16T10:53:11.492 INFO:tasks.workunit.client.0.smithi017.stdout:7/187: truncate d7/db/f18 160776 0 2024-03-16T10:53:11.493 INFO:tasks.workunit.client.0.smithi017.stdout:7/188: truncate d7/db/d12/f3f 23695 0 2024-03-16T10:53:11.495 INFO:tasks.workunit.client.0.smithi017.stdout:5/210: creat d0/d1/d2/dc/f49 x:0 0 0 2024-03-16T10:53:11.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/141: dwrite d8/da/db/f23 [0,4194304] 0 2024-03-16T10:53:11.497 INFO:tasks.workunit.client.0.smithi017.stdout:8/190: symlink d6/d7/l3e 0 2024-03-16T10:53:11.498 INFO:tasks.workunit.client.0.smithi017.stdout:1/217: dwrite d1/f41 [0,4194304] 0 2024-03-16T10:53:11.498 INFO:tasks.workunit.client.0.smithi017.stdout:0/145: dwrite d2/d25/d2b/f35 [0,4194304] 0 2024-03-16T10:53:11.498 INFO:tasks.workunit.client.0.smithi017.stdout:0/146: dread - d2/d7/de/d19/d2e/f3e zero size 2024-03-16T10:53:11.499 INFO:tasks.workunit.client.0.smithi017.stdout:7/189: creat d7/db/d21/d33/d34/f44 x:0 0 0 2024-03-16T10:53:11.499 INFO:tasks.workunit.client.0.smithi017.stdout:7/190: truncate d7/db/dc/ff 607443 0 2024-03-16T10:53:11.503 INFO:tasks.workunit.client.0.smithi017.stdout:8/191: rename d6/dd/f1f to d6/d7/d34/f3f 0 2024-03-16T10:53:11.504 INFO:tasks.workunit.client.0.smithi017.stdout:5/211: dread d0/f8 [0,4194304] 0 2024-03-16T10:53:11.504 INFO:tasks.workunit.client.0.smithi017.stdout:5/212: dread - d0/d1/d2/d24/f2e zero size 2024-03-16T10:53:11.504 INFO:tasks.workunit.client.0.smithi017.stdout:5/213: fdatasync d0/d1/d1f/d29/f2a 0 2024-03-16T10:53:11.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/191: dread d7/db/f14 [0,4194304] 0 2024-03-16T10:53:11.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/218: creat d1/d24/f4e x:0 0 0 2024-03-16T10:53:11.516 INFO:tasks.workunit.client.0.smithi017.stdout:0/147: dwrite d2/d7/de/f27 [0,4194304] 0 2024-03-16T10:53:11.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/192: creat d6/dd/f40 x:0 0 0 2024-03-16T10:53:11.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/193: dread - d6/dd/f40 zero size 2024-03-16T10:53:11.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/214: link d0/d1/d2/dc/d2f/d37/f39 d0/d1/d2/dc/d2f/d37/d42/f4a 0 2024-03-16T10:53:11.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/219: rename d1/d3/d2c/l49 to d1/d3/d2c/l4f 0 2024-03-16T10:53:11.524 INFO:tasks.workunit.client.0.smithi017.stdout:0/148: mknod d2/d7/de/d19/d2e/c41 0 2024-03-16T10:53:11.525 INFO:tasks.workunit.client.0.smithi017.stdout:5/215: link d0/d1/d2/ff d0/d1/d30/f4b 0 2024-03-16T10:53:11.530 INFO:tasks.workunit.client.0.smithi017.stdout:1/220: mkdir d1/d50 0 2024-03-16T10:53:11.530 INFO:tasks.workunit.client.0.smithi017.stdout:1/221: fsync d1/d3/de/d36/f39 0 2024-03-16T10:53:11.531 INFO:tasks.workunit.client.0.smithi017.stdout:5/216: mkdir d0/d1/d2/dc/d2f/d37/d42/d4c 0 2024-03-16T10:53:11.532 INFO:tasks.workunit.client.0.smithi017.stdout:0/149: rmdir d2 39 2024-03-16T10:53:11.533 INFO:tasks.workunit.client.0.smithi017.stdout:5/217: symlink d0/d1/d2/dc/d2f/l4d 0 2024-03-16T10:53:11.533 INFO:tasks.workunit.client.0.smithi017.stdout:5/218: chown d0/d1/d1f/f23 1114 1 2024-03-16T10:53:11.534 INFO:tasks.workunit.client.0.smithi017.stdout:0/150: fsync d2/f3d 0 2024-03-16T10:53:11.536 INFO:tasks.workunit.client.0.smithi017.stdout:1/222: write d1/d3/dd/f12 [672348,103444] 0 2024-03-16T10:53:11.537 INFO:tasks.workunit.client.0.smithi017.stdout:5/219: creat d0/d1/d2/dc/d2f/d37/d42/d4c/f4e x:0 0 0 2024-03-16T10:53:11.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/220: dread d0/f8 [0,4194304] 0 2024-03-16T10:53:11.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/81: sync 2024-03-16T10:53:11.542 INFO:tasks.workunit.client.0.smithi017.stdout:2/116: sync 2024-03-16T10:53:11.544 INFO:tasks.workunit.client.0.smithi017.stdout:2/117: creat d4/d6/f21 x:0 0 0 2024-03-16T10:53:11.544 INFO:tasks.workunit.client.0.smithi017.stdout:2/118: chown d4/dd/df/f15 192219460 1 2024-03-16T10:53:11.544 INFO:tasks.workunit.client.0.smithi017.stdout:1/223: write d1/d3/f3a [1392553,93938] 0 2024-03-16T10:53:11.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/119: stat d4/l1c 0 2024-03-16T10:53:11.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/120: truncate d4/d6/db/f11 4568730 0 2024-03-16T10:53:11.546 INFO:tasks.workunit.client.0.smithi017.stdout:1/224: read d1/f1e [309637,82873] 0 2024-03-16T10:53:11.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/158: sync 2024-03-16T10:53:11.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/170: sync 2024-03-16T10:53:11.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/159: stat d15/d1d/d27/d28/f32 0 2024-03-16T10:53:11.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/171: chown d0/d15/d1f/l23 2339745 1 2024-03-16T10:53:11.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/121: symlink d4/d6/l22 0 2024-03-16T10:53:11.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/122: write d4/dd/df/f15 [394378,112500] 0 2024-03-16T10:53:11.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/172: getdents d0/d9/da 0 2024-03-16T10:53:11.548 INFO:tasks.workunit.client.0.smithi017.stdout:2/123: mknod d4/c23 0 2024-03-16T10:53:11.548 INFO:tasks.workunit.client.0.smithi017.stdout:1/225: dread d1/d3/f8 [0,4194304] 0 2024-03-16T10:53:11.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/124: mkdir d4/d6/db/d24 0 2024-03-16T10:53:11.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/125: dread - d4/d6/f20 zero size 2024-03-16T10:53:11.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/126: fsync d4/dd/f1d 0 2024-03-16T10:53:11.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/226: mknod d1/d3/de/d36/d45/c51 0 2024-03-16T10:53:11.551 INFO:tasks.workunit.client.0.smithi017.stdout:6/173: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.553 INFO:tasks.workunit.client.0.smithi017.stdout:2/127: creat d4/f25 x:0 0 0 2024-03-16T10:53:11.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/128: dread d4/d6/f16 [0,4194304] 0 2024-03-16T10:53:11.555 INFO:tasks.workunit.client.0.smithi017.stdout:1/227: rmdir d1/d3/de/d36/d45 39 2024-03-16T10:53:11.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/174: unlink d0/d21/d28/f2f 0 2024-03-16T10:53:11.558 INFO:tasks.workunit.client.0.smithi017.stdout:2/129: creat d4/d6/f26 x:0 0 0 2024-03-16T10:53:11.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/130: read - d4/d6/f26 zero size 2024-03-16T10:53:11.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/131: truncate d4/dd/df/f15 767431 0 2024-03-16T10:53:11.560 INFO:tasks.workunit.client.0.smithi017.stdout:6/175: creat d0/d9/da/d2c/f33 x:0 0 0 2024-03-16T10:53:11.562 INFO:tasks.workunit.client.0.smithi017.stdout:6/176: symlink d0/d15/l34 0 2024-03-16T10:53:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:11 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:11.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:11 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:11.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/82: dwrite d8/df/f10 [0,4194304] 0 2024-03-16T10:53:11.568 INFO:tasks.workunit.client.0.smithi017.stdout:5/221: dwrite d0/d1/d2/dc/f1d [0,4194304] 0 2024-03-16T10:53:11.568 INFO:tasks.workunit.client.0.smithi017.stdout:5/222: fdatasync d0/f22 0 2024-03-16T10:53:11.570 INFO:tasks.workunit.client.0.smithi017.stdout:1/228: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:11.570 INFO:tasks.workunit.client.0.smithi017.stdout:2/132: dread d4/dd/f1d [0,4194304] 0 2024-03-16T10:53:11.571 INFO:tasks.workunit.client.0.smithi017.stdout:4/160: dwrite fe [0,4194304] 0 2024-03-16T10:53:11.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/83: unlink d8/df/c18 0 2024-03-16T10:53:11.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/84: fsync d8/df/f13 0 2024-03-16T10:53:11.576 INFO:tasks.workunit.client.0.smithi017.stdout:9/85: fdatasync d8/f17 0 2024-03-16T10:53:11.581 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:11.581 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:11.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/229: creat d1/d3/de/d36/f52 x:0 0 0 2024-03-16T10:53:11.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/230: dread d1/d3/d16/f2a [0,4194304] 0 2024-03-16T10:53:11.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/231: chown d1/d3/d16/f1a 372585 1 2024-03-16T10:53:11.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/232: write d1/d3/de/d36/f39 [752709,48569] 0 2024-03-16T10:53:11.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/233: truncate d1/d3/d16/f1a 5301349 0 2024-03-16T10:53:11.587 INFO:tasks.workunit.client.0.smithi017.stdout:6/177: dwrite d0/d9/f18 [0,4194304] 0 2024-03-16T10:53:11.587 INFO:tasks.workunit.client.0.smithi017.stdout:6/178: chown d0/d9/da/f25 12741738 1 2024-03-16T10:53:11.587 INFO:tasks.workunit.client.0.smithi017.stdout:2/133: truncate d4/f8 2748931 0 2024-03-16T10:53:11.588 INFO:tasks.workunit.client.0.smithi017.stdout:2/134: read - d4/d6/f21 zero size 2024-03-16T10:53:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:11 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:11.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:11 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:11.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/135: fsync d4/d6/f21 0 2024-03-16T10:53:11.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/136: truncate d4/d6/db/f13 913492 0 2024-03-16T10:53:11.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/137: dread - d4/d6/f26 zero size 2024-03-16T10:53:11.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/138: truncate d4/d6/f26 751233 0 2024-03-16T10:53:11.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/86: rename d8/df/f10 to d8/df/f1a 0 2024-03-16T10:53:11.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/87: chown d8/df/f13 1217 1 2024-03-16T10:53:11.593 INFO:tasks.workunit.client.0.smithi017.stdout:1/234: write d1/d3/d16/f30 [4063191,80978] 0 2024-03-16T10:53:11.595 INFO:tasks.workunit.client.0.smithi017.stdout:4/161: dwrite d15/d1d/d27/f30 [0,4194304] 0 2024-03-16T10:53:11.595 INFO:tasks.workunit.client.0.smithi017.stdout:6/179: creat d0/d9/da/d2c/f35 x:0 0 0 2024-03-16T10:53:11.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/162: creat d15/d1d/d27/d28/f34 x:0 0 0 2024-03-16T10:53:11.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/163: chown d15/c1a 54960157 1 2024-03-16T10:53:11.603 INFO:tasks.workunit.client.0.smithi017.stdout:5/223: dwrite d0/d1/d2/dc/f45 [0,4194304] 0 2024-03-16T10:53:11.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/139: dread d4/dd/df/f15 [0,4194304] 0 2024-03-16T10:53:11.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/140: chown d4/d6/db/l12 1 1 2024-03-16T10:53:11.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/141: chown d4/d6/fa 163976 1 2024-03-16T10:53:11.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/142: chown d4/l1c 591981877 1 2024-03-16T10:53:11.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/143: getdents d4/d6/db/d24 0 2024-03-16T10:53:11.610 INFO:tasks.workunit.client.0.smithi017.stdout:1/235: dwrite d1/d3/dd/f1f [0,4194304] 0 2024-03-16T10:53:11.612 INFO:tasks.workunit.client.0.smithi017.stdout:5/224: dread d0/d1/d2/dc/f1d [0,4194304] 0 2024-03-16T10:53:11.612 INFO:tasks.workunit.client.0.smithi017.stdout:5/225: chown d0/d1/d2/d24 0 1 2024-03-16T10:53:11.613 INFO:tasks.workunit.client.0.smithi017.stdout:5/226: write d0/d1/f16 [4537385,71946] 0 2024-03-16T10:53:11.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/164: unlink c3 0 2024-03-16T10:53:11.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/165: stat d15/d1d/d21 0 2024-03-16T10:53:11.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/166: write d15/d1d/f25 [244267,57788] 0 2024-03-16T10:53:11.617 INFO:tasks.workunit.client.0.smithi017.stdout:4/167: read f4 [2827021,61119] 0 2024-03-16T10:53:11.619 INFO:tasks.workunit.client.0.smithi017.stdout:1/236: rename d1/d3/f8 to d1/d3/de/d36/d45/f53 0 2024-03-16T10:53:11.619 INFO:tasks.workunit.client.0.smithi017.stdout:1/237: rename d1/d3 to d1/d3/d54 22 2024-03-16T10:53:11.620 INFO:tasks.workunit.client.0.smithi017.stdout:1/238: write d1/d3/dd/d31/d35/f38 [1041723,109820] 0 2024-03-16T10:53:11.621 INFO:tasks.workunit.client.0.smithi017.stdout:4/168: creat d15/d1d/d21/d26/f35 x:0 0 0 2024-03-16T10:53:11.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/169: creat d15/d1d/f36 x:0 0 0 2024-03-16T10:53:11.628 INFO:tasks.workunit.client.0.smithi017.stdout:5/227: dwrite d0/d1/d30/f4b [0,4194304] 0 2024-03-16T10:53:11.628 INFO:tasks.workunit.client.0.smithi017.stdout:2/144: dwrite d4/d6/f21 [0,4194304] 0 2024-03-16T10:53:11.631 INFO:tasks.workunit.client.0.smithi017.stdout:6/180: dwrite d0/dc/f14 [0,4194304] 0 2024-03-16T10:53:11.632 INFO:tasks.workunit.client.0.smithi017.stdout:5/228: mkdir d0/d1/d30/d4f 0 2024-03-16T10:53:11.632 INFO:tasks.workunit.client.0.smithi017.stdout:5/229: fsync d0/d1/d2/f18 0 2024-03-16T10:53:11.632 INFO:tasks.workunit.client.0.smithi017.stdout:5/230: readlink d0/d1/d2/dc/d2f/l4d 0 2024-03-16T10:53:11.638 INFO:tasks.workunit.client.0.smithi017.stdout:1/239: dwrite d1/d3/dd/f1f [0,4194304] 0 2024-03-16T10:53:11.639 INFO:tasks.workunit.client.0.smithi017.stdout:6/181: creat d0/d21/f36 x:0 0 0 2024-03-16T10:53:11.639 INFO:tasks.workunit.client.0.smithi017.stdout:6/182: write d0/d9/da/f25 [536480,52665] 0 2024-03-16T10:53:11.641 INFO:tasks.workunit.client.0.smithi017.stdout:5/231: creat d0/d1/d1f/f50 x:0 0 0 2024-03-16T10:53:11.642 INFO:tasks.workunit.client.0.smithi017.stdout:4/170: dwrite d15/d1d/d27/f2a [0,4194304] 0 2024-03-16T10:53:11.648 INFO:tasks.workunit.client.0.smithi017.stdout:1/240: creat d1/d3/dd/f55 x:0 0 0 2024-03-16T10:53:11.649 INFO:tasks.workunit.client.0.smithi017.stdout:6/183: mkdir d0/d9/da/d2e/d37 0 2024-03-16T10:53:11.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/171: mknod d15/d1d/d21/d26/c37 0 2024-03-16T10:53:11.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/172: chown d15/d1d/d21/d26/l2b 5 1 2024-03-16T10:53:11.656 INFO:tasks.workunit.client.0.smithi017.stdout:5/232: dwrite d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:11.661 INFO:tasks.workunit.client.0.smithi017.stdout:5/233: mkdir d0/d1/d2/d2c/d36/d51 0 2024-03-16T10:53:11.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/184: rmdir d0/d21/d28 0 2024-03-16T10:53:11.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/185: chown d0/c1 8711838 1 2024-03-16T10:53:11.665 INFO:tasks.workunit.client.0.smithi017.stdout:5/234: truncate d0/d1/d2/f35 123196 0 2024-03-16T10:53:11.665 INFO:tasks.workunit.client.0.smithi017.stdout:1/241: dwrite d1/d3/de/d36/f39 [0,4194304] 0 2024-03-16T10:53:11.666 INFO:tasks.workunit.client.0.smithi017.stdout:1/242: fdatasync d1/d3/dd/f12 0 2024-03-16T10:53:11.667 INFO:tasks.workunit.client.0.smithi017.stdout:6/186: mkdir d0/d9/d38 0 2024-03-16T10:53:11.667 INFO:tasks.workunit.client.0.smithi017.stdout:6/187: chown d0/c8 10770396 1 2024-03-16T10:53:11.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/243: dread d1/d3/f29 [0,4194304] 0 2024-03-16T10:53:11.669 INFO:tasks.workunit.client.0.smithi017.stdout:1/244: chown d1/d3/d16/f1a 130976 1 2024-03-16T10:53:11.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/235: symlink d0/d1/d2/d2c/d36/l52 0 2024-03-16T10:53:11.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/173: dwrite d15/d1d/f36 [0,4194304] 0 2024-03-16T10:53:11.673 INFO:tasks.workunit.client.0.smithi017.stdout:6/188: rmdir d0/d9/da 39 2024-03-16T10:53:11.673 INFO:tasks.workunit.client.0.smithi017.stdout:1/245: stat d1/d3/dd/l10 0 2024-03-16T10:53:11.674 INFO:tasks.workunit.client.0.smithi017.stdout:5/236: write d0/d1/d2/dc/f1d [1664586,19203] 0 2024-03-16T10:53:11.676 INFO:tasks.workunit.client.0.smithi017.stdout:6/189: mkdir d0/d21/d39 0 2024-03-16T10:53:11.678 INFO:tasks.workunit.client.0.smithi017.stdout:1/246: symlink d1/d3/l56 0 2024-03-16T10:53:11.681 INFO:tasks.workunit.client.0.smithi017.stdout:5/237: creat d0/d1/d2/dc/d2f/d37/d42/d4c/f53 x:0 0 0 2024-03-16T10:53:11.682 INFO:tasks.workunit.client.0.smithi017.stdout:1/247: mkdir d1/d3/d57 0 2024-03-16T10:53:11.683 INFO:tasks.workunit.client.0.smithi017.stdout:4/174: dwrite d15/d1d/f1e [0,4194304] 0 2024-03-16T10:53:11.684 INFO:tasks.workunit.client.0.smithi017.stdout:5/238: mknod d0/d1/c54 0 2024-03-16T10:53:11.684 INFO:tasks.workunit.client.0.smithi017.stdout:5/239: stat d0/d1/d2/l10 0 2024-03-16T10:53:11.686 INFO:tasks.workunit.client.0.smithi017.stdout:1/248: mknod d1/d3/de/d36/c58 0 2024-03-16T10:53:11.686 INFO:tasks.workunit.client.0.smithi017.stdout:1/249: readlink d1/d3/dd/l10 0 2024-03-16T10:53:11.687 INFO:tasks.workunit.client.0.smithi017.stdout:6/190: dwrite d0/d9/da/d2c/f33 [0,4194304] 0 2024-03-16T10:53:11.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/240: mkdir d0/d1/d30/d55 0 2024-03-16T10:53:11.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/241: read d0/d1/d2/f12 [671433,91179] 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/191: symlink d0/d9/da/l3a 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/192: fsync d0/d22/f27 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/193: write d0/d15/d1f/f32 [53574,71516] 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/194: stat d0/ce 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/175: read d15/d1d/d27/f30 [1301977,25920] 0 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/176: chown d15/d1d/f29 432833001 1 2024-03-16T10:53:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/177: dread - d15/d1d/d27/d28/f32 zero size 2024-03-16T10:53:11.696 INFO:tasks.workunit.client.0.smithi017.stdout:1/250: dread d1/d3/dd/f12 [4194304,4194304] 0 2024-03-16T10:53:11.698 INFO:tasks.workunit.client.0.smithi017.stdout:6/195: rmdir d0/d9/da/d2e/d37 0 2024-03-16T10:53:11.698 INFO:tasks.workunit.client.0.smithi017.stdout:6/196: write d0/d9/da/d2c/f35 [221220,40762] 0 2024-03-16T10:53:11.700 INFO:tasks.workunit.client.0.smithi017.stdout:4/178: creat d15/d1d/d27/d28/f38 x:0 0 0 2024-03-16T10:53:11.701 INFO:tasks.workunit.client.0.smithi017.stdout:6/197: symlink d0/d21/d39/l3b 0 2024-03-16T10:53:11.705 INFO:tasks.workunit.client.0.smithi017.stdout:6/198: dread d0/d22/f30 [0,4194304] 0 2024-03-16T10:53:11.706 INFO:tasks.workunit.client.0.smithi017.stdout:1/251: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:11.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/252: rmdir d1/d3/dd 39 2024-03-16T10:53:11.712 INFO:tasks.workunit.client.0.smithi017.stdout:6/199: read d0/d9/f18 [1410274,77938] 0 2024-03-16T10:53:11.725 INFO:tasks.workunit.client.0.smithi017.stdout:1/253: dwrite d1/d3/dd/d31/d35/f38 [0,4194304] 0 2024-03-16T10:53:11.729 INFO:tasks.workunit.client.0.smithi017.stdout:1/254: symlink d1/d3/d2c/l59 0 2024-03-16T10:53:11.729 INFO:tasks.workunit.client.0.smithi017.stdout:6/200: dwrite d0/d15/d1f/f32 [0,4194304] 0 2024-03-16T10:53:11.729 INFO:tasks.workunit.client.0.smithi017.stdout:6/201: write d0/d9/da/f25 [1360135,130299] 0 2024-03-16T10:53:11.732 INFO:tasks.workunit.client.0.smithi017.stdout:1/255: link d1/d3/d16/l28 d1/d3/dd/d31/d35/l5a 0 2024-03-16T10:53:11.738 INFO:tasks.workunit.client.0.smithi017.stdout:1/256: mknod d1/d3/dd/d31/d35/c5b 0 2024-03-16T10:53:11.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/257: unlink d1/c4b 0 2024-03-16T10:53:11.745 INFO:tasks.workunit.client.0.smithi017.stdout:1/258: dread d1/d3/d16/f30 [0,4194304] 0 2024-03-16T10:53:11.745 INFO:tasks.workunit.client.0.smithi017.stdout:1/259: getdents d1/d50 0 2024-03-16T10:53:11.750 INFO:tasks.workunit.client.0.smithi017.stdout:1/260: write d1/d3/dd/f1f [2567332,7562] 0 2024-03-16T10:53:11.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/202: dwrite d0/d9/f13 [4194304,4194304] 0 2024-03-16T10:53:11.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/203: write d0/d22/f27 [481152,76723] 0 2024-03-16T10:53:11.756 INFO:tasks.workunit.client.0.smithi017.stdout:6/204: creat d0/f3c x:0 0 0 2024-03-16T10:53:11.756 INFO:tasks.workunit.client.0.smithi017.stdout:6/205: readlink d0/d15/d1f/l23 0 2024-03-16T10:53:11.756 INFO:tasks.workunit.client.0.smithi017.stdout:6/206: chown d0 0 1 2024-03-16T10:53:11.759 INFO:tasks.workunit.client.0.smithi017.stdout:1/261: write d1/d3/d16/f1a [2315400,131008] 0 2024-03-16T10:53:11.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/207: truncate d0/d22/f30 4073414 0 2024-03-16T10:53:11.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/208: chown d0/d9/da/d2e 3300229 1 2024-03-16T10:53:11.765 INFO:tasks.workunit.client.0.smithi017.stdout:1/262: write d1/f34 [2220654,35438] 0 2024-03-16T10:53:11.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/209: creat d0/d15/f3d x:0 0 0 2024-03-16T10:53:11.771 INFO:tasks.workunit.client.0.smithi017.stdout:1/263: creat d1/f5c x:0 0 0 2024-03-16T10:53:11.796 INFO:tasks.workunit.client.0.smithi017.stdout:1/264: mknod d1/d3/dd/d31/c5d 0 2024-03-16T10:53:11.796 INFO:tasks.workunit.client.0.smithi017.stdout:1/265: write d1/d3/dd/f1f [4214647,53690] 0 2024-03-16T10:53:11.800 INFO:tasks.workunit.client.0.smithi017.stdout:6/210: truncate d0/d22/f30 2285890 0 2024-03-16T10:53:11.800 INFO:tasks.workunit.client.0.smithi017.stdout:6/211: fsync d0/d9/da/d2c/f33 0 2024-03-16T10:53:11.801 INFO:tasks.workunit.client.0.smithi017.stdout:1/266: getdents d1 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:1/267: symlink d1/d3/de/d36/l5e 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:1/268: write d1/d3/de/d36/d45/f53 [778191,65250] 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:1/269: chown d1/d3/d2c/l4f 0 1 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:1/270: readlink d1/d3/d16/l28 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:1/271: readlink d1/d3/d2c/l4f 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/212: dwrite d0/d9/da/d2c/f33 [0,4194304] 0 2024-03-16T10:53:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/213: write d0/dc/f19 [549073,9836] 0 2024-03-16T10:53:11.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/272: unlink d1/d3/d16/f26 0 2024-03-16T10:53:11.830 INFO:tasks.workunit.client.0.smithi017.stdout:6/214: mkdir d0/d3e 0 2024-03-16T10:53:11.835 INFO:tasks.workunit.client.0.smithi017.stdout:1/273: rmdir d1/d3/dd 39 2024-03-16T10:53:11.842 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.577+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdd [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog/ auth v1220 ap=1 f(v0 m2024-03-16T10:52:40.976107+0000 4=4+0) n(v0 rc2024-03-16T10:52:40.976107+0000 b39343 5=4+1) (inest mix) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fdd:[<0x10000000fba/watchdog v660>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000fdd:[<0x10000000fba/watchdog v1220>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:40.976107+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:40.976107+0000 b39343 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:40.976107+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:40.976107+0000 b39343 5=4+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.842 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.780+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241d [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/ auth v103 ap=1 f(v0 m2024-03-16T10:52:58.837937+0000 13=11+2) n(v1 rc2024-03-16T10:52:58.838937+0000 b100967 49=46+3) (inest lock dirty) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000241d:[<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x1000000241d:[<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.837937+0000 13=11+2)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.838937+0000 b100967 49=46+3)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.837937+0000 13=11+2)","memory_value.rstat":"n(v1 rc2024-03-16T10:52:58.838937+0000 b100967 49=46+3)","error_str":""},"return_code":0} 2024-03-16T10:53:11.842 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.780+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002439 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO auth v153 ap=1 s=589 n(v0 rc2024-03-16T10:52:58.809938+0000 b589 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002439:[<0x1000000241d/TODO v56>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002439:[<0x1000000241d/TODO v153>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.843 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.578+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010be [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap/ auth v1206 ap=1 f(v0 m2024-03-16T10:52:41.257104+0000 56=56+0) n(v0 rc2024-03-16T10:52:41.258104+0000 b1452345 57=56+1) (inest mix) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac4ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010be:[<0x10000000fba/oa_soap v662>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000010be:[<0x10000000fba/oa_soap v1206>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.257104+0000 56=56+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.258104+0000 b1452345 57=56+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.257104+0000 56=56+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:41.258104+0000 b1452345 57=56+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.843 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.578+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110b [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator/ auth v1237 ap=1 f(v0 m2024-03-16T10:52:41.451102+0000 41=40+1) n(v2 rc2024-03-16T10:52:41.453102+0000 b447520 91=89+2) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | dirtyscattered=0 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000110b:[<0x10000000fba/simulator v664>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000110b:[<0x10000000fba/simulator v1237>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.451102+0000 41=40+1)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.453102+0000 b447520 91=89+2)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.451102+0000 41=40+1)","memory_value.rstat":"n(v2 rc2024-03-16T10:52:41.453102+0000 b447520 91=89+2)","error_str":""},"return_code":0} 2024-03-16T10:53:11.843 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.781+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile auth v67 ap=1 s=990 n(v0 rc2024-03-16T10:52:58.781938+0000 b990 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241c:[<0x100000023fd/Makefile v20>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000241c:[<0x100000023fd/Makefile v67>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.843 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.781+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h auth v187 ap=1 s=1579 n(v0 rc2024-03-16T10:52:58.834937+0000 b1579 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244a:[<0x1000000241d/debug.h v90>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000244a:[<0x1000000241d/debug.h v187>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.844 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.579+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f7 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl/ auth v1208 ap=1 f(v0 m2024-03-16T10:52:41.283104+0000 19=19+0) n(v0 rc2024-03-16T10:52:41.285104+0000 b359090 20=19+1) (inest mix) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac4f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000010f7:[<0x10000000fba/ilo2_ribcl v666>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x100000010f7:[<0x10000000fba/ilo2_ribcl v1208>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.283104+0000 19=19+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.285104+0000 b359090 20=19+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.283104+0000 19=19+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:41.285104+0000 b359090 20=19+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.844 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.580+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001166 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas/ auth v1222 ap=1 f(v0 m2024-03-16T10:52:41.494102+0000 32=32+0) n(v0 rc2024-03-16T10:52:41.495102+0000 b130352 33=32+1) (inest mix) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001166:[<0x10000000fba/rtas v668>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001166:[<0x10000000fba/rtas v1222>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.494102+0000 32=32+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.495102+0000 b130352 33=32+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.494102+0000 32=32+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:41.495102+0000 b130352 33=32+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.844 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.781+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002449 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h auth v127 ap=1 s=3011 n(v0 rc2024-03-16T10:52:58.833937+0000 b3011 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002449:[<0x1000000241d/memtoy.h v88>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002449:[<0x1000000241d/memtoy.h v127>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.844 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.781+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243a [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/ auth v193 ap=1 f(v0 m2024-03-16T10:52:58.830937+0000 14=14+0) n(v0 rc2024-03-16T10:52:58.831937+0000 b3566 15=14+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463649f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000243a:[<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x1000000243a:[<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.830937+0000 14=14+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.831937+0000 b3566 15=14+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.830937+0000 14=14+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:58.831937+0000 b3566 15=14+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.844 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.582+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbb [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ auth v1235 ap=1 f(v0 m2024-03-16T10:52:40.969107+0000 30=29+1) n(v2 rc2024-03-16T10:52:40.970107+0000 b645706 34=32+2) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | dirtyscattered=0 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fbb:[<0x10000000fba/ipmi v670>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000fbb:[<0x10000000fba/ipmi v1235>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:40.969107+0000 30=29+1)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:40.970107+0000 b645706 34=32+2)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:40.969107+0000 30=29+1)","memory_value.rstat":"n(v2 rc2024-03-16T10:52:40.970107+0000 b645706 34=32+2)","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.583+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in auth v746 ap=1 s=17703 n(v0 rc2024-03-16T10:52:41.506102+0000 b17703 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b08ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118c:[<0x10000000fba/Makefile.in v654>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000118c:[<0x10000000fba/Makefile.in v746>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.583+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am auth v1172 ap=1 s=1810 n(v0 rc2024-03-16T10:52:41.508102+0000 b1810 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b08f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118d:[<0x10000000fba/Makefile.am v656>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000118d:[<0x10000000fba/Makefile.am v1172>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.782+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h auth v115 ap=1 s=898 n(v0 rc2024-03-16T10:52:58.784938+0000 b898 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241f:[<0x1000000241d/version.h v4>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000241f:[<0x1000000241d/version.h v115>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.783+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c auth v175 ap=1 s=9333 n(v0 rc2024-03-16T10:52:58.835937+0000 b9333 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244b:[<0x1000000241d/memtoy.c v92>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000244b:[<0x1000000241d/memtoy.c v175>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.783+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c auth v109 ap=1 s=21744 n(v0 rc2024-03-16T10:52:58.838937+0000 b21744 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244d:[<0x1000000241d/segment.c v96>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000244d:[<0x1000000241d/segment.c v109>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.845 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.783+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023fe [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ auth{0=1,4=1} v105 ap=1 f(v0 m2024-03-16T10:52:58.780938+0000 8=4+4) n(v1 rc2024-03-16T10:52:58.780938+0000 b54525 30=25+5) (inest mix dirty) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 dirtyscattered=1 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56463649d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000023fe:[<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x100000023fe:[<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.780938+0000 8=4+4)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.780938+0000 b54525 30=25+5)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.780938+0000 8=4+4)","memory_value.rstat":"n(v1 rc2024-03-16T10:52:58.780938+0000 b54525 30=25+5)","error_str":""},"return_code":0} 2024-03-16T10:53:11.846 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.583+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001187 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs/ auth v1214 ap=1 f(v0 m2024-03-16T10:52:41.501102+0000 4=4+0) n(v0 rc2024-03-16T10:52:41.503102+0000 b53504 5=4+1) (inest mix) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001187:[<0x10000000fba/sysfs v674>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000001187:[<0x10000000fba/sysfs v1214>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.501102+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.503102+0000 b53504 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.501102+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:41.503102+0000 b53504 5=4+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.846 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.585+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe2 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/ auth v1233 ap=1 f(v0 m2024-03-16T10:52:41.068106+0000 83=82+1) n(v2 rc2024-03-16T10:52:41.069106+0000 b746375 91=89+2) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25189 | dirtyscattered=0 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8ac56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000fe2:[<0x10000000fba/ipmidirect v672>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x10000000fe2:[<0x10000000fba/ipmidirect v1233>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.068106+0000 83=82+1)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.069106+0000 b746375 91=89+2)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.068106+0000 83=82+1)","memory_value.rstat":"n(v2 rc2024-03-16T10:52:41.069106+0000 b746375 91=89+2)","error_str":""},"return_code":0} 2024-03-16T10:53:11.846 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:11.596+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103d [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc/ auth{4=1} v1240 ap=2 RANDEPHEMERALPIN f(v0 m2024-03-16T10:52:41.195105+0000 48=47+1) n(v3 rc2024-03-16T10:52:41.196105+0000 b2560809 129=127+2) (inest sync->mix g=4) caps={25189=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x55ab8b08e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000103d:[<0x10000000fba/snmp_bc v658>,<0x10000000c2d/plugins v579>,<0x10000000204/open_hpi_testsuite v336>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(2)0x1000000103d:[<0x10000000fba/snmp_bc v1231>,<0x10000000c2d/plugins v1154>,<0x10000000204/open_hpi_testsuite v796>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:41.195105+0000 48=47+1)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:41.196105+0000 b2560809 129=127+2)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:41.195105+0000 48=47+1)","memory_value.rstat":"n(v3 rc2024-03-16T10:52:41.196105+0000 b2560809 129=127+2)","error_str":""},"return_code":0} 2024-03-16T10:53:11.847 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.784+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002420 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile auth v147 ap=1 s=1212 n(v0 rc2024-03-16T10:52:58.785938+0000 b1212 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002420:[<0x1000000241d/Makefile v6>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002420:[<0x1000000241d/Makefile v147>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.847 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.784+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002437 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README auth v99 ap=1 s=3460 n(v0 rc2024-03-16T10:52:58.806938+0000 b3460 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002437:[<0x1000000241d/README v52>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002437:[<0x1000000241d/README v99>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.847 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.784+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002421 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/ auth v191 ap=1 f(v0 m2024-03-16T10:52:58.803938+0000 21=21+0) n(v0 rc2024-03-16T10:52:58.805938+0000 b6317 22=21+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002421:[<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x10000002421:[<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.803938+0000 21=21+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.805938+0000 b6317 22=21+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.803938+0000 21=21+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:58.805938+0000 b6317 22=21+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.784+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002438 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h auth v121 ap=1 s=1795 n(v0 rc2024-03-16T10:52:58.808938+0000 b1795 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002438:[<0x1000000241d/segment.h v54>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002438:[<0x1000000241d/segment.h v121>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.785+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000244c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c auth v177 ap=1 s=29394 n(v0 rc2024-03-16T10:52:58.837937+0000 b29394 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000244c:[<0x1000000241d/commands.c v94>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000244c:[<0x1000000241d/commands.c v177>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.785+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING auth v135 ap=1 s=18069 n(v0 rc2024-03-16T10:52:58.783938+0000 b18069 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241e:[<0x1000000241d/COPYING v2>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000241e:[<0x1000000241d/COPYING v135>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.785+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh auth v95 ap=1 s=240 n(v0 rc2008-06-03T12:08:42.000000+0000 b240 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241b:[<0x100000023fe/runtests.sh v58>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000241b:[<0x100000023fe/runtests.sh v95>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.785+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002417 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog auth v105 ap=1 s=1097 n(v0 rc2024-03-16T10:52:58.777938+0000 b1097 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002417:[<0x100000023fe/ChangeLog v50>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002417:[<0x100000023fe/ChangeLog v105>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.786+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002408 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/ auth v111 ap=1 f(v0 m2024-03-16T10:52:58.770938+0000 8=8+0) n(v0 rc2024-03-16T10:52:58.771938+0000 b17486 9=8+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002408:[<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x10000002408:[<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.770938+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.771938+0000 b17486 9=8+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.770938+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:58.771938+0000 b17486 9=8+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.786+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ff [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING auth v85 ap=1 s=18069 n(v0 rc2024-03-16T10:52:58.754938+0000 b18069 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023ff:[<0x100000023fe/COPYING v2>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x100000023ff:[<0x100000023fe/COPYING v85>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.787+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002411 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/ auth v109 ap=1 f(v0 m2024-03-16T10:52:58.774938+0000 4=4+0) n(v0 rc2024-03-16T10:52:58.775938+0000 b1820 5=4+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002411:[<0x100000023fe/tools v46>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x10000002411:[<0x100000023fe/tools v109>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.774938+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.775938+0000 b1820 5=4+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.774938+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:58.775938+0000 b1820 5=4+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.787+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002440 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f auth v44 ap=1 s=371 n(v0 rc2024-03-16T10:52:58.819937+0000 b371 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002440:[<0x1000000243a/test4f v12>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002440:[<0x1000000243a/test4f v44>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.787+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002416 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README auth v65 ap=1 s=1357 n(v0 rc2024-03-16T10:52:58.776938+0000 b1357 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002416:[<0x100000023fe/README v48>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002416:[<0x100000023fe/README v65>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.788+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002400 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/ auth v113 ap=1 f(v0 m2024-03-16T10:52:58.762938+0000 7=7+0) n(v0 rc2024-03-16T10:52:58.763938+0000 b6269 8=7+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002400:[<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x10000002400:[<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.762938+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.763938+0000 b6269 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.762938+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:58.763938+0000 b6269 8=7+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.848 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.788+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8 auth v36 ap=1 s=184 n(v0 rc2024-03-16T10:52:58.818937+0000 b184 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243f:[<0x1000000243a/test1c8 v10>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000243f:[<0x1000000243a/test1c8 v36>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.789+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002447 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm auth v38 ap=1 s=135 n(v0 rc2024-03-16T10:52:58.830937+0000 b135 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002447:[<0x1000000243a/test1shm v26>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002447:[<0x1000000243a/test1shm v38>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.789+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l auth v56 ap=1 s=238 n(v0 rc2024-03-16T10:52:58.813938+0000 b238 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243c:[<0x1000000243a/test1l v4>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000243c:[<0x1000000243a/test1l v56>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.789+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002441 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l auth v40 ap=1 s=293 n(v0 rc2024-03-16T10:52:58.820937+0000 b293 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002441:[<0x1000000243a/test2l v14>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002441:[<0x1000000243a/test2l v40>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.790+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002448 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2 auth v48 ap=1 s=283 n(v0 rc2024-03-16T10:52:58.831937+0000 b283 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002448:[<0x1000000243a/test2 v28>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002448:[<0x1000000243a/test2 v48>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.790+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002444 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4 auth v52 ap=1 s=232 n(v0 rc2024-03-16T10:52:58.825937+0000 b232 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002444:[<0x1000000243a/test4 v20>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002444:[<0x1000000243a/test4 v52>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.790+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002443 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l auth v46 ap=1 s=268 n(v0 rc2024-03-16T10:52:58.823937+0000 b268 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002443:[<0x1000000243a/test3l v18>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002443:[<0x1000000243a/test3l v46>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.790+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3 auth v50 ap=1 s=262 n(v0 rc2024-03-16T10:52:58.812938+0000 b262 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243b:[<0x1000000243a/test3 v2>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000243b:[<0x1000000243a/test3 v50>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.791+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002446 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la auth v30 ap=1 s=294 n(v0 rc2024-03-16T10:52:58.828937+0000 b294 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002446:[<0x1000000243a/test1la v24>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002446:[<0x1000000243a/test1la v30>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.791+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c auth v42 ap=1 s=186 n(v0 rc2024-03-16T10:52:58.816938+0000 b186 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243e:[<0x1000000243a/test1c v8>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000243e:[<0x1000000243a/test1c v42>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.791+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f auth v54 ap=1 s=341 n(v0 rc2024-03-16T10:52:58.815938+0000 b341 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243d:[<0x1000000243a/test1f v6>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000243d:[<0x1000000243a/test1f v54>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.792+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002445 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1 auth v32 ap=1 s=190 n(v0 rc2024-03-16T10:52:58.827937+0000 b190 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002445:[<0x1000000243a/test1 v22>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002445:[<0x1000000243a/test1 v32>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.849 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.792+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002442 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m auth v34 ap=1 s=289 n(v0 rc2024-03-16T10:52:58.822937+0000 b289 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002442:[<0x1000000243a/test3-1m v16>,<0x1000000241d/Scripts v86>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002442:[<0x1000000243a/test3-1m v34>,<0x1000000241d/Scripts v193>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.850 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.792+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002430 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved auth v50 ap=1 s=286 n(v0 rc2024-03-16T10:52:58.799938+0000 b286 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002430:[<0x10000002421/test-mpm-anon-1g-interleaved v30>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002430:[<0x10000002421/test-mpm-anon-1g-interleaved v50>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.853 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.792+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002422 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m auth v54 ap=1 s=301 n(v0 rc2024-03-16T10:52:58.786938+0000 b301 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002422:[<0x10000002421/test-lazy-file-1m v2>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002422:[<0x10000002421/test-lazy-file-1m v54>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.793+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002431 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m auth v70 ap=1 s=264 n(v0 rc2024-03-16T10:52:58.800938+0000 b264 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002431:[<0x10000002421/test-mpm-file-16m v32>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002431:[<0x10000002421/test-mpm-file-16m v70>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.793+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002423 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m auth v66 ap=1 s=428 n(v0 rc2024-03-16T10:52:58.787938+0000 b428 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002423:[<0x10000002421/test-lazy-2shm-1m v4>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002423:[<0x10000002421/test-lazy-2shm-1m v66>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.793+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002435 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g auth v84 ap=1 s=226 n(v0 rc2024-03-16T10:52:58.803938+0000 b226 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002435:[<0x10000002421/test-lazy-anon-1g v40>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002435:[<0x10000002421/test-lazy-anon-1g v84>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.793+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002436 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p auth v56 ap=1 s=257 n(v0 rc2024-03-16T10:52:58.805938+0000 b257 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002436:[<0x10000002421/test-lazy-anon-1p v42>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002436:[<0x10000002421/test-lazy-anon-1p v56>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.794+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002434 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m auth v46 ap=1 s=339 n(v0 rc2024-03-16T10:52:58.802938+0000 b339 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002434:[<0x10000002421/test-mpm-2shm-1m v38>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002434:[<0x10000002421/test-mpm-2shm-1m v46>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.795+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002428 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig auth v52 ap=1 s=299 n(v0 rc2024-03-16T10:52:58.792938+0000 b299 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002428:[<0x10000002421/test-lazy-anon-8p-nomig v14>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002428:[<0x10000002421/test-lazy-anon-8p-nomig v52>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.795+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002432 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m auth v60 ap=1 s=253 n(v0 rc2008-06-03T12:08:46.000000+0000 b253 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002432:[<0x10000002421/test-mpm-file-1m v34>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002432:[<0x10000002421/test-mpm-file-1m v60>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.795+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002424 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p auth v58 ap=1 s=215 n(v0 rc2024-03-16T10:52:58.788938+0000 b215 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002424:[<0x10000002421/test-mpm-anon-1p v6>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002424:[<0x10000002421/test-mpm-anon-1p v58>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.795+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002429 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g auth v64 ap=1 s=193 n(v0 rc2024-03-16T10:52:58.793938+0000 b193 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002429:[<0x10000002421/test-mpm-anon-1g v16>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002429:[<0x10000002421/test-mpm-anon-1g v64>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.854 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.796+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch auth v68 ap=1 s=394 n(v0 rc2008-06-03T12:08:45.000000+0000 b394 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242b:[<0x10000002421/test-lazy-file-16m-touch v20>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242b:[<0x10000002421/test-lazy-file-16m-touch v68>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.796+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p auth v82 ap=1 s=304 n(v0 rc2024-03-16T10:52:58.796938+0000 b304 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242d:[<0x10000002421/test-lazy-file-8p v24>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242d:[<0x10000002421/test-lazy-file-8p v82>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.796+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002425 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p auth v80 ap=1 s=285 n(v0 rc2024-03-16T10:52:58.789938+0000 b285 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002425:[<0x10000002421/test-lazy-shm-8p v8>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002425:[<0x10000002421/test-lazy-shm-8p v80>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.796+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002427 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch auth v44 ap=1 s=324 n(v0 rc2024-03-16T10:52:58.791938+0000 b324 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002427:[<0x10000002421/test-lazy-anon-1g-touch v12>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002427:[<0x10000002421/test-lazy-anon-1g-touch v44>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.797+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p auth v72 ap=1 s=248 n(v0 rc2024-03-16T10:52:58.794938+0000 b248 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242a:[<0x10000002421/test-lazy-anon-8p v18>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242a:[<0x10000002421/test-lazy-anon-8p v72>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.797+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002426 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m auth v78 ap=1 s=316 n(v0 rc2024-03-16T10:52:58.790938+0000 b316 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002426:[<0x10000002421/test-lazy-file-16m v10>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002426:[<0x10000002421/test-lazy-file-16m v78>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.798+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002433 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p auth v62 ap=1 s=196 n(v0 rc2024-03-16T10:52:58.801938+0000 b196 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002433:[<0x10000002421/test-mpm-anon-8p v36>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002433:[<0x10000002421/test-mpm-anon-8p v62>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.798+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch auth v48 ap=1 s=472 n(v0 rc2024-03-16T10:52:58.795938+0000 b472 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242c:[<0x10000002421/test-lazy-file-1m-touch v22>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242c:[<0x10000002421/test-lazy-file-1m-touch v48>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.798+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002404 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt auth v18 ap=1 s=1336 n(v0 rc2024-03-16T10:52:58.760938+0000 b1336 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002404:[<0x10000002400/hotplug06.txt v8>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002404:[<0x10000002400/hotplug06.txt v18>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.798+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002403 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt auth v26 ap=1 s=781 n(v0 rc2024-03-16T10:52:58.759938+0000 b781 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002403:[<0x10000002400/todo.txt v6>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002403:[<0x10000002400/todo.txt v26>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.799+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002406 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt auth v16 ap=1 s=1312 n(v0 rc2024-03-16T10:52:58.762938+0000 b1312 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002406:[<0x10000002400/hotplug01.txt v12>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002406:[<0x10000002400/hotplug01.txt v16>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.799+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002407 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt auth v20 ap=1 s=1109 n(v0 rc2024-03-16T10:52:58.763938+0000 b1109 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002407:[<0x10000002400/hotplug03.txt v14>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002407:[<0x10000002400/hotplug03.txt v20>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.799+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002402 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt auth v24 ap=1 s=396 n(v0 rc2024-03-16T10:52:58.758938+0000 b396 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002402:[<0x10000002400/hotplug04.txt v4>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002402:[<0x10000002400/hotplug04.txt v24>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.855 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.799+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002401 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt auth v22 ap=1 s=794 n(v0 rc2024-03-16T10:52:58.756938+0000 b794 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002401:[<0x10000002400/hotplug05.txt v2>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002401:[<0x10000002400/hotplug05.txt v22>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.802+0000 7f0fdc022700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002418 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/ auth{0=1,4=1} v115 ap=2 RANDEPHEMERALPIN f(v0 m2024-03-16T10:52:58.779938+0000 2=2+0) n(v1 rc2024-03-16T10:52:58.780938+0000 b8187 3=2+1) (inest sync->mix g=0,4) caps={25189=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x56463649d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002418:[<0x100000023fe/include v56>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(2)0x10000002418:[<0x100000023fe/include v115>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:58.779938+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:58.780938+0000 b8187 3=2+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:58.779938+0000 2=2+0)","memory_value.rstat":"n(v1 rc2024-03-16T10:52:58.780938+0000 b8187 3=2+1)","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.802+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh auth v30 ap=1 s=2044 n(v0 rc2024-03-16T10:52:58.769938+0000 b2044 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240e:[<0x10000002408/hotplug02.sh v12>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240e:[<0x10000002408/hotplug02.sh v30>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.803+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh auth v24 ap=1 s=3718 n(v0 rc2024-03-16T10:52:58.767938+0000 b3718 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240c:[<0x10000002408/hotplug01.sh v8>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240c:[<0x10000002408/hotplug01.sh v24>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.803+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002409 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh auth v26 ap=1 s=1915 n(v0 rc2024-03-16T10:52:58.765938+0000 b1915 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002409:[<0x10000002408/hotplug06.top.sh v2>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002409:[<0x10000002408/hotplug06.top.sh v26>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v1174>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.841+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved auth v74 ap=1 s=311 n(v0 rc2024-03-16T10:52:58.797938+0000 b311 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242e:[<0x10000002421/test-lazy-anon-1g-interleaved v26>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242e:[<0x10000002421/test-lazy-anon-1g-interleaved v74>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.841+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch auth v76 ap=1 s=406 n(v0 rc2024-03-16T10:52:58.798938+0000 b406 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242f:[<0x10000002421/test-lazy-anon-8p-touch v28>,<0x1000000241d/Xpm-tests v50>,<0x100000023fd/memory_hotplug v48>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000242f:[<0x10000002421/test-lazy-anon-8p-touch v76>,<0x1000000241d/Xpm-tests v191>,<0x100000023fd/memory_hotplug v103>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.841+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh auth v18 ap=1 s=2621 n(v0 rc2024-03-16T10:52:58.768938+0000 b2621 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240d:[<0x10000002408/hotplug06.sar.sh v10>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240d:[<0x10000002408/hotplug06.sar.sh v18>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.842+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh auth v22 ap=1 s=2193 n(v0 rc2024-03-16T10:52:58.766938+0000 b2193 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240b:[<0x10000002408/hotplug07.sh v6>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240b:[<0x10000002408/hotplug07.sh v22>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.842+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002405 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt auth v28 ap=1 s=541 n(v0 rc2024-03-16T10:52:58.761938+0000 b541 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002405:[<0x10000002400/hotplug02.txt v10>,<0x100000023fe/doc v18>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002405:[<0x10000002400/hotplug02.txt v28>,<0x100000023fe/doc v113>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.842+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh auth v32 ap=1 s=1432 n(v0 rc2009-10-26T14:49:23.000000+0000 b1432 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240a:[<0x10000002408/hotplug04.sh v4>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240a:[<0x10000002408/hotplug04.sh v32>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.842+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh auth v28 ap=1 s=535 n(v0 rc2024-03-16T10:52:58.770938+0000 b535 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240f:[<0x10000002408/hotplug06.sh v14>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000240f:[<0x10000002408/hotplug06.sh v28>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.843+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002410 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh auth v20 ap=1 s=3028 n(v0 rc2024-03-16T10:52:58.771938+0000 b3028 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002410:[<0x10000002408/hotplug03.sh v16>,<0x100000023fe/functional v36>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002410:[<0x10000002408/hotplug03.sh v20>,<0x100000023fe/functional v111>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.856 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.843+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002415 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop auth v14 ap=1 s=262 n(v0 rc2024-03-16T10:52:58.775938+0000 b262 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002415:[<0x10000002411/do_kcompile_loop v8>,<0x100000023fe/tools v46>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002415:[<0x10000002411/do_kcompile_loop v14>,<0x100000023fe/tools v109>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.857 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.843+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002413 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop auth v10 ap=1 s=45 n(v0 rc2024-03-16T10:52:58.773938+0000 b45 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002413:[<0x10000002411/do_spin_loop v4>,<0x100000023fe/tools v46>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002413:[<0x10000002411/do_spin_loop v10>,<0x100000023fe/tools v109>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.857 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.843+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002414 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts auth v12 ap=1 s=1253 n(v0 rc2024-03-16T10:52:58.774938+0000 b1253 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002414:[<0x10000002411/report_proc_interrupts v6>,<0x100000023fe/tools v46>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002414:[<0x10000002411/report_proc_interrupts v12>,<0x100000023fe/tools v109>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.857 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:11.843+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002412 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop auth v16 ap=1 s=260 n(v0 rc2024-03-16T10:52:58.772938+0000 b260 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5646364f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002412:[<0x10000002411/do_disk_write_loop v2>,<0x100000023fe/tools v46>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002412:[<0x10000002411/do_disk_write_loop v16>,<0x100000023fe/tools v109>,<0x100000023fd/cpu_hotplug v105>,<0x10000001f2c/hotplug v2088>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/274: write d1/d3/de/d36/f39 [3911464,119608] 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/275: fsync d1/d3/f3d 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/276: write d1/d3/dd/f1f [1577125,60303] 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/277: creat d1/f5f x:0 0 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/278: write d1/f5f [946056,36249] 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/279: read d1/d3/f3d [302040,67952] 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/280: creat d1/d3/dd/f60 x:0 0 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:6/215: dwrite d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:6/216: symlink d0/d15/l3f 0 2024-03-16T10:53:11.858 INFO:tasks.workunit.client.0.smithi017.stdout:6/217: write d0/f3c [930818,91156] 0 2024-03-16T10:53:11.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/281: dread d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:11.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/282: rename d1/d3/d2c to d1/d50/d61 0 2024-03-16T10:53:11.863 INFO:tasks.workunit.client.0.smithi017.stdout:1/283: creat d1/d24/f62 x:0 0 0 2024-03-16T10:53:11.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/284: symlink d1/d3/l63 0 2024-03-16T10:53:11.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/285: chown d1/d3/fb 15 1 2024-03-16T10:53:11.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/286: dread - d1/d3/de/f43 zero size 2024-03-16T10:53:11.865 INFO:tasks.workunit.client.0.smithi017.stdout:6/218: dwrite d0/d9/f13 [0,4194304] 0 2024-03-16T10:53:11.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/287: rename d1/d3/d16/f2a to d1/d3/d16/f64 0 2024-03-16T10:53:11.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/219: dread d0/dc/f19 [0,4194304] 0 2024-03-16T10:53:11.872 INFO:tasks.workunit.client.0.smithi017.stdout:1/288: dread d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:11.873 INFO:tasks.workunit.client.0.smithi017.stdout:6/220: creat d0/f40 x:0 0 0 2024-03-16T10:53:11.875 INFO:tasks.workunit.client.0.smithi017.stdout:1/289: rename d1/d3/dd/d31/c5d to d1/d3/de/d36/d45/c65 0 2024-03-16T10:53:11.876 INFO:tasks.workunit.client.0.smithi017.stdout:1/290: mkdir d1/d3/dd/d31/d66 0 2024-03-16T10:53:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/291: dwrite d1/d3/dd/f55 [0,4194304] 0 2024-03-16T10:53:11.888 INFO:tasks.workunit.client.0.smithi017.stdout:1/292: mkdir d1/d3/de/d36/d67 0 2024-03-16T10:53:11.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/293: dwrite d1/d3/f29 [4194304,4194304] 0 2024-03-16T10:53:11.903 INFO:tasks.workunit.client.0.smithi017.stdout:1/294: dread d1/f1e [0,4194304] 0 2024-03-16T10:53:11.904 INFO:tasks.workunit.client.0.smithi017.stdout:1/295: read d1/d3/d16/f64 [296081,61863] 0 2024-03-16T10:53:11.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/296: mknod d1/d3/dd/d31/d66/c68 0 2024-03-16T10:53:11.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/297: truncate d1/d3/f29 8714400 0 2024-03-16T10:53:11.908 INFO:tasks.workunit.client.0.smithi017.stdout:1/298: unlink d1/d3/de/f43 0 2024-03-16T10:53:11.917 INFO:tasks.workunit.client.0.smithi017.stdout:1/299: dwrite d1/d3/dd/f60 [0,4194304] 0 2024-03-16T10:53:11.917 INFO:tasks.workunit.client.0.smithi017.stdout:1/300: fsync d1/f5f 0 2024-03-16T10:53:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:8/194: sync 2024-03-16T10:53:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/142: sync 2024-03-16T10:53:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:7/192: sync 2024-03-16T10:53:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/143: chown d8/d1b/f27 903360 1 2024-03-16T10:53:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/144: chown d8/fc 7189643 1 2024-03-16T10:53:11.934 INFO:tasks.workunit.client.0.smithi017.stdout:3/145: read d8/d1b/d1c/f26 [1306969,74909] 0 2024-03-16T10:53:11.934 INFO:tasks.workunit.client.0.smithi017.stdout:1/301: dwrite d1/d3/dd/d31/d35/f38 [0,4194304] 0 2024-03-16T10:53:11.934 INFO:tasks.workunit.client.0.smithi017.stdout:1/302: fdatasync d1/d3/dd/f60 0 2024-03-16T10:53:11.935 INFO:tasks.workunit.client.0.smithi017.stdout:8/195: creat d6/dd/f41 x:0 0 0 2024-03-16T10:53:11.937 INFO:tasks.workunit.client.0.smithi017.stdout:3/146: link d8/da/l2b d8/d1d/l2c 0 2024-03-16T10:53:11.938 INFO:tasks.workunit.client.0.smithi017.stdout:1/303: mknod d1/d3/dd/d31/d35/c69 0 2024-03-16T10:53:11.946 INFO:tasks.workunit.client.0.smithi017.stdout:8/196: dread f5 [4194304,4194304] 0 2024-03-16T10:53:11.946 INFO:tasks.workunit.client.0.smithi017.stdout:8/197: read d6/d7/d34/f3f [3650757,51673] 0 2024-03-16T10:53:11.946 INFO:tasks.workunit.client.0.smithi017.stdout:3/147: dread d8/da/db/f15 [0,4194304] 0 2024-03-16T10:53:11.946 INFO:tasks.workunit.client.0.smithi017.stdout:3/148: chown d8/f17 51 1 2024-03-16T10:53:11.948 INFO:tasks.workunit.client.0.smithi017.stdout:3/149: mkdir d8/d1d/d2d 0 2024-03-16T10:53:11.948 INFO:tasks.workunit.client.0.smithi017.stdout:3/150: write d8/fc [713624,123393] 0 2024-03-16T10:53:11.952 INFO:tasks.workunit.client.0.smithi017.stdout:8/198: dread d6/d39/f38 [0,4194304] 0 2024-03-16T10:53:11.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/199: mknod d6/d7/c42 0 2024-03-16T10:53:11.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/151: write d8/da/db/f23 [1979272,125004] 0 2024-03-16T10:53:11.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/152: readlink d8/d1d/l2c 0 2024-03-16T10:53:11.959 INFO:tasks.workunit.client.0.smithi017.stdout:3/153: rename d8/d1d/d2d to d8/d1b/d2e 0 2024-03-16T10:53:11.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/154: dread d8/fc [0,4194304] 0 2024-03-16T10:53:11.971 INFO:tasks.workunit.client.0.smithi017.stdout:8/200: dwrite d6/d39/d35/f21 [4194304,4194304] 0 2024-03-16T10:53:12.036 INFO:tasks.workunit.client.0.smithi017.stdout:1/304: dwrite d1/d3/dd/f55 [0,4194304] 0 2024-03-16T10:53:12.036 INFO:tasks.workunit.client.0.smithi017.stdout:1/305: write d1/d3/d16/f64 [1479496,129328] 0 2024-03-16T10:53:12.041 INFO:tasks.workunit.client.0.smithi017.stdout:1/306: rename d1/d24/f62 to d1/d3/de/d36/d67/f6a 0 2024-03-16T10:53:12.041 INFO:tasks.workunit.client.0.smithi017.stdout:1/307: dread - d1/d24/f4e zero size 2024-03-16T10:53:12.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/308: dwrite d1/d3/f29 [0,4194304] 0 2024-03-16T10:53:12.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/309: dread - d1/f5c zero size 2024-03-16T10:53:12.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/310: write d1/d3/d16/f1a [4404888,42479] 0 2024-03-16T10:53:12.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/311: stat d1/d3/d16/f1a 0 2024-03-16T10:53:12.074 INFO:tasks.workunit.client.0.smithi017.stdout:1/312: dwrite d1/d24/f4e [0,4194304] 0 2024-03-16T10:53:12.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/313: mknod d1/d3/dd/d31/d66/c6b 0 2024-03-16T10:53:12.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/314: stat d1/d50/d61/l3c 0 2024-03-16T10:53:12.078 INFO:tasks.workunit.client.0.smithi017.stdout:1/315: mknod d1/d3/de/d36/d67/c6c 0 2024-03-16T10:53:12.079 INFO:tasks.workunit.client.0.smithi017.stdout:1/316: rename d1/d3/de/d36/d45/f53 to d1/d3/f6d 0 2024-03-16T10:53:12.079 INFO:tasks.workunit.client.0.smithi017.stdout:1/317: write d1/d3/de/d36/d67/f6a [310039,61144] 0 2024-03-16T10:53:12.084 INFO:tasks.workunit.client.0.smithi017.stdout:1/318: dread d1/d3/f3a [0,4194304] 0 2024-03-16T10:53:12.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/319: dread d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:12.090 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:11.786+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns auth v6 ap=1 s=4249 n(v0 rc2024-03-16T10:52:58.780938+0000 b4249 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f538100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241a:[<0x10000002418/hotplug.fns v4>,<0x100000023fe/include v56>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x1000000241a:[<0x10000002418/hotplug.fns v6>,<0x100000023fe/include v115>,<0x100000023fd/cpu_hotplug v95>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:12.090 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:11.786+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002419 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns auth v8 ap=1 s=3938 n(v0 rc2008-06-03T12:08:43.000000+0000 b3938 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f538680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002419:[<0x10000002418/testsuite.fns v2>,<0x100000023fe/include v56>,<0x100000023fd/cpu_hotplug v18>,<0x10000001f2c/hotplug v364>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002419:[<0x10000002418/testsuite.fns v8>,<0x100000023fe/include v115>,<0x100000023fd/cpu_hotplug v95>,<0x10000001f2c/hotplug v454>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:12.099 INFO:tasks.workunit.client.0.smithi017.stdout:0/151: sync 2024-03-16T10:53:12.101 INFO:tasks.workunit.client.0.smithi017.stdout:0/152: link d2/d25/f33 d2/d7/d24/d3a/f42 0 2024-03-16T10:53:12.103 INFO:tasks.workunit.client.0.smithi017.stdout:1/320: dwrite d1/d3/f6d [8388608,4194304] 0 2024-03-16T10:53:12.103 INFO:tasks.workunit.client.0.smithi017.stdout:0/153: creat d2/d4/f43 x:0 0 0 2024-03-16T10:53:12.103 INFO:tasks.workunit.client.0.smithi017.stdout:0/154: rename d2/d7 to d2/d7/d44 22 2024-03-16T10:53:12.103 INFO:tasks.workunit.client.0.smithi017.stdout:0/155: chown d2/d7/de/d19/d2e/c41 40271 1 2024-03-16T10:53:12.103 INFO:tasks.workunit.client.0.smithi017.stdout:0/156: dread - d2/d7/d24/d29/f2c zero size 2024-03-16T10:53:12.107 INFO:tasks.workunit.client.0.smithi017.stdout:0/157: creat d2/d7/de/f45 x:0 0 0 2024-03-16T10:53:12.108 INFO:tasks.workunit.client.0.smithi017.stdout:0/158: link d2/d4/l8 d2/d25/l46 0 2024-03-16T10:53:12.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/321: write d1/d3/f29 [7064195,3615] 0 2024-03-16T10:53:12.109 INFO:tasks.workunit.client.0.smithi017.stdout:0/159: mknod d2/d7/d24/d3a/c47 0 2024-03-16T10:53:12.126 INFO:tasks.workunit.client.0.smithi017.stdout:1/322: dwrite d1/d3/de/d36/f39 [4194304,4194304] 0 2024-03-16T10:53:12.143 INFO:tasks.workunit.client.0.smithi017.stdout:1/323: dwrite d1/f41 [0,4194304] 0 2024-03-16T10:53:12.143 INFO:tasks.workunit.client.0.smithi017.stdout:1/324: fsync d1/d3/f3a 0 2024-03-16T10:53:12.150 INFO:tasks.workunit.client.0.smithi017.stdout:1/325: write d1/d3/f29 [486686,6478] 0 2024-03-16T10:53:12.150 INFO:tasks.workunit.client.0.smithi017.stdout:1/326: chown d1/d50/d61/l3c 12 1 2024-03-16T10:53:12.153 INFO:tasks.workunit.client.0.smithi017.stdout:1/327: rmdir d1/d3/de/d4d 0 2024-03-16T10:53:12.153 INFO:tasks.workunit.client.0.smithi017.stdout:1/328: truncate d1/d3/de/d36/f52 894141 0 2024-03-16T10:53:12.155 INFO:tasks.workunit.client.0.smithi017.stdout:1/329: truncate d1/f34 1680666 0 2024-03-16T10:53:12.157 INFO:tasks.workunit.client.0.smithi017.stdout:1/330: creat d1/d3/de/d36/d45/f6e x:0 0 0 2024-03-16T10:53:12.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/331: creat d1/d3/f6f x:0 0 0 2024-03-16T10:53:12.162 INFO:tasks.workunit.client.0.smithi017.stdout:1/332: mkdir d1/d3/dd/d31/d66/d70 0 2024-03-16T10:53:12.163 INFO:tasks.workunit.client.0.smithi017.stdout:1/333: getdents d1/d3/dd/d31/d35 0 2024-03-16T10:53:12.181 INFO:tasks.workunit.client.0.smithi017.stdout:1/334: dwrite d1/d3/f3a [0,4194304] 0 2024-03-16T10:53:12.187 INFO:tasks.workunit.client.0.smithi017.stdout:1/335: rmdir d1/d3/dd/d31/d66/d70 0 2024-03-16T10:53:12.189 INFO:tasks.workunit.client.0.smithi017.stdout:1/336: rmdir d1/d3/dd/d31 39 2024-03-16T10:53:12.192 INFO:tasks.workunit.client.0.smithi017.stdout:1/337: rename d1/d3/l56 to d1/d3/dd/d31/d35/l71 0 2024-03-16T10:53:12.202 INFO:tasks.workunit.client.0.smithi017.stdout:9/88: sync 2024-03-16T10:53:12.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/338: dwrite d1/d3/de/d36/d45/f6e [0,4194304] 0 2024-03-16T10:53:12.205 INFO:tasks.workunit.client.0.smithi017.stdout:9/89: mknod d8/c1b 0 2024-03-16T10:53:12.205 INFO:tasks.workunit.client.0.smithi017.stdout:9/90: readlink l6 0 2024-03-16T10:53:12.208 INFO:tasks.workunit.client.0.smithi017.stdout:1/339: mkdir d1/d3/dd/d72 0 2024-03-16T10:53:12.208 INFO:tasks.workunit.client.0.smithi017.stdout:1/340: write d1/f1e [1446242,126689] 0 2024-03-16T10:53:12.211 INFO:tasks.workunit.client.0.smithi017.stdout:9/91: rename d8/f17 to d8/f1c 0 2024-03-16T10:53:12.211 INFO:tasks.workunit.client.0.smithi017.stdout:9/92: dread - d8/df/f13 zero size 2024-03-16T10:53:12.213 INFO:tasks.workunit.client.0.smithi017.stdout:1/341: unlink d1/l48 0 2024-03-16T10:53:12.214 INFO:tasks.workunit.client.0.smithi017.stdout:9/93: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:12.215 INFO:tasks.workunit.client.0.smithi017.stdout:1/342: creat d1/d3/de/d36/f73 x:0 0 0 2024-03-16T10:53:12.216 INFO:tasks.workunit.client.0.smithi017.stdout:9/94: creat d8/df/f1d x:0 0 0 2024-03-16T10:53:12.222 INFO:tasks.workunit.client.0.smithi017.stdout:1/343: write d1/d3/f3a [795773,87302] 0 2024-03-16T10:53:12.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/344: getdents d1/d3/dd/d31 0 2024-03-16T10:53:12.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/345: getdents d1 0 2024-03-16T10:53:12.233 INFO:tasks.workunit.client.0.smithi017.stdout:1/346: creat d1/d3/dd/d72/f74 x:0 0 0 2024-03-16T10:53:12.236 INFO:tasks.workunit.client.0.smithi017.stdout:9/95: dwrite d8/fa [0,4194304] 0 2024-03-16T10:53:12.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/96: rename d8/df/f1d to d8/df/f1e 0 2024-03-16T10:53:12.248 INFO:tasks.workunit.client.0.smithi017.stdout:1/347: dwrite d1/f5c [0,4194304] 0 2024-03-16T10:53:12.249 INFO:tasks.workunit.client.0.smithi017.stdout:1/348: readlink d1/d3/de/d36/l5e 0 2024-03-16T10:53:12.249 INFO:tasks.workunit.client.0.smithi017.stdout:1/349: fsync d1/f34 0 2024-03-16T10:53:12.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/350: unlink d1/f1e 0 2024-03-16T10:53:12.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/97: dwrite d8/df/f1a [0,4194304] 0 2024-03-16T10:53:12.264 INFO:tasks.workunit.client.0.smithi017.stdout:1/351: dwrite d1/d3/dd/f60 [0,4194304] 0 2024-03-16T10:53:12.266 INFO:tasks.workunit.client.0.smithi017.stdout:9/98: mknod d8/c1f 0 2024-03-16T10:53:12.269 INFO:tasks.workunit.client.0.smithi017.stdout:1/352: creat d1/d3/dd/d31/d35/f75 x:0 0 0 2024-03-16T10:53:12.273 INFO:tasks.workunit.client.0.smithi017.stdout:2/145: sync 2024-03-16T10:53:12.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/242: sync 2024-03-16T10:53:12.274 INFO:tasks.workunit.client.0.smithi017.stdout:5/243: symlink d0/d1/d2/dc/l56 0 2024-03-16T10:53:12.276 INFO:tasks.workunit.client.0.smithi017.stdout:2/146: creat d4/dd/f27 x:0 0 0 2024-03-16T10:53:12.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/179: sync 2024-03-16T10:53:12.278 INFO:tasks.workunit.client.0.smithi017.stdout:5/244: mkdir d0/d1/d2/dc/d2f/d37/d57 0 2024-03-16T10:53:12.281 INFO:tasks.workunit.client.0.smithi017.stdout:2/147: truncate d4/dd/f1d 976087 0 2024-03-16T10:53:12.283 INFO:tasks.workunit.client.0.smithi017.stdout:4/180: mknod d15/d1d/d21/c39 0 2024-03-16T10:53:12.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/99: dwrite d8/df/f1e [0,4194304] 0 2024-03-16T10:53:12.285 INFO:tasks.workunit.client.0.smithi017.stdout:5/245: creat d0/d1/d2/dc/d2f/f58 x:0 0 0 2024-03-16T10:53:12.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/148: mkdir d4/dd/d1e/d28 0 2024-03-16T10:53:12.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/181: rmdir d15/d1d 39 2024-03-16T10:53:12.288 INFO:tasks.workunit.client.0.smithi017.stdout:4/182: readlink d15/d1d/d21/l31 0 2024-03-16T10:53:12.296 INFO:tasks.workunit.client.0.smithi017.stdout:9/100: truncate d8/fa 262135 0 2024-03-16T10:53:12.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/246: rename d0/d1/d1f/f23 to d0/d1/d30/d55/f59 0 2024-03-16T10:53:12.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/149: mkdir d4/dd/d1e/d28/d29 0 2024-03-16T10:53:12.303 INFO:tasks.workunit.client.0.smithi017.stdout:4/183: creat d15/d1d/d27/d28/f3a x:0 0 0 2024-03-16T10:53:12.304 INFO:tasks.workunit.client.0.smithi017.stdout:0/160: sync 2024-03-16T10:53:12.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/221: sync 2024-03-16T10:53:12.304 INFO:tasks.workunit.client.0.smithi017.stdout:8/201: sync 2024-03-16T10:53:12.304 INFO:tasks.workunit.client.0.smithi017.stdout:3/155: sync 2024-03-16T10:53:12.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/193: sync 2024-03-16T10:53:12.306 INFO:tasks.workunit.client.0.smithi017.stdout:9/101: rename d8/c1b to d8/df/c20 0 2024-03-16T10:53:12.306 INFO:tasks.workunit.client.0.smithi017.stdout:9/102: dread - d8/df/f11 zero size 2024-03-16T10:53:12.307 INFO:tasks.workunit.client.0.smithi017.stdout:5/247: getdents d0/d1/d2/dc 0 2024-03-16T10:53:12.309 INFO:tasks.workunit.client.0.smithi017.stdout:6/222: mkdir d0/d9/da/d2c/d41 0 2024-03-16T10:53:12.312 INFO:tasks.workunit.client.0.smithi017.stdout:5/248: creat d0/d1/d2/f5a x:0 0 0 2024-03-16T10:53:12.314 INFO:tasks.workunit.client.0.smithi017.stdout:2/150: dwrite d4/dd/f14 [0,4194304] 0 2024-03-16T10:53:12.317 INFO:tasks.workunit.client.0.smithi017.stdout:2/151: getdents d4/dd 0 2024-03-16T10:53:12.318 INFO:tasks.workunit.client.0.smithi017.stdout:2/152: dread d4/d6/f16 [0,4194304] 0 2024-03-16T10:53:12.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/223: dread d0/d9/da/f25 [0,4194304] 0 2024-03-16T10:53:12.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/224: dread - d0/d15/f3d zero size 2024-03-16T10:53:12.320 INFO:tasks.workunit.client.0.smithi017.stdout:8/202: dread d6/d7/fa [0,4194304] 0 2024-03-16T10:53:12.320 INFO:tasks.workunit.client.0.smithi017.stdout:2/153: rename d4/l1c to d4/l2a 0 2024-03-16T10:53:12.321 INFO:tasks.workunit.client.0.smithi017.stdout:5/249: dread d0/f9 [4194304,4194304] 0 2024-03-16T10:53:12.322 INFO:tasks.workunit.client.0.smithi017.stdout:6/225: mknod d0/d22/c42 0 2024-03-16T10:53:12.324 INFO:tasks.workunit.client.0.smithi017.stdout:5/250: truncate d0/f8 2830468 0 2024-03-16T10:53:12.327 INFO:tasks.workunit.client.0.smithi017.stdout:5/251: mknod d0/d1/d2/c5b 0 2024-03-16T10:53:12.327 INFO:tasks.workunit.client.0.smithi017.stdout:4/184: dwrite d15/f1f [0,4194304] 0 2024-03-16T10:53:12.327 INFO:tasks.workunit.client.0.smithi017.stdout:7/194: dwrite d7/db/d12/d1c/f3c [0,4194304] 0 2024-03-16T10:53:12.334 INFO:tasks.workunit.client.0.smithi017.stdout:4/185: creat d15/d1d/d27/f3b x:0 0 0 2024-03-16T10:53:12.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/154: dwrite d4/d6/db/f11 [4194304,4194304] 0 2024-03-16T10:53:12.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/103: getdents d8 0 2024-03-16T10:53:12.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/104: chown d8/df/f1e 28 1 2024-03-16T10:53:12.335 INFO:tasks.workunit.client.0.smithi017.stdout:2/155: read d4/d6/db/f13 [30684,46787] 0 2024-03-16T10:53:12.335 INFO:tasks.workunit.client.0.smithi017.stdout:2/156: chown d4/d6/db 22 1 2024-03-16T10:53:12.339 INFO:tasks.workunit.client.0.smithi017.stdout:5/252: dwrite d0/d1/d2/dc/d2f/d37/d42/d4c/f53 [0,4194304] 0 2024-03-16T10:53:12.340 INFO:tasks.workunit.client.0.smithi017.stdout:5/253: fdatasync d0/d1/d2/ff 0 2024-03-16T10:53:12.340 INFO:tasks.workunit.client.0.smithi017.stdout:5/254: write d0/d1/d2/f35 [182122,107245] 0 2024-03-16T10:53:12.340 INFO:tasks.workunit.client.0.smithi017.stdout:5/255: chown d0/d1/d30/d55/f59 709308 1 2024-03-16T10:53:12.340 INFO:tasks.workunit.client.0.smithi017.stdout:7/195: rename d7/db/d21 to d7/db/d45 0 2024-03-16T10:53:12.342 INFO:tasks.workunit.client.0.smithi017.stdout:9/105: unlink d8/df/f1e 0 2024-03-16T10:53:12.342 INFO:tasks.workunit.client.0.smithi017.stdout:9/106: stat d8/df/c19 0 2024-03-16T10:53:12.342 INFO:tasks.workunit.client.0.smithi017.stdout:9/107: fdatasync d8/f1c 0 2024-03-16T10:53:12.345 INFO:tasks.workunit.client.0.smithi017.stdout:2/157: symlink d4/dd/l2b 0 2024-03-16T10:53:12.346 INFO:tasks.workunit.client.0.smithi017.stdout:5/256: dread d0/d1/d30/f4b [0,4194304] 0 2024-03-16T10:53:12.346 INFO:tasks.workunit.client.0.smithi017.stdout:2/158: dread d4/dd/df/f1b [0,4194304] 0 2024-03-16T10:53:12.346 INFO:tasks.workunit.client.0.smithi017.stdout:5/257: fdatasync d0/d1/f16 0 2024-03-16T10:53:12.349 INFO:tasks.workunit.client.0.smithi017.stdout:5/258: dread d0/d1/d2/f12 [0,4194304] 0 2024-03-16T10:53:12.349 INFO:tasks.workunit.client.0.smithi017.stdout:4/186: dwrite fe [0,4194304] 0 2024-03-16T10:53:12.350 INFO:tasks.workunit.client.0.smithi017.stdout:7/196: link d7/db/dc/ff d7/db/d45/f46 0 2024-03-16T10:53:12.351 INFO:tasks.workunit.client.0.smithi017.stdout:9/108: write d8/df/f1a [811333,53799] 0 2024-03-16T10:53:12.351 INFO:tasks.workunit.client.0.smithi017.stdout:9/109: readlink d8/df/l15 0 2024-03-16T10:53:12.352 INFO:tasks.workunit.client.0.smithi017.stdout:4/187: mkdir d15/d1d/d21/d3c 0 2024-03-16T10:53:12.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/110: write d8/f1c [807098,37185] 0 2024-03-16T10:53:12.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/197: creat d7/db/d45/d33/d34/f47 x:0 0 0 2024-03-16T10:53:12.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/198: fdatasync d7/db/d12/d1c/f41 0 2024-03-16T10:53:12.355 INFO:tasks.workunit.client.0.smithi017.stdout:9/111: rename d8/df/c19 to d8/df/c21 0 2024-03-16T10:53:12.355 INFO:tasks.workunit.client.0.smithi017.stdout:9/112: write d8/df/f11 [622781,20275] 0 2024-03-16T10:53:12.355 INFO:tasks.workunit.client.0.smithi017.stdout:9/113: dread - d8/df/f13 zero size 2024-03-16T10:53:12.356 INFO:tasks.workunit.client.0.smithi017.stdout:9/114: write d8/df/f11 [588670,57062] 0 2024-03-16T10:53:12.356 INFO:tasks.workunit.client.0.smithi017.stdout:2/159: write d4/d6/db/f11 [7305533,128599] 0 2024-03-16T10:53:12.356 INFO:tasks.workunit.client.0.smithi017.stdout:7/199: mknod d7/db/d32/c48 0 2024-03-16T10:53:12.361 INFO:tasks.workunit.client.0.smithi017.stdout:9/115: dread d8/df/f11 [0,4194304] 0 2024-03-16T10:53:12.361 INFO:tasks.workunit.client.0.smithi017.stdout:9/116: write d8/df/f13 [767744,117541] 0 2024-03-16T10:53:12.364 INFO:tasks.workunit.client.0.smithi017.stdout:4/188: write d15/d1d/f36 [1667628,66974] 0 2024-03-16T10:53:12.364 INFO:tasks.workunit.client.0.smithi017.stdout:4/189: dread - d15/d1d/d21/d26/f35 zero size 2024-03-16T10:53:12.367 INFO:tasks.workunit.client.0.smithi017.stdout:2/160: dread d4/d6/f10 [0,4194304] 0 2024-03-16T10:53:12.368 INFO:tasks.workunit.client.0.smithi017.stdout:9/117: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:12.368 INFO:tasks.workunit.client.0.smithi017.stdout:4/190: getdents d15/d1d/d27 0 2024-03-16T10:53:12.368 INFO:tasks.workunit.client.0.smithi017.stdout:4/191: fsync fe 0 2024-03-16T10:53:12.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/200: dwrite d7/db/dc/f17 [4194304,4194304] 0 2024-03-16T10:53:12.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/201: chown d7/db/d45/f29 1 1 2024-03-16T10:53:12.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/161: rename d2/f3d to d2/d7/de/d19/d2e/f48 0 2024-03-16T10:53:12.378 INFO:tasks.workunit.client.0.smithi017.stdout:0/162: mknod d2/d7/d24/c49 0 2024-03-16T10:53:12.380 INFO:tasks.workunit.client.0.smithi017.stdout:0/163: truncate d2/d25/d2b/f35 1522629 0 2024-03-16T10:53:12.383 INFO:tasks.workunit.client.0.smithi017.stdout:8/203: rename d6/d14/d28 to d6/d7/d43 0 2024-03-16T10:53:12.383 INFO:tasks.workunit.client.0.smithi017.stdout:5/259: rename d0 to d0/d1/d2/dc/d2f/d37/d57/d5c 22 2024-03-16T10:53:12.383 INFO:tasks.workunit.client.0.smithi017.stdout:5/260: stat d0/d1/d2/d2c/d36/d41 0 2024-03-16T10:53:12.385 INFO:tasks.workunit.client.0.smithi017.stdout:8/204: write d6/d7/d43/f2b [710656,57841] 0 2024-03-16T10:53:12.386 INFO:tasks.workunit.client.0.smithi017.stdout:9/118: rename d8/c1f to d8/df/c22 0 2024-03-16T10:53:12.386 INFO:tasks.workunit.client.0.smithi017.stdout:4/192: dwrite d15/d1d/d27/f30 [0,4194304] 0 2024-03-16T10:53:12.390 INFO:tasks.workunit.client.0.smithi017.stdout:4/193: creat d15/d1d/f3d x:0 0 0 2024-03-16T10:53:12.392 INFO:tasks.workunit.client.0.smithi017.stdout:5/261: mkdir d0/d5d 0 2024-03-16T10:53:12.392 INFO:tasks.workunit.client.0.smithi017.stdout:5/262: write d0/d1/d2/d2c/d38/f3b [934412,21808] 0 2024-03-16T10:53:12.393 INFO:tasks.workunit.client.0.smithi017.stdout:4/194: creat d15/d1d/d27/f3e x:0 0 0 2024-03-16T10:53:12.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/263: rename d0/d1/d2/dc/d2f/d37/f39 to d0/d1/d1f/d29/f5e 0 2024-03-16T10:53:12.397 INFO:tasks.workunit.client.0.smithi017.stdout:5/264: getdents d0/d1 0 2024-03-16T10:53:12.399 INFO:tasks.workunit.client.0.smithi017.stdout:4/195: link d15/l16 d15/d1d/d27/d28/l3f 0 2024-03-16T10:53:12.399 INFO:tasks.workunit.client.0.smithi017.stdout:4/196: chown d15/d1d/d27/d28/f38 28 1 2024-03-16T10:53:12.401 INFO:tasks.workunit.client.0.smithi017.stdout:9/119: link d8/df/c21 d8/df/c23 0 2024-03-16T10:53:12.401 INFO:tasks.workunit.client.0.smithi017.stdout:8/205: dwrite d6/d16/f2d [0,4194304] 0 2024-03-16T10:53:12.401 INFO:tasks.workunit.client.0.smithi017.stdout:5/265: mknod d0/d1/d2/c5f 0 2024-03-16T10:53:12.402 INFO:tasks.workunit.client.0.smithi017.stdout:4/197: mkdir d15/d1d/d27/d28/d40 0 2024-03-16T10:53:12.404 INFO:tasks.workunit.client.0.smithi017.stdout:8/206: dread f2 [0,4194304] 0 2024-03-16T10:53:12.405 INFO:tasks.workunit.client.0.smithi017.stdout:8/207: dread d6/d39/d35/f26 [0,4194304] 0 2024-03-16T10:53:12.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/266: creat d0/d1/d2/d2c/f60 x:0 0 0 2024-03-16T10:53:12.414 INFO:tasks.workunit.client.0.smithi017.stdout:8/208: dwrite d6/d14/f1e [0,4194304] 0 2024-03-16T10:53:12.414 INFO:tasks.workunit.client.0.smithi017.stdout:8/209: fsync d6/d7/d43/f31 0 2024-03-16T10:53:12.417 INFO:tasks.workunit.client.0.smithi017.stdout:5/267: creat d0/d1/d2/d2c/d38/f61 x:0 0 0 2024-03-16T10:53:12.418 INFO:tasks.workunit.client.0.smithi017.stdout:4/198: symlink d15/l41 0 2024-03-16T10:53:12.421 INFO:tasks.workunit.client.0.smithi017.stdout:8/210: mknod d6/d39/d35/c44 0 2024-03-16T10:53:12.425 INFO:tasks.workunit.client.0.smithi017.stdout:9/120: getdents d8 0 2024-03-16T10:53:12.425 INFO:tasks.workunit.client.0.smithi017.stdout:9/121: chown d8/df/ce 16087097 1 2024-03-16T10:53:12.426 INFO:tasks.workunit.client.0.smithi017.stdout:5/268: write d0/d1/d2/dc/f45 [3140602,82177] 0 2024-03-16T10:53:12.427 INFO:tasks.workunit.client.0.smithi017.stdout:8/211: rename d6/d39/d35/c24 to d6/d7/d43/c45 0 2024-03-16T10:53:12.429 INFO:tasks.workunit.client.0.smithi017.stdout:4/199: dwrite d15/f1f [0,4194304] 0 2024-03-16T10:53:12.429 INFO:tasks.workunit.client.0.smithi017.stdout:5/269: creat d0/d1/d2/d2c/d36/d41/f62 x:0 0 0 2024-03-16T10:53:12.430 INFO:tasks.workunit.client.0.smithi017.stdout:8/212: getdents d6/d14 0 2024-03-16T10:53:12.432 INFO:tasks.workunit.client.0.smithi017.stdout:5/270: symlink d0/d1/d2/l63 0 2024-03-16T10:53:12.434 INFO:tasks.workunit.client.0.smithi017.stdout:9/122: dwrite d8/df/f1a [4194304,4194304] 0 2024-03-16T10:53:12.434 INFO:tasks.workunit.client.0.smithi017.stdout:9/123: chown d8/df/c23 11187 1 2024-03-16T10:53:12.435 INFO:tasks.workunit.client.0.smithi017.stdout:9/124: read d8/df/f11 [162608,72470] 0 2024-03-16T10:53:12.435 INFO:tasks.workunit.client.0.smithi017.stdout:8/213: read d6/d7/f17 [3435176,10897] 0 2024-03-16T10:53:12.437 INFO:tasks.workunit.client.0.smithi017.stdout:5/271: rmdir d0/d1/d1f 39 2024-03-16T10:53:12.437 INFO:tasks.workunit.client.0.smithi017.stdout:4/200: write f14 [1392685,47953] 0 2024-03-16T10:53:12.439 INFO:tasks.workunit.client.0.smithi017.stdout:9/125: creat d8/f24 x:0 0 0 2024-03-16T10:53:12.439 INFO:tasks.workunit.client.0.smithi017.stdout:9/126: write d8/f1c [1431920,70682] 0 2024-03-16T10:53:12.439 INFO:tasks.workunit.client.0.smithi017.stdout:9/127: write d8/df/f11 [833260,82190] 0 2024-03-16T10:53:12.441 INFO:tasks.workunit.client.0.smithi017.stdout:5/272: creat d0/d1/d2/dc/d2f/d37/f64 x:0 0 0 2024-03-16T10:53:12.443 INFO:tasks.workunit.client.0.smithi017.stdout:8/214: write d6/fe [32980,11357] 0 2024-03-16T10:53:12.446 INFO:tasks.workunit.client.0.smithi017.stdout:8/215: rename d6/d7/d43/f31 to d6/d7/d43/f46 0 2024-03-16T10:53:12.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/128: dread d8/df/f11 [0,4194304] 0 2024-03-16T10:53:12.446 INFO:tasks.workunit.client.0.smithi017.stdout:4/201: write d15/d1d/f1e [244342,71260] 0 2024-03-16T10:53:12.450 INFO:tasks.workunit.client.0.smithi017.stdout:9/129: fdatasync d8/f1c 0 2024-03-16T10:53:12.454 INFO:tasks.workunit.client.0.smithi017.stdout:5/273: dwrite d0/d1/d2/d24/f2e [0,4194304] 0 2024-03-16T10:53:12.454 INFO:tasks.workunit.client.0.smithi017.stdout:5/274: getdents d0/d1/d2/dc 0 2024-03-16T10:53:12.463 INFO:tasks.workunit.client.0.smithi017.stdout:5/275: unlink d0/d1/d2/dc/d2f/f58 0 2024-03-16T10:53:12.463 INFO:tasks.workunit.client.0.smithi017.stdout:5/276: chown d0/d1/d2/dc/f45 124193 1 2024-03-16T10:53:12.463 INFO:tasks.workunit.client.0.smithi017.stdout:8/216: dwrite d6/fe [0,4194304] 0 2024-03-16T10:53:12.465 INFO:tasks.workunit.client.0.smithi017.stdout:9/130: fsync d8/f24 0 2024-03-16T10:53:12.465 INFO:tasks.workunit.client.0.smithi017.stdout:4/202: dwrite f7 [0,4194304] 0 2024-03-16T10:53:12.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/203: read - d15/d1d/d27/d28/f32 zero size 2024-03-16T10:53:12.482 INFO:tasks.workunit.client.0.smithi017.stdout:9/131: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:12.482 INFO:tasks.workunit.client.0.smithi017.stdout:9/132: rename d8/df to d8/df/d25 22 2024-03-16T10:53:12.482 INFO:tasks.workunit.client.0.smithi017.stdout:9/133: stat d8/df/l16 0 2024-03-16T10:53:12.486 INFO:tasks.workunit.client.0.smithi017.stdout:9/134: link l6 d8/l26 0 2024-03-16T10:53:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:8/217: dwrite d6/dd/f33 [0,4194304] 0 2024-03-16T10:53:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:5/277: dwrite d0/d1/d2/d2c/d38/f47 [0,4194304] 0 2024-03-16T10:53:12.488 INFO:tasks.workunit.client.0.smithi017.stdout:9/135: rename d8/df/l16 to d8/l27 0 2024-03-16T10:53:12.492 INFO:tasks.workunit.client.0.smithi017.stdout:8/218: creat d6/d39/d35/f47 x:0 0 0 2024-03-16T10:53:12.492 INFO:tasks.workunit.client.0.smithi017.stdout:8/219: chown d6/d7/d43 256 1 2024-03-16T10:53:12.492 INFO:tasks.workunit.client.0.smithi017.stdout:8/220: write d6/d7/d43/f46 [1028202,28444] 0 2024-03-16T10:53:12.493 INFO:tasks.workunit.client.0.smithi017.stdout:4/204: dwrite d15/d1d/d21/d26/f35 [0,4194304] 0 2024-03-16T10:53:12.493 INFO:tasks.workunit.client.0.smithi017.stdout:4/205: dread - d15/f17 zero size 2024-03-16T10:53:12.495 INFO:tasks.workunit.client.0.smithi017.stdout:5/278: creat d0/d1/f65 x:0 0 0 2024-03-16T10:53:12.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/136: mknod d8/c28 0 2024-03-16T10:53:12.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/137: fsync d8/fa 0 2024-03-16T10:53:12.500 INFO:tasks.workunit.client.0.smithi017.stdout:8/221: creat d6/d16/f48 x:0 0 0 2024-03-16T10:53:12.500 INFO:tasks.workunit.client.0.smithi017.stdout:8/222: write d6/d39/d35/f47 [32530,339] 0 2024-03-16T10:53:12.501 INFO:tasks.workunit.client.0.smithi017.stdout:9/138: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:12.506 INFO:tasks.workunit.client.0.smithi017.stdout:4/206: creat d15/d1d/d21/d26/f42 x:0 0 0 2024-03-16T10:53:12.508 INFO:tasks.workunit.client.0.smithi017.stdout:5/279: dwrite d0/d1/d2/dc/d2f/d37/d42/f4a [0,4194304] 0 2024-03-16T10:53:12.508 INFO:tasks.workunit.client.0.smithi017.stdout:8/223: creat d6/d16/f49 x:0 0 0 2024-03-16T10:53:12.508 INFO:tasks.workunit.client.0.smithi017.stdout:5/280: write d0/f27 [78688,116936] 0 2024-03-16T10:53:12.509 INFO:tasks.workunit.client.0.smithi017.stdout:9/139: creat d8/f29 x:0 0 0 2024-03-16T10:53:12.509 INFO:tasks.workunit.client.0.smithi017.stdout:9/140: dread - d8/f24 zero size 2024-03-16T10:53:12.511 INFO:tasks.workunit.client.0.smithi017.stdout:4/207: mkdir d15/d1d/d27/d28/d43 0 2024-03-16T10:53:12.511 INFO:tasks.workunit.client.0.smithi017.stdout:4/208: fsync d15/d1d/d27/f2a 0 2024-03-16T10:53:12.511 INFO:tasks.workunit.client.0.smithi017.stdout:4/209: write d15/d1d/d21/d26/f42 [435367,4921] 0 2024-03-16T10:53:12.514 INFO:tasks.workunit.client.0.smithi017.stdout:9/141: dread d8/df/f1a [0,4194304] 0 2024-03-16T10:53:12.515 INFO:tasks.workunit.client.0.smithi017.stdout:5/281: creat d0/d1/d30/d4f/f66 x:0 0 0 2024-03-16T10:53:12.516 INFO:tasks.workunit.client.0.smithi017.stdout:8/224: read d6/fe [3782353,76409] 0 2024-03-16T10:53:12.516 INFO:tasks.workunit.client.0.smithi017.stdout:8/225: readlink d6/d7/d43/l3a 0 2024-03-16T10:53:12.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/210: creat d15/d1d/d27/d28/d40/f44 x:0 0 0 2024-03-16T10:53:12.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/211: read d15/d1d/f1e [2567010,87475] 0 2024-03-16T10:53:12.518 INFO:tasks.workunit.client.0.smithi017.stdout:5/282: write d0/d1/d2/ff [2172573,93298] 0 2024-03-16T10:53:12.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/142: truncate d8/df/f13 496040 0 2024-03-16T10:53:12.520 INFO:tasks.workunit.client.0.smithi017.stdout:8/226: mkdir d6/d4a 0 2024-03-16T10:53:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:9/143: creat d8/f2a x:0 0 0 2024-03-16T10:53:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:9/144: chown d8/df/f11 18 1 2024-03-16T10:53:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:9/145: write d8/f29 [950717,129043] 0 2024-03-16T10:53:12.533 INFO:tasks.workunit.client.0.smithi017.stdout:4/212: dread d15/d1d/d21/d26/f35 [0,4194304] 0 2024-03-16T10:53:12.536 INFO:tasks.workunit.client.0.smithi017.stdout:9/146: dread d8/df/f13 [0,4194304] 0 2024-03-16T10:53:12.536 INFO:tasks.workunit.client.0.smithi017.stdout:9/147: fsync d8/df/f1a 0 2024-03-16T10:53:12.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/213: mknod d15/c45 0 2024-03-16T10:53:12.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/214: read fa [2849674,61547] 0 2024-03-16T10:53:12.537 INFO:tasks.workunit.client.0.smithi017.stdout:1/353: sync 2024-03-16T10:53:12.537 INFO:tasks.workunit.client.0.smithi017.stdout:1/354: dread - d1/d3/dd/d31/d35/f75 zero size 2024-03-16T10:53:12.538 INFO:tasks.workunit.client.0.smithi017.stdout:9/148: dread d8/df/f11 [0,4194304] 0 2024-03-16T10:53:12.539 INFO:tasks.workunit.client.0.smithi017.stdout:4/215: mknod d15/d1d/d21/d3c/c46 0 2024-03-16T10:53:12.539 INFO:tasks.workunit.client.0.smithi017.stdout:4/216: readlink d15/l41 0 2024-03-16T10:53:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:4/217: fdatasync f6 0 2024-03-16T10:53:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/283: dwrite d0/d1/d2/dc/f1d [0,4194304] 0 2024-03-16T10:53:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/284: chown d0/d1/d2/d24/f2e 3 1 2024-03-16T10:53:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/285: chown d0/d1/d2/dc/f1d 53 1 2024-03-16T10:53:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/286: chown d0/d1 463772961 1 2024-03-16T10:53:12.541 INFO:tasks.workunit.client.0.smithi017.stdout:8/227: dwrite d6/d7/d43/f2b [0,4194304] 0 2024-03-16T10:53:12.541 INFO:tasks.workunit.client.0.smithi017.stdout:1/355: symlink d1/l76 0 2024-03-16T10:53:12.541 INFO:tasks.workunit.client.0.smithi017.stdout:1/356: write d1/d3/d16/f30 [932102,113262] 0 2024-03-16T10:53:12.548 INFO:tasks.workunit.client.0.smithi017.stdout:8/228: mknod d6/d7/c4b 0 2024-03-16T10:53:12.548 INFO:tasks.workunit.client.0.smithi017.stdout:8/229: chown d6/d16 4725198 1 2024-03-16T10:53:12.549 INFO:tasks.workunit.client.0.smithi017.stdout:1/357: dread d1/d3/dd/f60 [0,4194304] 0 2024-03-16T10:53:12.551 INFO:tasks.workunit.client.0.smithi017.stdout:1/358: rmdir d1/d24 39 2024-03-16T10:53:12.561 INFO:tasks.workunit.client.0.smithi017.stdout:9/149: dwrite d8/f2a [0,4194304] 0 2024-03-16T10:53:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: pgmap v422: 97 pgs: 97 active+clean; 102 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 797 op/s 2024-03-16T10:53:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000010be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001166 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000118c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000118d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.567 INFO:tasks.workunit.client.0.smithi017.stdout:1/359: dread d1/d3/fb [0,4194304] 0 2024-03-16T10:53:12.567 INFO:tasks.workunit.client.0.smithi017.stdout:4/218: dwrite d15/f19 [4194304,4194304] 0 2024-03-16T10:53:12.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/150: mknod d8/c2b 0 2024-03-16T10:53:12.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/230: dwrite d6/f13 [0,4194304] 0 2024-03-16T10:53:12.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/231: truncate d6/d39/f30 4525035 0 2024-03-16T10:53:12.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002439 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000244a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002449 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000244b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000023fe (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002437 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002421 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002438 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000023ff (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002400 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002447 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002448 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002444 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002443 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002446 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002445 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002442 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002422 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002431 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002423 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002436 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002434 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002428 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002432 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002424 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002429 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002425 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002427 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002433 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002404 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002403 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002402 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:12.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:12 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:5/287: dwrite d0/d1/d1f/f50 [0,4194304] 0 2024-03-16T10:53:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:5/288: write d0/d1/d2/d2c/d36/d41/f62 [253239,101548] 0 2024-03-16T10:53:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:9/151: symlink d8/l2c 0 2024-03-16T10:53:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:8/232: symlink d6/d16/l4c 0 2024-03-16T10:53:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:8/233: write d6/d39/d35/f47 [866096,123246] 0 2024-03-16T10:53:12.580 INFO:tasks.workunit.client.0.smithi017.stdout:8/234: dread d6/d39/f30 [0,4194304] 0 2024-03-16T10:53:12.580 INFO:tasks.workunit.client.0.smithi017.stdout:8/235: chown d6/d39/d35/f21 3817 1 2024-03-16T10:53:12.582 INFO:tasks.workunit.client.0.smithi017.stdout:5/289: dwrite d0/d1/d1f/d29/f5e [0,4194304] 0 2024-03-16T10:53:12.582 INFO:tasks.workunit.client.0.smithi017.stdout:5/290: readlink d0/d1/d2/dc/d2f/d37/l3e 0 2024-03-16T10:53:12.582 INFO:tasks.workunit.client.0.smithi017.stdout:5/291: chown d0/d1/d2/l10 37263755 1 2024-03-16T10:53:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: pgmap v422: 97 pgs: 97 active+clean; 102 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 797 op/s 2024-03-16T10:53:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000010be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001166 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000118c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000118d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002439 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000244a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002449 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000244b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000023fe (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002437 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002421 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002438 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000023ff (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002400 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002447 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002448 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002444 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002443 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002446 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002445 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002442 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002422 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002431 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002423 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002436 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002434 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002428 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002432 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002424 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002429 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002425 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002427 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002433 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002404 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002403 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002402 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:12.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:12 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.604 INFO:tasks.workunit.client.0.smithi017.stdout:4/219: mkdir d15/d47 0 2024-03-16T10:53:12.606 INFO:tasks.workunit.client.0.smithi017.stdout:9/152: mkdir d8/d2d 0 2024-03-16T10:53:12.609 INFO:tasks.workunit.client.0.smithi017.stdout:8/236: unlink f5 0 2024-03-16T10:53:12.612 INFO:tasks.workunit.client.0.smithi017.stdout:4/220: dread f7 [0,4194304] 0 2024-03-16T10:53:12.612 INFO:tasks.workunit.client.0.smithi017.stdout:4/221: fdatasync d15/d1d/d27/d28/f38 0 2024-03-16T10:53:12.617 INFO:tasks.workunit.client.0.smithi017.stdout:9/153: rename d8/l2c to d8/df/l2e 0 2024-03-16T10:53:12.618 INFO:tasks.workunit.client.0.smithi017.stdout:8/237: creat d6/d4a/f4d x:0 0 0 2024-03-16T10:53:12.621 INFO:tasks.workunit.client.0.smithi017.stdout:9/154: rmdir d8 39 2024-03-16T10:53:12.623 INFO:tasks.workunit.client.0.smithi017.stdout:8/238: link d6/f13 d6/f4e 0 2024-03-16T10:53:12.625 INFO:tasks.workunit.client.0.smithi017.stdout:4/222: dwrite f4 [0,4194304] 0 2024-03-16T10:53:12.625 INFO:tasks.workunit.client.0.smithi017.stdout:4/223: chown d15/d1d/f25 0 1 2024-03-16T10:53:12.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/155: unlink d8/df/c23 0 2024-03-16T10:53:12.628 INFO:tasks.workunit.client.0.smithi017.stdout:8/239: creat d6/f4f x:0 0 0 2024-03-16T10:53:12.628 INFO:tasks.workunit.client.0.smithi017.stdout:8/240: fdatasync d6/d39/d35/f21 0 2024-03-16T10:53:12.629 INFO:tasks.workunit.client.0.smithi017.stdout:3/156: sync 2024-03-16T10:53:12.629 INFO:tasks.workunit.client.0.smithi017.stdout:3/157: chown d8/da/db/c13 39761579 1 2024-03-16T10:53:12.629 INFO:tasks.workunit.client.0.smithi017.stdout:9/156: symlink d8/df/l2f 0 2024-03-16T10:53:12.632 INFO:tasks.workunit.client.0.smithi017.stdout:8/241: rename d6/d39/f38 to d6/d7/f50 0 2024-03-16T10:53:12.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/158: truncate d8/d1d/f1f 769361 0 2024-03-16T10:53:12.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/159: fsync d8/f17 0 2024-03-16T10:53:12.636 INFO:tasks.workunit.client.0.smithi017.stdout:8/242: creat d6/d14/f51 x:0 0 0 2024-03-16T10:53:12.636 INFO:tasks.workunit.client.0.smithi017.stdout:8/243: write d6/d16/f48 [703605,96373] 0 2024-03-16T10:53:12.636 INFO:tasks.workunit.client.0.smithi017.stdout:8/244: chown d6/d16/l20 1003 1 2024-03-16T10:53:12.639 INFO:tasks.workunit.client.0.smithi017.stdout:8/245: rename d6/f4f to d6/d7/d34/f52 0 2024-03-16T10:53:12.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/246: creat d6/d39/d35/f53 x:0 0 0 2024-03-16T10:53:12.642 INFO:tasks.workunit.client.0.smithi017.stdout:4/224: dwrite d15/d1d/f29 [0,4194304] 0 2024-03-16T10:53:12.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/157: dwrite d8/f2a [4194304,4194304] 0 2024-03-16T10:53:12.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/158: write d8/df/f13 [1261284,128185] 0 2024-03-16T10:53:12.644 INFO:tasks.workunit.client.0.smithi017.stdout:8/247: creat d6/f54 x:0 0 0 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/202: sync 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:0/164: sync 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/226: sync 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:2/161: sync 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:2/162: write d4/dd/df/f15 [1169754,5815] 0 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/203: write d7/db/d12/f3f [979291,110152] 0 2024-03-16T10:53:12.646 INFO:tasks.workunit.client.0.smithi017.stdout:4/225: getdents d15/d1d/d21/d26 0 2024-03-16T10:53:12.648 INFO:tasks.workunit.client.0.smithi017.stdout:0/165: link d2/d4/l15 d2/d25/l4a 0 2024-03-16T10:53:12.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/159: creat d8/f30 x:0 0 0 2024-03-16T10:53:12.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/160: chown d8/df/ld 49430796 1 2024-03-16T10:53:12.654 INFO:tasks.workunit.client.0.smithi017.stdout:8/248: rename d6/d7/l3e to d6/d7/l55 0 2024-03-16T10:53:12.655 INFO:tasks.workunit.client.0.smithi017.stdout:6/227: mknod d0/d21/c43 0 2024-03-16T10:53:12.655 INFO:tasks.workunit.client.0.smithi017.stdout:6/228: chown d0/d21/f36 108 1 2024-03-16T10:53:12.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/163: creat d4/f2c x:0 0 0 2024-03-16T10:53:12.658 INFO:tasks.workunit.client.0.smithi017.stdout:7/204: rmdir d7/db/d45/d33 39 2024-03-16T10:53:12.660 INFO:tasks.workunit.client.0.smithi017.stdout:4/226: creat d15/d1d/d27/d28/d43/f48 x:0 0 0 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: pgmap v422: 97 pgs: 97 active+clean; 102 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 797 op/s 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000010be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001166 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000118c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000118d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000103d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc) see mds.e log and `damage ls` output for details 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.664 INFO:tasks.workunit.client.0.smithi017.stdout:0/166: creat d2/d7/de/d19/d2e/f4b x:0 0 0 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002439 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000244a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002449 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000244b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000244d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000023fe (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002420 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002437 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002421 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002438 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000244c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002417 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002408 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000023ff (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002400 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002447 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002448 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002444 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002443 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002446 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002445 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002442 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002422 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002431 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002423 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002436 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002434 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002428 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002432 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002424 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002429 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002425 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002427 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002433 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002404 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002403 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002407 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002402 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002418 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002409 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:12.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:12.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:12 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:12.673 INFO:tasks.workunit.client.0.smithi017.stdout:0/167: getdents d2/d32 0 2024-03-16T10:53:12.673 INFO:tasks.workunit.client.0.smithi017.stdout:0/168: write d2/d4/f1c [582585,106656] 0 2024-03-16T10:53:12.673 INFO:tasks.workunit.client.0.smithi017.stdout:0/169: chown d2/d7/d24 43159548 1 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:0/170: dread - d2/d7/de/f45 zero size 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:2/164: write d4/dd/f14 [893774,51926] 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/249: creat d6/d39/f56 x:0 0 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/250: write d6/d16/f49 [442835,3053] 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/227: dread d15/d1d/d21/d26/f35 [0,4194304] 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:6/229: mkdir d0/d21/d39/d44 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:0/171: dread f0 [0,4194304] 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:7/205: mknod d7/db/d12/c49 0 2024-03-16T10:53:12.674 INFO:tasks.workunit.client.0.smithi017.stdout:7/206: dread - d7/db/d45/d33/d34/f44 zero size 2024-03-16T10:53:12.676 INFO:tasks.workunit.client.0.smithi017.stdout:7/207: dread d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:12.676 INFO:tasks.workunit.client.0.smithi017.stdout:7/208: chown d7/db/d45 20312787 1 2024-03-16T10:53:12.676 INFO:tasks.workunit.client.0.smithi017.stdout:7/209: chown d7/db/d12 429767 1 2024-03-16T10:53:12.676 INFO:tasks.workunit.client.0.smithi017.stdout:2/165: symlink d4/dd/d1e/l2d 0 2024-03-16T10:53:12.676 INFO:tasks.workunit.client.0.smithi017.stdout:2/166: chown c3 43686340 1 2024-03-16T10:53:12.678 INFO:tasks.workunit.client.0.smithi017.stdout:8/251: creat d6/dd/f57 x:0 0 0 2024-03-16T10:53:12.681 INFO:tasks.workunit.client.0.smithi017.stdout:4/228: creat d15/d1d/d27/f49 x:0 0 0 2024-03-16T10:53:12.681 INFO:tasks.workunit.client.0.smithi017.stdout:4/229: dread - d15/d1d/f3d zero size 2024-03-16T10:53:12.681 INFO:tasks.workunit.client.0.smithi017.stdout:4/230: dread - d15/d1d/d27/f49 zero size 2024-03-16T10:53:12.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/230: mkdir d0/d9/d45 0 2024-03-16T10:53:12.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/172: creat d2/d7/de/d19/f4c x:0 0 0 2024-03-16T10:53:12.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/173: write d2/f5 [1681540,52013] 0 2024-03-16T10:53:12.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/174: write d2/d25/f31 [145002,119046] 0 2024-03-16T10:53:12.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/175: chown d2/d7/de/d19/d2e/d39 7084 1 2024-03-16T10:53:12.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/176: chown d2/d4/f1d 0 1 2024-03-16T10:53:12.688 INFO:tasks.workunit.client.0.smithi017.stdout:0/177: mkdir d2/d7/d4d 0 2024-03-16T10:53:12.689 INFO:tasks.workunit.client.0.smithi017.stdout:2/167: write d4/d6/f21 [770063,85946] 0 2024-03-16T10:53:12.690 INFO:tasks.workunit.client.0.smithi017.stdout:8/252: dread d6/d7/d34/f3f [0,4194304] 0 2024-03-16T10:53:12.691 INFO:tasks.workunit.client.0.smithi017.stdout:4/231: symlink d15/d1d/d27/d28/d40/l4a 0 2024-03-16T10:53:12.697 INFO:tasks.workunit.client.0.smithi017.stdout:7/210: dwrite d7/db/d12/d1c/f36 [0,4194304] 0 2024-03-16T10:53:12.697 INFO:tasks.workunit.client.0.smithi017.stdout:7/211: truncate d7/db/d45/d33/d34/f44 275241 0 2024-03-16T10:53:12.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/253: rename d6/d16/c25 to d6/d7/d43/c58 0 2024-03-16T10:53:12.698 INFO:tasks.workunit.client.0.smithi017.stdout:4/232: write fc [752490,14899] 0 2024-03-16T10:53:12.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/233: creat d15/d1d/d21/f4b x:0 0 0 2024-03-16T10:53:12.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/234: dread - d15/d1d/d27/f3e zero size 2024-03-16T10:53:12.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/235: write d15/d1d/d27/d28/d40/f44 [587832,29287] 0 2024-03-16T10:53:12.704 INFO:tasks.workunit.client.0.smithi017.stdout:7/212: write d7/db/dc/f17 [7107039,49938] 0 2024-03-16T10:53:12.704 INFO:tasks.workunit.client.0.smithi017.stdout:0/178: dread d2/d25/f31 [0,4194304] 0 2024-03-16T10:53:12.704 INFO:tasks.workunit.client.0.smithi017.stdout:0/179: fsync d2/d4/f1d 0 2024-03-16T10:53:12.704 INFO:tasks.workunit.client.0.smithi017.stdout:4/236: creat d15/d1d/d21/f4c x:0 0 0 2024-03-16T10:53:12.704 INFO:tasks.workunit.client.0.smithi017.stdout:4/237: dread - d15/d1d/d27/d28/f38 zero size 2024-03-16T10:53:12.705 INFO:tasks.workunit.client.0.smithi017.stdout:7/213: dread d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:12.707 INFO:tasks.workunit.client.0.smithi017.stdout:0/180: rmdir d2/d7 39 2024-03-16T10:53:12.707 INFO:tasks.workunit.client.0.smithi017.stdout:0/181: write d2/d7/d24/d3a/f42 [60234,96307] 0 2024-03-16T10:53:12.707 INFO:tasks.workunit.client.0.smithi017.stdout:0/182: stat d2/d7 0 2024-03-16T10:53:12.708 INFO:tasks.workunit.client.0.smithi017.stdout:3/160: dwrite d8/d1d/f1f [0,4194304] 0 2024-03-16T10:53:12.710 INFO:tasks.workunit.client.0.smithi017.stdout:4/238: write f6 [7946613,99061] 0 2024-03-16T10:53:12.710 INFO:tasks.workunit.client.0.smithi017.stdout:4/239: write fa [5037787,54777] 0 2024-03-16T10:53:12.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/231: dwrite d0/d15/f17 [4194304,4194304] 0 2024-03-16T10:53:12.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/232: write d0/f3 [1288812,21801] 0 2024-03-16T10:53:12.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/161: creat d8/d1b/d1c/f2f x:0 0 0 2024-03-16T10:53:12.720 INFO:tasks.workunit.client.0.smithi017.stdout:0/183: unlink d2/d7/de/f45 0 2024-03-16T10:53:12.720 INFO:tasks.workunit.client.0.smithi017.stdout:0/184: chown d2/d7/de/d19 487 1 2024-03-16T10:53:12.720 INFO:tasks.workunit.client.0.smithi017.stdout:7/214: dwrite f2 [4194304,4194304] 0 2024-03-16T10:53:12.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/168: dwrite d4/dd/f14 [0,4194304] 0 2024-03-16T10:53:12.721 INFO:tasks.workunit.client.0.smithi017.stdout:2/169: stat d4/dd/d1e/d28/d29 0 2024-03-16T10:53:12.723 INFO:tasks.workunit.client.0.smithi017.stdout:4/240: link d15/d1d/d21/d26/f33 d15/d1d/d21/d26/f4d 0 2024-03-16T10:53:12.725 INFO:tasks.workunit.client.0.smithi017.stdout:6/233: mknod d0/d9/da/d2e/c46 0 2024-03-16T10:53:12.727 INFO:tasks.workunit.client.0.smithi017.stdout:3/162: mkdir d8/d1b/d1c/d30 0 2024-03-16T10:53:12.727 INFO:tasks.workunit.client.0.smithi017.stdout:3/163: dread - d8/d1b/d1c/f2f zero size 2024-03-16T10:53:12.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/170: mkdir d4/dd/d1e/d28/d2e 0 2024-03-16T10:53:12.732 INFO:tasks.workunit.client.0.smithi017.stdout:4/241: creat d15/d47/f4e x:0 0 0 2024-03-16T10:53:12.732 INFO:tasks.workunit.client.0.smithi017.stdout:4/242: read d15/d1d/f36 [2877629,72545] 0 2024-03-16T10:53:12.735 INFO:tasks.workunit.client.0.smithi017.stdout:6/234: symlink d0/d9/da/l47 0 2024-03-16T10:53:12.737 INFO:tasks.workunit.client.0.smithi017.stdout:3/164: creat d8/da/f31 x:0 0 0 2024-03-16T10:53:12.738 INFO:tasks.workunit.client.0.smithi017.stdout:3/165: read - d8/d1b/d1c/f2f zero size 2024-03-16T10:53:12.748 INFO:tasks.workunit.client.0.smithi017.stdout:8/254: getdents d6/d16 0 2024-03-16T10:53:12.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/166: dwrite d8/da/db/f23 [4194304,4194304] 0 2024-03-16T10:53:12.756 INFO:tasks.workunit.client.0.smithi017.stdout:4/243: mknod d15/d1d/d21/c4f 0 2024-03-16T10:53:12.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/167: mknod d8/da/c32 0 2024-03-16T10:53:12.762 INFO:tasks.workunit.client.0.smithi017.stdout:4/244: mkdir d15/d1d/d50 0 2024-03-16T10:53:12.762 INFO:tasks.workunit.client.0.smithi017.stdout:4/245: write d15/d1d/d21/f4c [464069,64731] 0 2024-03-16T10:53:12.763 INFO:tasks.workunit.client.0.smithi017.stdout:4/246: stat d15/d1d/f24 0 2024-03-16T10:53:12.769 INFO:tasks.workunit.client.0.smithi017.stdout:4/247: write d15/d1d/d27/f2a [932187,121252] 0 2024-03-16T10:53:12.770 INFO:tasks.workunit.client.0.smithi017.stdout:4/248: chown lf 786 1 2024-03-16T10:53:12.770 INFO:tasks.workunit.client.0.smithi017.stdout:4/249: chown d15/d1d/l20 11064644 1 2024-03-16T10:53:12.771 INFO:tasks.workunit.client.0.smithi017.stdout:3/168: dwrite d8/d1b/d1c/f2f [0,4194304] 0 2024-03-16T10:53:12.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/250: mkdir d15/d1d/d27/d28/d40/d51 0 2024-03-16T10:53:12.776 INFO:tasks.workunit.client.0.smithi017.stdout:4/251: fdatasync d15/d1d/d21/f4c 0 2024-03-16T10:53:12.778 INFO:tasks.workunit.client.0.smithi017.stdout:4/252: rmdir d15/d1d/d27/d28/d43 39 2024-03-16T10:53:12.778 INFO:tasks.workunit.client.0.smithi017.stdout:4/253: read - d15/d1d/d27/f3b zero size 2024-03-16T10:53:12.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/254: mknod d15/d1d/d21/c52 0 2024-03-16T10:53:12.784 INFO:tasks.workunit.client.0.smithi017.stdout:4/255: dread d15/f19 [4194304,4194304] 0 2024-03-16T10:53:12.785 INFO:tasks.workunit.client.0.smithi017.stdout:3/169: dwrite d8/da/f31 [0,4194304] 0 2024-03-16T10:53:12.787 INFO:tasks.workunit.client.0.smithi017.stdout:4/256: unlink d15/d1d/d27/f2a 0 2024-03-16T10:53:12.787 INFO:tasks.workunit.client.0.smithi017.stdout:4/257: write d15/d1d/d27/d28/f32 [813202,119515] 0 2024-03-16T10:53:12.791 INFO:tasks.workunit.client.0.smithi017.stdout:3/170: rmdir d8/d1d 39 2024-03-16T10:53:12.795 INFO:tasks.workunit.client.0.smithi017.stdout:0/185: rename d2/f12 to d2/d7/de/d19/d2e/f4e 0 2024-03-16T10:53:12.796 INFO:tasks.workunit.client.0.smithi017.stdout:5/292: sync 2024-03-16T10:53:12.796 INFO:tasks.workunit.client.0.smithi017.stdout:1/360: sync 2024-03-16T10:53:12.796 INFO:tasks.workunit.client.0.smithi017.stdout:1/361: write d1/d3/d16/f30 [3989908,77341] 0 2024-03-16T10:53:12.797 INFO:tasks.workunit.client.0.smithi017.stdout:0/186: getdents d2/d7 0 2024-03-16T10:53:12.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/215: rename d7/db/l37 to d7/l4a 0 2024-03-16T10:53:12.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/216: fsync d7/db/d12/d1c/f41 0 2024-03-16T10:53:12.799 INFO:tasks.workunit.client.0.smithi017.stdout:3/171: write d8/da/db/f23 [8057963,37029] 0 2024-03-16T10:53:12.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/362: creat d1/d3/dd/f77 x:0 0 0 2024-03-16T10:53:12.802 INFO:tasks.workunit.client.0.smithi017.stdout:0/187: mknod d2/d7/de/d19/c4f 0 2024-03-16T10:53:12.805 INFO:tasks.workunit.client.0.smithi017.stdout:6/235: rename d0/c1 to d0/d3e/c48 0 2024-03-16T10:53:12.807 INFO:tasks.workunit.client.0.smithi017.stdout:7/217: creat d7/db/f4b x:0 0 0 2024-03-16T10:53:12.813 INFO:tasks.workunit.client.0.smithi017.stdout:1/363: rmdir d1/d3/dd/d31/d35 39 2024-03-16T10:53:12.817 INFO:tasks.workunit.client.0.smithi017.stdout:8/255: rename d6/d14/f1e to d6/d7/f59 0 2024-03-16T10:53:12.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/236: creat d0/d3e/f49 x:0 0 0 2024-03-16T10:53:12.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/237: fsync d0/dc/f19 0 2024-03-16T10:53:12.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/238: truncate d0/d3e/f49 783920 0 2024-03-16T10:53:12.822 INFO:tasks.workunit.client.0.smithi017.stdout:7/218: creat d7/db/d12/f4c x:0 0 0 2024-03-16T10:53:12.823 INFO:tasks.workunit.client.0.smithi017.stdout:7/219: chown d7/db/d12/d1c/f36 2164044 1 2024-03-16T10:53:12.823 INFO:tasks.workunit.client.0.smithi017.stdout:3/172: dwrite d8/da/f31 [4194304,4194304] 0 2024-03-16T10:53:12.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/364: creat d1/f78 x:0 0 0 2024-03-16T10:53:12.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/365: truncate d1/d3/dd/d72/f74 530156 0 2024-03-16T10:53:12.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/188: getdents d2/d7/de 0 2024-03-16T10:53:12.829 INFO:tasks.workunit.client.0.smithi017.stdout:0/189: mknod d2/d25/d2b/c50 0 2024-03-16T10:53:12.831 INFO:tasks.workunit.client.0.smithi017.stdout:8/256: mknod d6/d14/c5a 0 2024-03-16T10:53:12.837 INFO:tasks.workunit.client.0.smithi017.stdout:5/293: rename d0/d1/d2/f35 to d0/d1/d2/d2c/d36/d51/f67 0 2024-03-16T10:53:12.837 INFO:tasks.workunit.client.0.smithi017.stdout:0/190: write d2/d7/de/ff [605286,129741] 0 2024-03-16T10:53:12.837 INFO:tasks.workunit.client.0.smithi017.stdout:7/220: dwrite d7/f8 [0,4194304] 0 2024-03-16T10:53:12.837 INFO:tasks.workunit.client.0.smithi017.stdout:7/221: readlink d7/db/l40 0 2024-03-16T10:53:12.839 INFO:tasks.workunit.client.0.smithi017.stdout:6/239: dwrite d0/f40 [0,4194304] 0 2024-03-16T10:53:12.846 INFO:tasks.workunit.client.0.smithi017.stdout:0/191: write d2/d7/de/d19/d2e/f4e [1969192,82453] 0 2024-03-16T10:53:12.846 INFO:tasks.workunit.client.0.smithi017.stdout:0/192: fsync d2/d7/f9 0 2024-03-16T10:53:12.853 INFO:tasks.workunit.client.0.smithi017.stdout:3/173: mknod d8/d1d/c33 0 2024-03-16T10:53:12.860 INFO:tasks.workunit.client.0.smithi017.stdout:1/366: mkdir d1/d24/d79 0 2024-03-16T10:53:12.860 INFO:tasks.workunit.client.0.smithi017.stdout:1/367: fdatasync d1/d3/f3a 0 2024-03-16T10:53:12.860 INFO:tasks.workunit.client.0.smithi017.stdout:1/368: chown d1/d3/dd/d31/d35 7691173 1 2024-03-16T10:53:12.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/193: dwrite d2/d7/d24/d29/f2c [0,4194304] 0 2024-03-16T10:53:12.865 INFO:tasks.workunit.client.0.smithi017.stdout:0/194: creat d2/d4/f51 x:0 0 0 2024-03-16T10:53:12.865 INFO:tasks.workunit.client.0.smithi017.stdout:0/195: chown d2/d7/d24/d3a/f42 86299 1 2024-03-16T10:53:12.865 INFO:tasks.workunit.client.0.smithi017.stdout:0/196: write d2/d25/f31 [281870,44366] 0 2024-03-16T10:53:12.865 INFO:tasks.workunit.client.0.smithi017.stdout:0/197: chown d2/d7/de/d19/d2e/f4e 15 1 2024-03-16T10:53:12.865 INFO:tasks.workunit.client.0.smithi017.stdout:8/257: rmdir d6/d4a 39 2024-03-16T10:53:12.867 INFO:tasks.workunit.client.0.smithi017.stdout:0/198: link d2/d4/f51 d2/d7/f52 0 2024-03-16T10:53:12.869 INFO:tasks.workunit.client.0.smithi017.stdout:1/369: dread d1/f5c [0,4194304] 0 2024-03-16T10:53:12.869 INFO:tasks.workunit.client.0.smithi017.stdout:1/370: readlink d1/d50/d61/l4f 0 2024-03-16T10:53:12.874 INFO:tasks.workunit.client.0.smithi017.stdout:5/294: mkdir d0/d1/d2/dc/d68 0 2024-03-16T10:53:12.874 INFO:tasks.workunit.client.0.smithi017.stdout:5/295: truncate d0/d1/d2/f5a 340367 0 2024-03-16T10:53:12.880 INFO:tasks.workunit.client.0.smithi017.stdout:7/222: rename d7/db/d12/l38 to d7/db/d32/l4d 0 2024-03-16T10:53:12.880 INFO:tasks.workunit.client.0.smithi017.stdout:9/161: sync 2024-03-16T10:53:12.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/371: dwrite d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:12.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/372: write d1/d3/f6f [657755,5850] 0 2024-03-16T10:53:12.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/373: dread d1/d3/de/d36/f52 [0,4194304] 0 2024-03-16T10:53:12.885 INFO:tasks.workunit.client.0.smithi017.stdout:6/240: creat d0/d9/d45/f4a x:0 0 0 2024-03-16T10:53:12.887 INFO:tasks.workunit.client.0.smithi017.stdout:8/258: mknod d6/d7/d34/c5b 0 2024-03-16T10:53:12.888 INFO:tasks.workunit.client.0.smithi017.stdout:8/259: stat d6/d7/lc 0 2024-03-16T10:53:12.890 INFO:tasks.workunit.client.0.smithi017.stdout:5/296: creat d0/d1/d2/dc/d2f/d37/d42/d46/f69 x:0 0 0 2024-03-16T10:53:12.890 INFO:tasks.workunit.client.0.smithi017.stdout:5/297: readlink d0/d1/d2/d24/l44 0 2024-03-16T10:53:12.890 INFO:tasks.workunit.client.0.smithi017.stdout:5/298: dread - d0/d1/d2/dc/d2f/d37/d42/d46/f69 zero size 2024-03-16T10:53:12.892 INFO:tasks.workunit.client.0.smithi017.stdout:3/174: rename d8/d1d/c33 to d8/d1b/d2e/c34 0 2024-03-16T10:53:12.894 INFO:tasks.workunit.client.0.smithi017.stdout:7/223: mkdir d7/db/d12/d1c/d4e 0 2024-03-16T10:53:12.894 INFO:tasks.workunit.client.0.smithi017.stdout:7/224: fdatasync d7/db/dc/f10 0 2024-03-16T10:53:12.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/199: rename d2/d7/d24/d3a/f42 to d2/d32/f53 0 2024-03-16T10:53:12.898 INFO:tasks.workunit.client.0.smithi017.stdout:9/162: dwrite d8/fa [0,4194304] 0 2024-03-16T10:53:12.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/374: mkdir d1/d24/d79/d7a 0 2024-03-16T10:53:12.905 INFO:tasks.workunit.client.0.smithi017.stdout:8/260: unlink d6/dd/f40 0 2024-03-16T10:53:12.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/241: dwrite d0/d9/da/f25 [0,4194304] 0 2024-03-16T10:53:12.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/299: mkdir d0/d1/d30/d55/d6a 0 2024-03-16T10:53:12.909 INFO:tasks.workunit.client.0.smithi017.stdout:3/175: symlink d8/da/l35 0 2024-03-16T10:53:12.910 INFO:tasks.workunit.client.0.smithi017.stdout:7/225: rmdir d7/db/d12 39 2024-03-16T10:53:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/163: dwrite d8/f2a [4194304,4194304] 0 2024-03-16T10:53:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/164: truncate d8/f24 792688 0 2024-03-16T10:53:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/165: readlink d8/df/l2e 0 2024-03-16T10:53:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/166: fsync d8/df/f11 0 2024-03-16T10:53:12.916 INFO:tasks.workunit.client.0.smithi017.stdout:1/375: symlink d1/l7b 0 2024-03-16T10:53:12.918 INFO:tasks.workunit.client.0.smithi017.stdout:8/261: truncate d6/d7/d43/f46 814477 0 2024-03-16T10:53:12.918 INFO:tasks.workunit.client.0.smithi017.stdout:3/176: write d8/da/db/f19 [602067,29713] 0 2024-03-16T10:53:12.922 INFO:tasks.workunit.client.0.smithi017.stdout:9/167: dread d8/df/f13 [0,4194304] 0 2024-03-16T10:53:12.922 INFO:tasks.workunit.client.0.smithi017.stdout:9/168: read - d8/f30 zero size 2024-03-16T10:53:12.926 INFO:tasks.workunit.client.0.smithi017.stdout:6/242: dwrite d0/d3e/f49 [0,4194304] 0 2024-03-16T10:53:12.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/243: write d0/d22/f30 [778317,61167] 0 2024-03-16T10:53:12.938 INFO:tasks.workunit.client.0.smithi017.stdout:5/300: rename d0/d1/d2/dc/d2f/l4d to d0/d1/d2/l6b 0 2024-03-16T10:53:12.938 INFO:tasks.workunit.client.0.smithi017.stdout:5/301: write d0/d1/d2/d2c/d36/d41/f62 [959766,104073] 0 2024-03-16T10:53:12.941 INFO:tasks.workunit.client.0.smithi017.stdout:7/226: symlink d7/db/d12/l4f 0 2024-03-16T10:53:12.943 INFO:tasks.workunit.client.0.smithi017.stdout:1/376: mkdir d1/d50/d7c 0 2024-03-16T10:53:12.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/262: rmdir d6/d16 39 2024-03-16T10:53:12.947 INFO:tasks.workunit.client.0.smithi017.stdout:3/177: creat d8/da/f36 x:0 0 0 2024-03-16T10:53:12.949 INFO:tasks.workunit.client.0.smithi017.stdout:9/169: mknod d8/df/c31 0 2024-03-16T10:53:12.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/244: rename d0/d9/d45/f4a to d0/d9/da/d2e/f4b 0 2024-03-16T10:53:12.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/178: dread d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:12.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/179: dread f7 [0,4194304] 0 2024-03-16T10:53:12.959 INFO:tasks.workunit.client.0.smithi017.stdout:5/302: symlink d0/d1/d2/d2c/d38/l6c 0 2024-03-16T10:53:12.959 INFO:tasks.workunit.client.0.smithi017.stdout:5/303: fdatasync d0/d1/d2/d2c/d38/f3b 0 2024-03-16T10:53:12.959 INFO:tasks.workunit.client.0.smithi017.stdout:5/304: getdents d0/d1/d30/d55/d6a 0 2024-03-16T10:53:12.962 INFO:tasks.workunit.client.0.smithi017.stdout:5/305: dread d0/d1/d2/d2c/d38/f3b [0,4194304] 0 2024-03-16T10:53:12.962 INFO:tasks.workunit.client.0.smithi017.stdout:5/306: fdatasync d0/d1/f65 0 2024-03-16T10:53:12.963 INFO:tasks.workunit.client.0.smithi017.stdout:9/170: dwrite d8/f2a [8388608,4194304] 0 2024-03-16T10:53:12.964 INFO:tasks.workunit.client.0.smithi017.stdout:7/227: mkdir d7/db/dc/d50 0 2024-03-16T10:53:12.968 INFO:tasks.workunit.client.0.smithi017.stdout:1/377: mknod d1/d3/d16/c7d 0 2024-03-16T10:53:12.968 INFO:tasks.workunit.client.0.smithi017.stdout:1/378: chown d1/f78 3103718 1 2024-03-16T10:53:12.968 INFO:tasks.workunit.client.0.smithi017.stdout:1/379: chown d1/d50/d61/l59 435681 1 2024-03-16T10:53:12.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/263: rmdir d6/d16 39 2024-03-16T10:53:12.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/264: truncate d6/dd/f41 14707 0 2024-03-16T10:53:12.971 INFO:tasks.workunit.client.0.smithi017.stdout:6/245: creat d0/d9/da/d2c/f4c x:0 0 0 2024-03-16T10:53:12.972 INFO:tasks.workunit.client.0.smithi017.stdout:2/171: sync 2024-03-16T10:53:12.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/258: sync 2024-03-16T10:53:12.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/200: link d2/l1f d2/d7/de/l54 0 2024-03-16T10:53:12.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/259: chown d15/d1d/d21/f4c 35260684 1 2024-03-16T10:53:12.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/260: chown d15/d1d/d27 22 1 2024-03-16T10:53:12.974 INFO:tasks.workunit.client.0.smithi017.stdout:3/180: rename d8/l10 to d8/da/l37 0 2024-03-16T10:53:12.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/307: unlink d0/d1/d2/l6b 0 2024-03-16T10:53:12.979 INFO:tasks.workunit.client.0.smithi017.stdout:9/171: mkdir d8/d2d/d32 0 2024-03-16T10:53:12.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/201: unlink d2/d32/f37 0 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/202: mknod d2/d7/d24/d29/c55 0 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/203: write d2/d4/f6 [4489760,66457] 0 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/204: chown d2/d7/d24/d29 414899 1 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/205: dread - d2/d4/f43 zero size 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/206: write d2/d7/de/ff [4970622,82161] 0 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/207: chown d2/l10 980 1 2024-03-16T10:53:12.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/208: truncate d2/d32/f53 303254 0 2024-03-16T10:53:12.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/209: unlink d2/d7/f52 0 2024-03-16T10:53:12.983 INFO:tasks.workunit.client.0.smithi017.stdout:1/380: mknod d1/d3/d16/c7e 0 2024-03-16T10:53:12.984 INFO:tasks.workunit.client.0.smithi017.stdout:1/381: fsync d1/f78 0 2024-03-16T10:53:12.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/265: truncate d6/d16/f2d 26504 0 2024-03-16T10:53:12.990 INFO:tasks.workunit.client.0.smithi017.stdout:8/266: write d6/d7/f50 [979015,10470] 0 2024-03-16T10:53:12.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/172: symlink d4/dd/df/l2f 0 2024-03-16T10:53:12.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/246: dwrite d0/d22/f30 [0,4194304] 0 2024-03-16T10:53:12.995 INFO:tasks.workunit.client.0.smithi017.stdout:4/261: rmdir d15/d1d/d27/d28 39 2024-03-16T10:53:12.996 INFO:tasks.workunit.client.0.smithi017.stdout:4/262: readlink lf 0 2024-03-16T10:53:12.997 INFO:tasks.workunit.client.0.smithi017.stdout:5/308: dwrite d0/d1/d2/dc/f45 [0,4194304] 0 2024-03-16T10:53:13.001 INFO:tasks.workunit.client.0.smithi017.stdout:3/181: rename d8/da/l35 to d8/d1b/d2e/l38 0 2024-03-16T10:53:13.002 INFO:tasks.workunit.client.0.smithi017.stdout:5/309: dread d0/d1/f11 [0,4194304] 0 2024-03-16T10:53:13.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/310: fdatasync d0/d1/d2/f12 0 2024-03-16T10:53:13.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/311: write d0/d1/d30/f4b [881697,104079] 0 2024-03-16T10:53:13.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/312: truncate d0/d1/d1f/f50 4321434 0 2024-03-16T10:53:13.007 INFO:tasks.workunit.client.0.smithi017.stdout:9/172: dwrite d8/df/f13 [0,4194304] 0 2024-03-16T10:53:13.007 INFO:tasks.workunit.client.0.smithi017.stdout:9/173: fdatasync d8/f2a 0 2024-03-16T10:53:13.008 INFO:tasks.workunit.client.0.smithi017.stdout:3/182: dread d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:13.009 INFO:tasks.workunit.client.0.smithi017.stdout:3/183: dread f7 [0,4194304] 0 2024-03-16T10:53:13.012 INFO:tasks.workunit.client.0.smithi017.stdout:2/173: dwrite d4/d6/f16 [0,4194304] 0 2024-03-16T10:53:13.013 INFO:tasks.workunit.client.0.smithi017.stdout:8/267: dwrite d6/f54 [0,4194304] 0 2024-03-16T10:53:13.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/268: read - d6/dd/f57 zero size 2024-03-16T10:53:13.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/269: chown d6/d39/d35/f26 277 1 2024-03-16T10:53:13.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/382: mkdir d1/d3/de/d36/d67/d7f 0 2024-03-16T10:53:13.017 INFO:tasks.workunit.client.0.smithi017.stdout:9/174: dread d8/fa [0,4194304] 0 2024-03-16T10:53:13.026 INFO:tasks.workunit.client.0.smithi017.stdout:4/263: mkdir d15/d1d/d27/d53 0 2024-03-16T10:53:13.026 INFO:tasks.workunit.client.0.smithi017.stdout:5/313: mknod d0/d1/d2/d2c/d36/d41/c6d 0 2024-03-16T10:53:13.026 INFO:tasks.workunit.client.0.smithi017.stdout:4/264: fdatasync d15/d1d/d27/f3b 0 2024-03-16T10:53:13.031 INFO:tasks.workunit.client.0.smithi017.stdout:3/184: symlink d8/da/l39 0 2024-03-16T10:53:13.037 INFO:tasks.workunit.client.0.smithi017.stdout:2/174: mkdir d4/d6/d30 0 2024-03-16T10:53:13.037 INFO:tasks.workunit.client.0.smithi017.stdout:2/175: fdatasync d4/d6/f10 0 2024-03-16T10:53:13.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/270: mkdir d6/d5c 0 2024-03-16T10:53:13.044 INFO:tasks.workunit.client.0.smithi017.stdout:1/383: getdents d1/d24 0 2024-03-16T10:53:13.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/265: symlink d15/d1d/d50/l54 0 2024-03-16T10:53:13.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/266: write d15/d1d/f25 [1122997,17062] 0 2024-03-16T10:53:13.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/267: chown d15/d1d/d21/d26/l2b 956448608 1 2024-03-16T10:53:13.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/268: readlink l13 0 2024-03-16T10:53:13.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/271: link d6/d39/d35/f47 d6/d39/f5d 0 2024-03-16T10:53:13.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/384: creat d1/d3/dd/d72/f80 x:0 0 0 2024-03-16T10:53:13.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/176: dwrite d4/dd/f18 [0,4194304] 0 2024-03-16T10:53:13.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/177: truncate d4/dd/f27 621617 0 2024-03-16T10:53:13.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/272: unlink d6/c36 0 2024-03-16T10:53:13.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/273: fsync d6/dd/f57 0 2024-03-16T10:53:13.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/274: creat d6/d7/d43/f5e x:0 0 0 2024-03-16T10:53:13.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/178: read d4/dd/df/f15 [385088,130809] 0 2024-03-16T10:53:13.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/275: getdents d6/d14 0 2024-03-16T10:53:13.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/276: read - d6/d4a/f4d zero size 2024-03-16T10:53:13.061 INFO:tasks.workunit.client.0.smithi017.stdout:2/179: truncate d4/d6/f10 4062761 0 2024-03-16T10:53:13.063 INFO:tasks.workunit.client.0.smithi017.stdout:1/385: dwrite d1/d3/de/d36/f73 [0,4194304] 0 2024-03-16T10:53:13.063 INFO:tasks.workunit.client.0.smithi017.stdout:8/277: unlink l1 0 2024-03-16T10:53:13.065 INFO:tasks.workunit.client.0.smithi017.stdout:1/386: dread d1/f34 [0,4194304] 0 2024-03-16T10:53:13.065 INFO:tasks.workunit.client.0.smithi017.stdout:1/387: chown d1/d3/l63 979 1 2024-03-16T10:53:13.065 INFO:tasks.workunit.client.0.smithi017.stdout:1/388: chown d1/d3/de/c1d 763540288 1 2024-03-16T10:53:13.065 INFO:tasks.workunit.client.0.smithi017.stdout:2/180: creat d4/dd/d1e/d28/d2e/f31 x:0 0 0 2024-03-16T10:53:13.065 INFO:tasks.workunit.client.0.smithi017.stdout:2/181: read - d4/d6/f20 zero size 2024-03-16T10:53:13.070 INFO:tasks.workunit.client.0.smithi017.stdout:8/278: rename d6/dd to d6/d5f 0 2024-03-16T10:53:13.070 INFO:tasks.workunit.client.0.smithi017.stdout:8/279: chown d6/d7/f59 893670620 1 2024-03-16T10:53:13.071 INFO:tasks.workunit.client.0.smithi017.stdout:8/280: readlink d6/d16/l4c 0 2024-03-16T10:53:13.072 INFO:tasks.workunit.client.0.smithi017.stdout:2/182: getdents d4/dd 0 2024-03-16T10:53:13.074 INFO:tasks.workunit.client.0.smithi017.stdout:1/389: dwrite d1/f47 [0,4194304] 0 2024-03-16T10:53:13.078 INFO:tasks.workunit.client.0.smithi017.stdout:8/281: write d6/d7/f59 [1773121,84742] 0 2024-03-16T10:53:13.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/282: rmdir d6/d7 39 2024-03-16T10:53:13.080 INFO:tasks.workunit.client.0.smithi017.stdout:1/390: dread d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:13.080 INFO:tasks.workunit.client.0.smithi017.stdout:1/391: write d1/d3/de/d36/d45/f6e [5034034,58421] 0 2024-03-16T10:53:13.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/283: rmdir d6/d39/d35 39 2024-03-16T10:53:13.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/284: dread d6/d16/f48 [0,4194304] 0 2024-03-16T10:53:13.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/285: fdatasync d6/d14/f51 0 2024-03-16T10:53:13.088 INFO:tasks.workunit.client.0.smithi017.stdout:1/392: stat d1/d3/dd/c33 0 2024-03-16T10:53:13.090 INFO:tasks.workunit.client.0.smithi017.stdout:2/183: dwrite d4/dd/df/f19 [0,4194304] 0 2024-03-16T10:53:13.095 INFO:tasks.workunit.client.0.smithi017.stdout:2/184: mkdir d4/d32 0 2024-03-16T10:53:13.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/185: truncate d4/dd/df/f15 1120544 0 2024-03-16T10:53:13.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/186: chown d4/dd/df/f19 19 1 2024-03-16T10:53:13.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/187: chown d4/d6/db/f11 6326 1 2024-03-16T10:53:13.104 INFO:tasks.workunit.client.0.smithi017.stdout:1/393: dwrite d1/f78 [0,4194304] 0 2024-03-16T10:53:13.104 INFO:tasks.workunit.client.0.smithi017.stdout:1/394: fdatasync d1/d3/f29 0 2024-03-16T10:53:13.107 INFO:tasks.workunit.client.0.smithi017.stdout:8/286: dwrite d6/d7/fa [0,4194304] 0 2024-03-16T10:53:13.108 INFO:tasks.workunit.client.0.smithi017.stdout:2/188: write d4/f8 [1670615,109770] 0 2024-03-16T10:53:13.114 INFO:tasks.workunit.client.0.smithi017.stdout:8/287: mknod d6/d39/d35/c60 0 2024-03-16T10:53:13.123 INFO:tasks.workunit.client.0.smithi017.stdout:1/395: dwrite d1/d3/f29 [4194304,4194304] 0 2024-03-16T10:53:13.128 INFO:tasks.workunit.client.0.smithi017.stdout:2/189: dwrite d4/d6/f10 [0,4194304] 0 2024-03-16T10:53:13.130 INFO:tasks.workunit.client.0.smithi017.stdout:1/396: write d1/d3/f23 [2137047,16636] 0 2024-03-16T10:53:13.132 INFO:tasks.workunit.client.0.smithi017.stdout:2/190: rmdir d4/d32 0 2024-03-16T10:53:13.132 INFO:tasks.workunit.client.0.smithi017.stdout:2/191: read d4/dd/f14 [4443618,131068] 0 2024-03-16T10:53:13.145 INFO:tasks.workunit.client.0.smithi017.stdout:1/397: dwrite d1/d3/dd/f1f [0,4194304] 0 2024-03-16T10:53:13.147 INFO:tasks.workunit.client.0.smithi017.stdout:1/398: fdatasync d1/d3/de/d36/d45/f6e 0 2024-03-16T10:53:13.164 INFO:tasks.workunit.client.0.smithi017.stdout:1/399: symlink d1/d50/d61/l81 0 2024-03-16T10:53:13.164 INFO:tasks.workunit.client.0.smithi017.stdout:1/400: stat d1/f47 0 2024-03-16T10:53:13.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/210: rename d2/d4/f6 to d2/d7/de/d19/f56 0 2024-03-16T10:53:13.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/247: rename d0/d9/da to d0/d9/d45/d4d 0 2024-03-16T10:53:13.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/175: rename d8/df/f13 to d8/d2d/d32/f33 0 2024-03-16T10:53:13.177 INFO:tasks.workunit.client.0.smithi017.stdout:9/176: write d8/df/f1a [3344650,8064] 0 2024-03-16T10:53:13.177 INFO:tasks.workunit.client.0.smithi017.stdout:9/177: fdatasync d8/f29 0 2024-03-16T10:53:13.178 INFO:tasks.workunit.client.0.smithi017.stdout:6/248: write d0/dc/f19 [2898305,50498] 0 2024-03-16T10:53:13.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/228: sync 2024-03-16T10:53:13.180 INFO:tasks.workunit.client.0.smithi017.stdout:0/211: write d2/d4/f1d [1056253,119672] 0 2024-03-16T10:53:13.182 INFO:tasks.workunit.client.0.smithi017.stdout:0/212: mknod d2/d7/d24/d3a/c57 0 2024-03-16T10:53:13.182 INFO:tasks.workunit.client.0.smithi017.stdout:0/213: fdatasync d2/d7/de/d19/d2e/f4e 0 2024-03-16T10:53:13.183 INFO:tasks.workunit.client.0.smithi017.stdout:5/314: rename d0/d1/d2/l10 to d0/d1/d30/l6e 0 2024-03-16T10:53:13.183 INFO:tasks.workunit.client.0.smithi017.stdout:5/315: readlink d0/d1/d2/dc/l56 0 2024-03-16T10:53:13.183 INFO:tasks.workunit.client.0.smithi017.stdout:0/214: symlink d2/d7/d24/d3a/l58 0 2024-03-16T10:53:13.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/215: mkdir d2/d7/d24/d59 0 2024-03-16T10:53:13.186 INFO:tasks.workunit.client.0.smithi017.stdout:0/216: truncate d2/d7/d24/d29/f2c 223648 0 2024-03-16T10:53:13.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/217: creat d2/d25/f5a x:0 0 0 2024-03-16T10:53:13.188 INFO:tasks.workunit.client.0.smithi017.stdout:6/249: rmdir d0/d21/d39 39 2024-03-16T10:53:13.189 INFO:tasks.workunit.client.0.smithi017.stdout:0/218: symlink d2/d25/l5b 0 2024-03-16T10:53:13.189 INFO:tasks.workunit.client.0.smithi017.stdout:7/229: creat d7/db/d12/d1c/f51 x:0 0 0 2024-03-16T10:53:13.191 INFO:tasks.workunit.client.0.smithi017.stdout:0/219: creat d2/d7/f5c x:0 0 0 2024-03-16T10:53:13.192 INFO:tasks.workunit.client.0.smithi017.stdout:3/185: rename d8/d1b/d2e/c34 to d8/d1b/d1c/d30/c3a 0 2024-03-16T10:53:13.193 INFO:tasks.workunit.client.0.smithi017.stdout:6/250: creat d0/d9/d45/d4d/d2c/d41/f4e x:0 0 0 2024-03-16T10:53:13.194 INFO:tasks.workunit.client.0.smithi017.stdout:7/230: creat d7/db/f52 x:0 0 0 2024-03-16T10:53:13.196 INFO:tasks.workunit.client.0.smithi017.stdout:0/220: symlink d2/d7/de/d19/d2e/l5d 0 2024-03-16T10:53:13.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/221: getdents d2/d32 0 2024-03-16T10:53:13.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/222: truncate d2/f11 1005802 0 2024-03-16T10:53:13.199 INFO:tasks.workunit.client.0.smithi017.stdout:3/186: dread d8/d1b/d1c/f2f [0,4194304] 0 2024-03-16T10:53:13.199 INFO:tasks.workunit.client.0.smithi017.stdout:3/187: write d8/da/fe [4735438,87637] 0 2024-03-16T10:53:13.200 INFO:tasks.workunit.client.0.smithi017.stdout:4/269: rename f6 to d15/d1d/d27/f55 0 2024-03-16T10:53:13.202 INFO:tasks.workunit.client.0.smithi017.stdout:6/251: creat d0/d21/d39/d44/f4f x:0 0 0 2024-03-16T10:53:13.205 INFO:tasks.workunit.client.0.smithi017.stdout:7/231: mkdir d7/db/d45/d33/d34/d53 0 2024-03-16T10:53:13.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/232: dread d7/db/f28 [0,4194304] 0 2024-03-16T10:53:13.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/233: write d7/db/f52 [724331,86319] 0 2024-03-16T10:53:13.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/234: readlink d7/db/d45/l22 0 2024-03-16T10:53:13.209 INFO:tasks.workunit.client.0.smithi017.stdout:3/188: creat d8/d1b/d1c/d30/f3b x:0 0 0 2024-03-16T10:53:13.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/270: creat d15/d1d/f56 x:0 0 0 2024-03-16T10:53:13.216 INFO:tasks.workunit.client.0.smithi017.stdout:7/235: unlink d7/db/dc/ff 0 2024-03-16T10:53:13.217 INFO:tasks.workunit.client.0.smithi017.stdout:3/189: symlink d8/d1d/l3c 0 2024-03-16T10:53:13.219 INFO:tasks.workunit.client.0.smithi017.stdout:8/288: rename d6/d7/d43/f5e to d6/d7/d34/f61 0 2024-03-16T10:53:13.219 INFO:tasks.workunit.client.0.smithi017.stdout:8/289: getdents d6/d16 0 2024-03-16T10:53:13.220 INFO:tasks.workunit.client.0.smithi017.stdout:6/252: dwrite d0/d9/d45/d4d/d2e/f4b [0,4194304] 0 2024-03-16T10:53:13.221 INFO:tasks.workunit.client.0.smithi017.stdout:4/271: truncate d15/d1d/d27/f30 1320776 0 2024-03-16T10:53:13.221 INFO:tasks.workunit.client.0.smithi017.stdout:4/272: write d15/d1d/d27/d28/f32 [1954659,116752] 0 2024-03-16T10:53:13.222 INFO:tasks.workunit.client.0.smithi017.stdout:3/190: rmdir d8/d1d 39 2024-03-16T10:53:13.223 INFO:tasks.workunit.client.0.smithi017.stdout:0/223: dwrite d2/d7/de/f27 [0,4194304] 0 2024-03-16T10:53:13.225 INFO:tasks.workunit.client.0.smithi017.stdout:2/192: rename d4/l2a to d4/d6/db/l33 0 2024-03-16T10:53:13.226 INFO:tasks.workunit.client.0.smithi017.stdout:2/193: truncate d4/f2c 214544 0 2024-03-16T10:53:13.226 INFO:tasks.workunit.client.0.smithi017.stdout:8/290: getdents d6/d7 0 2024-03-16T10:53:13.226 INFO:tasks.workunit.client.0.smithi017.stdout:0/224: dread d2/f5 [0,4194304] 0 2024-03-16T10:53:13.227 INFO:tasks.workunit.client.0.smithi017.stdout:0/225: dread - d2/d7/de/d19/d2e/f3e zero size 2024-03-16T10:53:13.231 INFO:tasks.workunit.client.0.smithi017.stdout:6/253: unlink d0/dc/l10 0 2024-03-16T10:53:13.233 INFO:tasks.workunit.client.0.smithi017.stdout:3/191: mkdir d8/d1b/d1c/d30/d3d 0 2024-03-16T10:53:13.233 INFO:tasks.workunit.client.0.smithi017.stdout:3/192: chown d8/da/db/f23 166557793 1 2024-03-16T10:53:13.234 INFO:tasks.workunit.client.0.smithi017.stdout:3/193: chown d8/da/f31 22 1 2024-03-16T10:53:13.237 INFO:tasks.workunit.client.0.smithi017.stdout:1/401: rename d1/d3/d16/c7e to d1/d3/de/d36/d67/c82 0 2024-03-16T10:53:13.241 INFO:tasks.workunit.client.0.smithi017.stdout:2/194: unlink d4/d6/db/l12 0 2024-03-16T10:53:13.243 INFO:tasks.workunit.client.0.smithi017.stdout:0/226: dwrite d2/d25/f5a [0,4194304] 0 2024-03-16T10:53:13.244 INFO:tasks.workunit.client.0.smithi017.stdout:8/291: unlink d6/d7/c4b 0 2024-03-16T10:53:13.244 INFO:tasks.workunit.client.0.smithi017.stdout:8/292: fsync d6/d39/d35/f53 0 2024-03-16T10:53:13.247 INFO:tasks.workunit.client.0.smithi017.stdout:9/178: rename d8/fa to d8/d2d/d32/f34 0 2024-03-16T10:53:13.249 INFO:tasks.workunit.client.0.smithi017.stdout:6/254: dwrite d0/d9/d45/d4d/d2c/f4c [0,4194304] 0 2024-03-16T10:53:13.249 INFO:tasks.workunit.client.0.smithi017.stdout:6/255: dread - d0/d21/d39/d44/f4f zero size 2024-03-16T10:53:13.251 INFO:tasks.workunit.client.0.smithi017.stdout:6/256: dread d0/d15/f1c [0,4194304] 0 2024-03-16T10:53:13.251 INFO:tasks.workunit.client.0.smithi017.stdout:6/257: write d0/dc/f19 [1843724,127547] 0 2024-03-16T10:53:13.251 INFO:tasks.workunit.client.0.smithi017.stdout:1/402: dwrite d1/f47 [0,4194304] 0 2024-03-16T10:53:13.252 INFO:tasks.workunit.client.0.smithi017.stdout:8/293: mknod d6/d14/c62 0 2024-03-16T10:53:13.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/194: dwrite d8/d1d/f1f [4194304,4194304] 0 2024-03-16T10:53:13.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/195: chown d8/da/db/c16 37803748 1 2024-03-16T10:53:13.253 INFO:tasks.workunit.client.0.smithi017.stdout:0/227: rmdir d2/d7/d4d 0 2024-03-16T10:53:13.255 INFO:tasks.workunit.client.0.smithi017.stdout:5/316: rename d0/d1/d2/d24/l44 to d0/d1/d2/dc/d2f/d37/d57/l6f 0 2024-03-16T10:53:13.256 INFO:tasks.workunit.client.0.smithi017.stdout:9/179: rmdir d8/d2d 39 2024-03-16T10:53:13.261 INFO:tasks.workunit.client.0.smithi017.stdout:8/294: dread d6/d7/d34/f3f [0,4194304] 0 2024-03-16T10:53:13.262 INFO:tasks.workunit.client.0.smithi017.stdout:6/258: truncate d0/f3 580240 0 2024-03-16T10:53:13.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/259: fdatasync d0/d22/f27 0 2024-03-16T10:53:13.264 INFO:tasks.workunit.client.0.smithi017.stdout:1/403: symlink d1/d3/l83 0 2024-03-16T10:53:13.269 INFO:tasks.workunit.client.0.smithi017.stdout:3/196: dwrite d8/f17 [0,4194304] 0 2024-03-16T10:53:13.270 INFO:tasks.workunit.client.0.smithi017.stdout:0/228: symlink d2/d7/de/d1e/l5e 0 2024-03-16T10:53:13.272 INFO:tasks.workunit.client.0.smithi017.stdout:0/229: mknod d2/d25/c5f 0 2024-03-16T10:53:13.272 INFO:tasks.workunit.client.0.smithi017.stdout:0/230: truncate d2/d25/f33 1232187 0 2024-03-16T10:53:13.273 INFO:tasks.workunit.client.0.smithi017.stdout:7/236: rename d7/db/d45/f46 to d7/db/d32/f54 0 2024-03-16T10:53:13.273 INFO:tasks.workunit.client.0.smithi017.stdout:7/237: fsync d7/db/d12/f4c 0 2024-03-16T10:53:13.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/231: creat d2/d7/d24/d3a/f60 x:0 0 0 2024-03-16T10:53:13.274 INFO:tasks.workunit.client.0.smithi017.stdout:5/317: rmdir d0/d1/d30 39 2024-03-16T10:53:13.274 INFO:tasks.workunit.client.0.smithi017.stdout:5/318: fsync d0/d1/f65 0 2024-03-16T10:53:13.275 INFO:tasks.workunit.client.0.smithi017.stdout:9/180: mknod d8/d2d/d32/c35 0 2024-03-16T10:53:13.275 INFO:tasks.workunit.client.0.smithi017.stdout:9/181: write d8/df/f11 [835473,33525] 0 2024-03-16T10:53:13.275 INFO:tasks.workunit.client.0.smithi017.stdout:9/182: stat d8/df/c31 0 2024-03-16T10:53:13.279 INFO:tasks.workunit.client.0.smithi017.stdout:7/238: write d7/db/d32/f54 [172202,99456] 0 2024-03-16T10:53:13.282 INFO:tasks.workunit.client.0.smithi017.stdout:3/197: write d8/d1b/f27 [3021773,94921] 0 2024-03-16T10:53:13.282 INFO:tasks.workunit.client.0.smithi017.stdout:3/198: write d8/da/db/f19 [2388661,48439] 0 2024-03-16T10:53:13.282 INFO:tasks.workunit.client.0.smithi017.stdout:4/273: rename d15 to d15/d57 22 2024-03-16T10:53:13.282 INFO:tasks.workunit.client.0.smithi017.stdout:2/195: rename d4 to d4/d6/db/d34 22 2024-03-16T10:53:13.282 INFO:tasks.workunit.client.0.smithi017.stdout:5/319: mkdir d0/d1/d2/d70 0 2024-03-16T10:53:13.283 INFO:tasks.workunit.client.0.smithi017.stdout:0/232: mkdir d2/d4/d61 0 2024-03-16T10:53:13.285 INFO:tasks.workunit.client.0.smithi017.stdout:6/260: truncate d0/d9/d45/d4d/d2e/f4b 769492 0 2024-03-16T10:53:13.290 INFO:tasks.workunit.client.0.smithi017.stdout:7/239: link d7/db/d45/d33/d34/f44 d7/db/d45/d33/f55 0 2024-03-16T10:53:13.294 INFO:tasks.workunit.client.0.smithi017.stdout:3/199: rmdir d8/d1b 39 2024-03-16T10:53:13.294 INFO:tasks.workunit.client.0.smithi017.stdout:3/200: chown d8/da/db/c16 137 1 2024-03-16T10:53:13.294 INFO:tasks.workunit.client.0.smithi017.stdout:3/201: write d8/d1b/d1c/d30/f3b [982777,93642] 0 2024-03-16T10:53:13.296 INFO:tasks.workunit.client.0.smithi017.stdout:5/320: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:13.296 INFO:tasks.workunit.client.0.smithi017.stdout:4/274: link fe d15/d47/f58 0 2024-03-16T10:53:13.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/196: symlink d4/dd/df/l35 0 2024-03-16T10:53:13.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/197: write d4/d6/db/f11 [7548612,30949] 0 2024-03-16T10:53:13.301 INFO:tasks.workunit.client.0.smithi017.stdout:0/233: creat d2/d7/de/d19/f62 x:0 0 0 2024-03-16T10:53:13.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/240: mknod d7/db/d32/c56 0 2024-03-16T10:53:13.305 INFO:tasks.workunit.client.0.smithi017.stdout:3/202: creat d8/d1b/d2e/f3e x:0 0 0 2024-03-16T10:53:13.306 INFO:tasks.workunit.client.0.smithi017.stdout:6/261: write d0/f4 [700607,7299] 0 2024-03-16T10:53:13.306 INFO:tasks.workunit.client.0.smithi017.stdout:6/262: chown d0/d9/d45/d4d/d2c/f4c 1 1 2024-03-16T10:53:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/234: rmdir d2/d7 39 2024-03-16T10:53:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/235: chown d2/d7/de/d19/d2e 9 1 2024-03-16T10:53:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/236: stat d2/c3 0 2024-03-16T10:53:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/237: write d2/d7/f1b [16000,100964] 0 2024-03-16T10:53:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:5/321: symlink d0/d1/d1f/d29/l71 0 2024-03-16T10:53:13.314 INFO:tasks.workunit.client.0.smithi017.stdout:0/238: unlink d2/d7/f18 0 2024-03-16T10:53:13.315 INFO:tasks.workunit.client.0.smithi017.stdout:4/275: creat d15/f59 x:0 0 0 2024-03-16T10:53:13.315 INFO:tasks.workunit.client.0.smithi017.stdout:8/295: rename d6/d14/c62 to d6/d7/d43/c63 0 2024-03-16T10:53:13.316 INFO:tasks.workunit.client.0.smithi017.stdout:0/239: creat d2/d7/f63 x:0 0 0 2024-03-16T10:53:13.317 INFO:tasks.workunit.client.0.smithi017.stdout:2/198: creat d4/dd/d1e/f36 x:0 0 0 2024-03-16T10:53:13.319 INFO:tasks.workunit.client.0.smithi017.stdout:0/240: creat d2/d7/f64 x:0 0 0 2024-03-16T10:53:13.319 INFO:tasks.workunit.client.0.smithi017.stdout:7/241: symlink d7/db/dc/d50/l57 0 2024-03-16T10:53:13.322 INFO:tasks.workunit.client.0.smithi017.stdout:6/263: link d0/d3e/c48 d0/d9/d45/c50 0 2024-03-16T10:53:13.330 INFO:tasks.workunit.client.0.smithi017.stdout:1/404: rename d1/d3/dd/d31/d35/c69 to d1/d50/c84 0 2024-03-16T10:53:13.330 INFO:tasks.workunit.client.0.smithi017.stdout:1/405: readlink d1/d3/de/l11 0 2024-03-16T10:53:13.332 INFO:tasks.workunit.client.0.smithi017.stdout:4/276: rmdir d15/d1d/d27/d53 0 2024-03-16T10:53:13.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/296: mkdir d6/d5f/d64 0 2024-03-16T10:53:13.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/297: chown d6/d7/f17 0 1 2024-03-16T10:53:13.337 INFO:tasks.workunit.client.0.smithi017.stdout:2/199: mknod d4/d6/d30/c37 0 2024-03-16T10:53:13.337 INFO:tasks.workunit.client.0.smithi017.stdout:2/200: chown d4/d6/db/f13 21 1 2024-03-16T10:53:13.338 INFO:tasks.workunit.client.0.smithi017.stdout:7/242: mknod d7/db/c58 0 2024-03-16T10:53:13.342 INFO:tasks.workunit.client.0.smithi017.stdout:6/264: link d0/ce d0/d22/c51 0 2024-03-16T10:53:13.342 INFO:tasks.workunit.client.0.smithi017.stdout:6/265: fsync d0/d9/d45/d4d/f25 0 2024-03-16T10:53:13.342 INFO:tasks.workunit.client.0.smithi017.stdout:6/266: readlink d0/d9/d45/d4d/l47 0 2024-03-16T10:53:13.347 INFO:tasks.workunit.client.0.smithi017.stdout:9/183: rename d8/df/ce to d8/d2d/d32/c36 0 2024-03-16T10:53:13.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/406: rmdir d1/d3/de/d36/d67/d7f 0 2024-03-16T10:53:13.351 INFO:tasks.workunit.client.0.smithi017.stdout:8/298: mkdir d6/d4a/d65 0 2024-03-16T10:53:13.352 INFO:tasks.workunit.client.0.smithi017.stdout:2/201: mkdir d4/dd/d38 0 2024-03-16T10:53:13.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/243: write d7/db/d12/d1c/f41 [526943,11693] 0 2024-03-16T10:53:13.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/203: rename d8/d1b/d1c/d30 to d8/d3f 0 2024-03-16T10:53:13.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/204: chown d8/da/db/c16 7284816 1 2024-03-16T10:53:13.356 INFO:tasks.workunit.client.0.smithi017.stdout:9/184: dwrite d8/f30 [0,4194304] 0 2024-03-16T10:53:13.357 INFO:tasks.workunit.client.0.smithi017.stdout:1/407: rmdir d1/d3/de 39 2024-03-16T10:53:13.357 INFO:tasks.workunit.client.0.smithi017.stdout:7/244: dread f2 [0,4194304] 0 2024-03-16T10:53:13.359 INFO:tasks.workunit.client.0.smithi017.stdout:2/202: mkdir d4/d6/db/d24/d39 0 2024-03-16T10:53:13.359 INFO:tasks.workunit.client.0.smithi017.stdout:2/203: truncate d4/dd/df/f1b 1072536 0 2024-03-16T10:53:13.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/241: rename d2/c3 to d2/d25/c65 0 2024-03-16T10:53:13.371 INFO:tasks.workunit.client.0.smithi017.stdout:9/185: creat d8/f37 x:0 0 0 2024-03-16T10:53:13.372 INFO:tasks.workunit.client.0.smithi017.stdout:2/204: rmdir d4/dd/d1e/d28/d2e 39 2024-03-16T10:53:13.377 INFO:tasks.workunit.client.0.smithi017.stdout:9/186: creat d8/f38 x:0 0 0 2024-03-16T10:53:13.380 INFO:tasks.workunit.client.0.smithi017.stdout:1/408: dwrite d1/d3/dd/d31/d35/f3e [0,4194304] 0 2024-03-16T10:53:13.380 INFO:tasks.workunit.client.0.smithi017.stdout:2/205: link d4/d6/fa d4/dd/d1e/d28/d2e/f3a 0 2024-03-16T10:53:13.383 INFO:tasks.workunit.client.0.smithi017.stdout:4/277: rename d15/d1d/d21/l31 to d15/l5a 0 2024-03-16T10:53:13.385 INFO:tasks.workunit.client.0.smithi017.stdout:3/205: dwrite d8/da/f31 [0,4194304] 0 2024-03-16T10:53:13.386 INFO:tasks.workunit.client.0.smithi017.stdout:1/409: creat d1/d3/d57/f85 x:0 0 0 2024-03-16T10:53:13.387 INFO:tasks.workunit.client.0.smithi017.stdout:8/299: dwrite d6/d7/d43/f3c [0,4194304] 0 2024-03-16T10:53:13.387 INFO:tasks.workunit.client.0.smithi017.stdout:0/242: dwrite d2/d7/de/d19/d2e/f48 [0,4194304] 0 2024-03-16T10:53:13.388 INFO:tasks.workunit.client.0.smithi017.stdout:2/206: creat d4/d6/db/d24/d39/f3b x:0 0 0 2024-03-16T10:53:13.388 INFO:tasks.workunit.client.0.smithi017.stdout:2/207: chown d4/dd/d1e 44017370 1 2024-03-16T10:53:13.390 INFO:tasks.workunit.client.0.smithi017.stdout:6/267: rename d0/d15/l26 to d0/d15/d1f/l52 0 2024-03-16T10:53:13.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/206: symlink d8/d1b/d2e/l40 0 2024-03-16T10:53:13.397 INFO:tasks.workunit.client.0.smithi017.stdout:8/300: rmdir d6/d5f/d64 0 2024-03-16T10:53:13.401 INFO:tasks.workunit.client.0.smithi017.stdout:2/208: creat d4/dd/d1e/d28/d2e/f3c x:0 0 0 2024-03-16T10:53:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:7/245: rename d7/db/d45/d33 to d7/db/dc/d50/d59 0 2024-03-16T10:53:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:6/268: dwrite d0/f3 [0,4194304] 0 2024-03-16T10:53:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:6/269: write d0/d9/d45/d4d/d2c/d41/f4e [719424,9289] 0 2024-03-16T10:53:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:8/301: dread d6/d39/d35/f21 [4194304,4194304] 0 2024-03-16T10:53:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/207: dwrite d8/da/db/f15 [4194304,4194304] 0 2024-03-16T10:53:13.407 INFO:tasks.workunit.client.0.smithi017.stdout:2/209: rmdir d4/d6 39 2024-03-16T10:53:13.410 INFO:tasks.workunit.client.0.smithi017.stdout:9/187: rename d8/f29 to d8/d2d/d32/f39 0 2024-03-16T10:53:13.410 INFO:tasks.workunit.client.0.smithi017.stdout:9/188: chown d8/df/c20 10 1 2024-03-16T10:53:13.411 INFO:tasks.workunit.client.0.smithi017.stdout:0/243: symlink d2/d7/de/l66 0 2024-03-16T10:53:13.412 INFO:tasks.workunit.client.0.smithi017.stdout:7/246: mkdir d7/d5a 0 2024-03-16T10:53:13.415 INFO:tasks.workunit.client.0.smithi017.stdout:6/270: write d0/d9/d45/d4d/f25 [3105570,68087] 0 2024-03-16T10:53:13.417 INFO:tasks.workunit.client.0.smithi017.stdout:9/189: dread d8/f30 [0,4194304] 0 2024-03-16T10:53:13.418 INFO:tasks.workunit.client.0.smithi017.stdout:9/190: dread d8/d2d/d32/f39 [0,4194304] 0 2024-03-16T10:53:13.418 INFO:tasks.workunit.client.0.smithi017.stdout:3/208: creat d8/d1b/d1c/f41 x:0 0 0 2024-03-16T10:53:13.421 INFO:tasks.workunit.client.0.smithi017.stdout:6/271: dread d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:13.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/278: rename fe to d15/d1d/d50/f5b 0 2024-03-16T10:53:13.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/279: stat d15/d1d 0 2024-03-16T10:53:13.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/280: fdatasync d15/d47/f4e 0 2024-03-16T10:53:13.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/281: truncate d15/d1d/d27/d28/d40/f44 942797 0 2024-03-16T10:53:13.424 INFO:tasks.workunit.client.0.smithi017.stdout:6/272: dread d0/f3c [0,4194304] 0 2024-03-16T10:53:13.426 INFO:tasks.workunit.client.0.smithi017.stdout:8/302: dwrite d6/d39/f32 [0,4194304] 0 2024-03-16T10:53:13.427 INFO:tasks.workunit.client.0.smithi017.stdout:9/191: creat d8/d2d/f3a x:0 0 0 2024-03-16T10:53:13.427 INFO:tasks.workunit.client.0.smithi017.stdout:9/192: write d8/d2d/d32/f39 [1395223,27397] 0 2024-03-16T10:53:13.428 INFO:tasks.workunit.client.0.smithi017.stdout:0/244: dwrite d2/d7/de/d19/d2e/f4e [0,4194304] 0 2024-03-16T10:53:13.430 INFO:tasks.workunit.client.0.smithi017.stdout:1/410: rename d1/d24/f4e to d1/d50/d7c/f86 0 2024-03-16T10:53:13.435 INFO:tasks.workunit.client.0.smithi017.stdout:9/193: write d8/d2d/d32/f34 [2363937,34985] 0 2024-03-16T10:53:13.435 INFO:tasks.workunit.client.0.smithi017.stdout:9/194: fdatasync d8/f38 0 2024-03-16T10:53:13.436 INFO:tasks.workunit.client.0.smithi017.stdout:3/209: dwrite d8/d3f/f3b [0,4194304] 0 2024-03-16T10:53:13.439 INFO:tasks.workunit.client.0.smithi017.stdout:2/210: rename d4/dd/f27 to d4/dd/d1e/d28/d2e/f3d 0 2024-03-16T10:53:13.442 INFO:tasks.workunit.client.0.smithi017.stdout:9/195: creat d8/d2d/f3b x:0 0 0 2024-03-16T10:53:13.446 INFO:tasks.workunit.client.0.smithi017.stdout:3/210: creat d8/da/db/f42 x:0 0 0 2024-03-16T10:53:13.448 INFO:tasks.workunit.client.0.smithi017.stdout:4/282: rename d15/d1d/d21/c22 to d15/d47/c5c 0 2024-03-16T10:53:13.449 INFO:tasks.workunit.client.0.smithi017.stdout:2/211: write d4/dd/d1e/d28/d2e/f3a [209241,115868] 0 2024-03-16T10:53:13.449 INFO:tasks.workunit.client.0.smithi017.stdout:2/212: stat d4/d6/f10 0 2024-03-16T10:53:13.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/213: write d4/d6/f26 [741407,62618] 0 2024-03-16T10:53:13.450 INFO:tasks.workunit.client.0.smithi017.stdout:0/245: dwrite d2/d7/f1a [0,4194304] 0 2024-03-16T10:53:13.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/246: write d2/d32/f53 [26417,103530] 0 2024-03-16T10:53:13.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/247: read - d2/d7/de/d19/f4c zero size 2024-03-16T10:53:13.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/248: write d2/d7/de/d19/f4c [706374,56457] 0 2024-03-16T10:53:13.451 INFO:tasks.workunit.client.0.smithi017.stdout:3/211: mknod d8/c43 0 2024-03-16T10:53:13.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/283: getdents d15/d1d/d21/d3c 0 2024-03-16T10:53:13.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/284: chown d15/d1d/d21/c4f 229228988 1 2024-03-16T10:53:13.453 INFO:tasks.workunit.client.0.smithi017.stdout:8/303: dwrite f2 [0,4194304] 0 2024-03-16T10:53:13.455 INFO:tasks.workunit.client.0.smithi017.stdout:2/214: truncate d4/dd/df/f19 1134084 0 2024-03-16T10:53:13.457 INFO:tasks.workunit.client.0.smithi017.stdout:0/249: write d2/d7/de/f16 [2101334,101965] 0 2024-03-16T10:53:13.457 INFO:tasks.workunit.client.0.smithi017.stdout:3/212: symlink d8/d1b/l44 0 2024-03-16T10:53:13.458 INFO:tasks.workunit.client.0.smithi017.stdout:0/250: getdents d2/d7/d24/d29 0 2024-03-16T10:53:13.458 INFO:tasks.workunit.client.0.smithi017.stdout:0/251: stat d2/d7/f64 0 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/285: creat d15/d1d/f5d x:0 0 0 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/286: write d15/d1d/d21/d26/f4d [728727,41973] 0 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/287: fdatasync d15/d1d/f24 0 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/288: dread - d15/d1d/d27/f49 zero size 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/289: write d15/f19 [7083362,2474] 0 2024-03-16T10:53:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/290: dread - d15/d1d/d27/d28/f3a zero size 2024-03-16T10:53:13.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/252: creat d2/d4/f67 x:0 0 0 2024-03-16T10:53:13.460 INFO:tasks.workunit.client.0.smithi017.stdout:8/304: getdents d6/d7/d43 0 2024-03-16T10:53:13.461 INFO:tasks.workunit.client.0.smithi017.stdout:3/213: symlink d8/d3f/d3d/l45 0 2024-03-16T10:53:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/215: write d4/dd/f14 [245124,64296] 0 2024-03-16T10:53:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/216: fsync d4/d6/f16 0 2024-03-16T10:53:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/217: write d4/d6/f26 [1134981,13131] 0 2024-03-16T10:53:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:0/253: rmdir d2/d7/d24/d59 0 2024-03-16T10:53:13.465 INFO:tasks.workunit.client.0.smithi017.stdout:4/291: rmdir d15/d1d/d50 39 2024-03-16T10:53:13.465 INFO:tasks.workunit.client.0.smithi017.stdout:0/254: mknod d2/d7/c68 0 2024-03-16T10:53:13.467 INFO:tasks.workunit.client.0.smithi017.stdout:8/305: creat d6/d16/f66 x:0 0 0 2024-03-16T10:53:13.467 INFO:tasks.workunit.client.0.smithi017.stdout:3/214: dread d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:13.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/292: fsync d15/d1d/d21/d26/f4d 0 2024-03-16T10:53:13.468 INFO:tasks.workunit.client.0.smithi017.stdout:3/215: dread d8/da/db/f2a [0,4194304] 0 2024-03-16T10:53:13.468 INFO:tasks.workunit.client.0.smithi017.stdout:3/216: readlink d8/d1d/l25 0 2024-03-16T10:53:13.472 INFO:tasks.workunit.client.0.smithi017.stdout:0/255: symlink d2/d7/de/d19/l69 0 2024-03-16T10:53:13.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/256: dread d2/f23 [0,4194304] 0 2024-03-16T10:53:13.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/257: chown d2/d7/f64 13532 1 2024-03-16T10:53:13.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/293: creat d15/d1d/d21/f5e x:0 0 0 2024-03-16T10:53:13.478 INFO:tasks.workunit.client.0.smithi017.stdout:3/217: creat d8/d1d/f46 x:0 0 0 2024-03-16T10:53:13.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/294: symlink d15/d1d/d27/d28/l5f 0 2024-03-16T10:53:13.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/295: truncate f4 4194527 0 2024-03-16T10:53:13.486 INFO:tasks.workunit.client.0.smithi017.stdout:4/296: truncate d15/d1d/f36 3086327 0 2024-03-16T10:53:13.488 INFO:tasks.workunit.client.0.smithi017.stdout:4/297: mknod d15/d1d/d27/d28/d40/c60 0 2024-03-16T10:53:13.490 INFO:tasks.workunit.client.0.smithi017.stdout:1/411: rename d1/d50/d7c/f86 to d1/d3/f87 0 2024-03-16T10:53:13.491 INFO:tasks.workunit.client.0.smithi017.stdout:1/412: chown d1/d3/de/c1d 13111 1 2024-03-16T10:53:13.491 INFO:tasks.workunit.client.0.smithi017.stdout:1/413: fsync d1/f5c 0 2024-03-16T10:53:13.493 INFO:tasks.workunit.client.0.smithi017.stdout:0/258: dwrite d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:13.493 INFO:tasks.workunit.client.0.smithi017.stdout:0/259: truncate d2/d7/de/d19/d2e/f4b 155136 0 2024-03-16T10:53:13.493 INFO:tasks.workunit.client.0.smithi017.stdout:0/260: chown d2/f5 15 1 2024-03-16T10:53:13.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/218: dwrite d8/da/db/f42 [0,4194304] 0 2024-03-16T10:53:13.496 INFO:tasks.workunit.client.0.smithi017.stdout:2/218: getdents d4/dd 0 2024-03-16T10:53:13.499 INFO:tasks.workunit.client.0.smithi017.stdout:1/414: dread d1/d3/dd/f1f [0,4194304] 0 2024-03-16T10:53:13.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/219: symlink d8/d1b/d1c/l47 0 2024-03-16T10:53:13.504 INFO:tasks.workunit.client.0.smithi017.stdout:3/220: write d8/da/db/f2a [847714,86861] 0 2024-03-16T10:53:13.513 INFO:tasks.workunit.client.0.smithi017.stdout:1/415: write d1/d3/dd/d31/d35/f38 [2052783,101575] 0 2024-03-16T10:53:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/219: dwrite d4/dd/f14 [4194304,4194304] 0 2024-03-16T10:53:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/220: write d4/d6/f21 [2717356,33743] 0 2024-03-16T10:53:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/221: chown d4/f25 233666664 1 2024-03-16T10:53:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/222: chown d4/d6/f20 50097 1 2024-03-16T10:53:13.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/298: dwrite fc [0,4194304] 0 2024-03-16T10:53:13.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/299: readlink d15/d1d/d27/d28/l3f 0 2024-03-16T10:53:13.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/300: chown d15/d47/f58 4 1 2024-03-16T10:53:13.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/416: dread d1/d3/fb [0,4194304] 0 2024-03-16T10:53:13.521 INFO:tasks.workunit.client.0.smithi017.stdout:0/261: dwrite d2/d4/f1c [0,4194304] 0 2024-03-16T10:53:13.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/417: readlink d1/d3/d16/l3f 0 2024-03-16T10:53:13.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/418: stat d1/d3/dd/l2d 0 2024-03-16T10:53:13.523 INFO:tasks.workunit.client.0.smithi017.stdout:0/262: creat d2/d7/d24/d29/f6a x:0 0 0 2024-03-16T10:53:13.523 INFO:tasks.workunit.client.0.smithi017.stdout:0/263: dread - d2/d7/d24/d29/f40 zero size 2024-03-16T10:53:13.525 INFO:tasks.workunit.client.0.smithi017.stdout:1/419: mkdir d1/d3/d88 0 2024-03-16T10:53:13.527 INFO:tasks.workunit.client.0.smithi017.stdout:0/264: mkdir d2/d7/de/d19/d2e/d6b 0 2024-03-16T10:53:13.529 INFO:tasks.workunit.client.0.smithi017.stdout:1/420: mknod d1/d3/d16/c89 0 2024-03-16T10:53:13.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/221: dwrite d8/d1b/d1c/f26 [0,4194304] 0 2024-03-16T10:53:13.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/223: write d4/d6/f10 [3843948,56658] 0 2024-03-16T10:53:13.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/222: chown d8/d1b/c22 1778001226 1 2024-03-16T10:53:13.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/224: chown d4/d6/fa 13 1 2024-03-16T10:53:13.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/223: chown d8/da/l2b 786417686 1 2024-03-16T10:53:13.531 INFO:tasks.workunit.client.0.smithi017.stdout:1/421: creat d1/d3/f8a x:0 0 0 2024-03-16T10:53:13.533 INFO:tasks.workunit.client.0.smithi017.stdout:1/422: write d1/d3/dd/f60 [507840,75298] 0 2024-03-16T10:53:13.533 INFO:tasks.workunit.client.0.smithi017.stdout:1/423: chown d1/d3/dd/d31/d35/f3e 18 1 2024-03-16T10:53:13.534 INFO:tasks.workunit.client.0.smithi017.stdout:4/301: dwrite d15/d1d/f1e [0,4194304] 0 2024-03-16T10:53:13.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/225: mkdir d4/dd/d1e/d3e 0 2024-03-16T10:53:13.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/226: write d4/d6/f21 [121046,124769] 0 2024-03-16T10:53:13.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/227: fdatasync d4/d6/db/f11 0 2024-03-16T10:53:13.535 INFO:tasks.workunit.client.0.smithi017.stdout:0/265: rmdir d2/d7/de/d19 39 2024-03-16T10:53:13.539 INFO:tasks.workunit.client.0.smithi017.stdout:1/424: rename d1/d3/d16/f64 to d1/d3/de/f8b 0 2024-03-16T10:53:13.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/302: symlink d15/d47/l61 0 2024-03-16T10:53:13.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/303: chown d15/d1d/d21/c4f 60232 1 2024-03-16T10:53:13.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/228: mkdir d4/d6/d30/d3f 0 2024-03-16T10:53:13.545 INFO:tasks.workunit.client.0.smithi017.stdout:1/425: mknod d1/d3/c8c 0 2024-03-16T10:53:13.547 INFO:tasks.workunit.client.0.smithi017.stdout:4/304: symlink d15/d1d/d27/d28/d40/l62 0 2024-03-16T10:53:13.547 INFO:tasks.workunit.client.0.smithi017.stdout:4/305: chown d15/d1d/d27/d28/l3f 0 1 2024-03-16T10:53:13.547 INFO:tasks.workunit.client.0.smithi017.stdout:4/306: write d15/d1d/f5d [841567,6642] 0 2024-03-16T10:53:13.547 INFO:tasks.workunit.client.0.smithi017.stdout:0/266: dwrite d2/d7/de/d1e/f36 [0,4194304] 0 2024-03-16T10:53:13.548 INFO:tasks.workunit.client.0.smithi017.stdout:2/229: mknod d4/d6/d30/d3f/c40 0 2024-03-16T10:53:13.549 INFO:tasks.workunit.client.0.smithi017.stdout:1/426: rename d1/d50/d7c to d1/d50/d8d 0 2024-03-16T10:53:13.550 INFO:tasks.workunit.client.0.smithi017.stdout:0/267: mkdir d2/d25/d2b/d6c 0 2024-03-16T10:53:13.550 INFO:tasks.workunit.client.0.smithi017.stdout:0/268: readlink d2/d4/l3b 0 2024-03-16T10:53:13.551 INFO:tasks.workunit.client.0.smithi017.stdout:4/307: mkdir d15/d47/d63 0 2024-03-16T10:53:13.558 INFO:tasks.workunit.client.0.smithi017.stdout:0/269: rename d2/d25/d2b to d2/d4/d6d 0 2024-03-16T10:53:13.559 INFO:tasks.workunit.client.0.smithi017.stdout:0/270: creat d2/d4/d6d/f6e x:0 0 0 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000242f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002405 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:13.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:13 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.570 INFO:tasks.workunit.client.0.smithi017.stdout:1/427: write d1/f78 [2612635,82180] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/428: readlink d1/d3/de/l11 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/429: readlink d1/d3/dd/d31/d35/l5a 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/271: dread d2/d4/f1d [0,4194304] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/272: write d2/d7/d24/d3a/f60 [660781,109650] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/273: chown d2/d25/c65 373 1 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/230: dwrite d4/dd/d1e/d28/d2e/f31 [0,4194304] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/231: write d4/d6/f26 [1811346,68177] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/232: chown d4/dd/l2b 12 1 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/430: symlink d1/d3/dd/d31/d66/l8e 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/431: readlink d1/l2e 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/432: stat d1/d3/d16/l28 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/433: chown d1/d3/f3a 19028220 1 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/434: write d1/d3/dd/f1f [4487928,63790] 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/435: truncate d1/d3/dd/f60 4518934 0 2024-03-16T10:53:13.571 INFO:tasks.workunit.client.0.smithi017.stdout:1/436: write d1/d3/de/d36/d67/f6a [1320516,90349] 0 2024-03-16T10:53:13.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/308: rename d15/d47 to d15/d1d/d27/d28/d40/d51/d64 0 2024-03-16T10:53:13.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/309: chown d15/d1d/d27 926 1 2024-03-16T10:53:13.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/310: write d15/d1d/d27/d28/d40/f44 [689626,56067] 0 2024-03-16T10:53:13.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/311: write d15/d1d/d21/f2c [511252,121819] 0 2024-03-16T10:53:13.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/312: readlink d15/l5a 0 2024-03-16T10:53:13.577 INFO:tasks.workunit.client.0.smithi017.stdout:2/233: creat d4/d6/d30/f41 x:0 0 0 2024-03-16T10:53:13.578 INFO:tasks.workunit.client.0.smithi017.stdout:1/437: mkdir d1/d3/dd/d72/d8f 0 2024-03-16T10:53:13.581 INFO:tasks.workunit.client.0.smithi017.stdout:0/274: rmdir d2/d7/de/d19/d2e/d6b 0 2024-03-16T10:53:13.581 INFO:tasks.workunit.client.0.smithi017.stdout:0/275: write d2/d7/de/d19/d2e/f3e [601469,102871] 0 2024-03-16T10:53:13.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/234: creat d4/d6/db/d24/d39/f42 x:0 0 0 2024-03-16T10:53:13.584 INFO:tasks.workunit.client.0.smithi017.stdout:1/438: rmdir d1/d3/dd/d31/d66 39 2024-03-16T10:53:13.584 INFO:tasks.workunit.client.0.smithi017.stdout:1/439: chown d1/d3/de/c37 499244 1 2024-03-16T10:53:13.584 INFO:tasks.workunit.client.0.smithi017.stdout:1/440: read d1/f78 [3068374,106175] 0 2024-03-16T10:53:13.585 INFO:tasks.workunit.client.0.smithi017.stdout:4/313: dwrite d15/f59 [0,4194304] 0 2024-03-16T10:53:13.586 INFO:tasks.workunit.client.0.smithi017.stdout:2/235: creat d4/dd/f43 x:0 0 0 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000242f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002405 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.593 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:13.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:13 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.597 INFO:tasks.workunit.client.0.smithi017.stdout:4/314: rename d15/f1b to d15/f65 0 2024-03-16T10:53:13.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/315: dread f4 [0,4194304] 0 2024-03-16T10:53:13.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/316: stat fa 0 2024-03-16T10:53:13.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/317: chown d15/l2d 63391 1 2024-03-16T10:53:13.603 INFO:tasks.workunit.client.0.smithi017.stdout:1/441: dwrite d1/d3/de/d36/d67/f6a [0,4194304] 0 2024-03-16T10:53:13.603 INFO:tasks.workunit.client.0.smithi017.stdout:2/236: dwrite d4/d6/fa [4194304,4194304] 0 2024-03-16T10:53:13.604 INFO:tasks.workunit.client.0.smithi017.stdout:4/318: truncate fc 1140091 0 2024-03-16T10:53:13.604 INFO:tasks.workunit.client.0.smithi017.stdout:4/319: truncate d15/d1d/d21/d26/f4d 1277919 0 2024-03-16T10:53:13.608 INFO:tasks.workunit.client.0.smithi017.stdout:1/442: mknod d1/d3/dd/d72/c90 0 2024-03-16T10:53:13.612 INFO:tasks.workunit.client.0.smithi017.stdout:2/237: symlink d4/dd/df/l44 0 2024-03-16T10:53:13.612 INFO:tasks.workunit.client.0.smithi017.stdout:5/322: sync 2024-03-16T10:53:13.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/247: sync 2024-03-16T10:53:13.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/320: getdents d15/d1d/d27 0 2024-03-16T10:53:13.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/321: readlink l13 0 2024-03-16T10:53:13.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/322: truncate d15/d1d/d27/f49 724059 0 2024-03-16T10:53:13.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/323: chown d15/d1d/d27/f55 14910658 1 2024-03-16T10:53:13.617 INFO:tasks.workunit.client.0.smithi017.stdout:1/443: symlink d1/d3/dd/l91 0 2024-03-16T10:53:13.617 INFO:tasks.workunit.client.0.smithi017.stdout:1/444: read d1/d3/dd/f60 [4485247,97144] 0 2024-03-16T10:53:13.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/324: dread d15/d1d/f1e [0,4194304] 0 2024-03-16T10:53:13.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/325: fsync d15/d1d/d21/d26/f4d 0 2024-03-16T10:53:13.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/326: write d15/f19 [8806915,121070] 0 2024-03-16T10:53:13.621 INFO:tasks.workunit.client.0.smithi017.stdout:2/238: truncate d4/d6/db/f11 5374163 0 2024-03-16T10:53:13.622 INFO:tasks.workunit.client.0.smithi017.stdout:2/239: chown d4/d6/db/l33 84352 1 2024-03-16T10:53:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:7/248: mkdir d7/d5b 0 2024-03-16T10:53:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:7/249: fsync d7/db/dc/f10 0 2024-03-16T10:53:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:7/250: fsync d7/db/dc/d50/d59/d34/f47 0 2024-03-16T10:53:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/240: dread d4/dd/d1e/d28/d2e/f3d [0,4194304] 0 2024-03-16T10:53:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/241: stat d4/dd/df/l2f 0 2024-03-16T10:53:13.632 INFO:tasks.workunit.client.0.smithi017.stdout:1/445: creat d1/d3/dd/f92 x:0 0 0 2024-03-16T10:53:13.634 INFO:tasks.workunit.client.0.smithi017.stdout:4/327: mkdir d15/d1d/d21/d26/d66 0 2024-03-16T10:53:13.636 INFO:tasks.workunit.client.0.smithi017.stdout:2/242: creat d4/dd/d1e/d3e/f45 x:0 0 0 2024-03-16T10:53:13.636 INFO:tasks.workunit.client.0.smithi017.stdout:2/243: stat d4/dd/df/l2f 0 2024-03-16T10:53:13.636 INFO:tasks.workunit.client.0.smithi017.stdout:4/328: creat d15/d1d/d21/d26/d66/f67 x:0 0 0 2024-03-16T10:53:13.638 INFO:tasks.workunit.client.0.smithi017.stdout:2/244: symlink d4/dd/d1e/d28/d2e/l46 0 2024-03-16T10:53:13.638 INFO:tasks.workunit.client.0.smithi017.stdout:1/446: read d1/d3/f29 [7272378,111160] 0 2024-03-16T10:53:13.639 INFO:tasks.workunit.client.0.smithi017.stdout:2/245: rmdir d4/dd/d1e/d28/d2e 39 2024-03-16T10:53:13.640 INFO:tasks.workunit.client.0.smithi017.stdout:1/447: mkdir d1/d3/d57/d93 0 2024-03-16T10:53:13.642 INFO:tasks.workunit.client.0.smithi017.stdout:2/246: truncate d4/d6/f21 3736256 0 2024-03-16T10:53:13.644 INFO:tasks.workunit.client.0.smithi017.stdout:2/247: dread d4/dd/f1d [0,4194304] 0 2024-03-16T10:53:13.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/248: symlink d4/dd/d1e/l47 0 2024-03-16T10:53:13.646 INFO:tasks.workunit.client.0.smithi017.stdout:2/249: chown d4/d6/db/cc 1069971 1 2024-03-16T10:53:13.646 INFO:tasks.workunit.client.0.smithi017.stdout:2/250: fsync d4/dd/f43 0 2024-03-16T10:53:13.646 INFO:tasks.workunit.client.0.smithi017.stdout:0/276: rename d2/d7/de/f27 to d2/d4/d61/f6f 0 2024-03-16T10:53:13.647 INFO:tasks.workunit.client.0.smithi017.stdout:1/448: dread d1/d3/de/d36/d67/f6a [0,4194304] 0 2024-03-16T10:53:13.647 INFO:tasks.workunit.client.0.smithi017.stdout:1/449: write d1/f5c [4214788,86721] 0 2024-03-16T10:53:13.648 INFO:tasks.workunit.client.0.smithi017.stdout:2/251: link d4/d6/db/f11 d4/d6/db/d24/d39/f48 0 2024-03-16T10:53:13.650 INFO:tasks.workunit.client.0.smithi017.stdout:0/277: dread d2/d4/f1d [0,4194304] 0 2024-03-16T10:53:13.650 INFO:tasks.workunit.client.0.smithi017.stdout:0/278: chown d2/d7/de/d19/d2e/d39 3 1 2024-03-16T10:53:13.652 INFO:tasks.workunit.client.0.smithi017.stdout:0/279: write d2/d25/f33 [1059944,55814] 0 2024-03-16T10:53:13.652 INFO:tasks.workunit.client.0.smithi017.stdout:0/280: fsync d2/d7/de/d19/f62 0 2024-03-16T10:53:13.652 INFO:tasks.workunit.client.0.smithi017.stdout:5/323: rename d0/d1/c48 to d0/d1/d2/d2c/c72 0 2024-03-16T10:53:13.655 INFO:tasks.workunit.client.0.smithi017.stdout:1/450: unlink d1/d3/dd/d31/d35/l4a 0 2024-03-16T10:53:13.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/252: creat d4/dd/df/f49 x:0 0 0 2024-03-16T10:53:13.659 INFO:tasks.workunit.client.0.smithi017.stdout:5/324: unlink d0/d1/d30/f4b 0 2024-03-16T10:53:13.661 INFO:tasks.workunit.client.0.smithi017.stdout:0/281: write d2/d4/d61/f6f [32716,13761] 0 2024-03-16T10:53:13.661 INFO:tasks.workunit.client.0.smithi017.stdout:0/282: readlink d2/d4/l15 0 2024-03-16T10:53:13.661 INFO:tasks.workunit.client.0.smithi017.stdout:1/451: mkdir d1/d3/d57/d94 0 2024-03-16T10:53:13.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002419 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns) see mds.a log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000242f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002405 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000240f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002410 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002415 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002413 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.663 INFO:tasks.workunit.client.0.smithi017.stdout:2/253: unlink d4/l1a 0 2024-03-16T10:53:13.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002414 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002412 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop) see mds.h log and `damage ls` output for details 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:13.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:13 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:13.668 INFO:tasks.workunit.client.0.smithi017.stdout:4/329: rename d15/d1d/d27/f30 to d15/f68 0 2024-03-16T10:53:13.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/452: dread d1/d3/f6d [0,4194304] 0 2024-03-16T10:53:13.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/325: creat d0/d1/d2/dc/d2f/d37/d42/d4c/f73 x:0 0 0 2024-03-16T10:53:13.669 INFO:tasks.workunit.client.0.smithi017.stdout:2/254: mkdir d4/dd/d1e/d4a 0 2024-03-16T10:53:13.669 INFO:tasks.workunit.client.0.smithi017.stdout:2/255: read - d4/dd/d1e/f36 zero size 2024-03-16T10:53:13.669 INFO:tasks.workunit.client.0.smithi017.stdout:2/256: chown d4/dd/d1e/d3e 176652497 1 2024-03-16T10:53:13.669 INFO:tasks.workunit.client.0.smithi017.stdout:4/330: truncate d15/d1d/f29 6638190 0 2024-03-16T10:53:13.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/331: truncate d15/d1d/d27/d28/f38 32504 0 2024-03-16T10:53:13.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/332: dread - d15/d1d/d21/f5e zero size 2024-03-16T10:53:13.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/333: dread - d15/d1d/d27/f3e zero size 2024-03-16T10:53:13.671 INFO:tasks.workunit.client.0.smithi017.stdout:1/453: rename d1/l2e to d1/d3/dd/l95 0 2024-03-16T10:53:13.673 INFO:tasks.workunit.client.0.smithi017.stdout:2/257: unlink d4/d6/d30/f41 0 2024-03-16T10:53:13.673 INFO:tasks.workunit.client.0.smithi017.stdout:2/258: truncate d4/d6/db/d24/d39/f42 261034 0 2024-03-16T10:53:13.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/334: mknod d15/d1d/d50/c69 0 2024-03-16T10:53:13.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/454: mknod d1/d3/de/d36/d67/c96 0 2024-03-16T10:53:13.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/455: chown d1/d50/d61/l4f 27 1 2024-03-16T10:53:13.678 INFO:tasks.workunit.client.0.smithi017.stdout:0/283: dwrite d2/d7/d24/d29/f40 [0,4194304] 0 2024-03-16T10:53:13.678 INFO:tasks.workunit.client.0.smithi017.stdout:1/456: mkdir d1/d3/d57/d97 0 2024-03-16T10:53:13.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/284: read d2/f5 [1368772,67893] 0 2024-03-16T10:53:13.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/285: write d2/d7/d24/d29/f6a [756647,87350] 0 2024-03-16T10:53:13.680 INFO:tasks.workunit.client.0.smithi017.stdout:1/457: mknod d1/d3/c98 0 2024-03-16T10:53:13.680 INFO:tasks.workunit.client.0.smithi017.stdout:1/458: fdatasync d1/f34 0 2024-03-16T10:53:13.680 INFO:tasks.workunit.client.0.smithi017.stdout:1/459: write d1/f34 [297066,72078] 0 2024-03-16T10:53:13.681 INFO:tasks.workunit.client.0.smithi017.stdout:1/460: chown d1/d3/d16/l28 299 1 2024-03-16T10:53:13.682 INFO:tasks.workunit.client.0.smithi017.stdout:4/335: read d15/f1f [3906784,29539] 0 2024-03-16T10:53:13.682 INFO:tasks.workunit.client.0.smithi017.stdout:1/461: link d1/d3/dd/f60 d1/d3/d88/f99 0 2024-03-16T10:53:13.683 INFO:tasks.workunit.client.0.smithi017.stdout:1/462: write d1/d3/f29 [8463009,68336] 0 2024-03-16T10:53:13.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/196: sync 2024-03-16T10:53:13.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/273: sync 2024-03-16T10:53:13.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/274: write d0/d9/d45/d4d/f25 [2752146,64022] 0 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:4/336: rmdir d15/d1d 39 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:0/286: write d2/d7/de/d19/d2e/f48 [3806868,68490] 0 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/197: creat d8/d2d/d32/f3c x:0 0 0 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/198: write d8/d2d/d32/f33 [5241129,274] 0 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/199: chown d8/d2d/f3b 1 1 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/200: chown d8/df/l2f 14188733 1 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/201: dread - d8/d2d/f3a zero size 2024-03-16T10:53:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/202: truncate d8/f37 913923 0 2024-03-16T10:53:13.690 INFO:tasks.workunit.client.0.smithi017.stdout:0/287: mknod d2/d7/d24/d29/c70 0 2024-03-16T10:53:13.690 INFO:tasks.workunit.client.0.smithi017.stdout:0/288: fsync d2/d7/de/d19/f56 0 2024-03-16T10:53:13.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/326: dwrite d0/d1/d2/d2c/d38/f3b [0,4194304] 0 2024-03-16T10:53:13.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/337: creat d15/d1d/d27/d28/d40/d51/d64/f6a x:0 0 0 2024-03-16T10:53:13.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/338: write d15/f17 [314198,5357] 0 2024-03-16T10:53:13.697 INFO:tasks.workunit.client.0.smithi017.stdout:9/203: creat d8/d2d/d32/f3d x:0 0 0 2024-03-16T10:53:13.697 INFO:tasks.workunit.client.0.smithi017.stdout:9/204: fdatasync d8/f1c 0 2024-03-16T10:53:13.700 INFO:tasks.workunit.client.0.smithi017.stdout:0/289: rmdir d2/d7/de/d19/d2e/d39 0 2024-03-16T10:53:13.704 INFO:tasks.workunit.client.0.smithi017.stdout:1/463: dwrite d1/d3/d16/f1a [0,4194304] 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/205: write d8/f2a [2118117,107701] 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/206: dread - d8/d2d/d32/f3d zero size 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/207: readlink d8/df/l2f 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/208: chown d8/d2d/d32/c36 15344 1 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/209: fsync d8/d2d/f3b 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/210: fdatasync d8/f24 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/211: chown d8/f24 322645 1 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/212: readlink d8/df/l2e 0 2024-03-16T10:53:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/213: fdatasync d8/f24 0 2024-03-16T10:53:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:5/327: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/464: creat d1/d3/dd/f9a x:0 0 0 2024-03-16T10:53:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/465: write d1/d3/f6f [701463,6632] 0 2024-03-16T10:53:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/466: dread - d1/d3/f8a zero size 2024-03-16T10:53:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:4/339: dwrite d15/d1d/d21/f5e [0,4194304] 0 2024-03-16T10:53:13.711 INFO:tasks.workunit.client.0.smithi017.stdout:9/214: symlink d8/l3e 0 2024-03-16T10:53:13.712 INFO:tasks.workunit.client.0.smithi017.stdout:5/328: creat d0/d1/d2/dc/d2f/d37/d57/f74 x:0 0 0 2024-03-16T10:53:13.715 INFO:tasks.workunit.client.0.smithi017.stdout:1/467: rename d1/d3/d16/c7d to d1/d3/d57/c9b 0 2024-03-16T10:53:13.720 INFO:tasks.workunit.client.0.smithi017.stdout:4/340: getdents d15/d1d/d27 0 2024-03-16T10:53:13.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/215: dwrite d8/d2d/d32/f39 [0,4194304] 0 2024-03-16T10:53:13.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/216: write d8/d2d/d32/f3c [436911,93517] 0 2024-03-16T10:53:13.723 INFO:tasks.workunit.client.0.smithi017.stdout:5/329: truncate d0/d1/d2/f12 108638 0 2024-03-16T10:53:13.723 INFO:tasks.workunit.client.0.smithi017.stdout:5/330: fdatasync d0/d1/d30/d55/f59 0 2024-03-16T10:53:13.738 INFO:tasks.workunit.client.0.smithi017.stdout:4/341: creat d15/d1d/d27/f6b x:0 0 0 2024-03-16T10:53:13.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/217: rmdir d8/d2d 39 2024-03-16T10:53:13.743 INFO:tasks.workunit.client.0.smithi017.stdout:5/331: mknod d0/d1/d30/c75 0 2024-03-16T10:53:13.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/332: write d0/d1/d30/d55/f59 [589616,63499] 0 2024-03-16T10:53:13.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/333: chown d0/d1/d2/dc/d2f/d37/d42/f4a 95852982 1 2024-03-16T10:53:13.748 INFO:tasks.workunit.client.0.smithi017.stdout:9/218: link d8/c28 d8/d2d/c3f 0 2024-03-16T10:53:13.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/342: dwrite d15/d1d/d27/d28/d40/f44 [0,4194304] 0 2024-03-16T10:53:13.750 INFO:tasks.workunit.client.0.smithi017.stdout:5/334: mkdir d0/d1/d76 0 2024-03-16T10:53:13.750 INFO:tasks.workunit.client.0.smithi017.stdout:5/335: stat d0/d1/d2/dc/d2f/d37/d57 0 2024-03-16T10:53:13.751 INFO:tasks.workunit.client.0.smithi017.stdout:0/290: getdents d2/d7/de/d19/d2e 0 2024-03-16T10:53:13.753 INFO:tasks.workunit.client.0.smithi017.stdout:0/291: dread d2/d7/de/d19/f4c [0,4194304] 0 2024-03-16T10:53:13.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/219: creat d8/df/f40 x:0 0 0 2024-03-16T10:53:13.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/220: write d8/d2d/d32/f3d [341025,60156] 0 2024-03-16T10:53:13.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/221: write d8/f38 [375987,78112] 0 2024-03-16T10:53:13.759 INFO:tasks.workunit.client.0.smithi017.stdout:1/468: rename d1/d3/dd/f60 to d1/d3/d57/f9c 0 2024-03-16T10:53:13.764 INFO:tasks.workunit.client.0.smithi017.stdout:4/343: creat d15/d1d/d21/d3c/f6c x:0 0 0 2024-03-16T10:53:13.766 INFO:tasks.workunit.client.0.smithi017.stdout:9/222: symlink d8/d2d/d32/l41 0 2024-03-16T10:53:13.766 INFO:tasks.workunit.client.0.smithi017.stdout:9/223: chown d8/d2d/d32/c35 27 1 2024-03-16T10:53:13.767 INFO:tasks.workunit.client.0.smithi017.stdout:0/292: mknod d2/d4/c71 0 2024-03-16T10:53:13.767 INFO:tasks.workunit.client.0.smithi017.stdout:5/336: dwrite d0/f9 [0,4194304] 0 2024-03-16T10:53:13.767 INFO:tasks.workunit.client.0.smithi017.stdout:5/337: fdatasync d0/d1/d2/dc/f1d 0 2024-03-16T10:53:13.767 INFO:tasks.workunit.client.0.smithi017.stdout:5/338: readlink d0/d1/d2/d2c/d38/l6c 0 2024-03-16T10:53:13.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/344: symlink d15/d1d/d27/d28/d40/d51/l6d 0 2024-03-16T10:53:13.774 INFO:tasks.workunit.client.0.smithi017.stdout:4/345: truncate d15/d1d/f24 453449 0 2024-03-16T10:53:13.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/224: creat d8/d2d/f42 x:0 0 0 2024-03-16T10:53:13.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/225: dread - d8/d2d/f3b zero size 2024-03-16T10:53:13.776 INFO:tasks.workunit.client.0.smithi017.stdout:5/339: getdents d0/d1/d2/d2c/d36/d41 0 2024-03-16T10:53:13.778 INFO:tasks.workunit.client.0.smithi017.stdout:4/346: mknod d15/d1d/d21/d26/c6e 0 2024-03-16T10:53:13.780 INFO:tasks.workunit.client.0.smithi017.stdout:9/226: link d8/d2d/d32/f3c d8/d2d/f43 0 2024-03-16T10:53:13.781 INFO:tasks.workunit.client.0.smithi017.stdout:9/227: write d8/f37 [72092,33494] 0 2024-03-16T10:53:13.782 INFO:tasks.workunit.client.0.smithi017.stdout:9/228: dread d8/f24 [0,4194304] 0 2024-03-16T10:53:13.783 INFO:tasks.workunit.client.0.smithi017.stdout:5/340: symlink d0/d1/d30/l77 0 2024-03-16T10:53:13.784 INFO:tasks.workunit.client.0.smithi017.stdout:1/469: dwrite d1/d3/dd/d72/f74 [0,4194304] 0 2024-03-16T10:53:13.785 INFO:tasks.workunit.client.0.smithi017.stdout:4/347: creat d15/d1d/d27/d28/d40/d51/d64/d63/f6f x:0 0 0 2024-03-16T10:53:13.785 INFO:tasks.workunit.client.0.smithi017.stdout:0/293: dwrite d2/f23 [0,4194304] 0 2024-03-16T10:53:13.785 INFO:tasks.workunit.client.0.smithi017.stdout:0/294: write d2/d7/d24/d29/f2c [233612,129413] 0 2024-03-16T10:53:13.786 INFO:tasks.workunit.client.0.smithi017.stdout:5/341: creat d0/d1/d2/dc/d2f/d37/f78 x:0 0 0 2024-03-16T10:53:13.788 INFO:tasks.workunit.client.0.smithi017.stdout:5/342: dread d0/d1/d2/d2c/d36/d41/f62 [0,4194304] 0 2024-03-16T10:53:13.794 INFO:tasks.workunit.client.0.smithi017.stdout:0/295: dread d2/d7/de/d19/d2e/f4e [0,4194304] 0 2024-03-16T10:53:13.794 INFO:tasks.workunit.client.0.smithi017.stdout:9/229: dwrite d8/f38 [0,4194304] 0 2024-03-16T10:53:13.794 INFO:tasks.workunit.client.0.smithi017.stdout:9/230: fdatasync d8/d2d/d32/f33 0 2024-03-16T10:53:13.795 INFO:tasks.workunit.client.0.smithi017.stdout:1/470: fdatasync d1/d3/dd/f1f 0 2024-03-16T10:53:13.797 INFO:tasks.workunit.client.0.smithi017.stdout:4/348: creat d15/d1d/d21/d26/d66/f70 x:0 0 0 2024-03-16T10:53:13.798 INFO:tasks.workunit.client.0.smithi017.stdout:5/343: mknod d0/d1/d30/d55/d6a/c79 0 2024-03-16T10:53:13.799 INFO:tasks.workunit.client.0.smithi017.stdout:9/231: symlink d8/d2d/l44 0 2024-03-16T10:53:13.799 INFO:tasks.workunit.client.0.smithi017.stdout:9/232: truncate d8/d2d/f43 1012282 0 2024-03-16T10:53:13.801 INFO:tasks.workunit.client.0.smithi017.stdout:1/471: rmdir d1/d3/de 39 2024-03-16T10:53:13.801 INFO:tasks.workunit.client.0.smithi017.stdout:1/472: write d1/d3/d57/f85 [877759,126104] 0 2024-03-16T10:53:13.803 INFO:tasks.workunit.client.0.smithi017.stdout:4/349: creat d15/d1d/d27/d28/d40/d51/f71 x:0 0 0 2024-03-16T10:53:13.804 INFO:tasks.workunit.client.0.smithi017.stdout:1/473: write d1/d3/dd/d31/d35/f75 [668161,57781] 0 2024-03-16T10:53:13.810 INFO:tasks.workunit.client.0.smithi017.stdout:4/350: creat d15/d1d/d21/f72 x:0 0 0 2024-03-16T10:53:13.810 INFO:tasks.workunit.client.0.smithi017.stdout:1/474: creat d1/d3/de/f9d x:0 0 0 2024-03-16T10:53:13.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/296: dwrite d2/d7/de/d19/d2e/f4e [4194304,4194304] 0 2024-03-16T10:53:13.815 INFO:tasks.workunit.client.0.smithi017.stdout:0/297: mkdir d2/d7/d24/d72 0 2024-03-16T10:53:13.815 INFO:tasks.workunit.client.0.smithi017.stdout:0/298: fsync d2/d4/f67 0 2024-03-16T10:53:13.815 INFO:tasks.workunit.client.0.smithi017.stdout:4/351: rename d15/d1d/d27/d28/d40/d51/l6d to d15/d1d/d21/d26/l73 0 2024-03-16T10:53:13.816 INFO:tasks.workunit.client.0.smithi017.stdout:0/299: dread d2/f11 [0,4194304] 0 2024-03-16T10:53:13.818 INFO:tasks.workunit.client.0.smithi017.stdout:0/300: creat d2/d7/f73 x:0 0 0 2024-03-16T10:53:13.818 INFO:tasks.workunit.client.0.smithi017.stdout:1/475: truncate d1/d3/dd/d31/d35/f38 1781883 0 2024-03-16T10:53:13.821 INFO:tasks.workunit.client.0.smithi017.stdout:1/476: mknod d1/d24/d79/c9e 0 2024-03-16T10:53:13.822 INFO:tasks.workunit.client.0.smithi017.stdout:9/233: dwrite d8/df/f1a [0,4194304] 0 2024-03-16T10:53:13.823 INFO:tasks.workunit.client.0.smithi017.stdout:5/344: dwrite d0/d1/d2/dc/f45 [0,4194304] 0 2024-03-16T10:53:13.824 INFO:tasks.workunit.client.0.smithi017.stdout:5/345: dread d0/d1/d2/f5a [0,4194304] 0 2024-03-16T10:53:13.832 INFO:tasks.workunit.client.0.smithi017.stdout:9/234: write d8/df/f1a [2937344,46814] 0 2024-03-16T10:53:13.842 INFO:tasks.workunit.client.0.smithi017.stdout:0/301: dwrite d2/d4/d6d/f6e [0,4194304] 0 2024-03-16T10:53:13.844 INFO:tasks.workunit.client.0.smithi017.stdout:5/346: link d0/c15 d0/d5d/c7a 0 2024-03-16T10:53:13.847 INFO:tasks.workunit.client.0.smithi017.stdout:1/477: rename d1/d3/d16 to d1/d3/dd/d9f 0 2024-03-16T10:53:13.848 INFO:tasks.workunit.client.0.smithi017.stdout:9/235: dwrite d8/d2d/f43 [0,4194304] 0 2024-03-16T10:53:13.850 INFO:tasks.workunit.client.0.smithi017.stdout:0/302: rmdir d2/d7 39 2024-03-16T10:53:13.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/303: creat d2/d4/d6d/d6c/f74 x:0 0 0 2024-03-16T10:53:13.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/304: readlink d2/d7/de/l17 0 2024-03-16T10:53:13.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/305: dread - d2/d4/f43 zero size 2024-03-16T10:53:13.854 INFO:tasks.workunit.client.0.smithi017.stdout:5/347: read d0/d1/d2/d2c/d38/f47 [2468469,41224] 0 2024-03-16T10:53:13.854 INFO:tasks.workunit.client.0.smithi017.stdout:5/348: write d0/d1/d2/d2c/f60 [361535,6219] 0 2024-03-16T10:53:13.856 INFO:tasks.workunit.client.0.smithi017.stdout:5/349: creat d0/d1/d1f/f7b x:0 0 0 2024-03-16T10:53:13.857 INFO:tasks.workunit.client.0.smithi017.stdout:5/350: creat d0/d1/d2/dc/f7c x:0 0 0 2024-03-16T10:53:13.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/351: chown d0/d1/d2/f18 2173 1 2024-03-16T10:53:13.862 INFO:tasks.workunit.client.0.smithi017.stdout:1/478: dwrite d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/306: dread d2/d7/d24/d29/f40 [0,4194304] 0 2024-03-16T10:53:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/307: dread - d2/d4/f43 zero size 2024-03-16T10:53:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/308: write d2/d7/de/f16 [4608604,98481] 0 2024-03-16T10:53:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/309: chown d2/f5 5 1 2024-03-16T10:53:13.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/479: fsync d1/d3/dd/d31/d35/f38 0 2024-03-16T10:53:13.876 INFO:tasks.workunit.client.0.smithi017.stdout:1/480: creat d1/d50/d8d/fa0 x:0 0 0 2024-03-16T10:53:13.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/310: dread d2/d25/f5a [0,4194304] 0 2024-03-16T10:53:13.882 INFO:tasks.workunit.client.0.smithi017.stdout:5/352: dwrite d0/d1/d30/d4f/f66 [0,4194304] 0 2024-03-16T10:53:13.882 INFO:tasks.workunit.client.0.smithi017.stdout:5/353: write d0/d1/f11 [3281893,32265] 0 2024-03-16T10:53:13.882 INFO:tasks.workunit.client.0.smithi017.stdout:5/354: dread - d0/d1/d2/dc/d2f/d37/d42/d4c/f73 zero size 2024-03-16T10:53:13.889 INFO:tasks.workunit.client.0.smithi017.stdout:5/355: symlink d0/d1/d30/d4f/l7d 0 2024-03-16T10:53:13.889 INFO:tasks.workunit.client.0.smithi017.stdout:5/356: dread - d0/d1/d2/dc/f49 zero size 2024-03-16T10:53:13.889 INFO:tasks.workunit.client.0.smithi017.stdout:0/311: dwrite d2/d7/d24/d29/f2c [0,4194304] 0 2024-03-16T10:53:13.891 INFO:tasks.workunit.client.0.smithi017.stdout:0/312: creat d2/d4/d6d/f75 x:0 0 0 2024-03-16T10:53:13.891 INFO:tasks.workunit.client.0.smithi017.stdout:5/357: creat d0/d1/d30/d55/d6a/f7e x:0 0 0 2024-03-16T10:53:13.893 INFO:tasks.workunit.client.0.smithi017.stdout:0/313: mknod d2/d7/de/d1e/c76 0 2024-03-16T10:53:13.893 INFO:tasks.workunit.client.0.smithi017.stdout:5/358: write d0/d1/d2/d2c/d36/d41/f62 [640735,75865] 0 2024-03-16T10:53:13.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/314: dread d2/d7/de/d19/d2e/f3e [0,4194304] 0 2024-03-16T10:53:13.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/315: write d2/d7/de/ff [2599547,34700] 0 2024-03-16T10:53:13.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/316: rename d2/d25/f2d to d2/d32/f77 0 2024-03-16T10:53:13.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/317: rmdir d2/d25 39 2024-03-16T10:53:13.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/318: write d2/d7/f64 [677400,118504] 0 2024-03-16T10:53:13.912 INFO:tasks.workunit.client.0.smithi017.stdout:5/359: dwrite d0/f9 [0,4194304] 0 2024-03-16T10:53:13.914 INFO:tasks.workunit.client.0.smithi017.stdout:5/360: rename d0/d1/d30/d55/f59 to d0/d1/d30/d55/d6a/f7f 0 2024-03-16T10:53:13.917 INFO:tasks.workunit.client.0.smithi017.stdout:5/361: rename d0/d1/d2/dc/f7c to d0/d1/d2/f80 0 2024-03-16T10:53:13.918 INFO:tasks.workunit.client.0.smithi017.stdout:5/362: mknod d0/d1/d2/d2c/c81 0 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/306: sync 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:3/224: sync 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:2/259: sync 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:6/275: sync 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/307: chown d6/d39/d35/l3d 222225 1 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:2/260: chown d4/d6/db/d24/d39/f48 949 1 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/308: chown d6/d39/d35 20379 1 2024-03-16T10:53:13.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/309: chown d6/d7/lc 48043 1 2024-03-16T10:53:13.921 INFO:tasks.workunit.client.0.smithi017.stdout:7/251: sync 2024-03-16T10:53:13.921 INFO:tasks.workunit.client.0.smithi017.stdout:8/310: write d6/d16/f66 [328490,73368] 0 2024-03-16T10:53:13.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/261: write d4/dd/d1e/d3e/f45 [691728,8666] 0 2024-03-16T10:53:13.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/225: creat d8/d3f/d3d/f48 x:0 0 0 2024-03-16T10:53:13.925 INFO:tasks.workunit.client.0.smithi017.stdout:6/276: symlink d0/d9/d45/d4d/l53 0 2024-03-16T10:53:13.926 INFO:tasks.workunit.client.0.smithi017.stdout:7/252: chown d7/db/d12/d1c/l2f 1 1 2024-03-16T10:53:13.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/262: creat d4/dd/f4b x:0 0 0 2024-03-16T10:53:13.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/263: readlink d4/dd/d1e/l2d 0 2024-03-16T10:53:13.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/264: chown d4/d6/db/l33 2 1 2024-03-16T10:53:13.932 INFO:tasks.workunit.client.0.smithi017.stdout:3/226: dread d8/d1d/f1f [4194304,4194304] 0 2024-03-16T10:53:13.932 INFO:tasks.workunit.client.0.smithi017.stdout:5/363: dwrite d0/f8 [0,4194304] 0 2024-03-16T10:53:13.933 INFO:tasks.workunit.client.0.smithi017.stdout:2/265: symlink d4/dd/d38/l4c 0 2024-03-16T10:53:13.936 INFO:tasks.workunit.client.0.smithi017.stdout:7/253: unlink d7/db/d12/d1c/f51 0 2024-03-16T10:53:13.937 INFO:tasks.workunit.client.0.smithi017.stdout:0/319: getdents d2/d7/de/d1e 0 2024-03-16T10:53:13.938 INFO:tasks.workunit.client.0.smithi017.stdout:6/277: dwrite d0/d9/d45/d4d/d2c/f4c [0,4194304] 0 2024-03-16T10:53:13.939 INFO:tasks.workunit.client.0.smithi017.stdout:3/227: symlink d8/d1b/d1c/l49 0 2024-03-16T10:53:13.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/320: link d2/f11 d2/d4/d61/f78 0 2024-03-16T10:53:13.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/321: rename d2/d7/d24 to d2/d7/d24/d72/d79 22 2024-03-16T10:53:13.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/322: dread - d2/d7/f5c zero size 2024-03-16T10:53:13.941 INFO:tasks.workunit.client.0.smithi017.stdout:0/323: symlink d2/d7/d24/d3a/l7a 0 2024-03-16T10:53:13.941 INFO:tasks.workunit.client.0.smithi017.stdout:5/364: creat d0/d1/d2/d70/f82 x:0 0 0 2024-03-16T10:53:13.941 INFO:tasks.workunit.client.0.smithi017.stdout:7/254: dread d7/db/f14 [0,4194304] 0 2024-03-16T10:53:13.942 INFO:tasks.workunit.client.0.smithi017.stdout:2/266: creat d4/dd/d1e/d3e/f4d x:0 0 0 2024-03-16T10:53:13.945 INFO:tasks.workunit.client.0.smithi017.stdout:6/278: unlink d0/d22/f30 0 2024-03-16T10:53:13.946 INFO:tasks.workunit.client.0.smithi017.stdout:3/228: mknod d8/d1b/d1c/c4a 0 2024-03-16T10:53:13.946 INFO:tasks.workunit.client.0.smithi017.stdout:0/324: write d2/d7/f9 [3154232,99030] 0 2024-03-16T10:53:13.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/365: rename d0/d1/d2/f5a to d0/d1/d30/f83 0 2024-03-16T10:53:13.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/366: chown d0/d1/d2/ff 19896607 1 2024-03-16T10:53:13.954 INFO:tasks.workunit.client.0.smithi017.stdout:6/279: unlink d0/d9/d45/d4d/d2c/d41/f4e 0 2024-03-16T10:53:13.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/280: write d0/d15/f1c [1593734,114278] 0 2024-03-16T10:53:13.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/281: write d0/d9/f18 [4860871,85480] 0 2024-03-16T10:53:13.956 INFO:tasks.workunit.client.0.smithi017.stdout:5/367: read d0/d1/d2/d24/f2e [242557,76326] 0 2024-03-16T10:53:13.956 INFO:tasks.workunit.client.0.smithi017.stdout:5/368: truncate d0/d1/d2/f12 608387 0 2024-03-16T10:53:13.959 INFO:tasks.workunit.client.0.smithi017.stdout:3/229: creat d8/d1d/f4b x:0 0 0 2024-03-16T10:53:13.960 INFO:tasks.workunit.client.0.smithi017.stdout:0/325: dwrite d2/d7/f63 [0,4194304] 0 2024-03-16T10:53:13.961 INFO:tasks.workunit.client.0.smithi017.stdout:7/255: rmdir d7/db/d12/d1c/d30 39 2024-03-16T10:53:13.961 INFO:tasks.workunit.client.0.smithi017.stdout:7/256: fsync f2 0 2024-03-16T10:53:13.961 INFO:tasks.workunit.client.0.smithi017.stdout:7/257: chown d7/db/dc/d50/d59/d34/l35 156715 1 2024-03-16T10:53:13.966 INFO:tasks.workunit.client.0.smithi017.stdout:6/282: creat d0/d21/d39/f54 x:0 0 0 2024-03-16T10:53:13.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/369: symlink d0/d1/d2/dc/l84 0 2024-03-16T10:53:13.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/230: mknod d8/d3f/d3d/c4c 0 2024-03-16T10:53:13.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/231: chown l5 1046973 1 2024-03-16T10:53:13.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/232: read d8/da/db/f19 [2661355,116873] 0 2024-03-16T10:53:13.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/283: rename d0/d9/d45/d4d/d2c/f35 to d0/d15/f55 0 2024-03-16T10:53:13.977 INFO:tasks.workunit.client.0.smithi017.stdout:2/267: getdents d4/dd 0 2024-03-16T10:53:13.980 INFO:tasks.workunit.client.0.smithi017.stdout:0/326: dwrite d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:13.980 INFO:tasks.workunit.client.0.smithi017.stdout:0/327: chown d2/d7/de/d19/d2e/f4b 26836 1 2024-03-16T10:53:13.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/370: creat d0/d1/d2/dc/d2f/d37/d42/d4c/f85 x:0 0 0 2024-03-16T10:53:13.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/371: truncate d0/d1/f65 678937 0 2024-03-16T10:53:13.982 INFO:tasks.workunit.client.0.smithi017.stdout:7/258: dwrite d7/db/dc/d50/d59/d34/f44 [0,4194304] 0 2024-03-16T10:53:13.982 INFO:tasks.workunit.client.0.smithi017.stdout:3/233: truncate d8/da/db/f42 1987724 0 2024-03-16T10:53:13.994 INFO:tasks.workunit.client.0.smithi017.stdout:0/328: dwrite d2/d25/f5a [0,4194304] 0 2024-03-16T10:53:13.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/284: rmdir d0/d3e 39 2024-03-16T10:53:13.996 INFO:tasks.workunit.client.0.smithi017.stdout:0/329: mkdir d2/d7/d24/d72/d7b 0 2024-03-16T10:53:13.996 INFO:tasks.workunit.client.0.smithi017.stdout:3/234: dwrite d8/da/fe [4194304,4194304] 0 2024-03-16T10:53:13.997 INFO:tasks.workunit.client.0.smithi017.stdout:2/268: unlink d4/d6/db/l33 0 2024-03-16T10:53:13.998 INFO:tasks.workunit.client.0.smithi017.stdout:2/269: chown d4/dd/f1d 61 1 2024-03-16T10:53:14.001 INFO:tasks.workunit.client.0.smithi017.stdout:5/372: rename d0/d1/d2/dc/d2f/d37/d42/d4c/f73 to d0/d1/d2/dc/d2f/d37/d42/d46/f86 0 2024-03-16T10:53:14.001 INFO:tasks.workunit.client.0.smithi017.stdout:5/373: truncate d0/d1/d2/dc/d2f/d37/f78 670502 0 2024-03-16T10:53:14.001 INFO:tasks.workunit.client.0.smithi017.stdout:5/374: write d0/d1/d2/d2c/d36/d41/f62 [999624,96509] 0 2024-03-16T10:53:14.008 INFO:tasks.workunit.client.0.smithi017.stdout:7/259: creat d7/db/d12/d1c/d30/f5c x:0 0 0 2024-03-16T10:53:14.009 INFO:tasks.workunit.client.0.smithi017.stdout:3/235: dwrite d8/d1d/f46 [0,4194304] 0 2024-03-16T10:53:14.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/375: dread d0/d1/d1f/f50 [0,4194304] 0 2024-03-16T10:53:14.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/376: chown d0/d1/d2/d2c/d36/d41 20140812 1 2024-03-16T10:53:14.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/377: truncate d0/d1/d2/dc/f49 299485 0 2024-03-16T10:53:14.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/378: chown d0/d1/d30/d4f/l7d 52 1 2024-03-16T10:53:14.011 INFO:tasks.workunit.client.0.smithi017.stdout:6/285: creat d0/d9/d45/d4d/d2c/f56 x:0 0 0 2024-03-16T10:53:14.012 INFO:tasks.workunit.client.0.smithi017.stdout:2/270: creat d4/dd/d1e/d28/d29/f4e x:0 0 0 2024-03-16T10:53:14.012 INFO:tasks.workunit.client.0.smithi017.stdout:2/271: dread - d4/f25 zero size 2024-03-16T10:53:14.014 INFO:tasks.workunit.client.0.smithi017.stdout:3/236: write d8/d1b/d1c/f2f [2755791,116633] 0 2024-03-16T10:53:14.020 INFO:tasks.workunit.client.0.smithi017.stdout:6/286: creat d0/d3e/f57 x:0 0 0 2024-03-16T10:53:14.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/272: rename d4/dd/d1e/l2d to d4/dd/d1e/d3e/l4f 0 2024-03-16T10:53:14.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/273: chown d4/d6/db/d24 23 1 2024-03-16T10:53:14.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/274: dread - d4/d6/f20 zero size 2024-03-16T10:53:14.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/275: write d4/d6/f20 [931956,13386] 0 2024-03-16T10:53:14.024 INFO:tasks.workunit.client.0.smithi017.stdout:3/237: creat d8/d1b/d1c/f4d x:0 0 0 2024-03-16T10:53:14.025 INFO:tasks.workunit.client.0.smithi017.stdout:3/238: chown l4 113584271 1 2024-03-16T10:53:14.026 INFO:tasks.workunit.client.0.smithi017.stdout:5/379: dwrite d0/f22 [0,4194304] 0 2024-03-16T10:53:14.026 INFO:tasks.workunit.client.0.smithi017.stdout:5/380: fsync d0/d1/d2/d24/f2b 0 2024-03-16T10:53:14.026 INFO:tasks.workunit.client.0.smithi017.stdout:7/260: symlink d7/db/d12/d1c/d4e/l5d 0 2024-03-16T10:53:14.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/287: symlink d0/d9/l58 0 2024-03-16T10:53:14.030 INFO:tasks.workunit.client.0.smithi017.stdout:2/276: rename d4/d6/d30/c37 to d4/d6/c50 0 2024-03-16T10:53:14.033 INFO:tasks.workunit.client.0.smithi017.stdout:6/288: mknod d0/d15/d1f/c59 0 2024-03-16T10:53:14.034 INFO:tasks.workunit.client.0.smithi017.stdout:6/289: fsync d0/d21/d39/f54 0 2024-03-16T10:53:14.034 INFO:tasks.workunit.client.0.smithi017.stdout:3/239: dread d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:14.036 INFO:tasks.workunit.client.0.smithi017.stdout:2/277: mkdir d4/dd/d1e/d3e/d51 0 2024-03-16T10:53:14.038 INFO:tasks.workunit.client.0.smithi017.stdout:3/240: dread f3 [0,4194304] 0 2024-03-16T10:53:14.038 INFO:tasks.workunit.client.0.smithi017.stdout:3/241: chown d8/l20 576904 1 2024-03-16T10:53:14.038 INFO:tasks.workunit.client.0.smithi017.stdout:6/290: creat d0/d21/d39/f5a x:0 0 0 2024-03-16T10:53:14.039 INFO:tasks.workunit.client.0.smithi017.stdout:7/261: dwrite d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:14.039 INFO:tasks.workunit.client.0.smithi017.stdout:7/262: fdatasync d7/db/d45/f39 0 2024-03-16T10:53:14.040 INFO:tasks.workunit.client.0.smithi017.stdout:2/278: rename d4/d6/db/f13 to d4/f52 0 2024-03-16T10:53:14.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/291: unlink d0/d21/d39/f54 0 2024-03-16T10:53:14.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/292: chown d0/d9/d45/d4d/l47 861753446 1 2024-03-16T10:53:14.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/293: readlink d0/d15/l34 0 2024-03-16T10:53:14.045 INFO:tasks.workunit.client.0.smithi017.stdout:5/381: dwrite d0/d1/d2/dc/f1d [0,4194304] 0 2024-03-16T10:53:14.045 INFO:tasks.workunit.client.0.smithi017.stdout:5/382: chown d0/d1/d2/dc/d2f/d37/d42/d4c 32 1 2024-03-16T10:53:14.048 INFO:tasks.workunit.client.0.smithi017.stdout:5/383: dread d0/d1/d30/d55/d6a/f7f [0,4194304] 0 2024-03-16T10:53:14.048 INFO:tasks.workunit.client.0.smithi017.stdout:2/279: rename d4/c5 to d4/dd/d1e/d28/c53 0 2024-03-16T10:53:14.048 INFO:tasks.workunit.client.0.smithi017.stdout:2/280: chown d4/d6 16382 1 2024-03-16T10:53:14.048 INFO:tasks.workunit.client.0.smithi017.stdout:2/281: chown d4/dd/d38/l4c 3426 1 2024-03-16T10:53:14.049 INFO:tasks.workunit.client.0.smithi017.stdout:6/294: dread d0/f3 [0,4194304] 0 2024-03-16T10:53:14.050 INFO:tasks.workunit.client.0.smithi017.stdout:7/263: link d7/db/d12/d1c/f3c d7/db/dc/d50/d59/d34/f5e 0 2024-03-16T10:53:14.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/352: sync 2024-03-16T10:53:14.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/353: write fa [6120190,62252] 0 2024-03-16T10:53:14.053 INFO:tasks.workunit.client.0.smithi017.stdout:3/242: dwrite d8/da/f36 [0,4194304] 0 2024-03-16T10:53:14.053 INFO:tasks.workunit.client.0.smithi017.stdout:3/243: write d8/d1b/d1c/f26 [4466682,104714] 0 2024-03-16T10:53:14.053 INFO:tasks.workunit.client.0.smithi017.stdout:3/244: readlink d8/d1b/d2e/l40 0 2024-03-16T10:53:14.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/264: dread d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:14.056 INFO:tasks.workunit.client.0.smithi017.stdout:5/384: creat d0/f87 x:0 0 0 2024-03-16T10:53:14.058 INFO:tasks.workunit.client.0.smithi017.stdout:2/282: creat d4/d6/d30/d3f/f54 x:0 0 0 2024-03-16T10:53:14.063 INFO:tasks.workunit.client.0.smithi017.stdout:6/295: dwrite d0/d9/d45/d4d/d2e/f4b [0,4194304] 0 2024-03-16T10:53:14.072 INFO:tasks.workunit.client.0.smithi017.stdout:4/354: dwrite d15/d1d/d21/d26/d66/f67 [0,4194304] 0 2024-03-16T10:53:14.074 INFO:tasks.workunit.client.0.smithi017.stdout:7/265: unlink d7/f8 0 2024-03-16T10:53:14.076 INFO:tasks.workunit.client.0.smithi017.stdout:2/283: symlink d4/dd/d1e/d3e/d51/l55 0 2024-03-16T10:53:14.082 INFO:tasks.workunit.client.0.smithi017.stdout:6/296: dwrite d0/f40 [4194304,4194304] 0 2024-03-16T10:53:14.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/284: rmdir d4/dd 39 2024-03-16T10:53:14.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/285: dread - d4/dd/df/f49 zero size 2024-03-16T10:53:14.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/286: stat d4/d6 0 2024-03-16T10:53:14.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/287: write d4/dd/d1e/d28/d2e/f3c [401122,25364] 0 2024-03-16T10:53:14.087 INFO:tasks.workunit.client.0.smithi017.stdout:2/288: link d4/dd/df/f19 d4/f56 0 2024-03-16T10:53:14.089 INFO:tasks.workunit.client.0.smithi017.stdout:2/289: mknod d4/dd/d1e/d28/d2e/c57 0 2024-03-16T10:53:14.091 INFO:tasks.workunit.client.0.smithi017.stdout:2/290: getdents d4/d6/db/d24/d39 0 2024-03-16T10:53:14.091 INFO:tasks.workunit.client.0.smithi017.stdout:2/291: write d4/d6/f10 [1596695,92499] 0 2024-03-16T10:53:14.094 INFO:tasks.workunit.client.0.smithi017.stdout:7/266: dwrite d7/db/f4b [0,4194304] 0 2024-03-16T10:53:14.094 INFO:tasks.workunit.client.0.smithi017.stdout:3/245: dwrite d8/d1b/d1c/f26 [0,4194304] 0 2024-03-16T10:53:14.094 INFO:tasks.workunit.client.0.smithi017.stdout:6/297: read d0/f40 [2779740,14586] 0 2024-03-16T10:53:14.094 INFO:tasks.workunit.client.0.smithi017.stdout:2/292: creat d4/d6/d30/f58 x:0 0 0 2024-03-16T10:53:14.095 INFO:tasks.workunit.client.0.smithi017.stdout:2/293: write d4/dd/d1e/d28/d2e/f3c [695761,64533] 0 2024-03-16T10:53:14.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/267: symlink d7/db/d45/l5f 0 2024-03-16T10:53:14.103 INFO:tasks.workunit.client.0.smithi017.stdout:3/246: dread d8/d3f/f3b [0,4194304] 0 2024-03-16T10:53:14.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/294: rename d4/d6/db/d24/d39/f48 to d4/dd/d1e/d28/d2e/f59 0 2024-03-16T10:53:14.103 INFO:tasks.workunit.client.0.smithi017.stdout:4/355: dwrite d15/f19 [0,4194304] 0 2024-03-16T10:53:14.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/247: creat d8/f4e x:0 0 0 2024-03-16T10:53:14.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/248: write d8/da/f31 [9252791,79822] 0 2024-03-16T10:53:14.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/268: write d7/db/d12/f3f [2768232,33739] 0 2024-03-16T10:53:14.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/269: stat d7/db/f4b 0 2024-03-16T10:53:14.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/270: dread - d7/db/d12/d1c/d30/f5c zero size 2024-03-16T10:53:14.107 INFO:tasks.workunit.client.0.smithi017.stdout:7/271: chown d7/db/dc/d50/d59/l42 158794110 1 2024-03-16T10:53:14.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/295: mknod d4/dd/d1e/d28/d2e/c5a 0 2024-03-16T10:53:14.115 INFO:tasks.workunit.client.0.smithi017.stdout:4/356: dread d15/d1d/d27/d28/d40/f44 [0,4194304] 0 2024-03-16T10:53:14.115 INFO:tasks.workunit.client.0.smithi017.stdout:6/298: dwrite d0/d15/f55 [0,4194304] 0 2024-03-16T10:53:14.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/249: dwrite d8/d1d/f46 [4194304,4194304] 0 2024-03-16T10:53:14.121 INFO:tasks.workunit.client.0.smithi017.stdout:2/296: creat d4/d6/db/d24/f5b x:0 0 0 2024-03-16T10:53:14.121 INFO:tasks.workunit.client.0.smithi017.stdout:2/297: stat d4/d6/l22 0 2024-03-16T10:53:14.123 INFO:tasks.workunit.client.0.smithi017.stdout:7/272: dwrite f1 [0,4194304] 0 2024-03-16T10:53:14.124 INFO:tasks.workunit.client.0.smithi017.stdout:5/385: truncate d0/d1/d2/dc/d2f/d37/f78 318320 0 2024-03-16T10:53:14.128 INFO:tasks.workunit.client.0.smithi017.stdout:4/357: creat d15/d1d/d50/f74 x:0 0 0 2024-03-16T10:53:14.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/299: mknod d0/d15/d1f/c5b 0 2024-03-16T10:53:14.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/300: read d0/f3 [944015,101171] 0 2024-03-16T10:53:14.133 INFO:tasks.workunit.client.0.smithi017.stdout:3/250: getdents d8/d1b/d2e 0 2024-03-16T10:53:14.136 INFO:tasks.workunit.client.0.smithi017.stdout:2/298: creat d4/dd/d1e/d3e/d51/f5c x:0 0 0 2024-03-16T10:53:14.141 INFO:tasks.workunit.client.0.smithi017.stdout:5/386: truncate d0/f22 1865042 0 2024-03-16T10:53:14.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/273: dread d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:14.144 INFO:tasks.workunit.client.0.smithi017.stdout:4/358: creat d15/d1d/f75 x:0 0 0 2024-03-16T10:53:14.144 INFO:tasks.workunit.client.0.smithi017.stdout:4/359: chown d15/d1d/d27/f49 203 1 2024-03-16T10:53:14.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/301: dread d0/d15/f55 [0,4194304] 0 2024-03-16T10:53:14.144 INFO:tasks.workunit.client.0.smithi017.stdout:5/387: mkdir d0/d1/d1f/d29/d88 0 2024-03-16T10:53:14.146 INFO:tasks.workunit.client.0.smithi017.stdout:5/388: truncate d0/d1/d2/d2c/d38/f47 1227320 0 2024-03-16T10:53:14.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/389: creat d0/d1/d2/dc/d2f/f89 x:0 0 0 2024-03-16T10:53:14.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/390: write d0/d1/d2/dc/d2f/d37/d57/f74 [121341,113374] 0 2024-03-16T10:53:14.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/391: write d0/d1/d2/dc/f49 [528313,74682] 0 2024-03-16T10:53:14.149 INFO:tasks.workunit.client.0.smithi017.stdout:5/392: getdents d0/d1/d2/dc/d68 0 2024-03-16T10:53:14.151 INFO:tasks.workunit.client.0.smithi017.stdout:5/393: creat d0/d1/d30/d55/f8a x:0 0 0 2024-03-16T10:53:14.155 INFO:tasks.workunit.client.0.smithi017.stdout:6/302: dread d0/d9/d45/d4d/d2e/f4b [0,4194304] 0 2024-03-16T10:53:14.156 INFO:tasks.workunit.client.0.smithi017.stdout:3/251: dwrite d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:14.158 INFO:tasks.workunit.client.0.smithi017.stdout:5/394: creat d0/d1/d2/dc/d2f/d37/d57/f8b x:0 0 0 2024-03-16T10:53:14.158 INFO:tasks.workunit.client.0.smithi017.stdout:7/274: dwrite d7/db/d12/d1c/d30/f5c [0,4194304] 0 2024-03-16T10:53:14.158 INFO:tasks.workunit.client.0.smithi017.stdout:7/275: write d7/db/f52 [1192638,13771] 0 2024-03-16T10:53:14.159 INFO:tasks.workunit.client.0.smithi017.stdout:6/303: mknod d0/d21/d39/c5c 0 2024-03-16T10:53:14.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/276: mkdir d7/db/dc/d60 0 2024-03-16T10:53:14.170 INFO:tasks.workunit.client.0.smithi017.stdout:6/304: symlink d0/dc/l5d 0 2024-03-16T10:53:14.171 INFO:tasks.workunit.client.0.smithi017.stdout:7/277: creat d7/db/dc/d50/d59/f61 x:0 0 0 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/481: sync 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/330: sync 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:9/236: sync 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/482: stat d1/f41 0 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/483: stat d1/d3/f3a 0 2024-03-16T10:53:14.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/484: fsync d1/d3/f3a 0 2024-03-16T10:53:14.173 INFO:tasks.workunit.client.0.smithi017.stdout:1/485: fdatasync d1/d50/d8d/fa0 0 2024-03-16T10:53:14.173 INFO:tasks.workunit.client.0.smithi017.stdout:8/311: sync 2024-03-16T10:53:14.173 INFO:tasks.workunit.client.0.smithi017.stdout:3/252: dwrite d8/f17 [0,4194304] 0 2024-03-16T10:53:14.173 INFO:tasks.workunit.client.0.smithi017.stdout:7/278: rmdir d7/db/d45 39 2024-03-16T10:53:14.174 INFO:tasks.workunit.client.0.smithi017.stdout:0/331: getdents d2/d4 0 2024-03-16T10:53:14.175 INFO:tasks.workunit.client.0.smithi017.stdout:9/237: mkdir d8/d2d/d32/d45 0 2024-03-16T10:53:14.177 INFO:tasks.workunit.client.0.smithi017.stdout:1/486: write d1/d3/dd/f55 [4419651,40468] 0 2024-03-16T10:53:14.177 INFO:tasks.workunit.client.0.smithi017.stdout:1/487: write d1/d3/dd/f1f [5422842,91080] 0 2024-03-16T10:53:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:3/253: rmdir d8/d1b/d1c 39 2024-03-16T10:53:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:3/254: fdatasync d8/f4e 0 2024-03-16T10:53:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:3/255: chown d8/da/db/f15 103795 1 2024-03-16T10:53:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:3/256: write d8/da/db/f23 [8912729,43240] 0 2024-03-16T10:53:14.180 INFO:tasks.workunit.client.0.smithi017.stdout:7/279: dread f2 [4194304,4194304] 0 2024-03-16T10:53:14.181 INFO:tasks.workunit.client.0.smithi017.stdout:0/332: truncate d2/d7/de/d1e/f36 668405 0 2024-03-16T10:53:14.184 INFO:tasks.workunit.client.0.smithi017.stdout:9/238: mkdir d8/df/d46 0 2024-03-16T10:53:14.189 INFO:tasks.workunit.client.0.smithi017.stdout:3/257: dread d8/da/fe [4194304,4194304] 0 2024-03-16T10:53:14.189 INFO:tasks.workunit.client.0.smithi017.stdout:3/258: stat d8/d1d/l25 0 2024-03-16T10:53:14.189 INFO:tasks.workunit.client.0.smithi017.stdout:3/259: dread - d8/d1b/d2e/f3e zero size 2024-03-16T10:53:14.189 INFO:tasks.workunit.client.0.smithi017.stdout:1/488: unlink d1/d50/d61/l59 0 2024-03-16T10:53:14.192 INFO:tasks.workunit.client.0.smithi017.stdout:0/333: write d2/d7/f1a [3204645,88069] 0 2024-03-16T10:53:14.192 INFO:tasks.workunit.client.0.smithi017.stdout:6/305: dwrite d0/f3c [0,4194304] 0 2024-03-16T10:53:14.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/239: write d8/df/f1a [7424195,73983] 0 2024-03-16T10:53:14.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/240: chown d8/d2d 57 1 2024-03-16T10:53:14.194 INFO:tasks.workunit.client.0.smithi017.stdout:0/334: dread d2/d7/d24/d29/f6a [0,4194304] 0 2024-03-16T10:53:14.195 INFO:tasks.workunit.client.0.smithi017.stdout:3/260: rename d8/d3f/d3d/c4c to d8/da/c4f 0 2024-03-16T10:53:14.199 INFO:tasks.workunit.client.0.smithi017.stdout:6/306: dread d0/d15/f1c [0,4194304] 0 2024-03-16T10:53:14.201 INFO:tasks.workunit.client.0.smithi017.stdout:8/312: dwrite d6/d7/fa [0,4194304] 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:8/313: fsync d6/d39/d35/f26 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/395: dwrite d0/d1/d2/dc/d2f/d37/f78 [0,4194304] 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:9/241: creat d8/f47 x:0 0 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/396: write d0/d1/d2/dc/d2f/d37/d57/f8b [447167,10470] 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/397: fsync d0/d1/d2/d2c/d38/f3b 0 2024-03-16T10:53:14.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/398: chown d0/d1/d2/dc/f45 3857969 1 2024-03-16T10:53:14.203 INFO:tasks.workunit.client.0.smithi017.stdout:3/261: creat d8/da/db/f50 x:0 0 0 2024-03-16T10:53:14.203 INFO:tasks.workunit.client.0.smithi017.stdout:3/262: readlink d8/d1b/d1c/l49 0 2024-03-16T10:53:14.204 INFO:tasks.workunit.client.0.smithi017.stdout:7/280: dwrite d7/db/dc/d50/d59/d34/f5e [0,4194304] 0 2024-03-16T10:53:14.206 INFO:tasks.workunit.client.0.smithi017.stdout:1/489: truncate d1/d3/dd/f12 7558620 0 2024-03-16T10:53:14.206 INFO:tasks.workunit.client.0.smithi017.stdout:1/490: truncate d1/f5f 1924000 0 2024-03-16T10:53:14.206 INFO:tasks.workunit.client.0.smithi017.stdout:1/491: stat d1/d3/dd/f12 0 2024-03-16T10:53:14.208 INFO:tasks.workunit.client.0.smithi017.stdout:6/307: creat d0/d15/d1f/f5e x:0 0 0 2024-03-16T10:53:14.211 INFO:tasks.workunit.client.0.smithi017.stdout:8/314: link d6/d16/f2d d6/f67 0 2024-03-16T10:53:14.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/308: dread d0/f3 [0,4194304] 0 2024-03-16T10:53:14.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/309: write d0/d21/d39/d44/f4f [764753,110825] 0 2024-03-16T10:53:14.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/315: dread d6/d7/d43/f46 [0,4194304] 0 2024-03-16T10:53:14.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/399: dwrite d0/d1/d2/dc/d2f/d37/d42/d4c/f53 [0,4194304] 0 2024-03-16T10:53:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/400: dread d0/d1/d2/d2c/d36/d41/f62 [0,4194304] 0 2024-03-16T10:53:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:9/242: rename d8/df/c20 to d8/d2d/d32/d45/c48 0 2024-03-16T10:53:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/401: write d0/d1/d2/dc/d2f/d37/d42/d4c/f85 [560489,75918] 0 2024-03-16T10:53:14.216 INFO:tasks.workunit.client.0.smithi017.stdout:3/263: link d8/d1d/l25 d8/da/db/l51 0 2024-03-16T10:53:14.218 INFO:tasks.workunit.client.0.smithi017.stdout:7/281: creat d7/db/d12/f62 x:0 0 0 2024-03-16T10:53:14.220 INFO:tasks.workunit.client.0.smithi017.stdout:0/335: mknod d2/d7/de/c7c 0 2024-03-16T10:53:14.221 INFO:tasks.workunit.client.0.smithi017.stdout:1/492: mkdir d1/d3/dd/d31/d66/da1 0 2024-03-16T10:53:14.221 INFO:tasks.workunit.client.0.smithi017.stdout:1/493: fdatasync d1/d3/de/f9d 0 2024-03-16T10:53:14.221 INFO:tasks.workunit.client.0.smithi017.stdout:1/494: write d1/d3/dd/d72/f80 [94795,41531] 0 2024-03-16T10:53:14.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/310: mknod d0/d9/d45/d4d/d2c/c5f 0 2024-03-16T10:53:14.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/311: truncate d0/d9/d45/d4d/d2c/f4c 5090291 0 2024-03-16T10:53:14.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/312: dread - d0/d21/d39/f5a zero size 2024-03-16T10:53:14.225 INFO:tasks.workunit.client.0.smithi017.stdout:8/316: link d6/d7/d43/f46 d6/f68 0 2024-03-16T10:53:14.226 INFO:tasks.workunit.client.0.smithi017.stdout:1/495: dread d1/d3/de/d36/d45/f6e [0,4194304] 0 2024-03-16T10:53:14.229 INFO:tasks.workunit.client.0.smithi017.stdout:9/243: creat d8/df/f49 x:0 0 0 2024-03-16T10:53:14.230 INFO:tasks.workunit.client.0.smithi017.stdout:3/264: dwrite d8/d1d/f46 [4194304,4194304] 0 2024-03-16T10:53:14.230 INFO:tasks.workunit.client.0.smithi017.stdout:3/265: stat d8/d3f/d3d 0 2024-03-16T10:53:14.230 INFO:tasks.workunit.client.0.smithi017.stdout:3/266: fsync d8/fc 0 2024-03-16T10:53:14.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/402: mkdir d0/d1/d2/d8c 0 2024-03-16T10:53:14.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/403: chown d0/d1/d2/cd 5337410 1 2024-03-16T10:53:14.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/404: truncate d0/d1/d2/dc/d2f/d37/d57/f8b 803241 0 2024-03-16T10:53:14.233 INFO:tasks.workunit.client.0.smithi017.stdout:7/282: mknod d7/db/c63 0 2024-03-16T10:53:14.235 INFO:tasks.workunit.client.0.smithi017.stdout:6/313: creat d0/d15/d1f/f60 x:0 0 0 2024-03-16T10:53:14.235 INFO:tasks.workunit.client.0.smithi017.stdout:6/314: write d0/f40 [3604460,105351] 0 2024-03-16T10:53:14.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/317: truncate d6/d7/d43/f3c 1888126 0 2024-03-16T10:53:14.239 INFO:tasks.workunit.client.0.smithi017.stdout:9/244: creat d8/d2d/d32/d45/f4a x:0 0 0 2024-03-16T10:53:14.241 INFO:tasks.workunit.client.0.smithi017.stdout:5/405: creat d0/d1/d30/d55/f8d x:0 0 0 2024-03-16T10:53:14.242 INFO:tasks.workunit.client.0.smithi017.stdout:7/283: rmdir d7/db/dc/d50/d59 39 2024-03-16T10:53:14.242 INFO:tasks.workunit.client.0.smithi017.stdout:7/284: write d7/db/dc/d50/d59/d34/f43 [111805,37541] 0 2024-03-16T10:53:14.243 INFO:tasks.workunit.client.0.smithi017.stdout:7/285: fsync d7/db/d45/f39 0 2024-03-16T10:53:14.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/315: mknod d0/d21/d39/d44/c61 0 2024-03-16T10:53:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:1/496: mknod d1/d3/dd/ca2 0 2024-03-16T10:53:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:1/497: chown d1/l76 412 1 2024-03-16T10:53:14.250 INFO:tasks.workunit.client.0.smithi017.stdout:1/498: mknod d1/d3/d57/d97/ca3 0 2024-03-16T10:53:14.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/499: symlink d1/d3/de/d36/d67/la4 0 2024-03-16T10:53:14.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/500: readlink d1/d50/d61/l3c 0 2024-03-16T10:53:14.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/501: fsync d1/f34 0 2024-03-16T10:53:14.253 INFO:tasks.workunit.client.0.smithi017.stdout:6/316: read d0/d9/d45/d4d/d2c/f33 [1930615,52628] 0 2024-03-16T10:53:14.253 INFO:tasks.workunit.client.0.smithi017.stdout:6/317: fdatasync d0/d15/f1c 0 2024-03-16T10:53:14.254 INFO:tasks.workunit.client.0.smithi017.stdout:6/318: write d0/d21/d39/d44/f4f [1097909,105957] 0 2024-03-16T10:53:14.254 INFO:tasks.workunit.client.0.smithi017.stdout:1/502: symlink d1/d3/de/d36/d45/la5 0 2024-03-16T10:53:14.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/245: dwrite d8/d2d/f42 [0,4194304] 0 2024-03-16T10:53:14.258 INFO:tasks.workunit.client.0.smithi017.stdout:6/319: link d0/d15/d1f/l52 d0/d9/l62 0 2024-03-16T10:53:14.258 INFO:tasks.workunit.client.0.smithi017.stdout:6/320: chown d0/d15/d1f/l52 299 1 2024-03-16T10:53:14.261 INFO:tasks.workunit.client.0.smithi017.stdout:1/503: dread d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:14.262 INFO:tasks.workunit.client.0.smithi017.stdout:7/286: dwrite d7/db/f18 [0,4194304] 0 2024-03-16T10:53:14.262 INFO:tasks.workunit.client.0.smithi017.stdout:7/287: write d7/db/dc/d50/d59/d34/f47 [386647,65802] 0 2024-03-16T10:53:14.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/321: creat d0/d9/d38/f63 x:0 0 0 2024-03-16T10:53:14.264 INFO:tasks.workunit.client.0.smithi017.stdout:7/288: dread d7/db/d12/d1c/f41 [0,4194304] 0 2024-03-16T10:53:14.264 INFO:tasks.workunit.client.0.smithi017.stdout:1/504: symlink d1/d24/la6 0 2024-03-16T10:53:14.268 INFO:tasks.workunit.client.0.smithi017.stdout:6/322: write d0/d15/f55 [3811004,39510] 0 2024-03-16T10:53:14.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/289: dwrite d7/db/d45/f39 [0,4194304] 0 2024-03-16T10:53:14.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/290: fdatasync d7/db/d45/f39 0 2024-03-16T10:53:14.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/291: chown d7/l4a 4 1 2024-03-16T10:53:14.290 INFO:tasks.workunit.client.0.smithi017.stdout:6/323: dwrite d0/f3c [0,4194304] 0 2024-03-16T10:53:14.307 INFO:tasks.workunit.client.0.smithi017.stdout:7/292: dwrite d7/db/f52 [0,4194304] 0 2024-03-16T10:53:14.340 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.077+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c auth v30 ap=1 s=2396 n(v0 rc2024-03-16T10:52:43.797080+0000 b2396 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164b:[<0x10000001643/1-1.c v16>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164b:[<0x10000001643/1-1.c v30>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.077+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001648 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h auth v32 ap=1 s=2420 n(v0 rc2024-03-16T10:52:43.792080+0000 b2420 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001648:[<0x10000001643/testfrmw.h v10>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001648:[<0x10000001643/testfrmw.h v32>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.077+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001646 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt auth v44 ap=1 s=290 n(v0 rc2024-03-16T10:52:43.790080+0000 b290 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001646:[<0x10000001643/coverage.txt v6>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001646:[<0x10000001643/coverage.txt v44>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.078+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c auth v48 ap=1 s=1884 n(v0 rc2024-03-16T10:52:43.798080+0000 b1884 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164c:[<0x10000001643/8-1.c v18>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164c:[<0x10000001643/8-1.c v48>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.078+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c auth v28 ap=1 s=4799 n(v0 rc2024-03-16T10:52:43.801080+0000 b4799 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164e:[<0x10000001643/7-1.c v22>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164e:[<0x10000001643/7-1.c v28>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.078+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c auth v46 ap=1 s=2213 n(v0 rc2024-03-16T10:52:43.802080+0000 b2213 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164f:[<0x10000001643/4-1.c v24>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164f:[<0x10000001643/4-1.c v46>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.078+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001649 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c auth v26 ap=1 s=3753 n(v0 rc2024-03-16T10:52:43.794080+0000 b3753 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f8cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001649:[<0x10000001643/2-1.c v12>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001649:[<0x10000001643/2-1.c v26>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.078+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c auth v34 ap=1 s=4897 n(v0 rc2024-03-16T10:52:43.795080+0000 b4897 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f888000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164a:[<0x10000001643/6-1.c v14>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164a:[<0x10000001643/6-1.c v34>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.079+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001644 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c auth v38 ap=1 s=2706 n(v0 rc2024-03-16T10:52:43.787080+0000 b2706 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f888b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001644:[<0x10000001643/3-1.c v2>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001644:[<0x10000001643/3-1.c v38>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.079+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml auth v40 ap=1 s=2699 n(v0 rc2024-03-16T10:52:43.799080+0000 b2699 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f889600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164d:[<0x10000001643/assertions.xml v20>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000164d:[<0x10000001643/assertions.xml v40>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.079+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001647 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c auth v42 ap=1 s=2106 n(v0 rc2024-03-16T10:52:43.791080+0000 b2106 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f889080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001647:[<0x10000001643/testfrmw.c v8>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001647:[<0x10000001643/testfrmw.c v42>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.341 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.079+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001645 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c auth v36 ap=1 s=5055 n(v0 rc2024-03-16T10:52:43.788080+0000 b5055 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f888580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001645:[<0x10000001643/6-2.c v4>,<0x10000001414/sigwait v1126>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001645:[<0x10000001643/6-2.c v36>,<0x10000001414/sigwait v4643>,<0x100000012ee/interfaces v570>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v58>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: pgmap v423: 97 pgs: 97 active+clean; 328 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 936 op/s 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:53:14.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:14.347 INFO:tasks.workunit.client.0.smithi017.stdout:7/293: stat d7/db/d12/d1c/f36 0 2024-03-16T10:53:14.355 INFO:tasks.workunit.client.0.smithi017.stdout:7/294: dread d7/db/dc/f17 [0,4194304] 0 2024-03-16T10:53:14.355 INFO:tasks.workunit.client.0.smithi017.stdout:7/295: chown f1 25 1 2024-03-16T10:53:14.371 INFO:tasks.workunit.client.0.smithi017.stdout:7/296: dwrite d7/db/d12/d1c/f3c [0,4194304] 0 2024-03-16T10:53:14.420 INFO:tasks.workunit.client.0.smithi017.stdout:7/297: truncate d7/db/f52 562477 0 2024-03-16T10:53:14.436 INFO:tasks.workunit.client.0.smithi017.stdout:7/298: creat d7/db/d45/f64 x:0 0 0 2024-03-16T10:53:14.445 INFO:tasks.workunit.client.0.smithi017.stdout:7/299: write d7/db/f18 [3027857,60069] 0 2024-03-16T10:53:14.464 INFO:tasks.workunit.client.0.smithi017.stdout:0/336: rename d2/d7/de/c7c to d2/d4/c7d 0 2024-03-16T10:53:14.466 INFO:tasks.workunit.client.0.smithi017.stdout:6/324: sync 2024-03-16T10:53:14.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/360: sync 2024-03-16T10:53:14.466 INFO:tasks.workunit.client.0.smithi017.stdout:2/299: sync 2024-03-16T10:53:14.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/361: mkdir d15/d1d/d27/d28/d40/d51/d64/d76 0 2024-03-16T10:53:14.479 INFO:tasks.workunit.client.0.smithi017.stdout:3/267: rename d8/d1d/f1f to d8/f52 0 2024-03-16T10:53:14.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/325: dwrite d0/f3 [0,4194304] 0 2024-03-16T10:53:14.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/362: symlink d15/d1d/d21/d3c/l77 0 2024-03-16T10:53:14.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/363: fsync d15/f59 0 2024-03-16T10:53:14.489 INFO:tasks.workunit.client.0.smithi017.stdout:8/318: rename f2 to d6/d14/f69 0 2024-03-16T10:53:14.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/337: unlink d2/l22 0 2024-03-16T10:53:14.492 INFO:tasks.workunit.client.0.smithi017.stdout:3/268: read - d8/da/db/f50 zero size 2024-03-16T10:53:14.492 INFO:tasks.workunit.client.0.smithi017.stdout:0/338: getdents d2/d4/d61 0 2024-03-16T10:53:14.492 INFO:tasks.workunit.client.0.smithi017.stdout:0/339: chown d2/d25/f33 0 1 2024-03-16T10:53:14.497 INFO:tasks.workunit.client.0.smithi017.stdout:6/326: truncate d0/f40 7160790 0 2024-03-16T10:53:14.497 INFO:tasks.workunit.client.0.smithi017.stdout:6/327: chown d0/d9/d45/d4d 1744093 1 2024-03-16T10:53:14.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/364: getdents d15 0 2024-03-16T10:53:14.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/365: readlink d15/d1d/d50/l54 0 2024-03-16T10:53:14.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/366: write d15/d1d/d21/f4b [304342,33618] 0 2024-03-16T10:53:14.503 INFO:tasks.workunit.client.0.smithi017.stdout:5/406: rename d0/d1/f65 to d0/d1/d2/d2c/d36/d41/f8e 0 2024-03-16T10:53:14.505 INFO:tasks.workunit.client.0.smithi017.stdout:8/319: symlink d6/d7/d34/l6a 0 2024-03-16T10:53:14.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/269: truncate d8/d1b/d1c/f4d 304051 0 2024-03-16T10:53:14.510 INFO:tasks.workunit.client.0.smithi017.stdout:7/300: mknod d7/db/dc/d50/d59/d34/d53/c65 0 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: pgmap v423: 97 pgs: 97 active+clean; 328 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 936 op/s 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:53:14.513 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:53:14.513 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:14.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/367: creat d15/d1d/d27/f78 x:0 0 0 2024-03-16T10:53:14.515 INFO:tasks.workunit.client.0.smithi017.stdout:9/246: rename d8/df/f49 to d8/d2d/d32/f4b 0 2024-03-16T10:53:14.515 INFO:tasks.workunit.client.0.smithi017.stdout:9/247: write d8/df/f1a [4178470,67160] 0 2024-03-16T10:53:14.517 INFO:tasks.workunit.client.0.smithi017.stdout:8/320: mkdir d6/d14/d6b 0 2024-03-16T10:53:14.517 INFO:tasks.workunit.client.0.smithi017.stdout:0/340: dwrite d2/d7/de/d19/d2e/f4e [0,4194304] 0 2024-03-16T10:53:14.517 INFO:tasks.workunit.client.0.smithi017.stdout:0/341: chown d2/d7/f1a 61940 1 2024-03-16T10:53:14.517 INFO:tasks.workunit.client.0.smithi017.stdout:0/342: fdatasync d2/d7/de/f16 0 2024-03-16T10:53:14.518 INFO:tasks.workunit.client.0.smithi017.stdout:0/343: truncate d2/d4/f1c 3125525 0 2024-03-16T10:53:14.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/407: dwrite d0/d1/d2/d2c/d38/f47 [0,4194304] 0 2024-03-16T10:53:14.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/408: chown d0/d1/d2/d2c/d36/l52 7987 1 2024-03-16T10:53:14.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/409: fsync d0/d1/d2/dc/d2f/d37/d42/f4a 0 2024-03-16T10:53:14.522 INFO:tasks.workunit.client.0.smithi017.stdout:3/270: symlink d8/da/db/l53 0 2024-03-16T10:53:14.524 INFO:tasks.workunit.client.0.smithi017.stdout:0/344: write d2/d7/f63 [2034516,120468] 0 2024-03-16T10:53:14.526 INFO:tasks.workunit.client.0.smithi017.stdout:7/301: mkdir d7/db/d45/d66 0 2024-03-16T10:53:14.527 INFO:tasks.workunit.client.0.smithi017.stdout:0/345: mknod d2/d7/d24/d29/c7e 0 2024-03-16T10:53:14.527 INFO:tasks.workunit.client.0.smithi017.stdout:2/300: creat d4/dd/d1e/d28/f5d x:0 0 0 2024-03-16T10:53:14.532 INFO:tasks.workunit.client.0.smithi017.stdout:4/368: unlink d15/d1d/d21/c52 0 2024-03-16T10:53:14.532 INFO:tasks.workunit.client.0.smithi017.stdout:4/369: dread - d15/d1d/d27/d28/d43/f48 zero size 2024-03-16T10:53:14.540 INFO:tasks.workunit.client.0.smithi017.stdout:9/248: creat d8/f4c x:0 0 0 2024-03-16T10:53:14.546 INFO:tasks.workunit.client.0.smithi017.stdout:8/321: mkdir d6/d16/d6c 0 2024-03-16T10:53:14.547 INFO:tasks.workunit.client.0.smithi017.stdout:8/322: write d6/fe [2455684,49184] 0 2024-03-16T10:53:14.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/346: dwrite d2/f5 [0,4194304] 0 2024-03-16T10:53:14.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/347: write d2/d4/f43 [1010484,42677] 0 2024-03-16T10:53:14.551 INFO:tasks.workunit.client.0.smithi017.stdout:7/302: dwrite d7/db/dc/d50/d59/d34/f44 [0,4194304] 0 2024-03-16T10:53:14.552 INFO:tasks.workunit.client.0.smithi017.stdout:5/410: unlink d0/d1/d2/d24/f2e 0 2024-03-16T10:53:14.554 INFO:tasks.workunit.client.0.smithi017.stdout:0/348: link d2/d7/d24/d29/f6a d2/d4/d6d/f7f 0 2024-03-16T10:53:14.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/249: dwrite d8/d2d/d32/f3d [0,4194304] 0 2024-03-16T10:53:14.559 INFO:tasks.workunit.client.0.smithi017.stdout:3/271: getdents d8/d1b/d1c 0 2024-03-16T10:53:14.561 INFO:tasks.workunit.client.0.smithi017.stdout:0/349: write d2/d4/f1c [1124660,56535] 0 2024-03-16T10:53:14.563 INFO:tasks.workunit.client.0.smithi017.stdout:0/350: link d2/d4/l3b d2/d7/d24/d72/l80 0 2024-03-16T10:53:14.571 INFO:tasks.workunit.client.0.smithi017.stdout:4/370: symlink d15/d1d/d21/d26/l79 0 2024-03-16T10:53:14.571 INFO:tasks.workunit.client.0.smithi017.stdout:4/371: truncate d15/d1d/d27/d28/f34 401968 0 2024-03-16T10:53:14.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/351: truncate d2/d4/f43 49285 0 2024-03-16T10:53:14.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/352: fdatasync d2/d7/d24/d29/f40 0 2024-03-16T10:53:14.572 INFO:tasks.workunit.client.0.smithi017.stdout:0/353: chown d2/d25/c2f 0 1 2024-03-16T10:53:14.573 INFO:tasks.workunit.client.0.smithi017.stdout:0/354: readlink d2/d25/l46 0 2024-03-16T10:53:14.573 INFO:tasks.workunit.client.0.smithi017.stdout:0/355: dread - d2/d7/f5c zero size 2024-03-16T10:53:14.579 INFO:tasks.workunit.client.0.smithi017.stdout:0/356: dread d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:14.581 INFO:tasks.workunit.client.0.smithi017.stdout:0/357: write d2/d7/f64 [216335,129178] 0 2024-03-16T10:53:14.581 INFO:tasks.workunit.client.0.smithi017.stdout:0/358: stat d2/d4/f1c 0 2024-03-16T10:53:14.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/323: creat d6/d16/d6c/f6d x:0 0 0 2024-03-16T10:53:14.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/324: dread - d6/d5f/f57 zero size 2024-03-16T10:53:14.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/325: readlink d6/d16/l4c 0 2024-03-16T10:53:14.583 INFO:tasks.workunit.client.0.smithi017.stdout:8/326: chown d6 853706998 1 2024-03-16T10:53:14.584 INFO:tasks.workunit.client.0.smithi017.stdout:0/359: dread d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:14.584 INFO:tasks.workunit.client.0.smithi017.stdout:0/360: chown d2/d25/f33 341 1 2024-03-16T10:53:14.585 INFO:tasks.workunit.client.0.smithi017.stdout:0/361: creat d2/d7/f81 x:0 0 0 2024-03-16T10:53:14.586 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.481+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001707 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c auth v24 ap=1 s=2201 n(v0 rc2024-03-16T10:52:43.989078+0000 b2201 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001707:[<0x10000001702/1-1.c v10>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001707:[<0x10000001702/1-1.c v24>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.586 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001704 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c auth v30 ap=1 s=2222 n(v0 rc2024-03-16T10:52:43.986078+0000 b2222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001704:[<0x10000001702/1-2.c v4>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001704:[<0x10000001702/1-2.c v30>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: pgmap v423: 97 pgs: 97 active+clean; 328 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 35 MiB/s wr, 936 op/s 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.587 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.588 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:14.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001705 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c auth v26 ap=1 s=2417 n(v0 rc2024-03-16T10:52:43.987078+0000 b2417 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001705:[<0x10000001702/2-1.c v6>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001705:[<0x10000001702/2-1.c v26>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001703 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt auth v22 ap=1 s=118 n(v0 rc2005-06-03T16:30:56.000000+0000 b118 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001703:[<0x10000001702/coverage.txt v2>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001703:[<0x10000001702/coverage.txt v22>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001709 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh auth v32 ap=1 s=541 n(v0 rc2024-03-16T10:52:43.991078+0000 b541 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001709:[<0x10000001702/3-1.sh v14>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001709:[<0x10000001702/3-1.sh v32>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001706 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c auth v18 ap=1 s=1961 n(v0 rc2024-03-16T10:52:43.988078+0000 b1961 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001706:[<0x10000001702/5-1.c v8>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001706:[<0x10000001702/5-1.c v18>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh auth v20 ap=1 s=552 n(v0 rc2024-03-16T10:52:43.992078+0000 b552 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170a:[<0x10000001702/4-1.sh v16>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000170a:[<0x10000001702/4-1.sh v20>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.482+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001708 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml auth v28 ap=1 s=1432 n(v0 rc2024-03-16T10:52:43.990078+0000 b1432 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001708:[<0x10000001702/assertions.xml v12>,<0x10000001414/mq_setattr v1488>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001708:[<0x10000001702/assertions.xml v28>,<0x10000001414/mq_setattr v5071>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.590 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.496+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d9 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c auth v16 ap=1 s=1713 n(v0 rc2024-03-16T10:52:43.619082+0000 b1713 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d9:[<0x100000015d6/1-1.c v6>,<0x10000001414/pthread_condattr_init v896>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015d9:[<0x100000015d6/1-1.c v16>,<0x10000001414/pthread_condattr_init v5053>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.591 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.496+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt auth v12 ap=1 s=292 n(v0 rc2024-03-16T10:52:43.617082+0000 b292 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d8:[<0x100000015d6/coverage.txt v4>,<0x10000001414/pthread_condattr_init v896>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015d8:[<0x100000015d6/coverage.txt v12>,<0x10000001414/pthread_condattr_init v5053>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.591 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.496+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c auth v10 ap=1 s=1227 n(v0 rc2024-03-16T10:52:43.615082+0000 b1227 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d7:[<0x100000015d6/3-1.c v2>,<0x10000001414/pthread_condattr_init v896>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015d7:[<0x100000015d6/3-1.c v10>,<0x10000001414/pthread_condattr_init v5053>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.591 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:53:14.496+0000 7fe26ecb1700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015da [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml auth v14 ap=1 s=946 n(v0 rc2024-03-16T10:52:43.620082+0000 b946 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ab8b2d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015da:[<0x100000015d6/assertions.xml v8>,<0x10000001414/pthread_condattr_init v896>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000015da:[<0x100000015d6/assertions.xml v14>,<0x10000001414/pthread_condattr_init v5053>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.591 INFO:tasks.workunit.client.0.smithi017.stdout:0/362: unlink d2/d7/f81 0 2024-03-16T10:53:14.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/303: getdents d7/db/d12/d1c/d4e 0 2024-03-16T10:53:14.594 INFO:tasks.workunit.client.0.smithi017.stdout:5/411: creat d0/d1/d2/d8c/f8f x:0 0 0 2024-03-16T10:53:14.594 INFO:tasks.workunit.client.0.smithi017.stdout:5/412: chown d0/d1/d30/d4f/l7d 2867 1 2024-03-16T10:53:14.598 INFO:tasks.workunit.client.0.smithi017.stdout:9/250: creat d8/f4d x:0 0 0 2024-03-16T10:53:14.600 INFO:tasks.workunit.client.0.smithi017.stdout:0/363: dread d2/f5 [0,4194304] 0 2024-03-16T10:53:14.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/372: symlink d15/d1d/d27/d28/d40/d51/d64/d76/l7a 0 2024-03-16T10:53:14.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/373: dread - d15/d1d/f56 zero size 2024-03-16T10:53:14.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/374: stat d15/d1d/d21/d26/f35 0 2024-03-16T10:53:14.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/304: unlink d7/db/l2a 0 2024-03-16T10:53:14.606 INFO:tasks.workunit.client.0.smithi017.stdout:5/413: creat d0/d5d/f90 x:0 0 0 2024-03-16T10:53:14.609 INFO:tasks.workunit.client.0.smithi017.stdout:9/251: symlink d8/df/l4e 0 2024-03-16T10:53:14.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/364: dread d2/d7/de/d19/f56 [0,4194304] 0 2024-03-16T10:53:14.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/365: fsync d2/d7/d24/d29/f6a 0 2024-03-16T10:53:14.610 INFO:tasks.workunit.client.0.smithi017.stdout:0/366: getdents d2/d7/d24/d3a 0 2024-03-16T10:53:14.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/272: link d8/fc d8/d1b/d1c/f54 0 2024-03-16T10:53:14.615 INFO:tasks.workunit.client.0.smithi017.stdout:4/375: unlink f14 0 2024-03-16T10:53:14.617 INFO:tasks.workunit.client.0.smithi017.stdout:7/305: mknod d7/db/d12/d1c/d30/c67 0 2024-03-16T10:53:14.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/414: mkdir d0/d1/d1f/d29/d88/d91 0 2024-03-16T10:53:14.622 INFO:tasks.workunit.client.0.smithi017.stdout:7/306: creat d7/db/dc/d50/d59/f68 x:0 0 0 2024-03-16T10:53:14.623 INFO:tasks.workunit.client.0.smithi017.stdout:7/307: fdatasync d7/db/f18 0 2024-03-16T10:53:14.624 INFO:tasks.workunit.client.0.smithi017.stdout:7/308: getdents d7/db/dc/d50 0 2024-03-16T10:53:14.629 INFO:tasks.workunit.client.0.smithi017.stdout:4/376: dwrite d15/d1d/d21/f5e [0,4194304] 0 2024-03-16T10:53:14.633 INFO:tasks.workunit.client.0.smithi017.stdout:7/309: write d7/db/dc/f17 [2093963,91311] 0 2024-03-16T10:53:14.633 INFO:tasks.workunit.client.0.smithi017.stdout:7/310: chown d7/db/d12/d1c/f36 148396 1 2024-03-16T10:53:14.635 INFO:tasks.workunit.client.0.smithi017.stdout:4/377: creat d15/d1d/d27/d28/d40/f7b x:0 0 0 2024-03-16T10:53:14.635 INFO:tasks.workunit.client.0.smithi017.stdout:4/378: readlink d15/d1d/d21/d26/l73 0 2024-03-16T10:53:14.638 INFO:tasks.workunit.client.0.smithi017.stdout:7/311: mknod d7/db/d32/c69 0 2024-03-16T10:53:14.639 INFO:tasks.workunit.client.0.smithi017.stdout:4/379: mkdir d15/d1d/d27/d28/d7c 0 2024-03-16T10:53:14.642 INFO:tasks.workunit.client.0.smithi017.stdout:7/312: creat d7/db/dc/d60/f6a x:0 0 0 2024-03-16T10:53:14.644 INFO:tasks.workunit.client.0.smithi017.stdout:5/415: dwrite d0/d1/d2/d2c/d38/f3b [0,4194304] 0 2024-03-16T10:53:14.644 INFO:tasks.workunit.client.0.smithi017.stdout:5/416: readlink d0/d1/d1f/l26 0 2024-03-16T10:53:14.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/301: sync 2024-03-16T10:53:14.654 INFO:tasks.workunit.client.0.smithi017.stdout:1/505: rename d1/d3/dd/f92 to d1/d24/fa7 0 2024-03-16T10:53:14.654 INFO:tasks.workunit.client.0.smithi017.stdout:1/506: chown d1/d3/dd/d72/f74 2 1 2024-03-16T10:53:14.656 INFO:tasks.workunit.client.0.smithi017.stdout:6/328: rename d0/ce to d0/d9/c64 0 2024-03-16T10:53:14.656 INFO:tasks.workunit.client.0.smithi017.stdout:6/329: read d0/d9/f18 [1371413,71966] 0 2024-03-16T10:53:14.657 INFO:tasks.workunit.client.0.smithi017.stdout:4/380: dwrite d15/d1d/d27/d28/f34 [0,4194304] 0 2024-03-16T10:53:14.658 INFO:tasks.workunit.client.0.smithi017.stdout:2/302: creat d4/f5e x:0 0 0 2024-03-16T10:53:14.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/327: rename d6/d7 to d6/d5f/d6e 0 2024-03-16T10:53:14.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/328: dread - d6/d39/d35/f53 zero size 2024-03-16T10:53:14.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/329: write d6/d16/f66 [999748,81318] 0 2024-03-16T10:53:14.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/313: dwrite d7/db/dc/d50/d59/f55 [0,4194304] 0 2024-03-16T10:53:14.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/330: link d0/c8 d0/d9/d45/c65 0 2024-03-16T10:53:14.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/507: mknod d1/d24/ca8 0 2024-03-16T10:53:14.666 INFO:tasks.workunit.client.0.smithi017.stdout:4/381: symlink d15/d1d/d50/l7d 0 2024-03-16T10:53:14.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/508: mkdir d1/d24/d79/d7a/da9 0 2024-03-16T10:53:14.669 INFO:tasks.workunit.client.0.smithi017.stdout:9/252: rename d8/f37 to d8/df/f4f 0 2024-03-16T10:53:14.669 INFO:tasks.workunit.client.0.smithi017.stdout:7/314: truncate d7/db/dc/d50/d59/f55 2639156 0 2024-03-16T10:53:14.669 INFO:tasks.workunit.client.0.smithi017.stdout:7/315: chown d7/db/d45/l5f 15656 1 2024-03-16T10:53:14.670 INFO:tasks.workunit.client.0.smithi017.stdout:8/330: creat d6/d14/d6b/f6f x:0 0 0 2024-03-16T10:53:14.670 INFO:tasks.workunit.client.0.smithi017.stdout:8/331: read - d6/d16/d6c/f6d zero size 2024-03-16T10:53:14.671 INFO:tasks.workunit.client.0.smithi017.stdout:0/367: rename d2/f5 to d2/d4/f82 0 2024-03-16T10:53:14.673 INFO:tasks.workunit.client.0.smithi017.stdout:6/331: mknod d0/d22/c66 0 2024-03-16T10:53:14.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/382: symlink d15/d1d/d27/d28/l7e 0 2024-03-16T10:53:14.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/383: dread - d15/d1d/f56 zero size 2024-03-16T10:53:14.674 INFO:tasks.workunit.client.0.smithi017.stdout:1/509: chown d1/d3/dd/l2b 2788 1 2024-03-16T10:53:14.677 INFO:tasks.workunit.client.0.smithi017.stdout:5/417: rename d0/d1/d2/f18 to d0/d1/d2/dc/d68/f92 0 2024-03-16T10:53:14.680 INFO:tasks.workunit.client.0.smithi017.stdout:6/332: link d0/d15/l20 d0/d21/d39/d44/l67 0 2024-03-16T10:53:14.682 INFO:tasks.workunit.client.0.smithi017.stdout:4/384: truncate f4 3824721 0 2024-03-16T10:53:14.682 INFO:tasks.workunit.client.0.smithi017.stdout:4/385: fdatasync d15/d1d/d50/f5b 0 2024-03-16T10:53:14.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/253: dread d8/d2d/d32/f3c [0,4194304] 0 2024-03-16T10:53:14.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/254: write d8/f47 [203992,98631] 0 2024-03-16T10:53:14.683 INFO:tasks.workunit.client.0.smithi017.stdout:9/255: getdents d8/df/d46 0 2024-03-16T10:53:14.684 INFO:tasks.workunit.client.0.smithi017.stdout:1/510: unlink d1/d3/de/d36/l46 0 2024-03-16T10:53:14.689 INFO:tasks.workunit.client.0.smithi017.stdout:2/303: rename d4/f8 to d4/dd/df/f5f 0 2024-03-16T10:53:14.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/316: dread d7/db/dc/d50/d59/f55 [0,4194304] 0 2024-03-16T10:53:14.692 INFO:tasks.workunit.client.0.smithi017.stdout:6/333: dread d0/f3c [0,4194304] 0 2024-03-16T10:53:14.693 INFO:tasks.workunit.client.0.smithi017.stdout:2/304: symlink d4/d6/db/d24/d39/l60 0 2024-03-16T10:53:14.693 INFO:tasks.workunit.client.0.smithi017.stdout:2/305: chown d4/dd/d1e/d28/d2e 1638386987 1 2024-03-16T10:53:14.693 INFO:tasks.workunit.client.0.smithi017.stdout:9/256: link d8/df/f11 d8/d2d/d32/f50 0 2024-03-16T10:53:14.694 INFO:tasks.workunit.client.0.smithi017.stdout:2/306: dread - d4/dd/d1e/d3e/d51/f5c zero size 2024-03-16T10:53:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:9/257: read - d8/d2d/d32/d45/f4a zero size 2024-03-16T10:53:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/368: dwrite d2/f23 [4194304,4194304] 0 2024-03-16T10:53:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/369: write d2/d7/de/f16 [2759425,29909] 0 2024-03-16T10:53:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/370: stat d2/d32/f53 0 2024-03-16T10:53:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:1/511: unlink d1/d3/dd/d9f/l3f 0 2024-03-16T10:53:14.696 INFO:tasks.workunit.client.0.smithi017.stdout:5/418: dwrite d0/d1/d2/dc/d2f/d37/d42/d4c/f4e [0,4194304] 0 2024-03-16T10:53:14.697 INFO:tasks.workunit.client.0.smithi017.stdout:2/307: symlink d4/dd/d1e/d4a/l61 0 2024-03-16T10:53:14.698 INFO:tasks.workunit.client.0.smithi017.stdout:2/308: chown d4/dd/d1e/d28/d2e/f59 1092 1 2024-03-16T10:53:14.698 INFO:tasks.workunit.client.0.smithi017.stdout:8/332: rename d6/d5f/d6e/fa to d6/d16/f70 0 2024-03-16T10:53:14.698 INFO:tasks.workunit.client.0.smithi017.stdout:8/333: getdents d6/d4a/d65 0 2024-03-16T10:53:14.698 INFO:tasks.workunit.client.0.smithi017.stdout:8/334: write d6/d39/f56 [709388,27122] 0 2024-03-16T10:53:14.699 INFO:tasks.workunit.client.0.smithi017.stdout:2/309: mknod d4/dd/d1e/d4a/c62 0 2024-03-16T10:53:14.699 INFO:tasks.workunit.client.0.smithi017.stdout:0/371: write d2/d4/f67 [1743455,75038] 0 2024-03-16T10:53:14.699 INFO:tasks.workunit.client.0.smithi017.stdout:0/372: write d2/d7/de/f16 [1392487,63164] 0 2024-03-16T10:53:14.700 INFO:tasks.workunit.client.0.smithi017.stdout:6/334: symlink d0/d9/d45/l68 0 2024-03-16T10:53:14.700 INFO:tasks.workunit.client.0.smithi017.stdout:6/335: fsync d0/f40 0 2024-03-16T10:53:14.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/419: dread d0/d1/f11 [0,4194304] 0 2024-03-16T10:53:14.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/420: truncate d0/d1/d2/d2c/d36/d51/f67 4650839 0 2024-03-16T10:53:14.701 INFO:tasks.workunit.client.0.smithi017.stdout:2/310: mkdir d4/dd/d1e/d28/d29/d63 0 2024-03-16T10:53:14.701 INFO:tasks.workunit.client.0.smithi017.stdout:9/258: mknod d8/d2d/d32/d45/c51 0 2024-03-16T10:53:14.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/311: creat d4/dd/d1e/d28/d29/f64 x:0 0 0 2024-03-16T10:53:14.704 INFO:tasks.workunit.client.0.smithi017.stdout:0/373: symlink d2/d7/de/d1e/l83 0 2024-03-16T10:53:14.704 INFO:tasks.workunit.client.0.smithi017.stdout:7/317: rmdir d7/db/dc/d50/d59 39 2024-03-16T10:53:14.705 INFO:tasks.workunit.client.0.smithi017.stdout:4/386: dwrite fa [0,4194304] 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/259: read d8/d2d/f43 [2961275,27247] 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/260: write d8/f2a [1119232,110310] 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/387: read d15/d1d/d21/f4c [93456,83187] 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/388: readlink d15/l16 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/389: dread - d15/d1d/d50/f74 zero size 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/390: dread - d15/d1d/d27/f3e zero size 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/391: truncate d15/d1d/d27/d28/f38 253791 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/261: write d8/f47 [131274,13421] 0 2024-03-16T10:53:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/262: write d8/d2d/d32/f4b [966214,7584] 0 2024-03-16T10:53:14.709 INFO:tasks.workunit.client.0.smithi017.stdout:1/512: rename d1/d3/dd/f1f to d1/d50/faa 0 2024-03-16T10:53:14.710 INFO:tasks.workunit.client.0.smithi017.stdout:8/335: creat d6/d5c/f71 x:0 0 0 2024-03-16T10:53:14.711 INFO:tasks.workunit.client.0.smithi017.stdout:9/263: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:14.712 INFO:tasks.workunit.client.0.smithi017.stdout:6/336: unlink d0/d9/d45/d4d/l53 0 2024-03-16T10:53:14.713 INFO:tasks.workunit.client.0.smithi017.stdout:1/513: dread d1/f5f [0,4194304] 0 2024-03-16T10:53:14.713 INFO:tasks.workunit.client.0.smithi017.stdout:5/421: getdents d0/d1/d30/d55/d6a 0 2024-03-16T10:53:14.715 INFO:tasks.workunit.client.0.smithi017.stdout:7/318: symlink d7/db/d45/d66/l6b 0 2024-03-16T10:53:14.719 INFO:tasks.workunit.client.0.smithi017.stdout:4/392: link d15/d1d/f24 d15/d1d/d21/f7f 0 2024-03-16T10:53:14.721 INFO:tasks.workunit.client.0.smithi017.stdout:8/336: mkdir d6/d14/d72 0 2024-03-16T10:53:14.721 INFO:tasks.workunit.client.0.smithi017.stdout:0/374: dwrite d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:14.722 INFO:tasks.workunit.client.0.smithi017.stdout:2/312: dwrite d4/f52 [0,4194304] 0 2024-03-16T10:53:14.722 INFO:tasks.workunit.client.0.smithi017.stdout:6/337: dread d0/d15/d1f/f32 [0,4194304] 0 2024-03-16T10:53:14.723 INFO:tasks.workunit.client.0.smithi017.stdout:0/375: truncate d2/d7/de/d19/d2e/f48 2334518 0 2024-03-16T10:53:14.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/264: unlink d8/c2b 0 2024-03-16T10:53:14.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/265: stat d8/f47 0 2024-03-16T10:53:14.724 INFO:tasks.workunit.client.0.smithi017.stdout:0/376: mkdir d2/d4/d6d/d84 0 2024-03-16T10:53:14.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/422: rmdir d0/d1/d30/d4f 39 2024-03-16T10:53:14.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/423: truncate d0/f27 536203 0 2024-03-16T10:53:14.727 INFO:tasks.workunit.client.0.smithi017.stdout:0/377: mkdir d2/d25/d85 0 2024-03-16T10:53:14.732 INFO:tasks.workunit.client.0.smithi017.stdout:4/393: rmdir d15/d1d 39 2024-03-16T10:53:14.742 INFO:tasks.workunit.client.0.smithi017.stdout:8/337: unlink d6/d39/d35/f21 0 2024-03-16T10:53:14.746 INFO:tasks.workunit.client.0.smithi017.stdout:2/313: getdents d4/dd/d38 0 2024-03-16T10:53:14.746 INFO:tasks.workunit.client.0.smithi017.stdout:2/314: stat d4/dd/df 0 2024-03-16T10:53:14.748 INFO:tasks.workunit.client.0.smithi017.stdout:6/338: mkdir d0/d9/d45/d4d/d2e/d69 0 2024-03-16T10:53:14.749 INFO:tasks.workunit.client.0.smithi017.stdout:9/266: mknod d8/c52 0 2024-03-16T10:53:14.751 INFO:tasks.workunit.client.0.smithi017.stdout:4/394: symlink d15/d1d/d50/l80 0 2024-03-16T10:53:14.751 INFO:tasks.workunit.client.0.smithi017.stdout:4/395: chown d15/l5a 1 1 2024-03-16T10:53:14.752 INFO:tasks.workunit.client.0.smithi017.stdout:2/315: creat d4/f65 x:0 0 0 2024-03-16T10:53:14.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/316: dread - d4/d6/db/d24/f5b zero size 2024-03-16T10:53:14.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/317: write d4/dd/d1e/d28/d2e/f3a [2418023,8365] 0 2024-03-16T10:53:14.754 INFO:tasks.workunit.client.0.smithi017.stdout:6/339: creat d0/f6a x:0 0 0 2024-03-16T10:53:14.758 INFO:tasks.workunit.client.0.smithi017.stdout:8/338: dwrite d6/d39/d35/f53 [0,4194304] 0 2024-03-16T10:53:14.759 INFO:tasks.workunit.client.0.smithi017.stdout:4/396: dread d15/d1d/d27/d28/f34 [0,4194304] 0 2024-03-16T10:53:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:9/267: read d8/d2d/d32/f3d [1833328,14142] 0 2024-03-16T10:53:14.767 INFO:tasks.workunit.client.0.smithi017.stdout:8/339: write d6/d39/f32 [2550504,1621] 0 2024-03-16T10:53:14.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/397: link d15/d1d/d27/d28/d40/d51/f71 d15/d1d/f81 0 2024-03-16T10:53:14.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/398: fsync d15/d1d/d27/f3b 0 2024-03-16T10:53:14.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/399: write d15/d1d/d21/f4c [1151032,60631] 0 2024-03-16T10:53:14.775 INFO:tasks.workunit.client.0.smithi017.stdout:4/400: unlink d15/d1d/d21/d3c/l77 0 2024-03-16T10:53:14.776 INFO:tasks.workunit.client.0.smithi017.stdout:9/268: truncate d8/f2a 9096605 0 2024-03-16T10:53:14.777 INFO:tasks.workunit.client.0.smithi017.stdout:8/340: dread d6/d39/d35/f53 [0,4194304] 0 2024-03-16T10:53:14.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/269: rename d8/df/l15 to d8/df/l53 0 2024-03-16T10:53:14.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/270: chown d8/d2d/f3a 1379 1 2024-03-16T10:53:14.780 INFO:tasks.workunit.client.0.smithi017.stdout:8/341: getdents d6 0 2024-03-16T10:53:14.782 INFO:tasks.workunit.client.0.smithi017.stdout:9/271: mknod d8/df/c54 0 2024-03-16T10:53:14.782 INFO:tasks.workunit.client.0.smithi017.stdout:9/272: getdents d8/df/d46 0 2024-03-16T10:53:14.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/342: creat d6/d5c/f73 x:0 0 0 2024-03-16T10:53:14.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/343: fdatasync d6/d5f/d6e/f50 0 2024-03-16T10:53:14.789 INFO:tasks.workunit.client.0.smithi017.stdout:1/514: rename d1/d3/dd/d31/d66/c6b to d1/d3/de/d36/d45/cab 0 2024-03-16T10:53:14.794 INFO:tasks.workunit.client.0.smithi017.stdout:9/273: dwrite d8/d2d/d32/f50 [0,4194304] 0 2024-03-16T10:53:14.795 INFO:tasks.workunit.client.0.smithi017.stdout:1/515: creat d1/d3/dd/d31/d35/fac x:0 0 0 2024-03-16T10:53:14.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/424: rename d0/d1/d30/d4f to d0/d93 0 2024-03-16T10:53:14.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/425: chown d0/d1/l1e 454547116 1 2024-03-16T10:53:14.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/426: stat d0/d1/d2/dc/d68/f92 0 2024-03-16T10:53:14.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/427: chown d0/d1/d2/d2c 46677623 1 2024-03-16T10:53:14.802 INFO:tasks.workunit.client.0.smithi017.stdout:0/378: rename d2/d25 to d2/d4/d6d/d6c/d86 0 2024-03-16T10:53:14.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/428: symlink d0/d1/d2/d2c/d36/d51/l94 0 2024-03-16T10:53:14.804 INFO:tasks.workunit.client.0.smithi017.stdout:0/379: creat d2/d7/f87 x:0 0 0 2024-03-16T10:53:14.804 INFO:tasks.workunit.client.0.smithi017.stdout:0/380: read d2/d32/f53 [663905,114418] 0 2024-03-16T10:53:14.805 INFO:tasks.workunit.client.0.smithi017.stdout:0/381: mkdir d2/d7/d24/d72/d88 0 2024-03-16T10:53:14.805 INFO:tasks.workunit.client.0.smithi017.stdout:0/382: stat d2/d7/de 0 2024-03-16T10:53:14.805 INFO:tasks.workunit.client.0.smithi017.stdout:5/429: rmdir d0/d1/d2 39 2024-03-16T10:53:14.806 INFO:tasks.workunit.client.0.smithi017.stdout:0/383: mknod d2/d4/d6d/c89 0 2024-03-16T10:53:14.809 INFO:tasks.workunit.client.0.smithi017.stdout:5/430: creat d0/d1/d30/d55/f95 x:0 0 0 2024-03-16T10:53:14.809 INFO:tasks.workunit.client.0.smithi017.stdout:5/431: dread - d0/d1/d2/dc/d2f/f89 zero size 2024-03-16T10:53:14.809 INFO:tasks.workunit.client.0.smithi017.stdout:5/432: dread - d0/d1/d1f/f7b zero size 2024-03-16T10:53:14.811 INFO:tasks.workunit.client.0.smithi017.stdout:5/433: write d0/f22 [1247228,39657] 0 2024-03-16T10:53:14.813 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.506+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c auth v533 ap=1 s=1339 n(v0 rc2024-03-16T10:52:44.023078+0000 b1339 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa09180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172e:[<0x10000001726/6-24.c v16>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172e:[<0x10000001726/6-24.c v533>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.813 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.507+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001733 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c auth v547 ap=1 s=1722 n(v0 rc2005-06-03T16:34:56.000000+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001733:[<0x10000001726/13-16.c v26>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001733:[<0x10000001726/13-16.c v547>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.813 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.507+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001778 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c auth v459 ap=1 s=1910 n(v0 rc2024-03-16T10:52:44.093077+0000 b1910 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001778:[<0x10000001726/4-24.c v164>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001778:[<0x10000001726/4-24.c v459>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.508+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001762 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c auth v443 ap=1 s=1770 n(v0 rc2024-03-16T10:52:44.069078+0000 b1770 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa26580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001762:[<0x10000001726/12-47.c v120>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001762:[<0x10000001726/12-47.c v443>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.508+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001776 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c auth v479 ap=1 s=2441 n(v0 rc2024-03-16T10:52:44.089077+0000 b2441 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001776:[<0x10000001726/25-21.c v160>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001776:[<0x10000001726/25-21.c v479>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.509+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c auth v503 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.022078+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa28100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172d:[<0x10000001726/12-39.c v14>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172d:[<0x10000001726/12-39.c v503>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.509+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c0 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c auth v583 ap=1 s=1476 n(v0 rc2024-03-16T10:52:44.184076+0000 b1476 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa28680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c0:[<0x10000001726/1-26.c v306>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c0:[<0x10000001726/1-26.c v583>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.510+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c auth v587 ap=1 s=1472 n(v0 rc2024-03-16T10:52:44.114077+0000 b1472 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178f:[<0x10000001726/1-8.c v208>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000178f:[<0x10000001726/1-8.c v587>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.511+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001793 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c auth v581 ap=1 s=1476 n(v0 rc2024-03-16T10:52:44.120077+0000 b1476 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001793:[<0x10000001726/1-19.c v216>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001793:[<0x10000001726/1-19.c v581>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.512+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c auth v507 ap=1 s=5509 n(v0 rc2024-03-16T10:52:44.172077+0000 b5509 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa35700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b7:[<0x10000001726/16-21.c v288>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b7:[<0x10000001726/16-21.c v507>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.512+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c auth v449 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.132077+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179b:[<0x10000001726/18-20.c v232>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179b:[<0x10000001726/18-20.c v449>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.814 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.512+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001791 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c auth v493 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.117077+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001791:[<0x10000001726/28-22.c v212>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001791:[<0x10000001726/28-22.c v493>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.817 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.512+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c auth v521 ap=1 s=1525 n(v0 rc2024-03-16T10:52:44.099077+0000 b1525 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177e:[<0x10000001726/3-17.c v176>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177e:[<0x10000001726/3-17.c v521>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.817 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.514+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a6 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c auth v511 ap=1 s=1525 n(v0 rc2024-03-16T10:52:44.147077+0000 b1525 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a6:[<0x10000001726/3-5.c v254>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a6:[<0x10000001726/3-5.c v511>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.817 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.515+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c auth v557 ap=1 s=2492 n(v0 rc2024-03-16T10:52:44.020078+0000 b2492 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa5b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172a:[<0x10000001726/22-9.c v8>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172a:[<0x10000001726/22-9.c v557>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.817 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.515+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c auth v563 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.050078+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa5b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174d:[<0x10000001726/12-22.c v78>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000174d:[<0x10000001726/12-22.c v563>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.817 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.519+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c4 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c auth v509 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.188076+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa5c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c4:[<0x10000001726/4-71.c v314>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c4:[<0x10000001726/4-71.c v509>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.519+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001736 [...2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/ auth v600 ap=1 f(v0 m2024-03-16T10:52:44.047078+0000 20=20+0) n(v0 rc2024-03-16T10:52:44.047078+0000 b50188 21=20+1) (inest lock) (ifile excl) caps={25189=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25189 | ptrwaiter=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa5d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001736:[<0x10000001726/templates v72>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(2)0x10000001736:[<0x10000001726/templates v600>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-16T10:52:44.047078+0000 20=20+0)","ondisk_value.rstat":"n(v0 rc2024-03-16T10:52:44.047078+0000 b50188 21=20+1)","memory_value.dirstat":"f(v0 m2024-03-16T10:52:44.047078+0000 20=20+0)","memory_value.rstat":"n(v0 rc2024-03-16T10:52:44.047078+0000 b50188 21=20+1)","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.520+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c3 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c auth v467 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.187076+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c3:[<0x10000001726/19-1.c v312>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c3:[<0x10000001726/19-1.c v467>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.520+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c auth v485 ap=1 s=2468 n(v0 rc2024-03-16T10:52:44.136077+0000 b2468 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179e:[<0x10000001726/25-24.c v238>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179e:[<0x10000001726/25-24.c v485>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.521+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001761 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c auth v495 ap=1 s=2588 n(v0 rc2024-03-16T10:52:44.068078+0000 b2588 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7f1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001761:[<0x10000001726/9-1.c v118>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001761:[<0x10000001726/9-1.c v495>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.522+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001751 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c auth v545 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.054078+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001751:[<0x10000001726/12-48.c v86>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001751:[<0x10000001726/12-48.c v545>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.523+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c5 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c auth v519 ap=1 s=2501 n(v0 rc2024-03-16T10:52:44.189076+0000 b2501 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da81cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c5:[<0x10000001726/22-2.c v316>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c5:[<0x10000001726/22-2.c v519>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.524+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001764 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c auth v455 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.071078+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da81d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001764:[<0x10000001726/4-103.c v124>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001764:[<0x10000001726/4-103.c v455>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.524+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c auth v579 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.149077+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da81c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a7:[<0x10000001726/12-27.c v256>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a7:[<0x10000001726/12-27.c v579>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.525+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001727 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c auth v601 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.017078+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da81e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001727:[<0x10000001726/12-16.c v2>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001727:[<0x10000001726/12-16.c v601>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.525+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c auth v535 ap=1 s=1333 n(v0 rc2024-03-16T10:52:44.174077+0000 b1333 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da81f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b8:[<0x10000001726/6-16.c v290>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b8:[<0x10000001726/6-16.c v535>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.526+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001799 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c auth v603 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.129077+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da824580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001799:[<0x10000001726/4-57.c v228>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001799:[<0x10000001726/4-57.c v603>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.818 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.527+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c auth v469 ap=1 s=4217 n(v0 rc2024-03-16T10:52:44.150077+0000 b4217 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da827700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a8:[<0x10000001726/19-3.c v258>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a8:[<0x10000001726/19-3.c v469>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.528+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c auth v467 ap=1 s=1472 n(v0 rc2024-03-16T10:52:44.097077+0000 b1472 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da971b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177c:[<0x10000001726/1-23.c v172>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177c:[<0x10000001726/1-23.c v467>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.529+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001754 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c auth v493 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.056078+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da972c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001754:[<0x10000001726/19-20.c v92>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001754:[<0x10000001726/19-20.c v493>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.529+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c auth v513 ap=1 s=1330 n(v0 rc2024-03-16T10:52:44.021078+0000 b1330 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da971080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172c:[<0x10000001726/6-21.c v12>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172c:[<0x10000001726/6-21.c v513>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.530+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001774 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c auth v505 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.086077+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da98c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001774:[<0x10000001726/25-22.c v156>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001774:[<0x10000001726/25-22.c v505>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.530+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001777 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c auth v457 ap=1 s=6203 n(v0 rc2024-03-16T10:52:44.091077+0000 b6203 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da98cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001777:[<0x10000001726/28-7.c v162>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001777:[<0x10000001726/28-7.c v457>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.531+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001796 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c auth v533 ap=1 s=1722 n(v0 rc2024-03-16T10:52:44.124077+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da98f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001796:[<0x10000001726/13-4.c v222>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001796:[<0x10000001726/13-4.c v533>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.531+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c auth v515 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da98ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172b:[<0x10000001726/13-25.c v10>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172b:[<0x10000001726/13-25.c v515>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.531+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001781 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c auth v575 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.101077+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da996580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001781:[<0x10000001726/4-67.c v182>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001781:[<0x10000001726/4-67.c v575>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.533+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cf [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c auth v487 ap=1 s=1722 n(v0 rc2024-03-16T10:52:44.202076+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cf:[<0x10000001726/13-20.c v336>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017cf:[<0x10000001726/13-20.c v487>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.533+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ae [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c auth v471 ap=1 s=4329 n(v0 rc2024-03-16T10:52:44.159077+0000 b4329 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ae:[<0x10000001726/23-21.c v270>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ae:[<0x10000001726/23-21.c v471>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.533+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c auth v569 ap=1 s=2004 n(v0 rc2024-03-16T10:52:44.049078+0000 b2004 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174c:[<0x10000001726/12-6.c v76>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000174c:[<0x10000001726/12-6.c v569>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.533+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c auth v507 ap=1 s=1722 n(v0 rc2024-03-16T10:52:44.113077+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178e:[<0x10000001726/13-22.c v206>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000178e:[<0x10000001726/13-22.c v507>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.819 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.535+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001780 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c auth v551 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001780:[<0x10000001726/1-22.c v180>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001780:[<0x10000001726/1-22.c v551>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.535+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cc [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c auth v507 ap=1 s=1333 n(v0 rc2024-03-16T10:52:44.199076+0000 b1333 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cc:[<0x10000001726/6-2.c v330>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017cc:[<0x10000001726/6-2.c v507>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.535+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl auth v479 ap=1 s=1363 n(v0 rc2024-03-16T10:52:44.135077+0000 b1363 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179d:[<0x10000001726/gentests.pl v236>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179d:[<0x10000001726/gentests.pl v479>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.535+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b9 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c auth v497 ap=1 s=4329 n(v0 rc2024-03-16T10:52:44.175077+0000 b4329 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b9:[<0x10000001726/23-8.c v292>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b9:[<0x10000001726/23-8.c v497>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.536+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c auth v577 ap=1 s=1525 n(v0 rc2024-03-16T10:52:44.063078+0000 b1525 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175b:[<0x10000001726/3-1.c v106>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175b:[<0x10000001726/3-1.c v577>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.536+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c auth v525 ap=1 s=1488 n(v0 rc2024-03-16T10:52:44.110077+0000 b1488 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178c:[<0x10000001726/2-12.c v202>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000178c:[<0x10000001726/2-12.c v525>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.537+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001731 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c auth v457 ap=1 s=5512 n(v0 rc2024-03-16T10:52:44.026078+0000 b5512 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001731:[<0x10000001726/16-11.c v22>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001731:[<0x10000001726/16-11.c v457>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.538+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d0 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c auth v499 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d0:[<0x10000001726/17-5.c v338>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017d0:[<0x10000001726/17-5.c v499>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.538+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001785 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c auth v495 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.105077+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001785:[<0x10000001726/12-18.c v190>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001785:[<0x10000001726/12-18.c v495>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.539+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d1 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c auth v505 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.204076+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaa4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d1:[<0x10000001726/23-22.c v340>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017d1:[<0x10000001726/23-22.c v505>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.540+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c auth v543 ap=1 s=1484 n(v0 rc2024-03-16T10:52:44.077077+0000 b1484 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176b:[<0x10000001726/2-21.c v138>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176b:[<0x10000001726/2-21.c v543>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.540+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001767 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c auth v541 ap=1 s=1681 n(v0 rc2005-06-03T16:35:47.000000+0000 b1681 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001767:[<0x10000001726/8-26.c v130>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001767:[<0x10000001726/8-26.c v541>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.820 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.540+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a9 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c auth v535 ap=1 s=1682 n(v0 rc2024-03-16T10:52:44.152077+0000 b1682 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a9:[<0x10000001726/8-24.c v260>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a9:[<0x10000001726/8-24.c v535>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.821 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.541+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c auth v537 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.193076+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaa5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c8:[<0x10000001726/28-15.c v322>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c8:[<0x10000001726/28-15.c v537>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.821 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.541+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a3 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c auth v579 ap=1 s=1719 n(v0 rc2024-03-16T10:52:44.143077+0000 b1719 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaa6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a3:[<0x10000001726/13-9.c v248>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a3:[<0x10000001726/13-9.c v579>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.821 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.544+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c auth v449 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.076077+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daad0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176a:[<0x10000001726/25-16.c v136>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176a:[<0x10000001726/25-16.c v449>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.821 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.544+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001787 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c auth v571 ap=1 s=1676 n(v0 rc2024-03-16T10:52:44.107077+0000 b1676 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daad0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001787:[<0x10000001726/8-23.c v194>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001787:[<0x10000001726/8-23.c v571>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.821 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.544+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001784 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c auth v455 ap=1 s=2269 n(v0 rc2024-03-16T10:52:44.104077+0000 b2269 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daad2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001784:[<0x10000001726/10-1.c v188>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001784:[<0x10000001726/10-1.c v455>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.822 INFO:tasks.workunit.client.0.smithi017.stdout:5/434: creat d0/d1/d76/f96 x:0 0 0 2024-03-16T10:53:14.822 INFO:tasks.workunit.client.0.smithi017.stdout:5/435: mkdir d0/d1/d1f/d97 0 2024-03-16T10:53:14.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/384: dwrite d2/d7/de/d19/d2e/f4e [4194304,4194304] 0 2024-03-16T10:53:14.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/385: mkdir d2/d4/d6d/d6c/d86/d8a 0 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.545+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001760 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c auth v557 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.067078+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daad1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001760:[<0x10000001726/12-44.c v116>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001760:[<0x10000001726/12-44.c v557>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.545+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c auth v447 ap=1 s=1902 n(v0 rc2024-03-16T10:52:44.081077+0000 b1902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daad3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176f:[<0x10000001726/4-12.c v146>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176f:[<0x10000001726/4-12.c v447>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.545+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c auth v493 ap=1 s=1898 n(v0 rc2024-03-16T10:52:44.137077+0000 b1898 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daadb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179f:[<0x10000001726/4-7.c v240>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179f:[<0x10000001726/4-7.c v493>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.546+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c auth v569 ap=1 s=3868 n(v0 rc2005-06-03T16:35:00.000000+0000 b3868 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daadab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175c:[<0x10000001726/18-3.c v108>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175c:[<0x10000001726/18-3.c v569>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.546+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001730 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c auth v489 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.025078+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daadb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001730:[<0x10000001726/4-79.c v20>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001730:[<0x10000001726/4-79.c v489>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.547+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ca [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c auth v495 ap=1 s=902 n(v0 rc2024-03-16T10:52:44.196076+0000 b902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab28b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ca:[<0x10000001726/4-87.c v326>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ca:[<0x10000001726/4-87.c v495>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.547+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017aa [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c auth v471 ap=1 s=1681 n(v0 rc2024-03-16T10:52:44.153077+0000 b1681 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab29080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017aa:[<0x10000001726/8-13.c v262>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017aa:[<0x10000001726/8-13.c v471>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.547+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001770 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c auth v545 ap=1 s=902 n(v0 rc2005-06-03T16:35:30.000000+0000 b902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab29b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001770:[<0x10000001726/4-60.c v148>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001770:[<0x10000001726/4-60.c v545>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.548+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c auth v503 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.111077+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab32000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178d:[<0x10000001726/25-13.c v204>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000178d:[<0x10000001726/25-13.c v503>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.548+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001794 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c auth{0=1} v565 ap=1 s=2501 n(v0 rc2024-03-16T10:52:44.121077+0000 b2501 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5638dab32580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001794:[<0x10000001726/22-10.c v218>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001794:[<0x10000001726/22-10.c v565>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.550+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cd [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c auth v497 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.200076+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cd:[<0x10000001726/18-18.c v332>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017cd:[<0x10000001726/18-18.c v497>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.829 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.550+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001783 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c auth v525 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.103077+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001783:[<0x10000001726/23-11.c v186>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001783:[<0x10000001726/23-11.c v525>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.551+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c auth v591 ap=1 s=4217 n(v0 rc2024-03-16T10:52:44.062078+0000 b4217 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175a:[<0x10000001726/19-7.c v104>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175a:[<0x10000001726/19-7.c v591>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.551+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001752 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c auth v603 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001752:[<0x10000001726/23-18.c v88>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001752:[<0x10000001726/23-18.c v603>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.552+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b1 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c auth v493 ap=1 s=908 n(v0 rc2024-03-16T10:52:44.163077+0000 b908 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b1:[<0x10000001726/4-102.c v276>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b1:[<0x10000001726/4-102.c v493>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.552+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001797 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c auth v485 ap=1 s=1525 n(v0 rc2024-03-16T10:52:44.126077+0000 b1525 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001797:[<0x10000001726/3-20.c v224>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001797:[<0x10000001726/3-20.c v485>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.553+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ba [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c auth v527 ap=1 s=1333 n(v0 rc2024-03-16T10:52:44.177077+0000 b1333 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ba:[<0x10000001726/6-11.c v294>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ba:[<0x10000001726/6-11.c v527>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.554+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001798 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c auth v459 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.127077+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab57700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001798:[<0x10000001726/12-37.c v226>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001798:[<0x10000001726/12-37.c v459>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.556+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c1 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c auth{0=1} v573 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.185076+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5638dab5f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c1:[<0x10000001726/28-16.c v308>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c1:[<0x10000001726/28-16.c v573>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.556+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001769 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c auth v533 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.075077+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab68000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001769:[<0x10000001726/28-5.c v134>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001769:[<0x10000001726/28-5.c v533>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.557+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b0 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c auth v587 ap=1 s=1719 n(v0 rc2024-03-16T10:52:44.162077+0000 b1719 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b0:[<0x10000001726/13-7.c v274>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b0:[<0x10000001726/13-7.c v587>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.557+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cb [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c auth v593 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.197076+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab60100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cb:[<0x10000001726/23-15.c v328>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017cb:[<0x10000001726/23-15.c v593>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.557+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001728 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c auth v505 ap=1 s=1676 n(v0 rc2024-03-16T10:52:44.018078+0000 b1676 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab69080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001728:[<0x10000001726/8-3.c v4>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001728:[<0x10000001726/8-3.c v505>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.557+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001772 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c auth v585 ap=1 s=5512 n(v0 rc2024-03-16T10:52:44.083077+0000 b5512 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001772:[<0x10000001726/16-15.c v152>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001772:[<0x10000001726/16-15.c v585>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.830 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.558+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001782 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c auth v601 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.102077+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab68580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001782:[<0x10000001726/19-26.c v184>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001782:[<0x10000001726/19-26.c v601>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.558+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001795 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c auth v491 ap=1 s=1770 n(v0 rc2024-03-16T10:52:44.123077+0000 b1770 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab69600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001795:[<0x10000001726/12-29.c v220>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001795:[<0x10000001726/12-29.c v491>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.559+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c auth v455 ap=1 s=1681 n(v0 rc2024-03-16T10:52:44.051078+0000 b1681 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174e:[<0x10000001726/8-14.c v80>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000174e:[<0x10000001726/8-14.c v455>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.560+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c auth v483 ap=1 s=6203 n(v0 rc2024-03-16T10:52:44.100077+0000 b6203 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177f:[<0x10000001726/28-6.c v178>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177f:[<0x10000001726/28-6.c v483>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.560+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001759 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c auth v477 ap=1 s=1333 n(v0 rc2024-03-16T10:52:44.061078+0000 b1333 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001759:[<0x10000001726/6-15.c v102>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001759:[<0x10000001726/6-15.c v477>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.560+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ab [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c auth v457 ap=1 s=2501 n(v0 rc2024-03-16T10:52:44.155077+0000 b2501 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ab:[<0x10000001726/22-14.c v264>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ab:[<0x10000001726/22-14.c v457>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.561+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bb [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c auth v555 ap=1 s=1330 n(v0 rc2024-03-16T10:52:44.178077+0000 b1330 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bb:[<0x10000001726/6-6.c v296>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017bb:[<0x10000001726/6-6.c v555>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.561+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b2 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c auth v509 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.165077+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b2:[<0x10000001726/18-26.c v278>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b2:[<0x10000001726/18-26.c v509>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.561+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c auth v537 ap=1 s=1989 n(v0 rc2024-03-16T10:52:44.064078+0000 b1989 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175d:[<0x10000001726/4-45.c v110>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175d:[<0x10000001726/4-45.c v537>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.562+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001765 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c auth v575 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.072078+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001765:[<0x10000001726/25-18.c v126>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001765:[<0x10000001726/25-18.c v575>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.562+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c auth v499 ap=1 s=5509 n(v0 rc2024-03-16T10:52:44.024078+0000 b5509 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172f:[<0x10000001726/16-7.c v18>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000172f:[<0x10000001726/16-7.c v499>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.562+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c auth v471 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.109077+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178a:[<0x10000001726/12-11.c v200>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000178a:[<0x10000001726/12-11.c v471>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.563+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001788 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c auth v515 ap=1 s=1488 n(v0 rc2024-03-16T10:52:44.108077+0000 b1488 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001788:[<0x10000001726/2-10.c v196>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001788:[<0x10000001726/2-10.c v515>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.831 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.563+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001758 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c auth v533 ap=1 s=2501 n(v0 rc2024-03-16T10:52:44.060078+0000 b2501 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001758:[<0x10000001726/22-4.c v100>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001758:[<0x10000001726/22-4.c v533>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.563+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c auth v579 ap=1 s=2176 n(v0 rc2024-03-16T10:52:44.192076+0000 b2176 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c7:[<0x10000001726/17-3.c v320>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c7:[<0x10000001726/17-3.c v579>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.564+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ce [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt auth v581 ap=1 s=459 n(v0 rc2024-03-16T10:52:44.201076+0000 b459 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ce:[<0x10000001726/coverage.txt v334>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ce:[<0x10000001726/coverage.txt v581>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.565+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001775 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c auth v491 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.088077+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001775:[<0x10000001726/12-5.c v158>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001775:[<0x10000001726/12-5.c v491>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.565+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b5 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c auth v511 ap=1 s=1898 n(v0 rc2024-03-16T10:52:44.169077+0000 b1898 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b5:[<0x10000001726/4-8.c v284>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b5:[<0x10000001726/4-8.c v511>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.565+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001763 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c auth v549 ap=1 s=1484 n(v0 rc2024-03-16T10:52:44.070078+0000 b1484 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001763:[<0x10000001726/1-24.c v122>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001763:[<0x10000001726/1-24.c v549>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.566+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c auth v495 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.052078+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da9e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174f:[<0x10000001726/4-89.c v82>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000174f:[<0x10000001726/4-89.c v495>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.568+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bf [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c auth v473 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.183076+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bf:[<0x10000001726/18-17.c v304>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017bf:[<0x10000001726/18-17.c v473>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.568+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001755 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c auth v527 ap=1 s=2181 n(v0 rc2024-03-16T10:52:44.057078+0000 b2181 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001755:[<0x10000001726/17-20.c v94>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001755:[<0x10000001726/17-20.c v527>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.568+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c6 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c auth v477 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.190076+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da289b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c6:[<0x10000001726/4-77.c v318>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c6:[<0x10000001726/4-77.c v477>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.568+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c auth v433 ap=1 s=1719 n(v0 rc2024-03-16T10:52:44.079077+0000 b1719 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da28a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176d:[<0x10000001726/13-21.c v142>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176d:[<0x10000001726/13-21.c v433>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.569+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001773 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c auth v457 ap=1 s=902 n(v0 rc2024-03-16T10:52:44.085077+0000 b902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da28b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001773:[<0x10000001726/4-81.c v154>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001773:[<0x10000001726/4-81.c v457>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.832 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.569+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017be [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c auth v493 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.182076+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da3ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017be:[<0x10000001726/28-18.c v302>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017be:[<0x10000001726/28-18.c v493>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.569+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ac [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c auth v527 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.156077+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da3ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ac:[<0x10000001726/23-1.c v266>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ac:[<0x10000001726/23-1.c v527>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.572+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c auth v475 ap=1 s=1989 n(v0 rc2024-03-16T10:52:44.080077+0000 b1989 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da853700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176e:[<0x10000001726/4-48.c v144>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176e:[<0x10000001726/4-48.c v475>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.573+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001756 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c auth v525 ap=1 s=5512 n(v0 rc2024-03-16T10:52:44.058078+0000 b5512 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da855b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001756:[<0x10000001726/16-5.c v96>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001756:[<0x10000001726/16-5.c v525>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.573+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001753 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c auth v515 ap=1 s=1989 n(v0 rc2024-03-16T10:52:44.055078+0000 b1989 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da857700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001753:[<0x10000001726/4-46.c v90>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001753:[<0x10000001726/4-46.c v515>,<0x10000001414/sigaction v6121>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.575+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017af [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c auth v529 ap=1 s=1333 n(v0 rc2024-03-16T10:52:44.160077+0000 b1333 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da78f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017af:[<0x10000001726/6-25.c v272>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017af:[<0x10000001726/6-25.c v529>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.576+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c auth v467 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.066078+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da791700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175f:[<0x10000001726/25-10.c v114>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175f:[<0x10000001726/25-10.c v467>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.576+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a5 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c auth v505 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.146077+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da792b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a5:[<0x10000001726/18-14.c v252>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a5:[<0x10000001726/18-14.c v505>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.576+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001732 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c auth v501 ap=1 s=1989 n(v0 rc2024-03-16T10:52:44.027078+0000 b1989 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da793080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001732:[<0x10000001726/4-44.c v24>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001732:[<0x10000001726/4-44.c v501>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.578+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a1 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c auth v491 ap=1 s=2181 n(v0 rc2024-03-16T10:52:44.140077+0000 b2181 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a1:[<0x10000001726/17-16.c v244>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a1:[<0x10000001726/17-16.c v491>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.578+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bd [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c auth v481 ap=1 s=904 n(v0 rc2024-03-16T10:52:44.181076+0000 b904 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bd:[<0x10000001726/4-94.c v300>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017bd:[<0x10000001726/4-94.c v481>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.579+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c auth v497 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.048078+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7bc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174b:[<0x10000001726/12-28.c v74>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000174b:[<0x10000001726/12-28.c v497>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.833 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.580+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001768 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c auth v487 ap=1 s=1496 n(v0 rc2024-03-16T10:52:44.074077+0000 b1496 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7bcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001768:[<0x10000001726/2-24.c v132>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001768:[<0x10000001726/2-24.c v487>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.580+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001779 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c auth v469 ap=1 s=1902 n(v0 rc2024-03-16T10:52:44.094077+0000 b1902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001779:[<0x10000001726/4-2.c v166>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001779:[<0x10000001726/4-2.c v469>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.580+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ad [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c auth v433 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.158077+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ad:[<0x10000001726/23-19.c v268>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017ad:[<0x10000001726/23-19.c v433>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.581+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c9 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c auth v501 ap=1 s=1722 n(v0 rc2024-03-16T10:52:44.195076+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da6fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c9:[<0x10000001726/13-17.c v324>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c9:[<0x10000001726/13-17.c v501>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.582+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a0 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c auth v441 ap=1 s=2176 n(v0 rc2024-03-16T10:52:44.139077+0000 b2176 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da6fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a0:[<0x10000001726/17-9.c v242>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a0:[<0x10000001726/17-9.c v441>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.583+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b3 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c auth v523 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.166077+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da56e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b3:[<0x10000001726/28-26.c v280>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b3:[<0x10000001726/28-26.c v523>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.583+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001757 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c auth v537 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.059078+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da56f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001757:[<0x10000001726/28-19.c v98>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001757:[<0x10000001726/28-19.c v537>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.584+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001789 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c auth v453 ap=1 s=1985 n(v0 rc2005-06-03T16:35:29.000000+0000 b1985 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da571180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001789:[<0x10000001726/4-49.c v198>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001789:[<0x10000001726/4-49.c v453>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.585+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001729 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c auth v509 ap=1 s=2007 n(v0 rc2024-03-16T10:52:44.019078+0000 b2007 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001729:[<0x10000001726/12-14.c v6>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001729:[<0x10000001726/12-14.c v509>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.585+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c auth v503 ap=1 s=2501 n(v0 rc2024-03-16T10:52:44.065078+0000 b2501 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175e:[<0x10000001726/22-15.c v112>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000175e:[<0x10000001726/22-15.c v503>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.585+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001790 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c auth v539 ap=1 s=2450 n(v0 rc2024-03-16T10:52:44.115077+0000 b2450 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001790:[<0x10000001726/25-15.c v210>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001790:[<0x10000001726/25-15.c v539>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.586+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c2 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c auth v475 ap=1 s=1667 n(v0 rc2024-03-16T10:52:44.186076+0000 b1667 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c2:[<0x10000001726/8-9.c v310>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017c2:[<0x10000001726/8-9.c v475>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.586+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001766 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c auth v519 ap=1 s=3868 n(v0 rc2005-06-03T16:35:01.000000+0000 b3868 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001766:[<0x10000001726/18-8.c v128>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001766:[<0x10000001726/18-8.c v519>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.586+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bc [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c auth v529 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.179076+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bc:[<0x10000001726/19-12.c v298>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017bc:[<0x10000001726/19-12.c v529>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.834 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.586+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b6 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c auth v525 ap=1 s=5512 n(v0 rc2024-03-16T10:52:44.171077+0000 b5512 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da7f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b6:[<0x10000001726/16-2.c v286>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b6:[<0x10000001726/16-2.c v525>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.587+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b4 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c auth v443 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.168077+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b4:[<0x10000001726/12-52.c v282>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017b4:[<0x10000001726/12-52.c v443>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.587+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001786 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c auth v469 ap=1 s=5512 n(v0 rc2024-03-16T10:52:44.106077+0000 b5512 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001786:[<0x10000001726/16-25.c v192>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001786:[<0x10000001726/16-25.c v469>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.587+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001750 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c auth v437 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.053078+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaeec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001750:[<0x10000001726/19-11.c v84>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001750:[<0x10000001726/19-11.c v437>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.588+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a2 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c auth v477 ap=1 s=5518 n(v0 rc2024-03-16T10:52:44.142077+0000 b5518 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a2:[<0x10000001726/16-24.c v246>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a2:[<0x10000001726/16-24.c v477>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.588+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001734 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c auth v521 ap=1 s=1472 n(v0 rc2024-03-16T10:52:44.028078+0000 b1472 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaf6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001734:[<0x10000001726/1-6.c v28>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001734:[<0x10000001726/1-6.c v521>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.588+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c auth v515 ap=1 s=1525 n(v0 rc2024-03-16T10:52:44.133077+0000 b1525 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaf6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179c:[<0x10000001726/3-14.c v234>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179c:[<0x10000001726/3-14.c v515>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.589+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001771 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c auth v425 ap=1 s=6206 n(v0 rc2024-03-16T10:52:44.082077+0000 b6206 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaf7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001771:[<0x10000001726/28-2.c v150>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001771:[<0x10000001726/28-2.c v425>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.589+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c auth v491 ap=1 s=1722 n(v0 rc2024-03-16T10:52:44.078077+0000 b1722 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaf8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176c:[<0x10000001726/13-5.c v140>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000176c:[<0x10000001726/13-5.c v491>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.589+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c auth v419 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.095077+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaf9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177a:[<0x10000001726/12-46.c v168>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177a:[<0x10000001726/12-46.c v419>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.590+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c auth v487 ap=1 s=4222 n(v0 rc2024-03-16T10:52:44.096077+0000 b4222 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daaff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177b:[<0x10000001726/19-16.c v170>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177b:[<0x10000001726/19-16.c v487>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.591+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d2 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c auth v439 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.205076+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d2:[<0x10000001726/18-11.c v342>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017d2:[<0x10000001726/18-11.c v439>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.591+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a4 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c auth v423 ap=1 s=4336 n(v0 rc2024-03-16T10:52:44.145077+0000 b4336 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab0c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a4:[<0x10000001726/23-16.c v250>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x100000017a4:[<0x10000001726/23-16.c v423>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.592+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c auth v525 ap=1 s=1773 n(v0 rc2024-03-16T10:52:44.130077+0000 b1773 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179a:[<0x10000001726/12-36.c v230>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000179a:[<0x10000001726/12-36.c v525>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.835 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.592+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001792 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c auth v505 ap=1 s=1989 n(v0 rc2024-03-16T10:52:44.118077+0000 b1989 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab0e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001792:[<0x10000001726/4-27.c v214>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001792:[<0x10000001726/4-27.c v505>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.593+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001735 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c auth v467 ap=1 s=1997 n(v0 rc2024-03-16T10:52:44.029078+0000 b1997 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab0f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001735:[<0x10000001726/4-50.c v30>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x10000001735:[<0x10000001726/4-50.c v467>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.593+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c auth v481 ap=1 s=3873 n(v0 rc2024-03-16T10:52:44.098077+0000 b3873 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638dab14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177d:[<0x10000001726/18-19.c v174>,<0x10000001414/sigaction v1892>,<0x100000012ee/interfaces v204>,<0x100000012ea/conformance v22>,<0x10000000204/open_posix_testsuite v364>,<0x10000000202/testcases v69>,<0x10000000007/ltp-full-20091231 v46>,<0x10000000006/fsstress v42>,<0x10000000005/tmp v34>,<0x100000001fb/client.0 v34>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v44>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v53>,<0x1/volumes v51>]//[]","memoryvalue":"(3)0x1000000177d:[<0x10000001726/18-19.c v481>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.594+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001747 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in auth v66 ap=1 s=2013 n(v0 rc2024-03-16T10:52:44.045078+0000 b2013 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001747:[<0x10000001736/template_12-1.in v34>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001747:[<0x10000001736/template_12-1.in v66>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001744 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in auth v72 ap=1 s=2191 n(v0 rc2024-03-16T10:52:44.042078+0000 b2191 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001744:[<0x10000001736/template_17-1.in v28>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001744:[<0x10000001736/template_17-1.in v72>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001746 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in auth v74 ap=1 s=1910 n(v0 rc2024-03-16T10:52:44.044078+0000 b1910 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001746:[<0x10000001736/template_4-1.in v32>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001746:[<0x10000001736/template_4-1.in v74>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001737 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in auth v70 ap=1 s=6212 n(v0 rc2024-03-16T10:52:44.031078+0000 b6212 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa65700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001737:[<0x10000001736/template_28-1.in v2>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001737:[<0x10000001736/template_28-1.in v70>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001748 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in auth v42 ap=1 s=3883 n(v0 rc2024-03-16T10:52:44.046078+0000 b3883 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001748:[<0x10000001736/template_18-1.in v36>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001748:[<0x10000001736/template_18-1.in v42>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173d [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in auth v46 ap=1 s=1728 n(v0 rc2024-03-16T10:52:44.036078+0000 b1728 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173d:[<0x10000001736/template_13-1.in v14>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173d:[<0x10000001736/template_13-1.in v46>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.595+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173e [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in auth v60 ap=1 s=1535 n(v0 rc2024-03-16T10:52:44.037078+0000 b1535 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173e:[<0x10000001736/template_3-1.in v16>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173e:[<0x10000001736/template_3-1.in v60>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in auth v56 ap=1 s=4350 n(v0 rc2024-03-16T10:52:44.033078+0000 b4350 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173a:[<0x10000001736/template_23-1.in v8>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173a:[<0x10000001736/template_23-1.in v56>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173b [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in auth v68 ap=1 s=5518 n(v0 rc2024-03-16T10:52:44.034078+0000 b5518 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173b:[<0x10000001736/template_16-1.in v10>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173b:[<0x10000001736/template_16-1.in v68>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001740 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in auth v64 ap=1 s=4232 n(v0 rc2024-03-16T10:52:44.039078+0000 b4232 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa6fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001740:[<0x10000001736/template_19-1.in v20>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001740:[<0x10000001736/template_19-1.in v64>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.836 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001739 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in auth v50 ap=1 s=1496 n(v0 rc2005-06-03T16:35:50.000000+0000 b1496 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001739:[<0x10000001736/template_2-1.in v6>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001739:[<0x10000001736/template_2-1.in v50>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001743 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in auth v52 ap=1 s=1718 n(v0 rc2024-03-16T10:52:44.041078+0000 b1718 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa70680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001743:[<0x10000001736/template_8-1.in v26>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001743:[<0x10000001736/template_8-1.in v52>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.596+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001745 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in auth v78 ap=1 s=1339 n(v0 rc2024-03-16T10:52:44.043078+0000 b1339 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001745:[<0x10000001736/template_6-1.in v30>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001745:[<0x10000001736/template_6-1.in v78>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001742 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in auth v62 ap=1 s=908 n(v0 rc2005-06-03T16:35:50.000000+0000 b908 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001742:[<0x10000001736/template_4-4.in v24>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001742:[<0x10000001736/template_4-4.in v62>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001741 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in auth v76 ap=1 s=1484 n(v0 rc2005-06-03T16:35:50.000000+0000 b1484 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001741:[<0x10000001736/template_1-1.in v22>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001741:[<0x10000001736/template_1-1.in v76>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174a [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in auth v44 ap=1 s=1779 n(v0 rc2005-06-03T16:35:50.000000+0000 b1779 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174a:[<0x10000001736/template_12-2.in v40>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000174a:[<0x10000001736/template_12-2.in v44>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001749 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in auth v80 ap=1 s=1997 n(v0 rc2024-03-16T10:52:44.047078+0000 b1997 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001749:[<0x10000001736/template_4-2.in v38>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001749:[<0x10000001736/template_4-2.in v80>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173f [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in auth v58 ap=1 s=2468 n(v0 rc2024-03-16T10:52:44.038078+0000 b2468 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173f:[<0x10000001736/template_25-1.in v18>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173f:[<0x10000001736/template_25-1.in v58>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001738 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in auth v54 ap=1 s=2519 n(v0 rc2024-03-16T10:52:44.032078+0000 b2519 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001738:[<0x10000001736/template_22-1.in v4>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001738:[<0x10000001736/template_22-1.in v54>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.837 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:14.597+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173c [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in auth v48 ap=1 s=908 n(v0 rc2024-03-16T10:52:44.035078+0000 b908 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638daa79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173c:[<0x10000001736/template_4-3.in v12>,<0x10000001726/templates v72>,<0x10000001414/sigaction v1856>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x1000000173c:[<0x10000001736/template_4-3.in v48>,<0x10000001726/templates v600>,<0x10000001414/sigaction v6189>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/436: dwrite d0/d1/d30/f83 [0,4194304] 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/437: truncate d0/d1/d30/d55/d6a/f7f 2566206 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:0/386: dread d2/d4/d61/f6f [0,4194304] 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:0/387: truncate d2/d7/d24/d29/f2c 4620850 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:0/388: chown d2/d7/de/l13 0 1 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/438: creat d0/f98 x:0 0 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/439: mkdir d0/d1/d1f/d29/d99 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/440: write d0/d1/d2/dc/d2f/d37/d42/d4c/f4e [4342494,4458] 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/441: read - d0/d1/d30/d55/f8a zero size 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/442: fdatasync d0/f9 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/443: creat d0/d1/d1f/f9a x:0 0 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/444: write d0/d1/d2/d2c/f60 [1336216,118029] 0 2024-03-16T10:53:14.839 INFO:tasks.workunit.client.0.smithi017.stdout:2/318: rename d4/dd/d1e/d28 to d4/d6/db/d66 0 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.560+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016de [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh auth v36 ap=1 s=411 n(v0 rc2024-03-16T10:52:43.949079+0000 b411 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f88a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016de:[<0x100000016dd/5-3.sh v2>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016de:[<0x100000016dd/5-3.sh v36>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh auth v40 ap=1 s=411 n(v0 rc2024-03-16T10:52:43.962079+0000 b411 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f889b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e8:[<0x100000016dd/5-2.sh v22>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e8:[<0x100000016dd/5-2.sh v40>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e4 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c auth v32 ap=1 s=1221 n(v0 rc2024-03-16T10:52:43.958079+0000 b1221 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f88a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e4:[<0x100000016dd/1-1.c v14>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e4:[<0x100000016dd/1-1.c v32>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e2 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c auth v24 ap=1 s=1412 n(v0 rc2024-03-16T10:52:43.955079+0000 b1412 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f88b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e2:[<0x100000016dd/5-core-buildonly.c v10>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e2:[<0x100000016dd/5-core-buildonly.c v24>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e0 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt auth v26 ap=1 s=341 n(v0 rc2024-03-16T10:52:43.952079+0000 b341 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f88ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e0:[<0x100000016dd/coverage.txt v6>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e0:[<0x100000016dd/coverage.txt v26>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e6 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c auth v28 ap=1 s=615 n(v0 rc2024-03-16T10:52:43.960079+0000 b615 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f88b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e6:[<0x100000016dd/4-1.c v18>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e6:[<0x100000016dd/4-1.c v28>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.561+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e3 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c auth v44 ap=1 s=902 n(v0 rc2024-03-16T10:52:43.956079+0000 b902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f6a0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e3:[<0x100000016dd/6-1.c v12>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e3:[<0x100000016dd/6-1.c v44>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.562+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh auth v34 ap=1 s=411 n(v0 rc2024-03-16T10:52:43.961079+0000 b411 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f6a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e7:[<0x100000016dd/5-4.sh v20>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e7:[<0x100000016dd/5-4.sh v34>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.562+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016df [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c auth v38 ap=1 s=902 n(v0 rc2024-03-16T10:52:43.951079+0000 b902 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f6a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016df:[<0x100000016dd/6-2.c v4>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016df:[<0x100000016dd/6-2.c v38>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.562+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e5 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml auth v30 ap=1 s=1309 n(v0 rc2024-03-16T10:52:43.959079+0000 b1309 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f6a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e5:[<0x100000016dd/assertions.xml v16>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e5:[<0x100000016dd/assertions.xml v30>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:14.562+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e1 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh auth v42 ap=1 s=411 n(v0 rc2024-03-16T10:52:43.953079+0000 b411 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f6a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e1:[<0x100000016dd/5-1.sh v8>,<0x10000001414/sigignore v1424>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016e1:[<0x100000016dd/5-1.sh v42>,<0x10000001414/sigignore v4525>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/340: rename d0/c5 to d0/d15/c6b 0 2024-03-16T10:53:14.843 INFO:tasks.workunit.client.0.smithi017.stdout:2/319: rmdir d4/dd/d1e/d4a 39 2024-03-16T10:53:14.843 INFO:tasks.workunit.client.0.smithi017.stdout:8/344: rename d6/d5f/c1b to d6/d5c/c74 0 2024-03-16T10:53:14.844 INFO:tasks.workunit.client.0.smithi017.stdout:8/345: write d6/d39/f5d [1463937,31852] 0 2024-03-16T10:53:14.845 INFO:tasks.workunit.client.0.smithi017.stdout:6/341: mkdir d0/d15/d6c 0 2024-03-16T10:53:14.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/445: dwrite d0/d1/d1f/f50 [4194304,4194304] 0 2024-03-16T10:53:14.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/446: truncate d0/d1/d2/dc/d2f/d37/d42/d46/f69 299695 0 2024-03-16T10:53:14.848 INFO:tasks.workunit.client.0.smithi017.stdout:1/516: rename d1/f47 to d1/d3/dd/d9f/fad 0 2024-03-16T10:53:14.850 INFO:tasks.workunit.client.0.smithi017.stdout:6/342: truncate d0/d9/f18 318340 0 2024-03-16T10:53:14.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/389: rename d2/l10 to d2/d7/d24/d72/d88/l8b 0 2024-03-16T10:53:14.852 INFO:tasks.workunit.client.0.smithi017.stdout:5/447: creat d0/d1/d2/dc/d2f/d37/d57/f9b x:0 0 0 2024-03-16T10:53:14.852 INFO:tasks.workunit.client.0.smithi017.stdout:5/448: chown d0/d1/l1e 5 1 2024-03-16T10:53:14.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/390: link d2/d7/d24/d29/f6a d2/f8c 0 2024-03-16T10:53:14.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/391: read d2/d7/f1a [3315613,176] 0 2024-03-16T10:53:14.855 INFO:tasks.workunit.client.0.smithi017.stdout:1/517: creat d1/fae x:0 0 0 2024-03-16T10:53:14.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/392: mknod d2/d7/d24/d72/d88/c8d 0 2024-03-16T10:53:14.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/346: dwrite d6/d16/f66 [0,4194304] 0 2024-03-16T10:53:14.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/347: fsync d6/d39/f56 0 2024-03-16T10:53:14.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/518: rename d1/d3/c8c to d1/d3/dd/d72/d8f/caf 0 2024-03-16T10:53:14.858 INFO:tasks.workunit.client.0.smithi017.stdout:0/393: mkdir d2/d7/d24/d72/d8e 0 2024-03-16T10:53:14.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/348: rmdir d6/d4a 39 2024-03-16T10:53:14.864 INFO:tasks.workunit.client.0.smithi017.stdout:5/449: dwrite d0/d1/d1f/d29/f2a [0,4194304] 0 2024-03-16T10:53:14.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/519: creat d1/d3/de/d36/fb0 x:0 0 0 2024-03-16T10:53:14.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/520: write d1/d3/f8a [858132,63095] 0 2024-03-16T10:53:14.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/521: write d1/d3/f23 [1489521,44156] 0 2024-03-16T10:53:14.866 INFO:tasks.workunit.client.0.smithi017.stdout:8/349: creat d6/d5f/d6e/f75 x:0 0 0 2024-03-16T10:53:14.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/343: dwrite d0/f3c [0,4194304] 0 2024-03-16T10:53:14.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/344: read - d0/d15/d1f/f60 zero size 2024-03-16T10:53:14.871 INFO:tasks.workunit.client.0.smithi017.stdout:5/450: getdents d0/d1/d76 0 2024-03-16T10:53:14.874 INFO:tasks.workunit.client.0.smithi017.stdout:8/350: creat d6/d5f/d6e/d34/f76 x:0 0 0 2024-03-16T10:53:14.874 INFO:tasks.workunit.client.0.smithi017.stdout:8/351: chown d6/d5f/d6e/d43/l3a 447526 1 2024-03-16T10:53:14.874 INFO:tasks.workunit.client.0.smithi017.stdout:8/352: chown d6/d5f/f33 525 1 2024-03-16T10:53:14.874 INFO:tasks.workunit.client.0.smithi017.stdout:8/353: dread - d6/d5f/d6e/f75 zero size 2024-03-16T10:53:14.874 INFO:tasks.workunit.client.0.smithi017.stdout:8/354: chown d6/d4a/f4d 1473 1 2024-03-16T10:53:14.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/394: dwrite d2/d7/d24/d29/f2c [4194304,4194304] 0 2024-03-16T10:53:14.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/395: fsync d2/d4/f51 0 2024-03-16T10:53:14.876 INFO:tasks.workunit.client.0.smithi017.stdout:1/522: dwrite d1/d3/dd/d9f/f30 [0,4194304] 0 2024-03-16T10:53:14.876 INFO:tasks.workunit.client.0.smithi017.stdout:1/523: chown d1/d3/de/c1d 127 1 2024-03-16T10:53:14.878 INFO:tasks.workunit.client.0.smithi017.stdout:6/345: write d0/f4 [416768,125202] 0 2024-03-16T10:53:14.878 INFO:tasks.workunit.client.0.smithi017.stdout:5/451: symlink d0/d1/d2/dc/d68/l9c 0 2024-03-16T10:53:14.881 INFO:tasks.workunit.client.0.smithi017.stdout:8/355: rename d6/d5f/d6e/d34/c5b to d6/d16/c77 0 2024-03-16T10:53:14.883 INFO:tasks.workunit.client.0.smithi017.stdout:3/273: sync 2024-03-16T10:53:14.883 INFO:tasks.workunit.client.0.smithi017.stdout:3/274: dread - d8/d1b/d2e/f3e zero size 2024-03-16T10:53:14.885 INFO:tasks.workunit.client.0.smithi017.stdout:6/346: mkdir d0/d9/d45/d4d/d6d 0 2024-03-16T10:53:14.885 INFO:tasks.workunit.client.0.smithi017.stdout:6/347: chown d0/d15/l3f 3546 1 2024-03-16T10:53:14.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/524: dread d1/d3/de/d36/f73 [0,4194304] 0 2024-03-16T10:53:14.886 INFO:tasks.workunit.client.0.smithi017.stdout:5/452: symlink d0/d1/d30/d55/l9d 0 2024-03-16T10:53:14.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/356: unlink d6/d39/d35/f26 0 2024-03-16T10:53:14.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/357: fsync d6/d5c/f73 0 2024-03-16T10:53:14.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/358: read - d6/d5f/d6e/d34/f76 zero size 2024-03-16T10:53:14.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/359: chown d6/d5f/d6e 727029 1 2024-03-16T10:53:14.891 INFO:tasks.workunit.client.0.smithi017.stdout:3/275: creat d8/d1b/d1c/f55 x:0 0 0 2024-03-16T10:53:14.894 INFO:tasks.workunit.client.0.smithi017.stdout:1/525: link d1/d3/de/d36/fb0 d1/d3/dd/d72/fb1 0 2024-03-16T10:53:14.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/396: rename d2/d7/de/d19/d2e/f4e to d2/d7/d24/d29/f8f 0 2024-03-16T10:53:14.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/397: chown d2/d7/de 0 1 2024-03-16T10:53:14.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/398: chown d2/d4/l20 51672 1 2024-03-16T10:53:14.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/348: dwrite d0/f3 [0,4194304] 0 2024-03-16T10:53:14.902 INFO:tasks.workunit.client.0.smithi017.stdout:5/453: dwrite d0/f27 [0,4194304] 0 2024-03-16T10:53:14.906 INFO:tasks.workunit.client.0.smithi017.stdout:8/360: creat d6/d4a/f78 x:0 0 0 2024-03-16T10:53:14.907 INFO:tasks.workunit.client.0.smithi017.stdout:0/399: dread d2/d4/f67 [0,4194304] 0 2024-03-16T10:53:14.907 INFO:tasks.workunit.client.0.smithi017.stdout:0/400: dread d2/f11 [0,4194304] 0 2024-03-16T10:53:14.907 INFO:tasks.workunit.client.0.smithi017.stdout:0/401: fdatasync d2/d7/f63 0 2024-03-16T10:53:14.907 INFO:tasks.workunit.client.0.smithi017.stdout:3/276: mkdir d8/da/d56 0 2024-03-16T10:53:14.909 INFO:tasks.workunit.client.0.smithi017.stdout:1/526: truncate d1/f5c 2953472 0 2024-03-16T10:53:14.909 INFO:tasks.workunit.client.0.smithi017.stdout:1/527: write d1/f41 [4618181,99209] 0 2024-03-16T10:53:14.910 INFO:tasks.workunit.client.0.smithi017.stdout:0/402: rename d2/d4/d6d/d6c to d2/d4/d90 0 2024-03-16T10:53:14.912 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:14.585+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a7 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c auth v8 ap=1 s=1734 n(v0 rc2005-06-03T16:30:23.000000+0000 b1734 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x564636030b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a7:[<0x100000016a5/1-1.c v4>,<0x10000001414/asctime v1300>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016a7:[<0x100000016a5/1-1.c v8>,<0x10000001414/asctime v4521>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.912 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:14.585+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a6 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt auth v12 ap=1 s=92 n(v0 rc2024-03-16T10:52:43.897079+0000 b92 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x564636031080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a6:[<0x100000016a5/coverage.txt v2>,<0x10000001414/asctime v1300>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016a6:[<0x100000016a5/coverage.txt v12>,<0x10000001414/asctime v4521>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.912 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:14.586+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a8 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml auth v10 ap=1 s=246 n(v0 rc2024-03-16T10:52:43.898079+0000 b246 1=1+0) caps={25189=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x564636031600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a8:[<0x100000016a5/assertions.xml v6>,<0x10000001414/asctime v1300>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x100000016a8:[<0x100000016a5/assertions.xml v10>,<0x10000001414/asctime v4521>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v279>,<0x10000000204/open_posix_testsuite v1169>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v82>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v67>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v73>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:14.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/403: dread d2/d4/d6d/f7f [0,4194304] 0 2024-03-16T10:53:14.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/349: symlink d0/d9/d45/d4d/l6e 0 2024-03-16T10:53:14.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/350: write d0/d15/d1f/f5e [923201,13032] 0 2024-03-16T10:53:14.914 INFO:tasks.workunit.client.0.smithi017.stdout:0/404: creat d2/d4/d90/d86/f91 x:0 0 0 2024-03-16T10:53:14.914 INFO:tasks.workunit.client.0.smithi017.stdout:0/405: readlink d2/d4/l3f 0 2024-03-16T10:53:14.914 INFO:tasks.workunit.client.0.smithi017.stdout:0/406: truncate d2/d4/f67 4292742 0 2024-03-16T10:53:14.915 INFO:tasks.workunit.client.0.smithi017.stdout:8/361: creat d6/d5f/d6e/d34/f79 x:0 0 0 2024-03-16T10:53:14.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/454: dwrite d0/d1/d30/d55/f8a [0,4194304] 0 2024-03-16T10:53:14.915 INFO:tasks.workunit.client.0.smithi017.stdout:0/407: truncate d2/d7/de/ff 3219759 0 2024-03-16T10:53:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:0/408: getdents d2/d7 0 2024-03-16T10:53:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:0/409: dread - d2/d7/f73 zero size 2024-03-16T10:53:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:0/410: read d2/d7/de/d19/d2e/f3e [658594,94874] 0 2024-03-16T10:53:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/277: mkdir d8/d1b/d2e/d57 0 2024-03-16T10:53:14.919 INFO:tasks.workunit.client.0.smithi017.stdout:0/411: dread d2/d7/d24/d3a/f60 [0,4194304] 0 2024-03-16T10:53:14.920 INFO:tasks.workunit.client.0.smithi017.stdout:0/412: creat d2/d4/d90/d86/d85/f92 x:0 0 0 2024-03-16T10:53:14.920 INFO:tasks.workunit.client.0.smithi017.stdout:0/413: stat d2/d7/d24/d3a/c47 0 2024-03-16T10:53:14.922 INFO:tasks.workunit.client.0.smithi017.stdout:1/528: dwrite d1/d3/dd/d31/d35/f75 [0,4194304] 0 2024-03-16T10:53:14.925 INFO:tasks.workunit.client.0.smithi017.stdout:0/414: mknod d2/d7/d24/d29/c93 0 2024-03-16T10:53:14.925 INFO:tasks.workunit.client.0.smithi017.stdout:0/415: write d2/d4/d61/f78 [1307630,96218] 0 2024-03-16T10:53:14.927 INFO:tasks.workunit.client.0.smithi017.stdout:8/362: mknod d6/d5f/d6e/d43/c7a 0 2024-03-16T10:53:14.928 INFO:tasks.workunit.client.0.smithi017.stdout:5/455: symlink d0/d1/d2/d2c/l9e 0 2024-03-16T10:53:14.931 INFO:tasks.workunit.client.0.smithi017.stdout:3/278: creat d8/da/f58 x:0 0 0 2024-03-16T10:53:14.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/529: rmdir d1/d50/d8d 39 2024-03-16T10:53:14.937 INFO:tasks.workunit.client.0.smithi017.stdout:5/456: dread d0/d1/d2/dc/f45 [0,4194304] 0 2024-03-16T10:53:14.939 INFO:tasks.workunit.client.0.smithi017.stdout:3/279: creat d8/da/f59 x:0 0 0 2024-03-16T10:53:14.942 INFO:tasks.workunit.client.0.smithi017.stdout:5/457: mkdir d0/d5d/d9f 0 2024-03-16T10:53:14.942 INFO:tasks.workunit.client.0.smithi017.stdout:0/416: rename d2/d7/de/d19/d2e/f3e to d2/d7/f94 0 2024-03-16T10:53:14.944 INFO:tasks.workunit.client.0.smithi017.stdout:0/417: creat d2/d4/d90/f95 x:0 0 0 2024-03-16T10:53:14.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/458: mkdir d0/d1/d30/d55/d6a/da0 0 2024-03-16T10:53:14.948 INFO:tasks.workunit.client.0.smithi017.stdout:0/418: rmdir d2/d4 39 2024-03-16T10:53:14.949 INFO:tasks.workunit.client.0.smithi017.stdout:8/363: rename d6/d39/d35/c60 to d6/d5f/d6e/c7b 0 2024-03-16T10:53:14.952 INFO:tasks.workunit.client.0.smithi017.stdout:5/459: symlink d0/d1/d1f/d29/la1 0 2024-03-16T10:53:14.952 INFO:tasks.workunit.client.0.smithi017.stdout:5/460: dread - d0/d1/d30/d55/d6a/f7e zero size 2024-03-16T10:53:14.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/364: dread d6/d5f/d6e/f50 [0,4194304] 0 2024-03-16T10:53:14.954 INFO:tasks.workunit.client.0.smithi017.stdout:5/461: creat d0/d1/d1f/d97/fa2 x:0 0 0 2024-03-16T10:53:14.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/365: write d6/d5f/d6e/d34/f52 [198906,46996] 0 2024-03-16T10:53:14.954 INFO:tasks.workunit.client.0.smithi017.stdout:5/462: write d0/d1/d2/d2c/f60 [280843,8930] 0 2024-03-16T10:53:14.956 INFO:tasks.workunit.client.0.smithi017.stdout:8/366: read d6/f68 [796201,59273] 0 2024-03-16T10:53:14.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/367: truncate d6/d5f/d6e/f17 2639685 0 2024-03-16T10:53:14.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/368: chown d6/d5f/d6e/d43/c7a 41083 1 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/280: dwrite d8/f17 [0,4194304] 0 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/281: dread - d8/d1b/d2e/f3e zero size 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/282: fsync d8/da/f36 0 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/369: symlink d6/d16/d6c/l7c 0 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/370: chown d6/d5f/d6e/d43/c7a 99708 1 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/371: write d6/d5f/d6e/d34/f76 [896731,104189] 0 2024-03-16T10:53:14.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/372: chown d6/d39/f32 17638 1 2024-03-16T10:53:14.961 INFO:tasks.workunit.client.0.smithi017.stdout:3/283: rmdir d8/da/d56 0 2024-03-16T10:53:14.963 INFO:tasks.workunit.client.0.smithi017.stdout:0/419: dwrite d2/d4/d90/f74 [0,4194304] 0 2024-03-16T10:53:14.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/373: symlink d6/d16/l7d 0 2024-03-16T10:53:14.964 INFO:tasks.workunit.client.0.smithi017.stdout:5/463: dread d0/d1/d30/d55/f8a [0,4194304] 0 2024-03-16T10:53:14.964 INFO:tasks.workunit.client.0.smithi017.stdout:8/374: creat d6/d5c/f7e x:0 0 0 2024-03-16T10:53:14.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/420: write d2/f11 [1194255,116200] 0 2024-03-16T10:53:14.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/421: chown d2/d4/l3b 5 1 2024-03-16T10:53:14.966 INFO:tasks.workunit.client.0.smithi017.stdout:0/422: creat d2/d7/d24/d72/d7b/f96 x:0 0 0 2024-03-16T10:53:14.966 INFO:tasks.workunit.client.0.smithi017.stdout:0/423: getdents d2/d7/d24/d72/d8e 0 2024-03-16T10:53:14.967 INFO:tasks.workunit.client.0.smithi017.stdout:5/464: link d0/d1/d2/d2c/d38/f61 d0/d1/d2/dc/d2f/fa3 0 2024-03-16T10:53:14.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/465: mknod d0/d1/d2/dc/d2f/d37/d42/d4c/ca4 0 2024-03-16T10:53:14.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/466: mkdir d0/d1/d2/d2c/d36/d41/da5 0 2024-03-16T10:53:14.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/467: stat d0/d1/d2/d2c/d38/f3b 0 2024-03-16T10:53:14.972 INFO:tasks.workunit.client.0.smithi017.stdout:5/468: creat d0/d1/d1f/d97/fa6 x:0 0 0 2024-03-16T10:53:14.972 INFO:tasks.workunit.client.0.smithi017.stdout:7/319: sync 2024-03-16T10:53:14.974 INFO:tasks.workunit.client.0.smithi017.stdout:5/469: creat d0/d1/d1f/d29/d88/d91/fa7 x:0 0 0 2024-03-16T10:53:14.975 INFO:tasks.workunit.client.0.smithi017.stdout:7/320: link d7/db/d12/d1c/d30/c3d d7/db/d12/c6c 0 2024-03-16T10:53:14.975 INFO:tasks.workunit.client.0.smithi017.stdout:7/321: chown d7/db/d45/d66 1 1 2024-03-16T10:53:14.975 INFO:tasks.workunit.client.0.smithi017.stdout:7/322: truncate d7/db/d12/f62 356308 0 2024-03-16T10:53:14.976 INFO:tasks.workunit.client.0.smithi017.stdout:8/375: dread d6/d16/f70 [0,4194304] 0 2024-03-16T10:53:14.976 INFO:tasks.workunit.client.0.smithi017.stdout:3/284: read d8/f17 [1561688,28784] 0 2024-03-16T10:53:14.976 INFO:tasks.workunit.client.0.smithi017.stdout:5/470: mknod d0/d1/d1f/d29/ca8 0 2024-03-16T10:53:14.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/323: mknod d7/db/c6d 0 2024-03-16T10:53:14.979 INFO:tasks.workunit.client.0.smithi017.stdout:7/324: chown d7/db/dc/c1a 1195996647 1 2024-03-16T10:53:14.979 INFO:tasks.workunit.client.0.smithi017.stdout:7/325: chown d7/db/d12/l4f 21452611 1 2024-03-16T10:53:14.980 INFO:tasks.workunit.client.0.smithi017.stdout:8/376: truncate d6/fe 3200789 0 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/377: fdatasync d6/d5f/d6e/f59 0 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/378: chown d6/d39/f56 3917485 1 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/379: readlink d6/d39/d35/l3d 0 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/380: chown d6/f68 2 1 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:0/424: dwrite d2/f11 [0,4194304] 0 2024-03-16T10:53:14.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/471: write d0/d1/d30/d55/f8a [2944037,85048] 0 2024-03-16T10:53:14.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/425: mknod d2/d4/d6d/d84/c97 0 2024-03-16T10:53:14.985 INFO:tasks.workunit.client.0.smithi017.stdout:0/426: creat d2/d7/d24/d29/f98 x:0 0 0 2024-03-16T10:53:14.992 INFO:tasks.workunit.client.0.smithi017.stdout:7/326: dwrite d7/db/dc/d50/d59/d34/f44 [0,4194304] 0 2024-03-16T10:53:14.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/472: creat d0/d1/d30/d55/d6a/da0/fa9 x:0 0 0 2024-03-16T10:53:14.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/473: chown d0/d1/d30/d55/d6a 892 1 2024-03-16T10:53:14.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/474: chown d0/d1/d1f/d29 0 1 2024-03-16T10:53:14.994 INFO:tasks.workunit.client.0.smithi017.stdout:0/427: dread d2/d7/d24/d29/f40 [0,4194304] 0 2024-03-16T10:53:14.995 INFO:tasks.workunit.client.0.smithi017.stdout:1/530: rmdir d1/d24 39 2024-03-16T10:53:14.999 INFO:tasks.workunit.client.0.smithi017.stdout:1/531: creat d1/d3/dd/d72/fb2 x:0 0 0 2024-03-16T10:53:14.999 INFO:tasks.workunit.client.0.smithi017.stdout:0/428: mkdir d2/d7/de/d1e/d99 0 2024-03-16T10:53:15.001 INFO:tasks.workunit.client.0.smithi017.stdout:7/327: dread d7/db/d45/f29 [0,4194304] 0 2024-03-16T10:53:15.001 INFO:tasks.workunit.client.0.smithi017.stdout:7/328: write d7/db/d12/f62 [1316180,51777] 0 2024-03-16T10:53:15.001 INFO:tasks.workunit.client.0.smithi017.stdout:7/329: readlink d7/db/dc/d50/d59/d34/l35 0 2024-03-16T10:53:15.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/330: rmdir d7/db/d12/d1c/d4e 39 2024-03-16T10:53:15.006 INFO:tasks.workunit.client.0.smithi017.stdout:0/429: dread d2/d7/f9 [0,4194304] 0 2024-03-16T10:53:15.006 INFO:tasks.workunit.client.0.smithi017.stdout:5/475: dwrite d0/d1/d1f/f7b [0,4194304] 0 2024-03-16T10:53:15.006 INFO:tasks.workunit.client.0.smithi017.stdout:7/331: creat d7/db/d12/d1c/f6e x:0 0 0 2024-03-16T10:53:15.006 INFO:tasks.workunit.client.0.smithi017.stdout:7/332: read - d7/db/dc/d50/d59/f61 zero size 2024-03-16T10:53:15.008 INFO:tasks.workunit.client.0.smithi017.stdout:1/532: write d1/d3/f6d [11742736,127665] 0 2024-03-16T10:53:15.008 INFO:tasks.workunit.client.0.smithi017.stdout:1/533: chown d1/d3/dd/d31/d35/f75 23885181 1 2024-03-16T10:53:15.012 INFO:tasks.workunit.client.0.smithi017.stdout:7/333: mknod d7/db/d45/d66/c6f 0 2024-03-16T10:53:15.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/430: symlink d2/d7/de/d1e/l9a 0 2024-03-16T10:53:15.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/534: creat d1/d3/dd/d72/d8f/fb3 x:0 0 0 2024-03-16T10:53:15.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/535: chown d1/d3/de/c1d 21 1 2024-03-16T10:53:15.019 INFO:tasks.workunit.client.0.smithi017.stdout:7/334: mknod d7/db/d12/d1c/c70 0 2024-03-16T10:53:15.020 INFO:tasks.workunit.client.0.smithi017.stdout:5/476: dwrite d0/d1/d2/d2c/d36/d41/f62 [0,4194304] 0 2024-03-16T10:53:15.024 INFO:tasks.workunit.client.0.smithi017.stdout:5/477: mknod d0/d1/d76/caa 0 2024-03-16T10:53:15.024 INFO:tasks.workunit.client.0.smithi017.stdout:5/478: chown d0/d1/d2/dc/d68 39 1 2024-03-16T10:53:15.027 INFO:tasks.workunit.client.0.smithi017.stdout:5/479: mkdir d0/d1/d30/d55/dab 0 2024-03-16T10:53:15.028 INFO:tasks.workunit.client.0.smithi017.stdout:0/431: dwrite d2/d7/de/f16 [0,4194304] 0 2024-03-16T10:53:15.029 INFO:tasks.workunit.client.0.smithi017.stdout:0/432: write d2/d7/de/ff [2182153,83927] 0 2024-03-16T10:53:15.029 INFO:tasks.workunit.client.0.smithi017.stdout:0/433: fdatasync d2/d4/d90/d86/d85/f92 0 2024-03-16T10:53:15.029 INFO:tasks.workunit.client.0.smithi017.stdout:0/434: dread - d2/d4/f51 zero size 2024-03-16T10:53:15.029 INFO:tasks.workunit.client.0.smithi017.stdout:5/480: creat d0/fac x:0 0 0 2024-03-16T10:53:15.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/335: dwrite d7/db/dc/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:15.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/536: rename d1/d3/de/d36/d45/cab to d1/d3/d57/d93/cb4 0 2024-03-16T10:53:15.031 INFO:tasks.workunit.client.0.smithi017.stdout:0/435: read d2/d4/f67 [3824682,28452] 0 2024-03-16T10:53:15.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/537: creat d1/d3/d57/d94/fb5 x:0 0 0 2024-03-16T10:53:15.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/538: write d1/d3/dd/d72/fb1 [1038286,96565] 0 2024-03-16T10:53:15.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/539: chown d1/d24/la6 115 1 2024-03-16T10:53:15.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/540: creat d1/d24/d79/fb6 x:0 0 0 2024-03-16T10:53:15.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/541: truncate d1/d3/dd/d72/fb2 971423 0 2024-03-16T10:53:15.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/436: dread d2/d4/d90/f74 [0,4194304] 0 2024-03-16T10:53:15.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/437: write d2/d4/d90/d86/f5a [5124800,40942] 0 2024-03-16T10:53:15.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/438: getdents d2/d7/d24/d72/d8e 0 2024-03-16T10:53:15.039 INFO:tasks.workunit.client.0.smithi017.stdout:1/542: creat d1/d3/d57/d94/fb7 x:0 0 0 2024-03-16T10:53:15.041 INFO:tasks.workunit.client.0.smithi017.stdout:1/543: symlink d1/d3/de/d36/d45/lb8 0 2024-03-16T10:53:15.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/439: creat d2/f9b x:0 0 0 2024-03-16T10:53:15.042 INFO:tasks.workunit.client.0.smithi017.stdout:1/544: mknod d1/d3/d57/cb9 0 2024-03-16T10:53:15.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/336: dwrite d7/db/d12/d1c/f36 [4194304,4194304] 0 2024-03-16T10:53:15.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/337: stat d7/db/d12/d1c/f6e 0 2024-03-16T10:53:15.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/338: dread - d7/db/d12/d1c/f6e zero size 2024-03-16T10:53:15.044 INFO:tasks.workunit.client.0.smithi017.stdout:0/440: link d2/d4/f51 d2/d7/d24/d72/d8e/f9c 0 2024-03-16T10:53:15.044 INFO:tasks.workunit.client.0.smithi017.stdout:1/545: truncate d1/d3/f3a 1228370 0 2024-03-16T10:53:15.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/546: chown d1/d3/dd/d31/d66/da1 121 1 2024-03-16T10:53:15.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/547: fsync d1/d3/dd/d31/d35/f75 0 2024-03-16T10:53:15.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/441: creat d2/d7/de/d1e/d99/f9d x:0 0 0 2024-03-16T10:53:15.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/442: mknod d2/d7/d24/c9e 0 2024-03-16T10:53:15.047 INFO:tasks.workunit.client.0.smithi017.stdout:1/548: creat d1/d24/d79/d7a/fba x:0 0 0 2024-03-16T10:53:15.049 INFO:tasks.workunit.client.0.smithi017.stdout:7/339: dread d7/db/d45/f29 [0,4194304] 0 2024-03-16T10:53:15.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/549: symlink d1/d3/dd/d72/lbb 0 2024-03-16T10:53:15.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/443: getdents d2/d7/de/d19 0 2024-03-16T10:53:15.051 INFO:tasks.workunit.client.0.smithi017.stdout:1/550: truncate d1/d3/d88/f99 1907416 0 2024-03-16T10:53:15.052 INFO:tasks.workunit.client.0.smithi017.stdout:0/444: rmdir d2/d4 39 2024-03-16T10:53:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.052+0000 7fed77252640 1 -- 172.21.15.17:0/3940892664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed701022b0 msgr2=0x7fed70108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.052+0000 7fed77252640 1 --2- 172.21.15.17:0/3940892664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed701022b0 0x7fed70108b40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fed68009ca0 tx=0x7fed6802c0f0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 -- 172.21.15.17:0/3940892664 shutdown_connections 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 --2- 172.21.15.17:0/3940892664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed701022b0 0x7fed70108b40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 --2- 172.21.15.17:0/3940892664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed701018f0 0x7fed70101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 --2- 172.21.15.17:0/3940892664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed70100700 0x7fed70100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 -- 172.21.15.17:0/3940892664 >> 172.21.15.17:0/3940892664 conn(0x7fed700fbc70 msgr2=0x7fed700fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 -- 172.21.15.17:0/3940892664 shutdown_connections 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 -- 172.21.15.17:0/3940892664 wait complete. 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 Processor -- start 2024-03-16T10:53:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.053+0000 7fed77252640 1 -- start start 2024-03-16T10:53:15.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/551: mkdir d1/d3/de/d36/dbc 0 2024-03-16T10:53:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed701018f0 0x7fed7019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed701022b0 0x7fed701a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.056 INFO:tasks.workunit.client.0.smithi017.stdout:0/445: creat d2/d7/de/d1e/f9f x:0 0 0 2024-03-16T10:53:15.056 INFO:tasks.workunit.client.0.smithi017.stdout:1/552: chown d1/d3/dd/d9f/fad 8 1 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed7010d460 con 0x7fed70100700 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fed7010d2e0 con 0x7fed701022b0 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed77252640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed7010d5e0 con 0x7fed701018f0 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37840/0 (socket says 172.21.15.17:37840) 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 -- 172.21.15.17:0/1682946418 learned_addr learned my addr 172.21.15.17:0/1682946418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:15.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 -- 172.21.15.17:0/1682946418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed701018f0 msgr2=0x7fed7019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed701018f0 0x7fed7019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 -- 172.21.15.17:0/1682946418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed701022b0 msgr2=0x7fed701a11c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed701022b0 0x7fed701a11c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.054+0000 7fed74fee640 1 -- 172.21.15.17:0/1682946418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed701a1860 con 0x7fed70100700 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed74fee640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fed6400e9c0 tx=0x7fed6400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed6dffb640 1 -- 172.21.15.17:0/1682946418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6400cd80 con 0x7fed70100700 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed701a1b50 con 0x7fed70100700 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed6dffb640 1 -- 172.21.15.17:0/1682946418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed640035f0 con 0x7fed70100700 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed6dffb640 1 -- 172.21.15.17:0/1682946418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64010690 con 0x7fed70100700 2024-03-16T10:53:15.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.055+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed701a20a0 con 0x7fed70100700 2024-03-16T10:53:15.059 INFO:tasks.workunit.client.0.smithi017.stdout:0/446: creat d2/d4/d6d/d84/fa0 x:0 0 0 2024-03-16T10:53:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.058+0000 7fed6dffb640 1 -- 172.21.15.17:0/1682946418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fed640037a0 con 0x7fed70100700 2024-03-16T10:53:15.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.059+0000 7fed6dffb640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 0x7fed600a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.059+0000 7fed6dffb640 1 -- 172.21.15.17:0/1682946418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fed640cef70 con 0x7fed70100700 2024-03-16T10:53:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.059+0000 7fed79e3e740 1 Processor -- start 2024-03-16T10:53:15.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.059+0000 7fed79e3e740 1 -- start start 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.059+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 0x7fed600a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e79a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79ad40 0x56551e79f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56551e6eea40 con 0x56551e79feb0 2024-03-16T10:53:15.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56551e697920 con 0x56551e79a350 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed79e3e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56551e6eaae0 con 0x56551e79ad40 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37854/0 (socket says 172.21.15.17:37854) 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 -- 172.21.15.17:0/938513507 learned_addr learned my addr 172.21.15.17:0/938513507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed6ffff640 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79ad40 0x56551e79f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed74fee640 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e79a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 0x7fed600a4d60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0058c0 tx=0x7fed5c009ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 -- 172.21.15.17:0/938513507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79ad40 msgr2=0x56551e79f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79ad40 0x56551e79f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 -- 172.21.15.17:0/938513507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 msgr2=0x56551e79a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e79a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.060+0000 7fed757ef640 1 -- 172.21.15.17:0/938513507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551e6af460 con 0x56551e79feb0 2024-03-16T10:53:15.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.061+0000 7fed757ef640 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fed680325f0 tx=0x7fed680093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f324ae4c0df027 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.061+0000 7fed5affd640 1 -- 172.21.15.17:0/938513507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68041020 con 0x56551e79feb0 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.061+0000 7fed5affd640 1 -- 172.21.15.17:0/938513507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed68032c90 con 0x56551e79feb0 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.061+0000 7fed5affd640 1 -- 172.21.15.17:0/938513507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68039040 con 0x56551e79feb0 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 -- 172.21.15.17:0/938513507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 msgr2=0x56551e7a2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fed680325f0 tx=0x7fed680093e0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 -- 172.21.15.17:0/938513507 shutdown_connections 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7a2340 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79ad40 0x56551e79f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 --2- 172.21.15.17:0/938513507 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e79a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 -- 172.21.15.17:0/938513507 >> 172.21.15.17:0/938513507 conn(0x56551e7848b0 msgr2=0x56551e784cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 -- 172.21.15.17:0/938513507 shutdown_connections 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.062+0000 7fed79e3e740 1 -- 172.21.15.17:0/938513507 wait complete. 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 -- start start 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 Processor -- start 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79a350 0x56551e7acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56551e7ab610 con 0x56551e79feb0 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56551e6aad70 con 0x56551e79ad40 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56551e7ab790 con 0x56551e79a350 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed79e3e740 10 client.0 _ll_register_callbacks cb 0x56551e402a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed757ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed757ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37862/0 (socket says 172.21.15.17:37862) 2024-03-16T10:53:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.063+0000 7fed757ef640 1 -- 172.21.15.17:0/1406252201 learned_addr learned my addr 172.21.15.17:0/1406252201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 -- 172.21.15.17:0/1406252201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79a350 msgr2=0x56551e7acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79a350 0x56551e7acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 -- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 msgr2=0x56551e7ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 -- 172.21.15.17:0/1406252201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551e403210 con 0x56551e79feb0 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed757ef640 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fed6802c630 tx=0x7fed68032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775f9c106e83e18 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:15.067 INFO:tasks.workunit.client.0.smithi017.stdout:7/340: dwrite d7/db/dc/d50/d59/f61 [0,4194304] 0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68041030 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fed68003fc0 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.064+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed68032c90 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fed68039050 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 10 client.16266 fetch_fsmap learned FSMap version 31 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56551e4cf620 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed68032c90 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8398+0+0 (secure 0 0 0) 0x7fed6803c030 con 0x56551e79feb0 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 10 client.16266 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 20 client.16266 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e7badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 4 client.16266 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.065+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56551e6fbf80 con 0x56551e7b8950 2024-03-16T10:53:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.067+0000 7fed74fee640 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e7badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.071+0000 7fed4ffff640 10 client.16266 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:15.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.071+0000 7fed74fee640 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e7badd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600adb1451403a8a server_cookie=85ecbe2e5bc2d836 in_seq=0 out_seq=0 2024-03-16T10:53:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed4ffff640 1 -- 172.21.15.17:0/1406252201 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56551e6fbf80 con 0x56551e7b8950 2024-03-16T10:53:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed4ffff640 10 client.16266 handle_command_reply: tid=0 2024-03-16T10:53:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 client.16266 shutdown 2024-03-16T10:53:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 msgr2=0x56551e7b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:15.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/553: dwrite d1/d3/f29 [0,4194304] 0 2024-03-16T10:53:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fed6802c630 tx=0x7fed68032e40 comp rx=0 tx=0).stop 2024-03-16T10:53:15.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/554: chown d1/d3/d57/f9c 3269840 1 2024-03-16T10:53:15.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/555: stat d1/d3/dd/d9f/l28 0 2024-03-16T10:53:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 shutdown_connections 2024-03-16T10:53:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e7badd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed4ffff640 0 client.16266 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:15.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79feb0 0x56551e7b4320 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1406252201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79a350 0x56551e7acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 >> 172.21.15.17:0/1406252201 conn(0x56551e7848b0 msgr2=0x56551e783bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 shutdown_connections 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 1 -- 172.21.15.17:0/1406252201 wait complete. 2024-03-16T10:53:15.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.076+0000 7fed79e3e740 20 client.16266 trim_cache size 0 max 16384 2024-03-16T10:53:15.080 INFO:tasks.workunit.client.0.smithi017.stdout:0/447: dwrite d2/d7/de/d19/d2e/f48 [0,4194304] 0 2024-03-16T10:53:15.082 INFO:tasks.workunit.client.0.smithi017.stdout:7/341: symlink d7/db/d12/d1c/l71 0 2024-03-16T10:53:15.082 INFO:tasks.workunit.client.0.smithi017.stdout:7/342: chown d7/db/d45/l22 44407495 1 2024-03-16T10:53:15.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/448: unlink d2/d4/l15 0 2024-03-16T10:53:15.085 INFO:tasks.workunit.client.0.smithi017.stdout:1/556: dread d1/d3/dd/d72/f74 [0,4194304] 0 2024-03-16T10:53:15.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/557: truncate d1/d3/dd/d9f/f30 3571422 0 2024-03-16T10:53:15.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/558: write d1/d3/f87 [4702156,83429] 0 2024-03-16T10:53:15.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/449: rename d2/d4/d90/d86/d85 to d2/da1 0 2024-03-16T10:53:15.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/450: write d2/d4/f43 [274155,38796] 0 2024-03-16T10:53:15.096 INFO:tasks.workunit.client.0.smithi017.stdout:7/343: dwrite d7/db/dc/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 Processor -- start 2024-03-16T10:53:15.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 -- start start 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e784c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed7006f760 con 0x56551e79ad40 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fed70071480 con 0x56551e79a350 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed79e3e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed7006fe30 con 0x56551e79feb0 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37866/0 (socket says 172.21.15.17:37866) 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.096+0000 7fed6ffff640 1 -- 172.21.15.17:0/4011556172 learned_addr learned my addr 172.21.15.17:0/4011556172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:15.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed74fee640 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e784c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/344: mknod d7/db/d45/d66/c72 0 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 -- 172.21.15.17:0/4011556172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 msgr2=0x56551e7acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 -- 172.21.15.17:0/4011556172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 msgr2=0x56551e784c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e784c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 -- 172.21.15.17:0/4011556172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551e788930 con 0x56551e79ad40 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed74fee640 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e784c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed6ffff640 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00edc0 tx=0x7fed5c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c865fcba1ea986 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed5a7fc640 1 -- 172.21.15.17:0/4011556172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c026440 con 0x56551e79ad40 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed5a7fc640 1 -- 172.21.15.17:0/4011556172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed5c010910 con 0x56551e79ad40 2024-03-16T10:53:15.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.097+0000 7fed5a7fc640 1 -- 172.21.15.17:0/4011556172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5c01c9b0 con 0x56551e79ad40 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- 172.21.15.17:0/4011556172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 msgr2=0x56551e7b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fed5c00edc0 tx=0x7fed5c013000 comp rx=0 tx=0).stop 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- 172.21.15.17:0/4011556172 shutdown_connections 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79ad40 0x56551e7b42e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 --2- 172.21.15.17:0/4011556172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79a350 0x56551e784c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- 172.21.15.17:0/4011556172 >> 172.21.15.17:0/4011556172 conn(0x56551e7848b0 msgr2=0x56551e7abb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- 172.21.15.17:0/4011556172 shutdown_connections 2024-03-16T10:53:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- 172.21.15.17:0/4011556172 wait complete. 2024-03-16T10:53:15.101 INFO:tasks.workunit.client.0.smithi017.stdout:0/451: stat d2/d32/f53 0 2024-03-16T10:53:15.102 INFO:tasks.workunit.client.0.smithi017.stdout:0/452: write d2/d7/d24/d72/d8e/f9c [672779,85750] 0 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.098+0000 7fed79e3e740 1 -- start start 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 Processor -- start 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed70070cf0 con 0x56551e79a350 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fed700705c0 con 0x56551e79ad40 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed7006d760 con 0x56551e79feb0 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed79e3e740 10 client.0 _ll_register_callbacks cb 0x7fed5c016050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37868/0 (socket says 172.21.15.17:37868) 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 -- 172.21.15.17:0/1102634721 learned_addr learned my addr 172.21.15.17:0/1102634721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 -- 172.21.15.17:0/1102634721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 msgr2=0x56551e7b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 -- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 msgr2=0x56551e7b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.099+0000 7fed74fee640 1 -- 172.21.15.17:0/1102634721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551e7b3830 con 0x56551e79a350 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed74fee640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fed6409b6b0 tx=0x7fed6409b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ccd0ec70203396 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed640b3070 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fed640ba1f0 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5c010910 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fed64003b30 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed79e3e740 10 client.16272 fetch_fsmap learned FSMap version 31 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.100+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56551e81eff0 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed5c010910 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8398+0+0 (secure 0 0 0) 0x7fed6409ae00 con 0x56551e79a350 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 10 client.16272 fetch_fsmap finished waiting for FSMap version 31 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 20 client.16272 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e821b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 4 client.16272 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56551e6f62d0 con 0x56551e7b8950 2024-03-16T10:53:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.101+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e821b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:15.107 INFO:tasks.workunit.client.0.smithi017.stdout:1/559: dwrite d1/f5f [0,4194304] 0 2024-03-16T10:53:15.107 INFO:tasks.workunit.client.0.smithi017.stdout:1/560: readlink d1/d3/de/d36/d45/lb8 0 2024-03-16T10:53:15.107 INFO:tasks.workunit.client.0.smithi017.stdout:1/561: write d1/f78 [3371002,87630] 0 2024-03-16T10:53:15.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.102+0000 7fed4ffff640 10 client.16272 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:15.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:15.102+0000 7fed6ffff640 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e821b20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5647dc75b96cb1 server_cookie=800ab5e87e309bf1 in_seq=0 out_seq=0 2024-03-16T10:53:15.107 INFO:tasks.workunit.client.0.smithi017.stdout:1/562: creat d1/d3/d57/d97/fbd x:0 0 0 2024-03-16T10:53:15.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/345: dwrite d7/db/d12/d1c/d30/f5c [0,4194304] 0 2024-03-16T10:53:15.112 INFO:tasks.workunit.client.0.smithi017.stdout:7/346: rmdir d7/db/d32 39 2024-03-16T10:53:15.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/347: getdents d7/db/d12/d1c/d30 0 2024-03-16T10:53:15.116 INFO:tasks.workunit.client.0.smithi017.stdout:0/453: creat d2/d7/de/d19/d2e/fa2 x:0 0 0 2024-03-16T10:53:15.117 INFO:tasks.workunit.client.0.smithi017.stdout:7/348: rename d7/d5b to d7/db/dc/d50/d73 0 2024-03-16T10:53:15.118 INFO:tasks.workunit.client.0.smithi017.stdout:1/563: dwrite d1/d3/d57/f9c [0,4194304] 0 2024-03-16T10:53:15.118 INFO:tasks.workunit.client.0.smithi017.stdout:0/454: mknod d2/d7/de/d1e/ca3 0 2024-03-16T10:53:15.119 INFO:tasks.workunit.client.0.smithi017.stdout:4/401: sync 2024-03-16T10:53:15.119 INFO:tasks.workunit.client.0.smithi017.stdout:4/402: chown d15/d1d/l20 23531 1 2024-03-16T10:53:15.120 INFO:tasks.workunit.client.0.smithi017.stdout:1/564: getdents d1/d3/dd 0 2024-03-16T10:53:15.121 INFO:tasks.workunit.client.0.smithi017.stdout:0/455: mknod d2/d7/d24/d72/d7b/ca4 0 2024-03-16T10:53:15.122 INFO:tasks.workunit.client.0.smithi017.stdout:4/403: symlink d15/d1d/d27/d28/d40/d51/d64/d63/l82 0 2024-03-16T10:53:15.122 INFO:tasks.workunit.client.0.smithi017.stdout:4/404: chown d15/d1d/l20 4 1 2024-03-16T10:53:15.122 INFO:tasks.workunit.client.0.smithi017.stdout:7/349: write f2 [8096892,12274] 0 2024-03-16T10:53:15.123 INFO:tasks.workunit.client.0.smithi017.stdout:0/456: mkdir d2/d7/d24/d3a/da5 0 2024-03-16T10:53:15.125 INFO:tasks.workunit.client.0.smithi017.stdout:4/405: rename d15/d1d/d21/d3c/c46 to d15/d1d/d50/c83 0 2024-03-16T10:53:15.127 INFO:tasks.workunit.client.0.smithi017.stdout:7/350: creat d7/d5a/f74 x:0 0 0 2024-03-16T10:53:15.129 INFO:tasks.workunit.client.0.smithi017.stdout:0/457: write d2/d4/d6d/f6e [1789848,67030] 0 2024-03-16T10:53:15.129 INFO:tasks.workunit.client.0.smithi017.stdout:0/458: write d2/d4/d6d/f6e [4225794,33121] 0 2024-03-16T10:53:15.133 INFO:tasks.workunit.client.0.smithi017.stdout:0/459: getdents d2/d7/d24 0 2024-03-16T10:53:15.135 INFO:tasks.workunit.client.0.smithi017.stdout:4/406: unlink d15/d1d/d21/d26/c37 0 2024-03-16T10:53:15.135 INFO:tasks.workunit.client.0.smithi017.stdout:7/351: symlink d7/db/d32/l75 0 2024-03-16T10:53:15.137 INFO:tasks.workunit.client.0.smithi017.stdout:0/460: creat d2/da1/fa6 x:0 0 0 2024-03-16T10:53:15.137 INFO:tasks.workunit.client.0.smithi017.stdout:4/407: creat d15/d1d/d21/d26/d66/f84 x:0 0 0 2024-03-16T10:53:15.137 INFO:tasks.workunit.client.0.smithi017.stdout:4/408: readlink d15/d1d/d27/d28/d40/l62 0 2024-03-16T10:53:15.137 INFO:tasks.workunit.client.0.smithi017.stdout:1/565: dwrite d1/f78 [0,4194304] 0 2024-03-16T10:53:15.137 INFO:tasks.workunit.client.0.smithi017.stdout:1/566: write d1/d3/dd/d9f/f30 [3846023,19238] 0 2024-03-16T10:53:15.139 INFO:tasks.workunit.client.0.smithi017.stdout:4/409: mkdir d15/d1d/d85 0 2024-03-16T10:53:15.140 INFO:tasks.workunit.client.0.smithi017.stdout:1/567: write d1/d3/f6f [204098,52046] 0 2024-03-16T10:53:15.140 INFO:tasks.workunit.client.0.smithi017.stdout:1/568: chown d1/d3/de/d36/d45 274228 1 2024-03-16T10:53:15.142 INFO:tasks.workunit.client.0.smithi017.stdout:1/569: mkdir d1/d3/dd/d72/d8f/dbe 0 2024-03-16T10:53:15.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/352: dwrite d7/db/dc/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:15.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/353: write d7/db/d12/d1c/f6e [274731,121829] 0 2024-03-16T10:53:15.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/354: stat d7/db/c6d 0 2024-03-16T10:53:15.150 INFO:tasks.workunit.client.0.smithi017.stdout:1/570: dread d1/d3/de/d36/f73 [0,4194304] 0 2024-03-16T10:53:15.152 INFO:tasks.workunit.client.0.smithi017.stdout:1/571: creat d1/d3/de/d36/d67/fbf x:0 0 0 2024-03-16T10:53:15.154 INFO:tasks.workunit.client.0.smithi017.stdout:1/572: mknod d1/d50/d8d/cc0 0 2024-03-16T10:53:15.160 INFO:tasks.workunit.client.0.smithi017.stdout:4/410: dwrite d15/d1d/f81 [0,4194304] 0 2024-03-16T10:53:15.161 INFO:tasks.workunit.client.0.smithi017.stdout:1/573: write d1/d3/dd/d31/d35/f3e [1305654,3855] 0 2024-03-16T10:53:15.163 INFO:tasks.workunit.client.0.smithi017.stdout:1/574: write d1/d3/dd/d72/fb1 [1029225,3041] 0 2024-03-16T10:53:15.163 INFO:tasks.workunit.client.0.smithi017.stdout:1/575: fsync d1/d24/d79/d7a/fba 0 2024-03-16T10:53:15.165 INFO:tasks.workunit.client.0.smithi017.stdout:7/355: dwrite d7/db/d12/d1c/f3c [4194304,4194304] 0 2024-03-16T10:53:15.165 INFO:tasks.workunit.client.0.smithi017.stdout:7/356: write d7/db/d12/d1c/f36 [820391,113085] 0 2024-03-16T10:53:15.175 INFO:tasks.workunit.client.0.smithi017.stdout:1/576: dwrite d1/d3/f8a [0,4194304] 0 2024-03-16T10:53:15.184 INFO:tasks.workunit.client.0.smithi017.stdout:1/577: dwrite d1/d3/dd/d9f/fad [0,4194304] 0 2024-03-16T10:53:15.184 INFO:tasks.workunit.client.0.smithi017.stdout:1/578: write d1/d3/dd/d31/d35/f38 [2578206,39469] 0 2024-03-16T10:53:15.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[32074]: 2024-03-16T10:53:14.860+0000 7f146d4f3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:15.523 INFO:tasks.workunit.client.0.smithi017.stdout:4/411: creat d15/d1d/d27/d28/f86 x:0 0 0 2024-03-16T10:53:15.552 INFO:tasks.workunit.client.0.smithi017.stdout:1/579: link d1/d3/d57/d97/ca3 d1/d3/de/d36/cc1 0 2024-03-16T10:53:15.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.566 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.567 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001707 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001709 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001778 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001762 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.569 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001799 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017cf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ae (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001780 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001731 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001784 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001730 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ab (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.575 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001773 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001756 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001753 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017bd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001729 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000175e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001790 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001734 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000176c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.579 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001747 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001744 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001748 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001743 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001741 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001738 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:53:15.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:15 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001707 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001709 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001778 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001762 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001799 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017cf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ae (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001780 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001731 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001784 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001730 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ab (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001773 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001756 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001753 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017bd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001729 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000175e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001790 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001734 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000176c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001747 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001744 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001748 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001743 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001741 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001738 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:53:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:15 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/580: symlink d1/d3/d57/lc2 0 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/581: chown d1/d3/dd/d72/d8f/fb3 0 1 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/582: dread - d1/d3/d57/d97/fbd zero size 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/583: chown d1/d3/dd/d72/fb1 5529016 1 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/584: truncate d1/d3/f3a 1517085 0 2024-03-16T10:53:15.613 INFO:tasks.workunit.client.0.smithi017.stdout:1/585: fdatasync d1/d3/f6f 0 2024-03-16T10:53:15.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/586: symlink d1/d3/d57/d97/lc3 0 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001707 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001705 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001703 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001709 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001706 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001708 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml) see mds.e log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001733 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.670 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001778 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001762 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001793 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001791 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.671 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001764 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001727 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001799 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.672 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001754 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001774 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001777 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001781 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017cf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ae (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000178e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001780 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017cc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.673 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001731 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017d0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001785 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001767 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.674 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001784 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001760 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001730 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ca (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017aa (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001770 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000178d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001794 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.675 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001752 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ba (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001769 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001772 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001782 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.676 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001759 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ab (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000178a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001788 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001758 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ce (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001775 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001763 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.677 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017bf (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001755 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001773 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017be (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001756 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001753 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017af (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.678 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017bd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001779 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017ad (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016a7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016a6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001789 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001729 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.679 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000175e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001790 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml) see mds.h log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017c2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001766 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017bc (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017b4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001786 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001750 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001734 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000176c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.680 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017d2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000017a4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000179a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001735 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000177d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001747 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001744 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001746 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001737 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001748 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173e (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.681 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173b (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001740 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001739 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001743 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001741 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000174a (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001749 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173f (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001738 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.i log and `damage ls` output for details 2024-03-16T10:53:15.682 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:15.683 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:15.683 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] up:active 2024-03-16T10:53:15.683 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:15 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:15.744 INFO:tasks.workunit.client.0.smithi017.stdout:4/412: dwrite d15/d1d/d21/d26/d66/f70 [0,4194304] 0 2024-03-16T10:53:15.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/413: rmdir d15/d1d/d21/d26/d66 39 2024-03-16T10:53:15.806 INFO:tasks.workunit.client.0.smithi017.stdout:4/414: creat d15/d1d/d21/d3c/f87 x:0 0 0 2024-03-16T10:53:15.806 INFO:tasks.workunit.client.0.smithi017.stdout:4/415: fdatasync d15/f68 0 2024-03-16T10:53:16.303 INFO:tasks.workunit.client.0.smithi017.stdout:7/357: link d7/db/c6d d7/db/dc/d50/d59/c76 0 2024-03-16T10:53:16.303 INFO:tasks.workunit.client.0.smithi017.stdout:7/358: write d7/db/f18 [3429790,84736] 0 2024-03-16T10:53:16.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/359: mkdir d7/db/d12/d1c/d77 0 2024-03-16T10:53:16.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/360: write d7/db/f4b [1526545,95995] 0 2024-03-16T10:53:16.313 INFO:tasks.workunit.client.0.smithi017.stdout:7/361: mkdir d7/db/d32/d78 0 2024-03-16T10:53:16.314 INFO:tasks.workunit.client.0.smithi017.stdout:7/362: getdents d7/db/d45/d66 0 2024-03-16T10:53:16.314 INFO:tasks.workunit.client.0.smithi017.stdout:7/363: truncate d7/db/d12/f62 1687505 0 2024-03-16T10:53:16.315 INFO:tasks.workunit.client.0.smithi017.stdout:7/364: creat d7/db/d12/d1c/f79 x:0 0 0 2024-03-16T10:53:16.317 INFO:tasks.workunit.client.0.smithi017.stdout:7/365: read d7/db/d12/f62 [1267711,24972] 0 2024-03-16T10:53:16.318 INFO:tasks.workunit.client.0.smithi017.stdout:7/366: stat d7/c2b 0 2024-03-16T10:53:16.335 INFO:tasks.workunit.client.0.smithi017.stdout:7/367: write d7/db/dc/d50/d59/d34/f5e [1644177,385] 0 2024-03-16T10:53:16.345 INFO:tasks.workunit.client.0.smithi017.stdout:7/368: dwrite d7/db/d45/f64 [0,4194304] 0 2024-03-16T10:53:16.345 INFO:tasks.workunit.client.0.smithi017.stdout:7/369: chown d7/db/d45/f64 50 1 2024-03-16T10:53:16.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/370: dread d7/db/d45/f29 [0,4194304] 0 2024-03-16T10:53:16.372 INFO:tasks.workunit.client.0.smithi017.stdout:1/587: creat d1/d3/dd/fc4 x:0 0 0 2024-03-16T10:53:16.375 INFO:tasks.workunit.client.0.smithi017.stdout:1/588: rename d1/d3/dd/f12 to d1/d50/d8d/fc5 0 2024-03-16T10:53:16.385 INFO:tasks.workunit.client.0.smithi017.stdout:1/589: dread d1/f5f [0,4194304] 0 2024-03-16T10:53:16.407 INFO:tasks.workunit.client.0.smithi017.stdout:4/416: rmdir d15/d1d/d27/d28/d40/d51/d64 39 2024-03-16T10:53:16.407 INFO:tasks.workunit.client.0.smithi017.stdout:4/417: chown d15/d1d/d27/d28/d40/l4a 12 1 2024-03-16T10:53:16.407 INFO:tasks.workunit.client.0.smithi017.stdout:4/418: truncate d15/d1d/d27/d28/d43/f48 930836 0 2024-03-16T10:53:16.408 INFO:tasks.workunit.client.0.smithi017.stdout:4/419: creat d15/d1d/d21/d26/f88 x:0 0 0 2024-03-16T10:53:16.408 INFO:tasks.workunit.client.0.smithi017.stdout:4/420: fdatasync d15/d1d/d21/d26/d66/f70 0 2024-03-16T10:53:16.408 INFO:tasks.workunit.client.0.smithi017.stdout:4/421: getdents d15/d1d/d85 0 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:3/285: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:6/351: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/461: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:8/381: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:5/481: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:2/320: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:9/274: sync 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:8/382: chown d6/d14/c5a 63246 1 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:9/275: stat d8/df/f40 0 2024-03-16T10:53:16.419 INFO:tasks.workunit.client.0.smithi017.stdout:3/286: write d8/da/db/f50 [1013582,120129] 0 2024-03-16T10:53:16.421 INFO:tasks.workunit.client.0.smithi017.stdout:0/462: mknod d2/d7/de/d1e/ca7 0 2024-03-16T10:53:16.422 INFO:tasks.workunit.client.0.smithi017.stdout:4/422: dwrite d15/d1d/d27/f55 [4194304,4194304] 0 2024-03-16T10:53:16.422 INFO:tasks.workunit.client.0.smithi017.stdout:2/321: rename d4/dd/df/f49 to d4/dd/f67 0 2024-03-16T10:53:16.422 INFO:tasks.workunit.client.0.smithi017.stdout:2/322: truncate d4/d6/db/d66/d29/f64 68317 0 2024-03-16T10:53:16.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/371: truncate d7/db/f4b 3292113 0 2024-03-16T10:53:16.424 INFO:tasks.workunit.client.0.smithi017.stdout:0/463: symlink d2/d4/d90/d86/la8 0 2024-03-16T10:53:16.427 INFO:tasks.workunit.client.0.smithi017.stdout:5/482: link d0/d1/d2/dc/d2f/d37/d42/f4a d0/d1/d2/d2c/d36/d41/da5/fad 0 2024-03-16T10:53:16.428 INFO:tasks.workunit.client.0.smithi017.stdout:8/383: mknod d6/d5f/d6e/d34/c7f 0 2024-03-16T10:53:16.429 INFO:tasks.workunit.client.0.smithi017.stdout:0/464: dread f0 [0,4194304] 0 2024-03-16T10:53:16.430 INFO:tasks.workunit.client.0.smithi017.stdout:7/372: read d7/db/d45/f64 [53796,88295] 0 2024-03-16T10:53:16.432 INFO:tasks.workunit.client.0.smithi017.stdout:4/423: symlink d15/d1d/d27/d28/d43/l89 0 2024-03-16T10:53:16.433 INFO:tasks.workunit.client.0.smithi017.stdout:2/323: getdents d4/d6 0 2024-03-16T10:53:16.439 INFO:tasks.workunit.client.0.smithi017.stdout:5/483: unlink d0/d1/d1f/d97/fa2 0 2024-03-16T10:53:16.441 INFO:tasks.workunit.client.0.smithi017.stdout:7/373: creat d7/f7a x:0 0 0 2024-03-16T10:53:16.444 INFO:tasks.workunit.client.0.smithi017.stdout:4/424: symlink d15/d1d/l8a 0 2024-03-16T10:53:16.445 INFO:tasks.workunit.client.0.smithi017.stdout:0/465: dwrite d2/d7/de/d19/f56 [0,4194304] 0 2024-03-16T10:53:16.447 INFO:tasks.workunit.client.0.smithi017.stdout:5/484: creat d0/d1/d2/d2c/d38/fae x:0 0 0 2024-03-16T10:53:16.447 INFO:tasks.workunit.client.0.smithi017.stdout:0/466: symlink d2/d4/d6d/d84/la9 0 2024-03-16T10:53:16.448 INFO:tasks.workunit.client.0.smithi017.stdout:7/374: link d7/db/d45/l5f d7/db/l7b 0 2024-03-16T10:53:16.449 INFO:tasks.workunit.client.0.smithi017.stdout:0/467: link d2/d7/d24/d72/d8e/f9c d2/d4/d6d/d84/faa 0 2024-03-16T10:53:16.449 INFO:tasks.workunit.client.0.smithi017.stdout:2/324: mknod d4/dd/d1e/c68 0 2024-03-16T10:53:16.450 INFO:tasks.workunit.client.0.smithi017.stdout:4/425: mknod d15/d1d/d27/d28/d40/c8b 0 2024-03-16T10:53:16.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/468: mkdir d2/d4/d90/d86/d8a/dab 0 2024-03-16T10:53:16.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/469: readlink d2/d7/d24/d3a/l7a 0 2024-03-16T10:53:16.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/470: write d2/f9b [226312,71909] 0 2024-03-16T10:53:16.452 INFO:tasks.workunit.client.0.smithi017.stdout:6/352: rename d0/c2 to d0/d9/d45/d4d/d2c/d41/c6f 0 2024-03-16T10:53:16.452 INFO:tasks.workunit.client.0.smithi017.stdout:6/353: dread - d0/d15/f3d zero size 2024-03-16T10:53:16.452 INFO:tasks.workunit.client.0.smithi017.stdout:6/354: readlink d0/d9/d45/l68 0 2024-03-16T10:53:16.452 INFO:tasks.workunit.client.0.smithi017.stdout:6/355: readlink d0/d15/d1f/l52 0 2024-03-16T10:53:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/471: mknod d2/d7/d24/d3a/cac 0 2024-03-16T10:53:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/472: dread - d2/d7/f5c zero size 2024-03-16T10:53:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/485: write d0/d1/d2/dc/d2f/d37/d42/d4c/f4e [2453438,3183] 0 2024-03-16T10:53:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/486: write d0/d1/d2/d8c/f8f [748687,47489] 0 2024-03-16T10:53:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:7/375: creat d7/db/dc/d50/f7c x:0 0 0 2024-03-16T10:53:16.455 INFO:tasks.workunit.client.0.smithi017.stdout:2/325: link d4/d6/f10 d4/d6/d30/d3f/f69 0 2024-03-16T10:53:16.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/326: write d4/dd/f14 [2381689,104302] 0 2024-03-16T10:53:16.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/327: chown d4/dd/f1d 86358 1 2024-03-16T10:53:16.456 INFO:tasks.workunit.client.0.smithi017.stdout:4/426: mkdir d15/d1d/d21/d26/d66/d8c 0 2024-03-16T10:53:16.457 INFO:tasks.workunit.client.0.smithi017.stdout:4/427: write d15/d1d/d27/d28/d43/f48 [1696720,90701] 0 2024-03-16T10:53:16.457 INFO:tasks.workunit.client.0.smithi017.stdout:4/428: write d15/d1d/d21/f4b [459807,86278] 0 2024-03-16T10:53:16.457 INFO:tasks.workunit.client.0.smithi017.stdout:4/429: chown d15/d1d/d21/f5e 123 1 2024-03-16T10:53:16.458 INFO:tasks.workunit.client.0.smithi017.stdout:0/473: dread d2/d4/d61/f78 [0,4194304] 0 2024-03-16T10:53:16.458 INFO:tasks.workunit.client.0.smithi017.stdout:0/474: read - d2/d4/d90/f95 zero size 2024-03-16T10:53:16.459 INFO:tasks.workunit.client.0.smithi017.stdout:0/475: symlink d2/d7/d24/lad 0 2024-03-16T10:53:16.459 INFO:tasks.workunit.client.0.smithi017.stdout:3/287: rename d8/da/db/l53 to d8/d1b/d2e/d57/l5a 0 2024-03-16T10:53:16.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/476: mknod d2/d7/d24/d29/cae 0 2024-03-16T10:53:16.463 INFO:tasks.workunit.client.0.smithi017.stdout:5/487: mkdir d0/d1/d30/d55/daf 0 2024-03-16T10:53:16.467 INFO:tasks.workunit.client.0.smithi017.stdout:7/376: mknod d7/d5a/c7d 0 2024-03-16T10:53:16.468 INFO:tasks.workunit.client.0.smithi017.stdout:6/356: write d0/f3c [2601893,98987] 0 2024-03-16T10:53:16.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/430: rmdir d15/d1d/d27/d28 39 2024-03-16T10:53:16.473 INFO:tasks.workunit.client.0.smithi017.stdout:0/477: unlink d2/d7/de/d1e/l5e 0 2024-03-16T10:53:16.473 INFO:tasks.workunit.client.0.smithi017.stdout:0/478: chown f0 0 1 2024-03-16T10:53:16.475 INFO:tasks.workunit.client.0.smithi017.stdout:8/384: rename d6/d5c/f7e to d6/d4a/d65/f80 0 2024-03-16T10:53:16.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/479: mknod d2/d4/d6d/d84/caf 0 2024-03-16T10:53:16.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/480: fsync d2/d7/d24/d29/f2c 0 2024-03-16T10:53:16.477 INFO:tasks.workunit.client.0.smithi017.stdout:8/385: dread d6/d39/f5d [0,4194304] 0 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed4ffff640 1 -- 172.21.15.17:0/1102634721 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56551e6f62d0 con 0x56551e7b8950 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed4ffff640 10 client.16272 handle_command_reply: tid=0 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 client.16272 shutdown 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 msgr2=0x56551e7b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fed6409b6b0 tx=0x7fed6409b9b0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 shutdown_connections 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56551e7b8950 0x56551e821b20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56551e79feb0 0x56551e7b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed4ffff640 0 client.16272 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56551e79ad40 0x56551e7b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 --2- 172.21.15.17:0/1102634721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56551e79a350 0x56551e7b1cf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 >> 172.21.15.17:0/1102634721 conn(0x56551e7848b0 msgr2=0x56551e784c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 shutdown_connections 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 1 -- 172.21.15.17:0/1102634721 wait complete. 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.477+0000 7fed79e3e740 20 client.16272 trim_cache size 0 max 16384 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:53:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 msgr2=0x7fed600a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 0x7fed600a4d60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0058c0 tx=0x7fed5c009ee0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 msgr2=0x7fed70199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fed6400e9c0 tx=0x7fed6400ee80 comp rx=0 tx=0).stop 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 shutdown_connections 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fed600a28a0 0x7fed600a4d60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed701022b0 0x7fed701a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed701018f0 0x7fed7019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 --2- 172.21.15.17:0/1682946418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed70100700 0x7fed70199c50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 >> 172.21.15.17:0/1682946418 conn(0x7fed700fbc70 msgr2=0x7fed70109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 shutdown_connections 2024-03-16T10:53:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:16.478+0000 7fed77252640 1 -- 172.21.15.17:0/1682946418 wait complete. 2024-03-16T10:53:16.482 INFO:tasks.workunit.client.0.smithi017.stdout:7/377: getdents d7/db/d45 0 2024-03-16T10:53:16.482 INFO:tasks.workunit.client.0.smithi017.stdout:7/378: write d7/db/d32/f54 [8437695,123615] 0 2024-03-16T10:53:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:6/357: creat d0/d21/d39/d44/f70 x:0 0 0 2024-03-16T10:53:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:4/431: creat d15/d1d/d27/d28/d43/f8d x:0 0 0 2024-03-16T10:53:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:3/288: rmdir d8/d3f 39 2024-03-16T10:53:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:4/432: fsync d15/d1d/f5d 0 2024-03-16T10:53:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:6/358: chown d0/d22/c42 61181025 1 2024-03-16T10:53:16.489 INFO:tasks.workunit.client.0.smithi017.stdout:8/386: rename d6/d5f/l1c to d6/d5f/d6e/d34/l81 0 2024-03-16T10:53:16.492 INFO:tasks.workunit.client.0.smithi017.stdout:2/328: getdents d4/d6/db/d66 0 2024-03-16T10:53:16.492 INFO:tasks.workunit.client.0.smithi017.stdout:2/329: truncate d4/d6/db/d24/f5b 418593 0 2024-03-16T10:53:16.492 INFO:tasks.workunit.client.0.smithi017.stdout:2/330: write d4/dd/d1e/d3e/f4d [953027,107436] 0 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/331: creat d4/d6/db/d66/d29/f6a x:0 0 0 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/332: chown d4/dd/f4b 1672882 1 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/481: link d2/d4/d61/f78 d2/d7/de/fb0 0 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/482: write d2/d4/d6d/f75 [708862,120997] 0 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/333: dread - d4/dd/d1e/f36 zero size 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/334: chown d4/f5e 5 1 2024-03-16T10:53:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/483: read d2/d7/f1b [5029,12304] 0 2024-03-16T10:53:16.495 INFO:tasks.workunit.client.0.smithi017.stdout:0/484: stat d2/d7/de/d1e/f36 0 2024-03-16T10:53:16.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/433: mknod d15/d1d/d27/c8e 0 2024-03-16T10:53:16.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/434: stat d15/d1d/d21/d26/c6e 0 2024-03-16T10:53:16.497 INFO:tasks.workunit.client.0.smithi017.stdout:6/359: creat d0/d9/d38/f71 x:0 0 0 2024-03-16T10:53:16.497 INFO:tasks.workunit.client.0.smithi017.stdout:6/360: chown d0/d15 50 1 2024-03-16T10:53:16.498 INFO:tasks.workunit.client.0.smithi017.stdout:7/379: dwrite d7/db/d45/f39 [0,4194304] 0 2024-03-16T10:53:16.499 INFO:tasks.workunit.client.0.smithi017.stdout:8/387: symlink d6/d16/d6c/l82 0 2024-03-16T10:53:16.499 INFO:tasks.workunit.client.0.smithi017.stdout:8/388: write d6/d14/f51 [869441,86199] 0 2024-03-16T10:53:16.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/289: creat d8/d3f/d3d/f5b x:0 0 0 2024-03-16T10:53:16.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/290: dread - d8/d1b/d1c/f55 zero size 2024-03-16T10:53:16.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/291: readlink d8/d1b/d2e/l40 0 2024-03-16T10:53:16.503 INFO:tasks.workunit.client.0.smithi017.stdout:7/380: dread d7/db/dc/d50/d59/d34/f47 [0,4194304] 0 2024-03-16T10:53:16.503 INFO:tasks.workunit.client.0.smithi017.stdout:2/335: rmdir d4/dd 39 2024-03-16T10:53:16.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/389: mknod d6/c83 0 2024-03-16T10:53:16.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/390: write d6/d39/f32 [4962704,125610] 0 2024-03-16T10:53:16.507 INFO:tasks.workunit.client.0.smithi017.stdout:3/292: symlink d8/da/db/l5c 0 2024-03-16T10:53:16.509 INFO:tasks.workunit.client.0.smithi017.stdout:7/381: creat d7/db/dc/d50/d59/f7e x:0 0 0 2024-03-16T10:53:16.510 INFO:tasks.workunit.client.0.smithi017.stdout:0/485: dwrite d2/d4/d6d/f7f [0,4194304] 0 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:4/435: dwrite d15/d1d/d21/f2c [0,4194304] 0 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:4/436: chown d15/d1d/d50/f5b 210145314 1 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:4/437: write d15/d1d/d27/d28/f3a [58165,43684] 0 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:2/336: symlink d4/d6/db/l6b 0 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:2/337: write d4/dd/df/f19 [1386111,42519] 0 2024-03-16T10:53:16.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/486: truncate d2/d4/d90/d86/f91 391478 0 2024-03-16T10:53:16.515 INFO:tasks.workunit.client.0.smithi017.stdout:8/391: mknod d6/d5f/d6e/c84 0 2024-03-16T10:53:16.516 INFO:tasks.workunit.client.0.smithi017.stdout:8/392: chown d6/d5f/d6e/d34/f52 4740 1 2024-03-16T10:53:16.523 INFO:tasks.workunit.client.0.smithi017.stdout:7/382: symlink d7/db/dc/d50/d59/l7f 0 2024-03-16T10:53:16.524 INFO:tasks.workunit.client.0.smithi017.stdout:7/383: truncate d7/db/d12/d1c/f79 428624 0 2024-03-16T10:53:16.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/338: dwrite d4/d6/db/d24/d39/f42 [0,4194304] 0 2024-03-16T10:53:16.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/339: write d4/d6/db/d66/d2e/f3a [2900890,21046] 0 2024-03-16T10:53:16.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/438: rename d15/d1d/d27/d28/d40/d51/d64/c5c to d15/d1d/d21/c8f 0 2024-03-16T10:53:16.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/439: fsync f7 0 2024-03-16T10:53:16.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/440: fdatasync d15/d1d/d27/d28/d40/d51/f71 0 2024-03-16T10:53:16.539 INFO:tasks.workunit.client.0.smithi017.stdout:2/340: truncate d4/d6/f16 1442968 0 2024-03-16T10:53:16.540 INFO:tasks.workunit.client.0.smithi017.stdout:7/384: mknod d7/db/dc/d50/d59/d34/d53/c80 0 2024-03-16T10:53:16.540 INFO:tasks.workunit.client.0.smithi017.stdout:7/385: chown d7/db/d12/d1c/l2f 865827 1 2024-03-16T10:53:16.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/361: getdents d0/d21/d39/d44 0 2024-03-16T10:53:16.545 INFO:tasks.workunit.client.0.smithi017.stdout:3/293: rmdir d8/d3f 39 2024-03-16T10:53:16.545 INFO:tasks.workunit.client.0.smithi017.stdout:4/441: dwrite d15/d1d/d27/d28/d40/d51/d64/f4e [0,4194304] 0 2024-03-16T10:53:16.548 INFO:tasks.workunit.client.0.smithi017.stdout:6/362: symlink d0/d9/d45/l72 0 2024-03-16T10:53:16.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/487: truncate d2/d4/d90/d86/f33 850433 0 2024-03-16T10:53:16.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/488: write d2/d7/f1b [620119,69322] 0 2024-03-16T10:53:16.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/489: creat d2/d4/d90/fb1 x:0 0 0 2024-03-16T10:53:16.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/490: write d2/d4/d61/f6f [3146383,55092] 0 2024-03-16T10:53:16.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/294: dread d8/da/db/f23 [0,4194304] 0 2024-03-16T10:53:16.557 INFO:tasks.workunit.client.0.smithi017.stdout:0/491: truncate d2/d4/d90/d86/f91 107532 0 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: pgmap v424: 97 pgs: 97 active+clean; 436 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 53 MiB/s wr, 601 op/s 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: Scrub error on inode 0x100000016e1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:16.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:16 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:16.587 INFO:tasks.workunit.client.0.smithi017.stdout:7/386: dwrite d7/db/dc/d50/d59/d34/f5e [4194304,4194304] 0 2024-03-16T10:53:16.589 INFO:tasks.workunit.client.0.smithi017.stdout:0/492: dwrite d2/d7/f1a [0,4194304] 0 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: pgmap v424: 97 pgs: 97 active+clean; 436 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 53 MiB/s wr, 601 op/s 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: Scrub error on inode 0x100000016e1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:16.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:16 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:16.591 INFO:tasks.workunit.client.0.smithi017.stdout:4/442: creat d15/d1d/d27/d28/d7c/f90 x:0 0 0 2024-03-16T10:53:16.591 INFO:tasks.workunit.client.0.smithi017.stdout:4/443: chown d15/f65 1861064 1 2024-03-16T10:53:16.591 INFO:tasks.workunit.client.0.smithi017.stdout:4/444: chown d15/d1d/l8a 5787723 1 2024-03-16T10:53:16.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/363: getdents d0/d9/d45/d4d/d2e 0 2024-03-16T10:53:16.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/364: chown d0/d15/f1c 80 1 2024-03-16T10:53:16.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/365: dread d0/d15/d1f/f5e [0,4194304] 0 2024-03-16T10:53:16.594 INFO:tasks.workunit.client.0.smithi017.stdout:3/295: read - d8/d3f/d3d/f5b zero size 2024-03-16T10:53:16.596 INFO:tasks.workunit.client.0.smithi017.stdout:0/493: creat d2/d4/d61/fb2 x:0 0 0 2024-03-16T10:53:16.597 INFO:tasks.workunit.client.0.smithi017.stdout:0/494: chown d2/d7/de/f16 1691133 1 2024-03-16T10:53:16.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/445: rename d15/f65 to d15/d1d/f91 0 2024-03-16T10:53:16.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/446: creat d15/d1d/d21/d26/d66/d8c/f92 x:0 0 0 2024-03-16T10:53:16.603 INFO:tasks.workunit.client.0.smithi017.stdout:6/366: rename d0/d9/d45/d4d/d2c/f33 to d0/d9/d45/d4d/d2c/f73 0 2024-03-16T10:53:16.609 INFO:tasks.workunit.client.0.smithi017.stdout:3/296: dwrite d8/d1b/f29 [0,4194304] 0 2024-03-16T10:53:16.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/297: dread d8/da/db/f50 [0,4194304] 0 2024-03-16T10:53:16.613 INFO:tasks.workunit.client.0.smithi017.stdout:3/298: unlink d8/da/db/c16 0 2024-03-16T10:53:16.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/299: creat d8/d1b/d1c/f5d x:0 0 0 2024-03-16T10:53:16.619 INFO:tasks.workunit.client.0.smithi017.stdout:4/447: rename d15/d1d/d27/d28 to d15/d1d/d21/d3c/d93 0 2024-03-16T10:53:16.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/300: link d8/l20 d8/l5e 0 2024-03-16T10:53:16.625 INFO:tasks.workunit.client.0.smithi017.stdout:4/448: rename d15/d1d/d21/d3c/d93/l5f to d15/d1d/d21/d26/d66/l94 0 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: pgmap v424: 97 pgs: 97 active+clean; 436 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 53 MiB/s wr, 601 op/s 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e8 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e4 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e2 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e0 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e3 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e7 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016df (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e5 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: Scrub error on inode 0x100000016e1 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh) see mds.a log and `damage ls` output for details 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:16.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:16 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.395 INFO:tasks.workunit.client.0.smithi017.stdout:1/590: sync 2024-03-16T10:53:17.396 INFO:tasks.workunit.client.0.smithi017.stdout:1/591: creat d1/d3/d57/d94/fc6 x:0 0 0 2024-03-16T10:53:17.398 INFO:tasks.workunit.client.0.smithi017.stdout:1/592: creat d1/d3/d88/fc7 x:0 0 0 2024-03-16T10:53:17.405 INFO:tasks.workunit.client.0.smithi017.stdout:1/593: dread d1/d3/dd/d9f/f30 [0,4194304] 0 2024-03-16T10:53:17.405 INFO:tasks.workunit.client.0.smithi017.stdout:1/594: write d1/d3/f8a [4774039,119983] 0 2024-03-16T10:53:17.411 INFO:tasks.workunit.client.0.smithi017.stdout:1/595: dread d1/d50/d8d/fc5 [0,4194304] 0 2024-03-16T10:53:17.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/596: creat d1/d3/dd/d31/fc8 x:0 0 0 2024-03-16T10:53:17.414 INFO:tasks.workunit.client.0.smithi017.stdout:1/597: fdatasync d1/d3/d88/fc7 0 2024-03-16T10:53:17.419 INFO:tasks.workunit.client.0.smithi017.stdout:1/598: getdents d1/d3/dd/d31/d66 0 2024-03-16T10:53:17.419 INFO:tasks.workunit.client.0.smithi017.stdout:1/599: truncate d1/d3/dd/d9f/f30 4726224 0 2024-03-16T10:53:17.420 INFO:tasks.workunit.client.0.smithi017.stdout:1/600: mknod d1/d3/d57/cc9 0 2024-03-16T10:53:17.425 INFO:tasks.workunit.client.0.smithi017.stdout:1/601: rmdir d1/d24 39 2024-03-16T10:53:17.442 INFO:tasks.workunit.client.0.smithi017.stdout:1/602: dwrite d1/d3/dd/d72/f80 [0,4194304] 0 2024-03-16T10:53:17.443 INFO:tasks.workunit.client.0.smithi017.stdout:1/603: creat d1/d24/d79/fca x:0 0 0 2024-03-16T10:53:17.445 INFO:tasks.workunit.client.0.smithi017.stdout:1/604: rename d1/c42 to d1/d3/dd/d31/ccb 0 2024-03-16T10:53:17.461 INFO:tasks.workunit.client.0.smithi017.stdout:1/605: dwrite d1/f5f [0,4194304] 0 2024-03-16T10:53:17.461 INFO:tasks.workunit.client.0.smithi017.stdout:1/606: readlink d1/d3/dd/d31/d35/l71 0 2024-03-16T10:53:17.461 INFO:tasks.workunit.client.0.smithi017.stdout:1/607: getdents d1/d3/dd/d72/d8f 0 2024-03-16T10:53:17.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/608: creat d1/d3/dd/d72/d8f/dbe/fcc x:0 0 0 2024-03-16T10:53:17.464 INFO:tasks.workunit.client.0.smithi017.stdout:1/609: symlink d1/d24/d79/d7a/da9/lcd 0 2024-03-16T10:53:17.469 INFO:tasks.workunit.client.0.smithi017.stdout:1/610: mkdir d1/d24/dce 0 2024-03-16T10:53:17.470 INFO:tasks.workunit.client.0.smithi017.stdout:1/611: unlink d1/d3/d88/fc7 0 2024-03-16T10:53:17.475 INFO:tasks.workunit.client.0.smithi017.stdout:1/612: rename d1/d3/de/d36/d45 to d1/d3/d57/d94/dcf 0 2024-03-16T10:53:17.476 INFO:tasks.workunit.client.0.smithi017.stdout:1/613: symlink d1/d3/de/d36/d67/ld0 0 2024-03-16T10:53:17.478 INFO:tasks.workunit.client.0.smithi017.stdout:1/614: creat d1/d3/de/d36/dbc/fd1 x:0 0 0 2024-03-16T10:53:17.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/615: mkdir d1/d24/d79/dd2 0 2024-03-16T10:53:17.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/616: write d1/d3/de/d36/dbc/fd1 [951730,14398] 0 2024-03-16T10:53:17.524 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.525 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.526 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:53:17.138+0000 7f65a8020700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001638 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c auth v4 ap=1 s=1719 n(v0 rc2024-03-16T10:52:43.770080+0000 b1719 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c49f29cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001638:[<0x10000001637/6-1.c v2>,<0x10000001629/speculative v30>,<0x10000001414/pthread_join v1080>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001638:[<0x10000001637/6-1.c v4>,<0x10000001629/speculative v62>,<0x10000001414/pthread_join v4907>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v295>,<0x10000000204/open_posix_testsuite v1265>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v86>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v91>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v97>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:17.528 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:17 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:53:17.175+0000 7fb730978700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001628 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c auth v4 ap=1 s=1528 n(v0 rc2024-03-16T10:52:43.748081+0000 b1528 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5638da6fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001628:[<0x10000001627/7-1.c v2>,<0x1000000161d/speculative v22>,<0x10000001414/mq_getattr v1050>,<0x100000012ee/interfaces v178>,<0x100000012ea/conformance v16>,<0x10000000204/open_posix_testsuite v338>,<0x10000000202/testcases v55>,<0x10000000007/ltp-full-20091231 v43>,<0x10000000006/fsstress v40>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v30>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v41>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v51>,<0x1/volumes v49>]//[]","memoryvalue":"(3)0x10000001628:[<0x10000001627/7-1.c v4>,<0x1000000161d/speculative v46>,<0x10000001414/mq_getattr v4909>,<0x100000012ee/interfaces v941>,<0x100000012ea/conformance v295>,<0x10000000204/open_posix_testsuite v1265>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v86>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v91>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v39>,<0x1/volumes v97>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] up:active 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:17.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:17 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:17.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/617: rename d1/d3/d57/d94/dcf to d1/d3/dd/d31/d66/dd3 0 2024-03-16T10:53:17.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/618: chown d1/d3/dd/d9f/f30 7 1 2024-03-16T10:53:17.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/619: write d1/d3/dd/d72/d8f/dbe/fcc [947559,79517] 0 2024-03-16T10:53:17.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/620: chown d1/d3/dd 116 1 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:9/276: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:8/393: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/488: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:7/387: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:6/367: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/621: creat d1/d3/d88/fd4 x:0 0 0 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:8/394: readlink d6/d16/l20 0 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:3/301: sync 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/489: dread - d0/d1/d2/dc/d2f/fa3 zero size 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/490: getdents d0/d1/d30/d55/dab 0 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/491: readlink d0/d1/d2/d24/l25 0 2024-03-16T10:53:17.585 INFO:tasks.workunit.client.0.smithi017.stdout:2/341: sync 2024-03-16T10:53:17.586 INFO:tasks.workunit.client.0.smithi017.stdout:0/495: sync 2024-03-16T10:53:17.586 INFO:tasks.workunit.client.0.smithi017.stdout:4/449: sync 2024-03-16T10:53:17.586 INFO:tasks.workunit.client.0.smithi017.stdout:8/395: write d6/d39/f30 [4354201,31602] 0 2024-03-16T10:53:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:0/496: truncate d2/d4/f67 1751060 0 2024-03-16T10:53:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:4/450: dread d15/d1d/d21/f4b [0,4194304] 0 2024-03-16T10:53:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:4/451: fsync fa 0 2024-03-16T10:53:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:4/452: fdatasync d15/d1d/d27/f55 0 2024-03-16T10:53:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:4/453: write d15/d1d/d21/d3c/d93/f38 [1109298,37522] 0 2024-03-16T10:53:17.589 INFO:tasks.workunit.client.0.smithi017.stdout:9/277: rename d8/d2d/d32/f3d to d8/df/d46/f55 0 2024-03-16T10:53:17.591 INFO:tasks.workunit.client.0.smithi017.stdout:6/368: creat d0/f74 x:0 0 0 2024-03-16T10:53:17.592 INFO:tasks.workunit.client.0.smithi017.stdout:1/622: mknod d1/d3/d57/d94/cd5 0 2024-03-16T10:53:17.595 INFO:tasks.workunit.client.0.smithi017.stdout:7/388: mkdir d7/db/d81 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:9/278: dread d8/df/d46/f55 [0,4194304] 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:9/279: fdatasync d8/df/d46/f55 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:9/280: readlink d8/df/ld 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:9/281: write d8/f4c [732397,74304] 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:8/396: creat d6/d14/d6b/f85 x:0 0 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:8/397: fdatasync d6/d39/f5d 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:1/623: dread d1/d3/f6f [0,4194304] 0 2024-03-16T10:53:17.599 INFO:tasks.workunit.client.0.smithi017.stdout:1/624: readlink d1/d3/d57/d97/lc3 0 2024-03-16T10:53:17.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/454: mknod d15/d1d/d21/d3c/d93/d7c/c95 0 2024-03-16T10:53:17.601 INFO:tasks.workunit.client.0.smithi017.stdout:1/625: symlink d1/d3/dd/d31/d66/da1/ld6 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:5/492: dwrite d0/f87 [0,4194304] 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:6/369: write d0/dc/f14 [2159150,123839] 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/389: symlink d7/d5a/l82 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:5/493: readlink d0/d1/d2/d2c/d36/l52 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:5/494: fsync d0/d1/d2/dc/d2f/d37/d42/d46/f86 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/390: write d7/db/dc/d60/f6a [618522,87010] 0 2024-03-16T10:53:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:9/282: rmdir d8/df/d46 39 2024-03-16T10:53:17.607 INFO:tasks.workunit.client.0.smithi017.stdout:8/398: creat d6/d16/f86 x:0 0 0 2024-03-16T10:53:17.607 INFO:tasks.workunit.client.0.smithi017.stdout:8/399: write d6/d14/d6b/f6f [3964,17735] 0 2024-03-16T10:53:17.611 INFO:tasks.workunit.client.0.smithi017.stdout:7/391: creat d7/db/dc/f83 x:0 0 0 2024-03-16T10:53:17.611 INFO:tasks.workunit.client.0.smithi017.stdout:7/392: write d7/db/dc/f17 [4527153,51609] 0 2024-03-16T10:53:17.613 INFO:tasks.workunit.client.0.smithi017.stdout:9/283: read d8/d2d/f42 [1709562,21982] 0 2024-03-16T10:53:17.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/302: dwrite d8/d1b/f27 [0,4194304] 0 2024-03-16T10:53:17.623 INFO:tasks.workunit.client.0.smithi017.stdout:9/284: unlink d8/f4c 0 2024-03-16T10:53:17.627 INFO:tasks.workunit.client.0.smithi017.stdout:5/495: dwrite d0/d1/d30/d55/f8a [4194304,4194304] 0 2024-03-16T10:53:17.627 INFO:tasks.workunit.client.0.smithi017.stdout:0/497: dwrite d2/d4/d61/f6f [0,4194304] 0 2024-03-16T10:53:17.627 INFO:tasks.workunit.client.0.smithi017.stdout:9/285: creat d8/df/d46/f56 x:0 0 0 2024-03-16T10:53:17.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/400: dread d6/f54 [0,4194304] 0 2024-03-16T10:53:17.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/401: truncate d6/d5f/f41 1061728 0 2024-03-16T10:53:17.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/402: dread - d6/d5c/f71 zero size 2024-03-16T10:53:17.629 INFO:tasks.workunit.client.0.smithi017.stdout:0/498: truncate d2/d4/f82 1836602 0 2024-03-16T10:53:17.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/403: dread d6/d5f/f41 [0,4194304] 0 2024-03-16T10:53:17.631 INFO:tasks.workunit.client.0.smithi017.stdout:0/499: mkdir d2/d7/d24/d29/db3 0 2024-03-16T10:53:17.631 INFO:tasks.workunit.client.0.smithi017.stdout:0/500: fdatasync d2/d4/d90/f95 0 2024-03-16T10:53:17.633 INFO:tasks.workunit.client.0.smithi017.stdout:5/496: mknod d0/d1/d2/dc/d2f/d37/cb0 0 2024-03-16T10:53:17.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/455: dwrite d15/d1d/d21/d26/d66/d8c/f92 [0,4194304] 0 2024-03-16T10:53:17.635 INFO:tasks.workunit.client.0.smithi017.stdout:7/393: getdents d7/db/dc/d50/d59/d34 0 2024-03-16T10:53:17.635 INFO:tasks.workunit.client.0.smithi017.stdout:7/394: chown d7/db/f52 8562831 1 2024-03-16T10:53:17.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/286: creat d8/d2d/d32/f57 x:0 0 0 2024-03-16T10:53:17.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/287: fsync d8/f1c 0 2024-03-16T10:53:17.640 INFO:tasks.workunit.client.0.smithi017.stdout:6/370: dwrite d0/d15/d1f/f5e [0,4194304] 0 2024-03-16T10:53:17.640 INFO:tasks.workunit.client.0.smithi017.stdout:5/497: creat d0/d1/d2/dc/d68/fb1 x:0 0 0 2024-03-16T10:53:17.640 INFO:tasks.workunit.client.0.smithi017.stdout:5/498: chown d0/d1/d1f/l26 11231118 1 2024-03-16T10:53:17.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/303: dwrite d8/d3f/d3d/f5b [0,4194304] 0 2024-03-16T10:53:17.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/304: truncate d8/d1b/d2e/f3e 301028 0 2024-03-16T10:53:17.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/305: fsync d8/da/fe 0 2024-03-16T10:53:17.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/288: dwrite d8/d2d/d32/f39 [0,4194304] 0 2024-03-16T10:53:17.651 INFO:tasks.workunit.client.0.smithi017.stdout:0/501: dwrite d2/d4/d6d/d84/faa [0,4194304] 0 2024-03-16T10:53:17.652 INFO:tasks.workunit.client.0.smithi017.stdout:0/502: read d2/d7/f9 [2237241,75372] 0 2024-03-16T10:53:17.652 INFO:tasks.workunit.client.0.smithi017.stdout:9/289: write d8/d2d/d32/f57 [94214,121716] 0 2024-03-16T10:53:17.652 INFO:tasks.workunit.client.0.smithi017.stdout:4/456: mkdir d15/d1d/d21/d3c/d93/d96 0 2024-03-16T10:53:17.658 INFO:tasks.workunit.client.0.smithi017.stdout:7/395: dwrite d7/db/d12/d1c/f41 [0,4194304] 0 2024-03-16T10:53:17.667 INFO:tasks.workunit.client.0.smithi017.stdout:6/371: mkdir d0/d9/d45/d4d/d6d/d75 0 2024-03-16T10:53:17.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/499: rmdir d0/d1/d2/d70 39 2024-03-16T10:53:17.671 INFO:tasks.workunit.client.0.smithi017.stdout:0/503: dwrite d2/d7/f87 [0,4194304] 0 2024-03-16T10:53:17.674 INFO:tasks.workunit.client.0.smithi017.stdout:7/396: dwrite d7/db/dc/d50/d59/d34/f5e [4194304,4194304] 0 2024-03-16T10:53:17.676 INFO:tasks.workunit.client.0.smithi017.stdout:0/504: dread d2/d4/d61/f78 [0,4194304] 0 2024-03-16T10:53:17.676 INFO:tasks.workunit.client.0.smithi017.stdout:6/372: write d0/d15/f17 [4956745,103096] 0 2024-03-16T10:53:17.680 INFO:tasks.workunit.client.0.smithi017.stdout:4/457: creat d15/d1d/d21/d3c/f97 x:0 0 0 2024-03-16T10:53:17.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/500: getdents d0/d1/d2/dc/d2f/d37/d42 0 2024-03-16T10:53:17.689 INFO:tasks.workunit.client.0.smithi017.stdout:3/306: symlink d8/l5f 0 2024-03-16T10:53:17.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/505: mkdir d2/d7/de/d1e/db4 0 2024-03-16T10:53:17.692 INFO:tasks.workunit.client.0.smithi017.stdout:6/373: truncate d0/d15/f55 4098928 0 2024-03-16T10:53:17.693 INFO:tasks.workunit.client.0.smithi017.stdout:0/506: mknod d2/d4/cb5 0 2024-03-16T10:53:17.693 INFO:tasks.workunit.client.0.smithi017.stdout:0/507: chown d2/d7/f64 1011 1 2024-03-16T10:53:17.693 INFO:tasks.workunit.client.0.smithi017.stdout:0/508: write d2/d7/de/ff [4002559,32804] 0 2024-03-16T10:53:17.694 INFO:tasks.workunit.client.0.smithi017.stdout:0/509: chown d2/d4/d90/d86/l5b 146220 1 2024-03-16T10:53:17.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/458: unlink d15/d1d/d21/d26/d66/f67 0 2024-03-16T10:53:17.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/510: mkdir d2/d7/db6 0 2024-03-16T10:53:17.696 INFO:tasks.workunit.client.0.smithi017.stdout:5/501: symlink d0/d1/d30/d55/dab/lb2 0 2024-03-16T10:53:17.698 INFO:tasks.workunit.client.0.smithi017.stdout:3/307: mkdir d8/d1b/d2e/d60 0 2024-03-16T10:53:17.698 INFO:tasks.workunit.client.0.smithi017.stdout:3/308: chown d8/da/f58 16040 1 2024-03-16T10:53:17.702 INFO:tasks.workunit.client.0.smithi017.stdout:5/502: creat d0/d1/fb3 x:0 0 0 2024-03-16T10:53:17.702 INFO:tasks.workunit.client.0.smithi017.stdout:5/503: fdatasync d0/d1/d1f/f7b 0 2024-03-16T10:53:17.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/309: creat d8/d1b/d1c/f61 x:0 0 0 2024-03-16T10:53:17.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/310: write d8/da/fe [8832657,22470] 0 2024-03-16T10:53:17.705 INFO:tasks.workunit.client.0.smithi017.stdout:5/504: unlink d0/d1/c54 0 2024-03-16T10:53:17.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/311: dread - d8/d1d/f4b zero size 2024-03-16T10:53:17.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/312: rmdir d8/d1b 39 2024-03-16T10:53:17.712 INFO:tasks.workunit.client.0.smithi017.stdout:0/511: dwrite d2/d7/de/d1e/f36 [0,4194304] 0 2024-03-16T10:53:17.714 INFO:tasks.workunit.client.0.smithi017.stdout:0/512: write d2/d32/f77 [264805,84867] 0 2024-03-16T10:53:17.714 INFO:tasks.workunit.client.0.smithi017.stdout:0/513: readlink d2/d4/l20 0 2024-03-16T10:53:17.715 INFO:tasks.workunit.client.0.smithi017.stdout:3/313: mkdir d8/d1b/d1c/d62 0 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:5/505: dread d0/d1/d2/dc/d2f/d37/f78 [0,4194304] 0 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:5/506: dread - d0/d1/d30/d55/f95 zero size 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:5/507: dread - d0/d1/d30/d55/d6a/da0/fa9 zero size 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/314: mkdir d8/d1b/d2e/d60/d63 0 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/315: write d8/d1b/d1c/f4d [1092134,94682] 0 2024-03-16T10:53:17.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/316: fsync d8/d3f/f3b 0 2024-03-16T10:53:17.719 INFO:tasks.workunit.client.0.smithi017.stdout:0/514: mkdir d2/d4/d90/d86/db7 0 2024-03-16T10:53:17.719 INFO:tasks.workunit.client.0.smithi017.stdout:5/508: mkdir d0/d1/d2/d2c/d36/db4 0 2024-03-16T10:53:17.721 INFO:tasks.workunit.client.0.smithi017.stdout:5/509: mkdir d0/d1/d2/dc/d2f/d37/d42/d46/db5 0 2024-03-16T10:53:17.725 INFO:tasks.workunit.client.0.smithi017.stdout:6/374: dwrite d0/d9/d45/d4d/d2c/f56 [0,4194304] 0 2024-03-16T10:53:17.725 INFO:tasks.workunit.client.0.smithi017.stdout:0/515: unlink d2/d4/d90/f95 0 2024-03-16T10:53:17.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/510: dread d0/d1/d2/dc/d68/f92 [0,4194304] 0 2024-03-16T10:53:17.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/511: chown d0/d1/d30/d55/d6a/f7f 31 1 2024-03-16T10:53:17.727 INFO:tasks.workunit.client.0.smithi017.stdout:5/512: write d0/d1/d2/d2c/d38/fae [1988,41511] 0 2024-03-16T10:53:17.727 INFO:tasks.workunit.client.0.smithi017.stdout:5/513: truncate d0/d1/d76/f96 436258 0 2024-03-16T10:53:17.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/516: creat d2/d4/d90/d86/fb8 x:0 0 0 2024-03-16T10:53:17.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/517: fdatasync d2/d32/f53 0 2024-03-16T10:53:17.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/518: chown d2/d7/d24/d29/f6a 337 1 2024-03-16T10:53:17.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/519: stat d2/f11 0 2024-03-16T10:53:17.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/520: read - d2/d7/de/d19/f62 zero size 2024-03-16T10:53:17.729 INFO:tasks.workunit.client.0.smithi017.stdout:0/521: read d2/d7/f1b [400143,69973] 0 2024-03-16T10:53:17.730 INFO:tasks.workunit.client.0.smithi017.stdout:0/522: getdents d2/d7/d24/d72 0 2024-03-16T10:53:17.730 INFO:tasks.workunit.client.0.smithi017.stdout:0/523: fdatasync d2/d4/f82 0 2024-03-16T10:53:17.730 INFO:tasks.workunit.client.0.smithi017.stdout:0/524: write d2/d32/f77 [511694,71923] 0 2024-03-16T10:53:17.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/375: mknod d0/c76 0 2024-03-16T10:53:17.732 INFO:tasks.workunit.client.0.smithi017.stdout:0/525: unlink d2/f23 0 2024-03-16T10:53:17.733 INFO:tasks.workunit.client.0.smithi017.stdout:0/526: getdents d2/da1 0 2024-03-16T10:53:17.735 INFO:tasks.workunit.client.0.smithi017.stdout:0/527: creat d2/d7/d24/d72/fb9 x:0 0 0 2024-03-16T10:53:17.735 INFO:tasks.workunit.client.0.smithi017.stdout:0/528: truncate d2/d4/d90/fb1 160403 0 2024-03-16T10:53:17.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/514: dread d0/d1/d1f/d29/f5e [0,4194304] 0 2024-03-16T10:53:17.735 INFO:tasks.workunit.client.0.smithi017.stdout:6/376: unlink d0/d9/d45/d4d/d2c/f73 0 2024-03-16T10:53:17.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/626: rename d1/d3/de/d36 to d1/d3/dd/d31/d66/dd7 0 2024-03-16T10:53:17.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/627: read - d1/fae zero size 2024-03-16T10:53:17.736 INFO:tasks.workunit.client.0.smithi017.stdout:6/377: mkdir d0/d77 0 2024-03-16T10:53:17.737 INFO:tasks.workunit.client.0.smithi017.stdout:1/628: creat d1/d3/dd/d31/d66/da1/fd8 x:0 0 0 2024-03-16T10:53:17.739 INFO:tasks.workunit.client.0.smithi017.stdout:8/404: rename d6/d5f/d6e/d43/c45 to d6/d4a/c87 0 2024-03-16T10:53:17.739 INFO:tasks.workunit.client.0.smithi017.stdout:8/405: readlink d6/d16/d6c/l7c 0 2024-03-16T10:53:17.742 INFO:tasks.workunit.client.0.smithi017.stdout:7/397: rename d7/db/d32/c48 to d7/db/d12/d1c/d30/c84 0 2024-03-16T10:53:17.744 INFO:tasks.workunit.client.0.smithi017.stdout:8/406: mknod d6/d14/c88 0 2024-03-16T10:53:17.746 INFO:tasks.workunit.client.0.smithi017.stdout:5/515: dread d0/f87 [0,4194304] 0 2024-03-16T10:53:17.746 INFO:tasks.workunit.client.0.smithi017.stdout:5/516: chown d0/d1/d2/d8c/f8f 1255 1 2024-03-16T10:53:17.746 INFO:tasks.workunit.client.0.smithi017.stdout:5/517: chown d0/d1/d2/dc/d68/fb1 810 1 2024-03-16T10:53:17.746 INFO:tasks.workunit.client.0.smithi017.stdout:5/518: fdatasync d0/d1/f16 0 2024-03-16T10:53:17.747 INFO:tasks.workunit.client.0.smithi017.stdout:0/529: dread d2/d4/d90/d86/f5a [0,4194304] 0 2024-03-16T10:53:17.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/459: rename d15/d1d/d50/l54 to d15/d1d/d21/d3c/d93/d40/d51/l98 0 2024-03-16T10:53:17.749 INFO:tasks.workunit.client.0.smithi017.stdout:0/530: creat d2/d7/d24/d72/d8e/fba x:0 0 0 2024-03-16T10:53:17.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/407: creat d6/d5f/d6e/f89 x:0 0 0 2024-03-16T10:53:17.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/408: fdatasync d6/d14/d6b/f6f 0 2024-03-16T10:53:17.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/409: truncate d6/d4a/d65/f80 799108 0 2024-03-16T10:53:17.752 INFO:tasks.workunit.client.0.smithi017.stdout:7/398: dread d7/db/d12/d1c/f41 [0,4194304] 0 2024-03-16T10:53:17.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/378: rename d0/dc to d0/d9/d45/d4d/d6d/d75/d78 0 2024-03-16T10:53:17.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/379: stat d0/f3 0 2024-03-16T10:53:17.754 INFO:tasks.workunit.client.0.smithi017.stdout:5/519: dread d0/d1/d1f/f50 [4194304,4194304] 0 2024-03-16T10:53:17.756 INFO:tasks.workunit.client.0.smithi017.stdout:7/399: dread d7/db/d45/f64 [0,4194304] 0 2024-03-16T10:53:17.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/520: unlink d0/d1/d30/d55/f8a 0 2024-03-16T10:53:17.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/521: chown d0/d1/d2/dc/d68 34062 1 2024-03-16T10:53:17.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/522: stat d0/d1/d76 0 2024-03-16T10:53:17.762 INFO:tasks.workunit.client.0.smithi017.stdout:5/523: mkdir d0/d1/d2/dc/d2f/d37/d42/db6 0 2024-03-16T10:53:17.763 INFO:tasks.workunit.client.0.smithi017.stdout:5/524: write d0/f27 [4885867,5197] 0 2024-03-16T10:53:17.763 INFO:tasks.workunit.client.0.smithi017.stdout:5/525: chown d0/d1/d2/f80 0 1 2024-03-16T10:53:17.765 INFO:tasks.workunit.client.0.smithi017.stdout:5/526: symlink d0/d1/d2/d8c/lb7 0 2024-03-16T10:53:17.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/380: dwrite d0/d3e/f57 [0,4194304] 0 2024-03-16T10:53:17.765 INFO:tasks.workunit.client.0.smithi017.stdout:5/527: stat d0/d1/d2/dc/d2f 0 2024-03-16T10:53:17.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/381: truncate d0/d15/d1f/f60 347167 0 2024-03-16T10:53:17.767 INFO:tasks.workunit.client.0.smithi017.stdout:4/460: dwrite d15/d1d/d21/f7f [0,4194304] 0 2024-03-16T10:53:17.769 INFO:tasks.workunit.client.0.smithi017.stdout:7/400: dwrite d7/db/f4b [4194304,4194304] 0 2024-03-16T10:53:17.769 INFO:tasks.workunit.client.0.smithi017.stdout:7/401: fdatasync d7/db/f4b 0 2024-03-16T10:53:17.770 INFO:tasks.workunit.client.0.smithi017.stdout:6/382: rename d0/f3 to d0/d22/f79 0 2024-03-16T10:53:17.772 INFO:tasks.workunit.client.0.smithi017.stdout:5/528: symlink d0/d1/d30/d55/dab/lb8 0 2024-03-16T10:53:17.775 INFO:tasks.workunit.client.0.smithi017.stdout:4/461: creat d15/d1d/d21/d26/f99 x:0 0 0 2024-03-16T10:53:17.776 INFO:tasks.workunit.client.0.smithi017.stdout:6/383: symlink d0/d21/l7a 0 2024-03-16T10:53:17.777 INFO:tasks.workunit.client.0.smithi017.stdout:5/529: mkdir d0/d1/d2/d8c/db9 0 2024-03-16T10:53:17.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/384: creat d0/d9/f7b x:0 0 0 2024-03-16T10:53:17.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/385: readlink d0/d15/l3f 0 2024-03-16T10:53:17.781 INFO:tasks.workunit.client.0.smithi017.stdout:5/530: rename d0/d1/d2/dc/d2f/d37/d57/f9b to d0/d1/d1f/d29/d88/d91/fba 0 2024-03-16T10:53:17.783 INFO:tasks.workunit.client.0.smithi017.stdout:6/386: creat d0/d21/f7c x:0 0 0 2024-03-16T10:53:17.783 INFO:tasks.workunit.client.0.smithi017.stdout:6/387: fdatasync d0/d9/f13 0 2024-03-16T10:53:17.783 INFO:tasks.workunit.client.0.smithi017.stdout:5/531: dread d0/d1/d2/dc/d2f/d37/d57/f8b [0,4194304] 0 2024-03-16T10:53:17.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/388: mkdir d0/d15/d1f/d7d 0 2024-03-16T10:53:17.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/389: truncate d0/d15/f1c 1839882 0 2024-03-16T10:53:17.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/390: readlink d0/d9/d45/d4d/l3a 0 2024-03-16T10:53:17.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/532: mknod d0/d1/d2/dc/cbb 0 2024-03-16T10:53:17.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/533: truncate d0/f22 2255795 0 2024-03-16T10:53:17.789 INFO:tasks.workunit.client.0.smithi017.stdout:5/534: symlink d0/d1/d2/dc/d68/lbc 0 2024-03-16T10:53:17.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/462: dwrite d15/d1d/f3d [0,4194304] 0 2024-03-16T10:53:17.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/391: write d0/d9/d45/d4d/d2c/f56 [3983253,76179] 0 2024-03-16T10:53:17.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/392: truncate d0/d9/f7b 948704 0 2024-03-16T10:53:17.807 INFO:tasks.workunit.client.0.smithi017.stdout:4/463: dwrite d15/d1d/d21/d3c/d93/d40/d51/d64/d63/f6f [0,4194304] 0 2024-03-16T10:53:17.807 INFO:tasks.workunit.client.0.smithi017.stdout:4/464: chown d15/d1d/d21/d3c/d93/d43/l89 1844730619 1 2024-03-16T10:53:17.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/465: creat d15/d1d/d21/d3c/d93/d7c/f9a x:0 0 0 2024-03-16T10:53:17.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/466: chown d15/d1d/d21/d26/d66/f70 31609 1 2024-03-16T10:53:17.814 INFO:tasks.workunit.client.0.smithi017.stdout:6/393: dwrite d0/d9/d45/d4d/d2c/f56 [0,4194304] 0 2024-03-16T10:53:17.824 INFO:tasks.workunit.client.0.smithi017.stdout:6/394: dread d0/f40 [4194304,4194304] 0 2024-03-16T10:53:17.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/467: dwrite d15/d1d/d27/f49 [0,4194304] 0 2024-03-16T10:53:17.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/468: chown d15/d1d/f81 7682 1 2024-03-16T10:53:17.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/469: stat d15/d1d/d21/c39 0 2024-03-16T10:53:17.827 INFO:tasks.workunit.client.0.smithi017.stdout:6/395: unlink d0/d9/l62 0 2024-03-16T10:53:17.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/470: getdents d15/d1d/d21/d3c/d93/d40/d51 0 2024-03-16T10:53:17.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/471: write d15/d1d/d21/d3c/d93/f3a [94950,30019] 0 2024-03-16T10:53:17.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/396: dread d0/d22/f79 [0,4194304] 0 2024-03-16T10:53:17.839 INFO:tasks.workunit.client.0.smithi017.stdout:4/472: read d15/d1d/d27/f49 [636522,46570] 0 2024-03-16T10:53:17.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/397: truncate d0/d21/d39/d44/f4f 104913 0 2024-03-16T10:53:17.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/398: read - d0/d21/d39/f5a zero size 2024-03-16T10:53:17.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/473: dread d15/d1d/d21/d26/d66/d8c/f92 [0,4194304] 0 2024-03-16T10:53:17.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/474: fsync d15/f17 0 2024-03-16T10:53:17.849 INFO:tasks.workunit.client.0.smithi017.stdout:6/399: rename d0/d15/d6c to d0/d9/d45/d4d/d2e/d69/d7e 0 2024-03-16T10:53:17.853 INFO:tasks.workunit.client.0.smithi017.stdout:4/475: unlink d15/d1d/d21/d3c/d93/d43/l89 0 2024-03-16T10:53:17.854 INFO:tasks.workunit.client.0.smithi017.stdout:6/400: dread d0/d9/d45/d4d/f25 [0,4194304] 0 2024-03-16T10:53:17.855 INFO:tasks.workunit.client.0.smithi017.stdout:4/476: creat d15/f9b x:0 0 0 2024-03-16T10:53:17.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/477: creat d15/f9c x:0 0 0 2024-03-16T10:53:17.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/478: dread - d15/f9c zero size 2024-03-16T10:53:17.858 INFO:tasks.workunit.client.0.smithi017.stdout:4/479: rename d15/d1d/d21/d3c/d93/l7e to d15/d1d/d21/d26/d66/d8c/l9d 0 2024-03-16T10:53:17.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/480: creat d15/d1d/d21/d3c/d93/d43/f9e x:0 0 0 2024-03-16T10:53:17.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/481: fdatasync d15/d1d/d21/d26/d66/f84 0 2024-03-16T10:53:17.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/482: write d15/d1d/d21/d3c/f97 [754125,45784] 0 2024-03-16T10:53:17.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/483: chown d15/d1d/d21/d26/d66/l94 1 1 2024-03-16T10:53:17.861 INFO:tasks.workunit.client.0.smithi017.stdout:6/401: read d0/d9/d45/d4d/d2c/f4c [2553049,9152] 0 2024-03-16T10:53:17.862 INFO:tasks.workunit.client.0.smithi017.stdout:4/484: mkdir d15/d1d/d21/d3c/d93/d40/d51/d64/d63/d9f 0 2024-03-16T10:53:17.865 INFO:tasks.workunit.client.0.smithi017.stdout:6/402: creat d0/d15/d1f/d7d/f7f x:0 0 0 2024-03-16T10:53:17.868 INFO:tasks.workunit.client.0.smithi017.stdout:6/403: symlink d0/d3e/l80 0 2024-03-16T10:53:17.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/404: rename d0/d15/d1f/c59 to d0/d9/d38/c81 0 2024-03-16T10:53:17.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/405: dread d0/d9/f18 [0,4194304] 0 2024-03-16T10:53:17.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/406: dread - d0/d15/d1f/d7d/f7f zero size 2024-03-16T10:53:17.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/407: dread d0/d9/f7b [0,4194304] 0 2024-03-16T10:53:17.874 INFO:tasks.workunit.client.0.smithi017.stdout:6/408: creat d0/d9/d45/d4d/d2e/d69/f82 x:0 0 0 2024-03-16T10:53:17.876 INFO:tasks.workunit.client.0.smithi017.stdout:4/485: dwrite d15/d1d/d27/f3e [0,4194304] 0 2024-03-16T10:53:17.879 INFO:tasks.workunit.client.0.smithi017.stdout:4/486: truncate d15/d1d/f1e 1574982 0 2024-03-16T10:53:17.880 INFO:tasks.workunit.client.0.smithi017.stdout:4/487: fdatasync f4 0 2024-03-16T10:53:17.883 INFO:tasks.workunit.client.0.smithi017.stdout:4/488: creat d15/d1d/d21/d3c/d93/d40/d51/d64/fa0 x:0 0 0 2024-03-16T10:53:17.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/489: rename d15/d1d/d21/d3c/d93/d40/d51/d64/fa0 to d15/d1d/d21/d26/fa1 0 2024-03-16T10:53:17.887 INFO:tasks.workunit.client.0.smithi017.stdout:6/409: dwrite d0/f3c [4194304,4194304] 0 2024-03-16T10:53:17.888 INFO:tasks.workunit.client.0.smithi017.stdout:4/490: link d15/d1d/d21/d3c/d93/d40/d51/d64/f6a d15/d1d/fa2 0 2024-03-16T10:53:17.891 INFO:tasks.workunit.client.0.smithi017.stdout:6/410: creat d0/d9/d45/d4d/f83 x:0 0 0 2024-03-16T10:53:17.892 INFO:tasks.workunit.client.0.smithi017.stdout:4/491: mkdir d15/d1d/d21/d3c/d93/d40/d51/d64/d76/da3 0 2024-03-16T10:53:17.893 INFO:tasks.workunit.client.0.smithi017.stdout:4/492: truncate d15/d1d/f91 5363727 0 2024-03-16T10:53:17.895 INFO:tasks.workunit.client.0.smithi017.stdout:4/493: mkdir d15/d1d/d21/d26/d66/d8c/da4 0 2024-03-16T10:53:17.898 INFO:tasks.workunit.client.0.smithi017.stdout:4/494: creat d15/d1d/d21/d3c/d93/d96/fa5 x:0 0 0 2024-03-16T10:53:17.901 INFO:tasks.workunit.client.0.smithi017.stdout:4/495: rename d15/d1d/d21/f2c to d15/d1d/d85/fa6 0 2024-03-16T10:53:17.901 INFO:tasks.workunit.client.0.smithi017.stdout:4/496: fdatasync d15/d1d/d21/f4c 0 2024-03-16T10:53:17.901 INFO:tasks.workunit.client.0.smithi017.stdout:4/497: truncate d15/d1d/d21/d3c/d93/d96/fa5 993476 0 2024-03-16T10:53:17.904 INFO:tasks.workunit.client.0.smithi017.stdout:6/411: dwrite d0/d9/d38/f71 [0,4194304] 0 2024-03-16T10:53:17.907 INFO:tasks.workunit.client.0.smithi017.stdout:2/342: sync 2024-03-16T10:53:17.907 INFO:tasks.workunit.client.0.smithi017.stdout:1/629: link d1/d3/dd/d31/d66/da1/fd8 d1/d3/dd/d72/fd9 0 2024-03-16T10:53:17.911 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:17.523+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002505 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh auth v6 ap=1 s=2523 n(v0 rc2024-03-16T10:52:59.071935+0000 b2523 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56463648a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002505:[<0x10000002503/selinux_relabel.sh v4>,<0x10000002502/relabel v6>,<0x10000002485/tests v216>,<0x1000000244e/selinux-testsuite v84>,<0x10000001f2c/security v378>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002505:[<0x10000002503/selinux_relabel.sh v6>,<0x10000002502/relabel v708>,<0x10000002485/tests v537>,<0x1000000244e/selinux-testsuite v315>,<0x10000001f2c/security v2164>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v86>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v91>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v97>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:17.912 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:53:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:53:17.523+0000 7f0fd5815700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002504 [2,head] /volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile auth v8 ap=1 s=1071 n(v0 rc2024-03-16T10:52:59.070935+0000 b1071 1=1+0) caps={25189=pAsLsXsFsc/-@1},l=25189(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x564636481700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002504:[<0x10000002503/Makefile v2>,<0x10000002502/relabel v6>,<0x10000002485/tests v216>,<0x1000000244e/selinux-testsuite v84>,<0x10000001f2c/security v378>,<0x10000000204/kernel v650>,<0x10000000202/testcases v113>,<0x10000000007/ltp-full-20091231 v69>,<0x10000000006/fsstress v67>,<0x10000000005/tmp v56>,<0x100000001fb/client.0 v56>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v65>,<0x10000000001/sv_1 v85>,<0x10000000000/qa v75>,<0x1/volumes v71>]//[]","memoryvalue":"(3)0x10000002504:[<0x10000002503/Makefile v8>,<0x10000002502/relabel v708>,<0x10000002485/tests v537>,<0x1000000244e/selinux-testsuite v315>,<0x10000001f2c/security v2164>,<0x10000000204/kernel v1159>,<0x10000000202/testcases v1351>,<0x10000000007/ltp-full-20091231 v222>,<0x10000000006/fsstress v116>,<0x10000000005/tmp v83>,<0x100000001fb/client.0 v86>,<0x100000001fa/2ecde2e9-9064-4313-8af9-9af36bbaaa28 v91>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v29>,<0x1/volumes v97>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-16T10:53:17.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/630: dread d1/d3/dd/d31/d66/dd7/d67/f6a [0,4194304] 0 2024-03-16T10:53:17.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/631: truncate d1/d3/dd/f77 377972 0 2024-03-16T10:53:17.917 INFO:tasks.workunit.client.0.smithi017.stdout:2/343: symlink d4/d6/db/d66/l6c 0 2024-03-16T10:53:17.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/412: dwrite d0/d21/f7c [0,4194304] 0 2024-03-16T10:53:17.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/344: creat d4/f6d x:0 0 0 2024-03-16T10:53:17.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/345: dread d4/f2c [0,4194304] 0 2024-03-16T10:53:17.924 INFO:tasks.workunit.client.0.smithi017.stdout:1/632: dwrite d1/d3/dd/d31/d66/dd7/f52 [0,4194304] 0 2024-03-16T10:53:17.924 INFO:tasks.workunit.client.0.smithi017.stdout:6/413: mkdir d0/d9/d45/d4d/d6d/d75/d84 0 2024-03-16T10:53:17.924 INFO:tasks.workunit.client.0.smithi017.stdout:6/414: chown d0/d9/d45/l72 17467 1 2024-03-16T10:53:17.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/633: rmdir d1/d50 39 2024-03-16T10:53:17.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/634: chown d1/d3/f29 10770 1 2024-03-16T10:53:17.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/635: truncate d1/d24/d79/fca 291844 0 2024-03-16T10:53:17.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/636: chown d1/d3/dd/d31/d66/dd7/d67/ld0 100844 1 2024-03-16T10:53:17.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/637: dread - d1/d3/dd/d31/fc8 zero size 2024-03-16T10:53:17.929 INFO:tasks.workunit.client.0.smithi017.stdout:6/415: mknod d0/d9/d45/d4d/d6d/d75/d84/c85 0 2024-03-16T10:53:17.932 INFO:tasks.workunit.client.0.smithi017.stdout:1/638: rmdir d1/d24/dce 0 2024-03-16T10:53:17.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/639: link d1/d3/dd/d31/fc8 d1/fda 0 2024-03-16T10:53:17.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/640: rmdir d1/d3/dd/d72 39 2024-03-16T10:53:17.940 INFO:tasks.workunit.client.0.smithi017.stdout:2/346: getdents d4 0 2024-03-16T10:53:17.952 INFO:tasks.workunit.client.0.smithi017.stdout:2/347: dread d4/dd/f14 [0,4194304] 0 2024-03-16T10:53:17.953 INFO:tasks.workunit.client.0.smithi017.stdout:2/348: truncate d4/d6/db/d66/d2e/f3a 8869761 0 2024-03-16T10:53:17.954 INFO:tasks.workunit.client.0.smithi017.stdout:2/349: creat d4/dd/d38/f6e x:0 0 0 2024-03-16T10:53:17.961 INFO:tasks.workunit.client.0.smithi017.stdout:1/641: dwrite d1/d3/f3a [0,4194304] 0 2024-03-16T10:53:17.963 INFO:tasks.workunit.client.0.smithi017.stdout:1/642: mkdir d1/d3/dd/d31/d66/dd7/dbc/ddb 0 2024-03-16T10:53:17.964 INFO:tasks.workunit.client.0.smithi017.stdout:1/643: getdents d1/d24/d79/d7a 0 2024-03-16T10:53:17.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/644: rmdir d1/d3/d57/d97 39 2024-03-16T10:53:17.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/645: chown d1/d3/dd/d31/ccb 88 1 2024-03-16T10:53:17.970 INFO:tasks.workunit.client.0.smithi017.stdout:1/646: mkdir d1/d3/dd/ddc 0 2024-03-16T10:53:17.972 INFO:tasks.workunit.client.0.smithi017.stdout:1/647: creat d1/d24/d79/fdd x:0 0 0 2024-03-16T10:53:17.973 INFO:tasks.workunit.client.0.smithi017.stdout:1/648: fdatasync d1/d3/f6f 0 2024-03-16T10:53:17.973 INFO:tasks.workunit.client.0.smithi017.stdout:1/649: chown d1/d3/de/c37 680638 1 2024-03-16T10:53:17.974 INFO:tasks.workunit.client.0.smithi017.stdout:1/650: truncate d1/d3/f29 3408974 0 2024-03-16T10:53:17.976 INFO:tasks.workunit.client.0.smithi017.stdout:1/651: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/fde x:0 0 0 2024-03-16T10:53:17.976 INFO:tasks.workunit.client.0.smithi017.stdout:1/652: fdatasync d1/f78 0 2024-03-16T10:53:17.992 INFO:tasks.workunit.client.0.smithi017.stdout:1/653: dwrite d1/d3/f8a [0,4194304] 0 2024-03-16T10:53:17.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/654: creat d1/d3/dd/ddc/fdf x:0 0 0 2024-03-16T10:53:17.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/655: chown d1/d50/d61 508 1 2024-03-16T10:53:17.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/656: chown d1/d50/d61/l3c 1 1 2024-03-16T10:53:18.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/657: mkdir d1/d3/dd/d31/d66/de0 0 2024-03-16T10:53:18.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/658: stat d1/d3/d57/d97/fbd 0 2024-03-16T10:53:18.006 INFO:tasks.workunit.client.0.smithi017.stdout:1/659: dread d1/d3/dd/d31/d66/dd3/f6e [0,4194304] 0 2024-03-16T10:53:18.007 INFO:tasks.workunit.client.0.smithi017.stdout:1/660: creat d1/d3/dd/d31/d66/dd7/dbc/fe1 x:0 0 0 2024-03-16T10:53:18.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/661: write d1/d3/d57/f9c [1875697,45809] 0 2024-03-16T10:53:18.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/662: getdents d1/d3/d57/d93 0 2024-03-16T10:53:18.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/663: dread - d1/d3/d57/d94/fc6 zero size 2024-03-16T10:53:18.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/664: dread d1/d24/d79/fca [0,4194304] 0 2024-03-16T10:53:18.028 INFO:tasks.workunit.client.0.smithi017.stdout:1/665: dwrite d1/f78 [0,4194304] 0 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:9/290: sync 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:8/410: sync 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:0/531: sync 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/317: sync 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:5/535: sync 2024-03-16T10:53:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:8/411: read - d6/d5f/d6e/d34/f79 zero size 2024-03-16T10:53:18.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/402: sync 2024-03-16T10:53:18.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/403: stat d7/db/dc/l1e 0 2024-03-16T10:53:18.030 INFO:tasks.workunit.client.0.smithi017.stdout:8/412: write d6/d4a/d65/f80 [807992,84539] 0 2024-03-16T10:53:18.030 INFO:tasks.workunit.client.0.smithi017.stdout:1/666: mkdir d1/d3/dd/d31/d66/dd7/dbc/ddb/de2 0 2024-03-16T10:53:18.030 INFO:tasks.workunit.client.0.smithi017.stdout:9/291: stat d8/d2d/d32/c36 0 2024-03-16T10:53:18.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/318: symlink d8/d1b/d2e/d60/d63/l64 0 2024-03-16T10:53:18.033 INFO:tasks.workunit.client.0.smithi017.stdout:5/536: creat d0/d1/d2/d2c/fbd x:0 0 0 2024-03-16T10:53:18.034 INFO:tasks.workunit.client.0.smithi017.stdout:7/404: getdents d7/db/dc/d50 0 2024-03-16T10:53:18.035 INFO:tasks.workunit.client.0.smithi017.stdout:8/413: mknod d6/d14/d6b/c8a 0 2024-03-16T10:53:18.036 INFO:tasks.workunit.client.0.smithi017.stdout:8/414: chown d6/d5f/f41 978 1 2024-03-16T10:53:18.039 INFO:tasks.workunit.client.0.smithi017.stdout:3/319: mkdir d8/d1b/d65 0 2024-03-16T10:53:18.039 INFO:tasks.workunit.client.0.smithi017.stdout:1/667: write d1/d50/d8d/fc5 [4950287,112015] 0 2024-03-16T10:53:18.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/405: write d7/db/dc/f10 [1144897,82922] 0 2024-03-16T10:53:18.040 INFO:tasks.workunit.client.0.smithi017.stdout:3/320: truncate d8/da/db/f19 1906902 0 2024-03-16T10:53:18.042 INFO:tasks.workunit.client.0.smithi017.stdout:1/668: mkdir d1/d3/dd/d31/d66/da1/de3 0 2024-03-16T10:53:18.042 INFO:tasks.workunit.client.0.smithi017.stdout:7/406: stat d7/db/dc/d50/d59/c76 0 2024-03-16T10:53:18.043 INFO:tasks.workunit.client.0.smithi017.stdout:3/321: rmdir d8/d1b/d2e/d60/d63 39 2024-03-16T10:53:18.043 INFO:tasks.workunit.client.0.smithi017.stdout:1/669: rmdir d1/d50/d61 39 2024-03-16T10:53:18.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/532: dwrite d2/d7/de/d19/d2e/f4b [0,4194304] 0 2024-03-16T10:53:18.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/322: link d8/d1d/f4b d8/da/f66 0 2024-03-16T10:53:18.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/323: stat d8/d1d/c24 0 2024-03-16T10:53:18.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/324: write d8/da/db/f42 [2559006,4393] 0 2024-03-16T10:53:18.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/325: chown d8/d1b/d2e/f3e 60189 1 2024-03-16T10:53:18.051 INFO:tasks.workunit.client.0.smithi017.stdout:7/407: dread d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:18.051 INFO:tasks.workunit.client.0.smithi017.stdout:3/326: write d8/da/db/f50 [204199,130858] 0 2024-03-16T10:53:18.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/415: dwrite d6/d39/d35/f47 [0,4194304] 0 2024-03-16T10:53:18.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/416: chown d6/d5f/f33 5 1 2024-03-16T10:53:18.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/417: fdatasync d6/d16/f49 0 2024-03-16T10:53:18.059 INFO:tasks.workunit.client.0.smithi017.stdout:7/408: write d7/db/f28 [2660090,127375] 0 2024-03-16T10:53:18.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/418: rename d6/f13 to d6/d4a/d65/f8b 0 2024-03-16T10:53:18.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/670: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:18.068 INFO:tasks.workunit.client.0.smithi017.stdout:7/409: write d7/db/dc/d50/d59/d34/f44 [640322,110727] 0 2024-03-16T10:53:18.069 INFO:tasks.workunit.client.0.smithi017.stdout:7/410: link c3 d7/db/d12/d1c/d30/c85 0 2024-03-16T10:53:18.072 INFO:tasks.workunit.client.0.smithi017.stdout:0/533: dwrite d2/d4/d6d/f35 [0,4194304] 0 2024-03-16T10:53:18.073 INFO:tasks.workunit.client.0.smithi017.stdout:3/327: dread d8/da/f36 [0,4194304] 0 2024-03-16T10:53:18.073 INFO:tasks.workunit.client.0.smithi017.stdout:5/537: dwrite d0/d1/d2/d2c/f60 [0,4194304] 0 2024-03-16T10:53:18.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/419: rename d6/d4a/d65 to d6/d14/d8c 0 2024-03-16T10:53:18.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/420: stat d6/d16/d6c/f6d 0 2024-03-16T10:53:18.075 INFO:tasks.workunit.client.0.smithi017.stdout:0/534: creat d2/d7/d24/d72/d88/fbb x:0 0 0 2024-03-16T10:53:18.076 INFO:tasks.workunit.client.0.smithi017.stdout:0/535: symlink d2/d7/de/d1e/d99/lbc 0 2024-03-16T10:53:18.077 INFO:tasks.workunit.client.0.smithi017.stdout:0/536: dread d2/d4/d90/d86/f91 [0,4194304] 0 2024-03-16T10:53:18.079 INFO:tasks.workunit.client.0.smithi017.stdout:0/537: creat d2/d7/d24/d72/fbd x:0 0 0 2024-03-16T10:53:18.079 INFO:tasks.workunit.client.0.smithi017.stdout:0/538: truncate d2/d7/d24/d72/d88/fbb 901606 0 2024-03-16T10:53:18.079 INFO:tasks.workunit.client.0.smithi017.stdout:5/538: rename d0/d1/d2/d2c/d36/d41/c6d to d0/d1/d2/d70/cbe 0 2024-03-16T10:53:18.080 INFO:tasks.workunit.client.0.smithi017.stdout:5/539: truncate d0/d1/d2/dc/d2f/fa3 830531 0 2024-03-16T10:53:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:0/539: mknod d2/d7/d24/d29/cbe 0 2024-03-16T10:53:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:0/540: chown d2/d7/d24/d72/l80 783 1 2024-03-16T10:53:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:8/421: symlink d6/d16/d6c/l8d 0 2024-03-16T10:53:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:8/422: chown d6/d5f/d6e/lc 3962 1 2024-03-16T10:53:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:8/423: write d6/d5c/f73 [27964,3932] 0 2024-03-16T10:53:18.082 INFO:tasks.workunit.client.0.smithi017.stdout:0/541: symlink d2/d7/d24/d72/d8e/lbf 0 2024-03-16T10:53:18.082 INFO:tasks.workunit.client.0.smithi017.stdout:0/542: dread - d2/d4/d6d/d84/fa0 zero size 2024-03-16T10:53:18.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/328: write d8/da/f36 [1561327,13781] 0 2024-03-16T10:53:18.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/329: write d8/da/db/f23 [3801476,113838] 0 2024-03-16T10:53:18.083 INFO:tasks.workunit.client.0.smithi017.stdout:7/411: dread d7/db/d45/f39 [0,4194304] 0 2024-03-16T10:53:18.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/424: unlink d6/d5f/d6e/lc 0 2024-03-16T10:53:18.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/425: write d6/d4a/f4d [987810,86179] 0 2024-03-16T10:53:18.087 INFO:tasks.workunit.client.0.smithi017.stdout:3/330: rename d8/d1d/l2c to d8/d1d/l67 0 2024-03-16T10:53:18.087 INFO:tasks.workunit.client.0.smithi017.stdout:3/331: chown d8/d1b/d1c/f54 5 1 2024-03-16T10:53:18.089 INFO:tasks.workunit.client.0.smithi017.stdout:7/412: creat d7/d5a/f86 x:0 0 0 2024-03-16T10:53:18.091 INFO:tasks.workunit.client.0.smithi017.stdout:8/426: creat d6/d14/d6b/f8e x:0 0 0 2024-03-16T10:53:18.095 INFO:tasks.workunit.client.0.smithi017.stdout:7/413: creat d7/db/dc/d50/f87 x:0 0 0 2024-03-16T10:53:18.095 INFO:tasks.workunit.client.0.smithi017.stdout:7/414: dread - d7/db/dc/f83 zero size 2024-03-16T10:53:18.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/415: dread d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:18.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/416: chown d7/db/d12/d1c/f36 11 1 2024-03-16T10:53:18.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/417: dread d7/db/dc/d60/f6a [0,4194304] 0 2024-03-16T10:53:18.108 INFO:tasks.workunit.client.0.smithi017.stdout:5/540: dwrite d0/d1/d2/dc/d2f/f89 [0,4194304] 0 2024-03-16T10:53:18.108 INFO:tasks.workunit.client.0.smithi017.stdout:5/541: chown d0/d1/d2/d24/c34 3718 1 2024-03-16T10:53:18.111 INFO:tasks.workunit.client.0.smithi017.stdout:5/542: rmdir d0/d1/d30 39 2024-03-16T10:53:18.111 INFO:tasks.workunit.client.0.smithi017.stdout:5/543: readlink d0/d1/d2/dc/d68/l9c 0 2024-03-16T10:53:18.112 INFO:tasks.workunit.client.0.smithi017.stdout:0/543: rename d2/d32 to d2/d4/d90/d86/db7/dc0 0 2024-03-16T10:53:18.113 INFO:tasks.workunit.client.0.smithi017.stdout:5/544: truncate d0/d1/d2/d2c/f60 1699707 0 2024-03-16T10:53:18.113 INFO:tasks.workunit.client.0.smithi017.stdout:5/545: stat d0/d1/d2/d24/c34 0 2024-03-16T10:53:18.113 INFO:tasks.workunit.client.0.smithi017.stdout:5/546: fsync d0/f9 0 2024-03-16T10:53:18.113 INFO:tasks.workunit.client.0.smithi017.stdout:5/547: chown d0/d1/d2/d2c/c72 39507407 1 2024-03-16T10:53:18.114 INFO:tasks.workunit.client.0.smithi017.stdout:5/548: dread d0/d1/d2/d2c/d38/f61 [0,4194304] 0 2024-03-16T10:53:18.116 INFO:tasks.workunit.client.0.smithi017.stdout:5/549: dread d0/d1/d2/dc/d2f/d37/d57/f8b [0,4194304] 0 2024-03-16T10:53:18.116 INFO:tasks.workunit.client.0.smithi017.stdout:5/550: dread - d0/d1/d1f/d29/d88/d91/fba zero size 2024-03-16T10:53:18.118 INFO:tasks.workunit.client.0.smithi017.stdout:5/551: link d0/l3 d0/d1/d2/lbf 0 2024-03-16T10:53:18.119 INFO:tasks.workunit.client.0.smithi017.stdout:5/552: creat d0/d1/d2/d8c/fc0 x:0 0 0 2024-03-16T10:53:18.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/553: dread d0/d1/d2/dc/d2f/d37/d42/d46/f69 [0,4194304] 0 2024-03-16T10:53:18.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/554: stat d0/d1/fb3 0 2024-03-16T10:53:18.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/332: dwrite d8/da/db/f42 [0,4194304] 0 2024-03-16T10:53:18.121 INFO:tasks.workunit.client.0.smithi017.stdout:5/555: creat d0/d1/d1f/d29/d88/d91/fc1 x:0 0 0 2024-03-16T10:53:18.122 INFO:tasks.workunit.client.0.smithi017.stdout:8/427: dwrite d6/d14/f51 [0,4194304] 0 2024-03-16T10:53:18.122 INFO:tasks.workunit.client.0.smithi017.stdout:0/544: dread d2/d4/f51 [0,4194304] 0 2024-03-16T10:53:18.122 INFO:tasks.workunit.client.0.smithi017.stdout:0/545: write d2/d7/f5c [606750,124556] 0 2024-03-16T10:53:18.123 INFO:tasks.workunit.client.0.smithi017.stdout:5/556: mknod d0/d1/cc2 0 2024-03-16T10:53:18.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/333: dread d8/da/db/f50 [0,4194304] 0 2024-03-16T10:53:18.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/334: readlink d8/d1d/l3c 0 2024-03-16T10:53:18.124 INFO:tasks.workunit.client.0.smithi017.stdout:3/335: readlink d8/da/db/l51 0 2024-03-16T10:53:18.124 INFO:tasks.workunit.client.0.smithi017.stdout:0/546: mkdir d2/d4/d6d/d84/dc1 0 2024-03-16T10:53:18.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/547: mkdir d2/d4/d90/dc2 0 2024-03-16T10:53:18.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/548: write d2/d7/de/d1e/d99/f9d [896098,11686] 0 2024-03-16T10:53:18.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/549: read - d2/d7/f73 zero size 2024-03-16T10:53:18.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/550: fdatasync d2/d4/d90/fb1 0 2024-03-16T10:53:18.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/428: rename d6/d5f/f41 to d6/d5c/f8f 0 2024-03-16T10:53:18.130 INFO:tasks.workunit.client.0.smithi017.stdout:7/418: dwrite f2 [4194304,4194304] 0 2024-03-16T10:53:18.130 INFO:tasks.workunit.client.0.smithi017.stdout:5/557: link d0/d1/d1f/d29/ca8 d0/d1/d2/dc/d2f/d37/cc3 0 2024-03-16T10:53:18.133 INFO:tasks.workunit.client.0.smithi017.stdout:7/419: mknod d7/db/d12/d1c/d30/c88 0 2024-03-16T10:53:18.134 INFO:tasks.workunit.client.0.smithi017.stdout:5/558: rmdir d0/d1/d30/d55/d6a 39 2024-03-16T10:53:18.137 INFO:tasks.workunit.client.0.smithi017.stdout:7/420: symlink d7/db/dc/d60/l89 0 2024-03-16T10:53:18.139 INFO:tasks.workunit.client.0.smithi017.stdout:5/559: creat d0/d1/d2/d2c/d36/d51/fc4 x:0 0 0 2024-03-16T10:53:18.139 INFO:tasks.workunit.client.0.smithi017.stdout:5/560: chown d0/d1/d2/dc/f1d 5850 1 2024-03-16T10:53:18.139 INFO:tasks.workunit.client.0.smithi017.stdout:5/561: fdatasync d0/d1/d1f/f9a 0 2024-03-16T10:53:18.141 INFO:tasks.workunit.client.0.smithi017.stdout:3/336: dwrite d8/d1b/d1c/f5d [0,4194304] 0 2024-03-16T10:53:18.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/421: rename d7/db/d45 to d7/d8a 0 2024-03-16T10:53:18.142 INFO:tasks.workunit.client.0.smithi017.stdout:5/562: creat d0/d1/d2/dc/d2f/d37/d42/fc5 x:0 0 0 2024-03-16T10:53:18.143 INFO:tasks.workunit.client.0.smithi017.stdout:0/551: dwrite d2/d7/de/ff [4194304,4194304] 0 2024-03-16T10:53:18.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/337: link d8/da/c32 d8/da/db/c68 0 2024-03-16T10:53:18.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/338: dread - d8/da/f58 zero size 2024-03-16T10:53:18.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/422: symlink d7/db/dc/d50/d59/l8b 0 2024-03-16T10:53:18.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/423: fdatasync d7/db/d12/f62 0 2024-03-16T10:53:18.149 INFO:tasks.workunit.client.0.smithi017.stdout:5/563: mkdir d0/d1/d2/d2c/d36/d41/da5/dc6 0 2024-03-16T10:53:18.150 INFO:tasks.workunit.client.0.smithi017.stdout:0/552: link d2/d4/d90/d86/c2f d2/d4/d6d/d84/dc1/cc3 0 2024-03-16T10:53:18.152 INFO:tasks.workunit.client.0.smithi017.stdout:8/429: dwrite d6/d5c/f8f [0,4194304] 0 2024-03-16T10:53:18.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/553: rmdir d2/d7/d24/d3a/da5 0 2024-03-16T10:53:18.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/554: read d2/d7/f9 [2969016,51955] 0 2024-03-16T10:53:18.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/555: read d2/d4/f43 [282546,56646] 0 2024-03-16T10:53:18.158 INFO:tasks.workunit.client.0.smithi017.stdout:5/564: creat d0/d1/d2/d2c/d36/d51/fc7 x:0 0 0 2024-03-16T10:53:18.160 INFO:tasks.workunit.client.0.smithi017.stdout:3/339: dwrite d8/da/f59 [0,4194304] 0 2024-03-16T10:53:18.160 INFO:tasks.workunit.client.0.smithi017.stdout:3/340: readlink d8/da/db/l51 0 2024-03-16T10:53:18.160 INFO:tasks.workunit.client.0.smithi017.stdout:3/341: readlink d8/d3f/d3d/l45 0 2024-03-16T10:53:18.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/556: write d2/d7/f1a [1744238,99632] 0 2024-03-16T10:53:18.162 INFO:tasks.workunit.client.0.smithi017.stdout:8/430: dread - d6/d5f/d6e/d34/f79 zero size 2024-03-16T10:53:18.162 INFO:tasks.workunit.client.0.smithi017.stdout:8/431: fdatasync d6/d39/d35/f47 0 2024-03-16T10:53:18.163 INFO:tasks.workunit.client.0.smithi017.stdout:0/557: creat d2/d4/d90/d86/db7/fc4 x:0 0 0 2024-03-16T10:53:18.163 INFO:tasks.workunit.client.0.smithi017.stdout:0/558: write d2/d7/de/d19/f62 [897193,38595] 0 2024-03-16T10:53:18.165 INFO:tasks.workunit.client.0.smithi017.stdout:5/565: mknod d0/d1/d2/d2c/d36/cc8 0 2024-03-16T10:53:18.169 INFO:tasks.workunit.client.0.smithi017.stdout:5/566: getdents d0/d1/d30/d55 0 2024-03-16T10:53:18.171 INFO:tasks.workunit.client.0.smithi017.stdout:0/559: dread d2/d7/d24/d29/f6a [0,4194304] 0 2024-03-16T10:53:18.171 INFO:tasks.workunit.client.0.smithi017.stdout:5/567: unlink d0/d1/d2/d2c/d38/l6c 0 2024-03-16T10:53:18.173 INFO:tasks.workunit.client.0.smithi017.stdout:0/560: creat d2/d7/d24/d29/fc5 x:0 0 0 2024-03-16T10:53:18.175 INFO:tasks.workunit.client.0.smithi017.stdout:0/561: rmdir d2/d7 39 2024-03-16T10:53:18.185 INFO:tasks.workunit.client.0.smithi017.stdout:4/498: sync 2024-03-16T10:53:18.185 INFO:tasks.workunit.client.0.smithi017.stdout:4/499: dread - d15/d1d/d27/f78 zero size 2024-03-16T10:53:18.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/432: dwrite d6/d16/d6c/f6d [0,4194304] 0 2024-03-16T10:53:18.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/342: dwrite d8/da/fe [4194304,4194304] 0 2024-03-16T10:53:18.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/433: rmdir d6/d39 39 2024-03-16T10:53:18.191 INFO:tasks.workunit.client.0.smithi017.stdout:3/343: mkdir d8/d1b/d1c/d62/d69 0 2024-03-16T10:53:18.191 INFO:tasks.workunit.client.0.smithi017.stdout:3/344: stat d8/d1b/d2e/d57 0 2024-03-16T10:53:18.193 INFO:tasks.workunit.client.0.smithi017.stdout:5/568: dwrite d0/d1/d2/d2c/d38/fae [0,4194304] 0 2024-03-16T10:53:18.194 INFO:tasks.workunit.client.0.smithi017.stdout:3/345: link d8/d1b/d1c/f61 d8/d1b/d2e/d57/f6a 0 2024-03-16T10:53:18.195 INFO:tasks.workunit.client.0.smithi017.stdout:0/562: dwrite d2/d7/f87 [0,4194304] 0 2024-03-16T10:53:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/563: truncate d2/d7/f64 171701 0 2024-03-16T10:53:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:5/569: rmdir d0 39 2024-03-16T10:53:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:5/570: chown d0/d5d 304272739 1 2024-03-16T10:53:18.199 INFO:tasks.workunit.client.0.smithi017.stdout:3/346: mknod d8/d1b/d2e/d57/c6b 0 2024-03-16T10:53:18.200 INFO:tasks.workunit.client.0.smithi017.stdout:5/571: symlink d0/d1/d2/d2c/d36/db4/lc9 0 2024-03-16T10:53:18.200 INFO:tasks.workunit.client.0.smithi017.stdout:2/350: sync 2024-03-16T10:53:18.200 INFO:tasks.workunit.client.0.smithi017.stdout:6/416: sync 2024-03-16T10:53:18.203 INFO:tasks.workunit.client.0.smithi017.stdout:5/572: truncate d0/f27 2849705 0 2024-03-16T10:53:18.204 INFO:tasks.workunit.client.0.smithi017.stdout:3/347: dread d8/da/db/f15 [0,4194304] 0 2024-03-16T10:53:18.208 INFO:tasks.workunit.client.0.smithi017.stdout:8/434: dwrite d6/d5f/d6e/d43/f2b [0,4194304] 0 2024-03-16T10:53:18.208 INFO:tasks.workunit.client.0.smithi017.stdout:8/435: truncate d6/d5c/f71 396219 0 2024-03-16T10:53:18.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/573: rmdir d0/d1/d1f/d29/d88/d91 39 2024-03-16T10:53:18.214 INFO:tasks.workunit.client.0.smithi017.stdout:8/436: chown d6/d5f/d6e/c42 1 1 2024-03-16T10:53:18.214 INFO:tasks.workunit.client.0.smithi017.stdout:8/437: fsync d6/d4a/f78 0 2024-03-16T10:53:18.216 INFO:tasks.workunit.client.0.smithi017.stdout:6/417: stat d0/d9/d45/d4d/d2c/d41/c6f 0 2024-03-16T10:53:18.216 INFO:tasks.workunit.client.0.smithi017.stdout:6/418: write d0/d15/d1f/f60 [731204,71235] 0 2024-03-16T10:53:18.216 INFO:tasks.workunit.client.0.smithi017.stdout:2/351: dwrite d4/dd/d1e/f36 [0,4194304] 0 2024-03-16T10:53:18.216 INFO:tasks.workunit.client.0.smithi017.stdout:3/348: dread d8/d1b/d1c/f26 [0,4194304] 0 2024-03-16T10:53:18.217 INFO:tasks.workunit.client.0.smithi017.stdout:5/574: rmdir d0/d1/d2/dc/d2f 39 2024-03-16T10:53:18.219 INFO:tasks.workunit.client.0.smithi017.stdout:0/564: dwrite d2/d7/f87 [0,4194304] 0 2024-03-16T10:53:18.219 INFO:tasks.workunit.client.0.smithi017.stdout:8/438: symlink d6/d14/l90 0 2024-03-16T10:53:18.220 INFO:tasks.workunit.client.0.smithi017.stdout:0/565: creat d2/d4/d6d/d84/dc1/fc6 x:0 0 0 2024-03-16T10:53:18.221 INFO:tasks.workunit.client.0.smithi017.stdout:6/419: mkdir d0/d9/d45/d4d/d2c/d41/d86 0 2024-03-16T10:53:18.221 INFO:tasks.workunit.client.0.smithi017.stdout:0/566: getdents d2/d7/d24 0 2024-03-16T10:53:18.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/352: link d4/dd/df/l2f d4/d6/l6f 0 2024-03-16T10:53:18.224 INFO:tasks.workunit.client.0.smithi017.stdout:2/353: readlink d4/dd/d1e/l47 0 2024-03-16T10:53:18.224 INFO:tasks.workunit.client.0.smithi017.stdout:2/354: fdatasync d4/d6/db/f11 0 2024-03-16T10:53:18.224 INFO:tasks.workunit.client.0.smithi017.stdout:3/349: creat d8/d1b/d2e/f6c x:0 0 0 2024-03-16T10:53:18.227 INFO:tasks.workunit.client.0.smithi017.stdout:5/575: rename d0/d1/d2/dc/d2f/d37/f78 to d0/d1/d1f/d97/fca 0 2024-03-16T10:53:18.229 INFO:tasks.workunit.client.0.smithi017.stdout:8/439: mknod d6/d39/d35/c91 0 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/567: rename d2/f11 to d2/d7/d24/d3a/fc7 0 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/568: chown d2/d4/d6d/d84/dc1/fc6 301464008 1 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/569: dread - d2/d7/d24/d72/d8e/fba zero size 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/570: read - d2/d7/f73 zero size 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/571: fsync d2/d4/f67 0 2024-03-16T10:53:18.230 INFO:tasks.workunit.client.0.smithi017.stdout:6/420: mkdir d0/d15/d1f/d7d/d87 0 2024-03-16T10:53:18.231 INFO:tasks.workunit.client.0.smithi017.stdout:6/421: chown d0/d21/d39/d44/c61 4 1 2024-03-16T10:53:18.231 INFO:tasks.workunit.client.0.smithi017.stdout:0/572: mkdir d2/d4/d90/dc2/dc8 0 2024-03-16T10:53:18.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/576: write d0/d1/d2/dc/d68/f92 [70232,31693] 0 2024-03-16T10:53:18.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/577: dread - d0/d1/d30/d55/f95 zero size 2024-03-16T10:53:18.235 INFO:tasks.workunit.client.0.smithi017.stdout:8/440: dread d6/d14/d8c/f8b [0,4194304] 0 2024-03-16T10:53:18.235 INFO:tasks.workunit.client.0.smithi017.stdout:8/441: fsync d6/fe 0 2024-03-16T10:53:18.235 INFO:tasks.workunit.client.0.smithi017.stdout:3/350: rename d8/d1b/d2e/d60/d63/l64 to d8/da/l6d 0 2024-03-16T10:53:18.235 INFO:tasks.workunit.client.0.smithi017.stdout:3/351: chown d8/d1b/d1c/f26 572794 1 2024-03-16T10:53:18.236 INFO:tasks.workunit.client.0.smithi017.stdout:6/422: mknod d0/d9/c88 0 2024-03-16T10:53:18.238 INFO:tasks.workunit.client.0.smithi017.stdout:2/355: rmdir d4 39 2024-03-16T10:53:18.245 INFO:tasks.workunit.client.0.smithi017.stdout:8/442: mkdir d6/d39/d35/d92 0 2024-03-16T10:53:18.297 INFO:tasks.workunit.client.0.smithi017.stdout:5/578: dread d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:18.297 INFO:tasks.workunit.client.0.smithi017.stdout:3/352: getdents d8/d3f/d3d 0 2024-03-16T10:53:18.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/443: write d6/d5f/d6e/f59 [1255524,114329] 0 2024-03-16T10:53:18.297 INFO:tasks.workunit.client.0.smithi017.stdout:0/573: rename d2/d4/d90/d86/d8a/dab to d2/d4/d61/dc9 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/574: dread - d2/d4/d6d/d84/dc1/fc6 zero size 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/579: mknod d0/d1/d30/d55/d6a/da0/ccb 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/575: creat d2/d4/d90/fca x:0 0 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/576: creat d2/d7/de/d1e/d99/fcb x:0 0 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:6/423: dwrite d0/d9/d45/d4d/d6d/d75/d78/f14 [0,4194304] 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:6/424: chown d0/f40 1729 1 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:6/425: creat d0/d9/d45/d4d/d2e/d69/f89 x:0 0 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:6/426: truncate d0/d9/d45/d4d/d2c/f56 2464752 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/580: dwrite d0/d1/d2/d2c/d36/d41/da5/fad [4194304,4194304] 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/581: fsync d0/d1/d2/d2c/d36/d41/da5/fad 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/582: creat d0/d1/d2/dc/d68/fcc x:0 0 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/583: write d0/d1/f16 [5629923,7865] 0 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/584: chown d0/d1/d2/d8c/f8f 430590 1 2024-03-16T10:53:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/585: write d0/d1/d2/f12 [143334,94580] 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/586: getdents d0/d1/d2/dc/d2f/d37/d42/db6 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/444: dwrite d6/d5f/d6e/d43/f2b [4194304,4194304] 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/445: rmdir d6 39 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/446: stat d6/d14/d6b/f6f 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/577: dwrite d2/d7/f1a [4194304,4194304] 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/587: write d0/d1/d1f/d97/fca [1179873,26296] 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/578: mknod d2/d7/d24/d29/db3/ccc 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/447: getdents d6/d39 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:2/356: rename d4/f65 to d4/d6/db/d66/d29/f70 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:2/357: write d4/d6/d30/d3f/f54 [479162,109451] 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/579: rmdir d2/d7/db6 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/580: stat d2/d4/d6d/d84/caf 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/581: symlink d2/d4/d90/dc2/lcd 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/448: symlink d6/d39/d35/d92/l93 0 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/449: chown d6/d39/d35/l3d 3167843 1 2024-03-16T10:53:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:3/353: rename d8/da/db/f42 to d8/d3f/d3d/f6e 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/354: fsync d8/da/f59 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/355: write d8/d1b/d2e/f6c [1043043,101471] 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:0/582: rename d2/d7/d24/d29/f2c to d2/d7/d24/d72/fce 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:0/583: mknod d2/d7/de/d1e/db4/ccf 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:0/584: write d2/d7/d24/d72/fbd [246899,6257] 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/427: dwrite d0/d9/d45/d4d/d2c/f56 [0,4194304] 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/356: creat d8/d1b/d2e/d60/f6f x:0 0 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/357: fdatasync d8/d1d/f46 0 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:9/292: sync 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/671: sync 2024-03-16T10:53:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:9/293: chown d8/d2d/d32/d45/f4a 4047 1 2024-03-16T10:53:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:8/450: rename d6/d14/d6b/c8a to d6/d16/d6c/c94 0 2024-03-16T10:53:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:5/588: dwrite d0/d1/d2/dc/f1d [0,4194304] 0 2024-03-16T10:53:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:5/589: read - d0/d1/d1f/d29/d88/d91/fa7 zero size 2024-03-16T10:53:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:5/590: read - d0/d1/d2/dc/d68/fb1 zero size 2024-03-16T10:53:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:6/428: creat d0/d9/d45/d4d/d2e/d69/d7e/f8a x:0 0 0 2024-03-16T10:53:18.302 INFO:tasks.workunit.client.0.smithi017.stdout:9/294: creat d8/df/d46/f58 x:0 0 0 2024-03-16T10:53:18.307 INFO:tasks.workunit.client.0.smithi017.stdout:7/424: sync 2024-03-16T10:53:18.311 INFO:tasks.workunit.client.0.smithi017.stdout:5/591: link d0/d1/d2/dc/d2f/d37/d57/f74 d0/d5d/fcd 0 2024-03-16T10:53:18.312 INFO:tasks.workunit.client.0.smithi017.stdout:4/500: sync 2024-03-16T10:53:18.312 INFO:tasks.workunit.client.0.smithi017.stdout:0/585: dwrite d2/d7/f63 [0,4194304] 0 2024-03-16T10:53:18.314 INFO:tasks.workunit.client.0.smithi017.stdout:6/429: mknod d0/d9/d45/d4d/d2c/d41/c8b 0 2024-03-16T10:53:18.315 INFO:tasks.workunit.client.0.smithi017.stdout:0/586: link d2/d7/d24/c49 d2/d4/d90/cd0 0 2024-03-16T10:53:18.316 INFO:tasks.workunit.client.0.smithi017.stdout:0/587: mkdir d2/d7/de/d19/d2e/dd1 0 2024-03-16T10:53:18.316 INFO:tasks.workunit.client.0.smithi017.stdout:9/295: dwrite d8/df/f11 [0,4194304] 0 2024-03-16T10:53:18.317 INFO:tasks.workunit.client.0.smithi017.stdout:1/672: rename d1/d3/d88/f99 to d1/d3/dd/d31/d66/dd3/fe4 0 2024-03-16T10:53:18.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/358: symlink d8/l70 0 2024-03-16T10:53:18.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/359: write d8/d1b/d1c/f41 [58133,84130] 0 2024-03-16T10:53:18.319 INFO:tasks.workunit.client.0.smithi017.stdout:8/451: unlink d6/d5f/d6e/c37 0 2024-03-16T10:53:18.319 INFO:tasks.workunit.client.0.smithi017.stdout:8/452: write d6/d4a/f4d [1480038,49722] 0 2024-03-16T10:53:18.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/425: mknod d7/c8c 0 2024-03-16T10:53:18.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/426: chown d7 15 1 2024-03-16T10:53:18.321 INFO:tasks.workunit.client.0.smithi017.stdout:5/592: mknod d0/d5d/d9f/cce 0 2024-03-16T10:53:18.322 INFO:tasks.workunit.client.0.smithi017.stdout:6/430: dread d0/f40 [0,4194304] 0 2024-03-16T10:53:18.323 INFO:tasks.workunit.client.0.smithi017.stdout:4/501: link d15/d1d/d21/f72 d15/d1d/d21/fa7 0 2024-03-16T10:53:18.325 INFO:tasks.workunit.client.0.smithi017.stdout:4/502: write d15/d1d/d21/f4c [691248,45828] 0 2024-03-16T10:53:18.325 INFO:tasks.workunit.client.0.smithi017.stdout:9/296: creat d8/f59 x:0 0 0 2024-03-16T10:53:18.326 INFO:tasks.workunit.client.0.smithi017.stdout:1/673: mknod d1/d3/dd/d31/d66/dd7/dbc/ddb/ce5 0 2024-03-16T10:53:18.327 INFO:tasks.workunit.client.0.smithi017.stdout:1/674: fsync d1/d3/d57/f85 0 2024-03-16T10:53:18.327 INFO:tasks.workunit.client.0.smithi017.stdout:1/675: write d1/fae [503173,87374] 0 2024-03-16T10:53:18.328 INFO:tasks.workunit.client.0.smithi017.stdout:8/453: creat d6/d14/d72/f95 x:0 0 0 2024-03-16T10:53:18.329 INFO:tasks.workunit.client.0.smithi017.stdout:8/454: fsync d6/d5c/f71 0 2024-03-16T10:53:18.330 INFO:tasks.workunit.client.0.smithi017.stdout:7/427: mknod d7/c8d 0 2024-03-16T10:53:18.331 INFO:tasks.workunit.client.0.smithi017.stdout:7/428: dread d7/db/dc/d60/f6a [0,4194304] 0 2024-03-16T10:53:18.332 INFO:tasks.workunit.client.0.smithi017.stdout:5/593: unlink d0/d1/d2/d8c/f8f 0 2024-03-16T10:53:18.332 INFO:tasks.workunit.client.0.smithi017.stdout:5/594: chown d0/d1/d30/d55/f95 0 1 2024-03-16T10:53:18.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/431: mknod d0/d9/d45/d4d/d6d/d75/c8c 0 2024-03-16T10:53:18.338 INFO:tasks.workunit.client.0.smithi017.stdout:3/360: dwrite d8/da/db/f2a [0,4194304] 0 2024-03-16T10:53:18.339 INFO:tasks.workunit.client.0.smithi017.stdout:5/595: dread d0/d1/d30/f83 [0,4194304] 0 2024-03-16T10:53:18.340 INFO:tasks.workunit.client.0.smithi017.stdout:9/297: link d8/df/d46/f58 d8/df/d46/f5a 0 2024-03-16T10:53:18.342 INFO:tasks.workunit.client.0.smithi017.stdout:0/588: rename d2/d7 to d2/d4/d6d/d84/dc1/dd2 0 2024-03-16T10:53:18.342 INFO:tasks.workunit.client.0.smithi017.stdout:1/676: creat d1/d3/dd/fe6 x:0 0 0 2024-03-16T10:53:18.342 INFO:tasks.workunit.client.0.smithi017.stdout:1/677: readlink d1/d3/dd/d31/d35/l5a 0 2024-03-16T10:53:18.343 INFO:tasks.workunit.client.0.smithi017.stdout:4/503: dwrite d15/d1d/fa2 [0,4194304] 0 2024-03-16T10:53:18.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/678: creat d1/d3/dd/d31/d66/da1/de3/fe7 x:0 0 0 2024-03-16T10:53:18.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/679: stat d1/d3/f6f 0 2024-03-16T10:53:18.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/680: stat d1/d3/c6 0 2024-03-16T10:53:18.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/681: dread - d1/d24/fa7 zero size 2024-03-16T10:53:18.346 INFO:tasks.workunit.client.0.smithi017.stdout:3/361: dread d8/da/f31 [4194304,4194304] 0 2024-03-16T10:53:18.346 INFO:tasks.workunit.client.0.smithi017.stdout:0/589: read d2/d4/d6d/d84/dc1/dd2/d24/d3a/fc7 [2398710,73816] 0 2024-03-16T10:53:18.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/455: unlink d6/d5f/d6e/c42 0 2024-03-16T10:53:18.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/456: fsync d6/d14/d8c/f8b 0 2024-03-16T10:53:18.350 INFO:tasks.workunit.client.0.smithi017.stdout:0/590: dread d2/d4/d6d/d84/dc1/dd2/de/d19/f4c [0,4194304] 0 2024-03-16T10:53:18.350 INFO:tasks.workunit.client.0.smithi017.stdout:0/591: stat d2/d4/d6d/d84/dc1/dd2/d24/d3a/l7a 0 2024-03-16T10:53:18.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/298: dread d8/df/f1a [0,4194304] 0 2024-03-16T10:53:18.355 INFO:tasks.workunit.client.0.smithi017.stdout:5/596: truncate d0/f9 2643006 0 2024-03-16T10:53:18.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/429: rename d7/db/d12/d1c/f79 to d7/db/d12/f8e 0 2024-03-16T10:53:18.359 INFO:tasks.workunit.client.0.smithi017.stdout:4/504: dwrite d15/d1d/d21/d3c/d93/d40/f44 [0,4194304] 0 2024-03-16T10:53:18.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/430: dread - d7/d5a/f74 zero size 2024-03-16T10:53:18.359 INFO:tasks.workunit.client.0.smithi017.stdout:4/505: dread - d15/d1d/f75 zero size 2024-03-16T10:53:18.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/592: rename d2/d4/d6d/c89 to d2/d4/d6d/d84/dc1/dd2/d24/d3a/cd3 0 2024-03-16T10:53:18.361 INFO:tasks.workunit.client.0.smithi017.stdout:0/593: write d2/d4/d6d/d84/dc1/dd2/f64 [131998,112467] 0 2024-03-16T10:53:18.362 INFO:tasks.workunit.client.0.smithi017.stdout:0/594: rmdir d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b 39 2024-03-16T10:53:18.363 INFO:tasks.workunit.client.0.smithi017.stdout:0/595: readlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d88/l8b 0 2024-03-16T10:53:18.367 INFO:tasks.workunit.client.0.smithi017.stdout:3/362: mknod d8/d1b/d2e/d57/c71 0 2024-03-16T10:53:18.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/597: dwrite d0/d1/d30/d55/d6a/f7e [0,4194304] 0 2024-03-16T10:53:18.372 INFO:tasks.workunit.client.0.smithi017.stdout:8/457: mkdir d6/d5c/d96 0 2024-03-16T10:53:18.372 INFO:tasks.workunit.client.0.smithi017.stdout:8/458: write d6/d14/d6b/f6f [889844,99573] 0 2024-03-16T10:53:18.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/596: rmdir d2/d4/d90/d86/d8a 0 2024-03-16T10:53:18.375 INFO:tasks.workunit.client.0.smithi017.stdout:6/432: link d0/d15/d1f/l52 d0/d9/d45/d4d/d2c/l8d 0 2024-03-16T10:53:18.376 INFO:tasks.workunit.client.0.smithi017.stdout:1/682: getdents d1/d3/dd/d31/d66/dd3 0 2024-03-16T10:53:18.379 INFO:tasks.workunit.client.0.smithi017.stdout:7/431: creat d7/db/dc/d50/d59/f8f x:0 0 0 2024-03-16T10:53:18.380 INFO:tasks.workunit.client.0.smithi017.stdout:4/506: mkdir d15/d1d/d21/d3c/d93/d40/d51/d64/da8 0 2024-03-16T10:53:18.381 INFO:tasks.workunit.client.0.smithi017.stdout:3/363: dwrite d8/d1d/f46 [4194304,4194304] 0 2024-03-16T10:53:18.388 INFO:tasks.workunit.client.0.smithi017.stdout:5/598: creat d0/d93/fcf x:0 0 0 2024-03-16T10:53:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:6/433: dwrite d0/d9/f18 [0,4194304] 0 2024-03-16T10:53:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/459: truncate d6/d39/f30 1491553 0 2024-03-16T10:53:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/460: fdatasync d6/d14/f51 0 2024-03-16T10:53:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/461: chown d6/d39/d35/f47 27658 1 2024-03-16T10:53:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:4/507: dread d15/d1d/f3d [0,4194304] 0 2024-03-16T10:53:18.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/432: link d7/db/dc/d50/d59/l7f d7/d5a/l90 0 2024-03-16T10:53:18.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/433: write d7/db/dc/d50/f7c [22654,29855] 0 2024-03-16T10:53:18.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/434: read - d7/db/dc/d50/d59/f7e zero size 2024-03-16T10:53:18.393 INFO:tasks.workunit.client.0.smithi017.stdout:6/434: dread d0/f40 [0,4194304] 0 2024-03-16T10:53:18.401 INFO:tasks.workunit.client.0.smithi017.stdout:3/364: unlink d8/da/f58 0 2024-03-16T10:53:18.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/599: unlink d0/d1/d2/dc/d68/fcc 0 2024-03-16T10:53:18.406 INFO:tasks.workunit.client.0.smithi017.stdout:7/435: dwrite d7/db/dc/d60/f6a [0,4194304] 0 2024-03-16T10:53:18.407 INFO:tasks.workunit.client.0.smithi017.stdout:8/462: getdents d6 0 2024-03-16T10:53:18.409 INFO:tasks.workunit.client.0.smithi017.stdout:4/508: creat d15/d1d/d85/fa9 x:0 0 0 2024-03-16T10:53:18.411 INFO:tasks.workunit.client.0.smithi017.stdout:6/435: creat d0/f8e x:0 0 0 2024-03-16T10:53:18.412 INFO:tasks.workunit.client.0.smithi017.stdout:5/600: dread d0/d1/d2/d2c/d36/d41/da5/fad [4194304,4194304] 0 2024-03-16T10:53:18.412 INFO:tasks.workunit.client.0.smithi017.stdout:3/365: creat d8/d1b/d2e/d60/d63/f72 x:0 0 0 2024-03-16T10:53:18.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/436: creat d7/db/d81/f91 x:0 0 0 2024-03-16T10:53:18.419 INFO:tasks.workunit.client.0.smithi017.stdout:9/299: rename d8/d2d to d8/df/d5b 0 2024-03-16T10:53:18.421 INFO:tasks.workunit.client.0.smithi017.stdout:8/463: rmdir d6/d5f/d6e/d43 39 2024-03-16T10:53:18.421 INFO:tasks.workunit.client.0.smithi017.stdout:8/464: readlink d6/d39/d35/l2a 0 2024-03-16T10:53:18.421 INFO:tasks.workunit.client.0.smithi017.stdout:5/601: write d0/d1/d2/d2c/d38/f47 [2507540,49927] 0 2024-03-16T10:53:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:2/358: sync 2024-03-16T10:53:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:4/509: creat d15/d1d/d21/d3c/d93/d40/faa x:0 0 0 2024-03-16T10:53:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:4/510: chown d15/d1d/d21/d26/d66 75 1 2024-03-16T10:53:18.427 INFO:tasks.workunit.client.0.smithi017.stdout:6/436: creat d0/d9/d45/d4d/d6d/d75/d78/f8f x:0 0 0 2024-03-16T10:53:18.429 INFO:tasks.workunit.client.0.smithi017.stdout:3/366: truncate d8/d1b/d1c/f26 871420 0 2024-03-16T10:53:18.431 INFO:tasks.workunit.client.0.smithi017.stdout:9/300: link d8/f38 d8/df/d46/f5c 0 2024-03-16T10:53:18.431 INFO:tasks.workunit.client.0.smithi017.stdout:9/301: write d8/df/d46/f5a [615203,72319] 0 2024-03-16T10:53:18.431 INFO:tasks.workunit.client.0.smithi017.stdout:9/302: fsync d8/df/d5b/d32/f33 0 2024-03-16T10:53:18.431 INFO:tasks.workunit.client.0.smithi017.stdout:8/465: fsync d6/d5f/d6e/f50 0 2024-03-16T10:53:18.434 INFO:tasks.workunit.client.0.smithi017.stdout:2/359: symlink d4/d6/d30/d3f/l71 0 2024-03-16T10:53:18.434 INFO:tasks.workunit.client.0.smithi017.stdout:2/360: write d4/d6/db/d66/d2e/f3d [1028110,119109] 0 2024-03-16T10:53:18.435 INFO:tasks.workunit.client.0.smithi017.stdout:4/511: mkdir d15/d1d/d21/d26/d66/d8c/dab 0 2024-03-16T10:53:18.438 INFO:tasks.workunit.client.0.smithi017.stdout:6/437: truncate d0/d15/f17 5589763 0 2024-03-16T10:53:18.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/602: dwrite d0/f87 [0,4194304] 0 2024-03-16T10:53:18.439 INFO:tasks.workunit.client.0.smithi017.stdout:5/603: write d0/d1/d2/dc/d2f/fa3 [161091,105300] 0 2024-03-16T10:53:18.439 INFO:tasks.workunit.client.0.smithi017.stdout:5/604: fdatasync d0/d5d/f90 0 2024-03-16T10:53:18.439 INFO:tasks.workunit.client.0.smithi017.stdout:5/605: write d0/d1/d2/d2c/d36/d51/fc4 [80235,42970] 0 2024-03-16T10:53:18.443 INFO:tasks.workunit.client.0.smithi017.stdout:9/303: creat d8/df/d5b/f5d x:0 0 0 2024-03-16T10:53:18.445 INFO:tasks.workunit.client.0.smithi017.stdout:8/466: rmdir d6/d14 39 2024-03-16T10:53:18.446 INFO:tasks.workunit.client.0.smithi017.stdout:0/597: rename d2/d4/d90/dc2/lcd to d2/d4/d6d/d84/dc1/dd2/de/d19/ld4 0 2024-03-16T10:53:18.446 INFO:tasks.workunit.client.0.smithi017.stdout:2/361: dwrite d4/d6/db/f11 [0,4194304] 0 2024-03-16T10:53:18.448 INFO:tasks.workunit.client.0.smithi017.stdout:4/512: unlink d15/d1d/d21/d26/l73 0 2024-03-16T10:53:18.449 INFO:tasks.workunit.client.0.smithi017.stdout:4/513: truncate d15/d1d/d85/fa9 948685 0 2024-03-16T10:53:18.451 INFO:tasks.workunit.client.0.smithi017.stdout:6/438: creat d0/d15/d1f/d7d/d87/f90 x:0 0 0 2024-03-16T10:53:18.455 INFO:tasks.workunit.client.0.smithi017.stdout:2/362: dwrite d4/f25 [0,4194304] 0 2024-03-16T10:53:18.459 INFO:tasks.workunit.client.0.smithi017.stdout:5/606: rmdir d0/d1/d2/dc/d2f/d37/d42/d46/db5 0 2024-03-16T10:53:18.463 INFO:tasks.workunit.client.0.smithi017.stdout:9/304: mkdir d8/df/d5b/d5e 0 2024-03-16T10:53:18.463 INFO:tasks.workunit.client.0.smithi017.stdout:9/305: chown d8/df/c14 0 1 2024-03-16T10:53:18.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/367: write d8/f52 [2859036,26654] 0 2024-03-16T10:53:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:3/368: read d8/d1b/d1c/f4d [758759,112278] 0 2024-03-16T10:53:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:6/439: dwrite d0/d22/f79 [0,4194304] 0 2024-03-16T10:53:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:8/467: creat d6/d5f/f97 x:0 0 0 2024-03-16T10:53:18.466 INFO:tasks.workunit.client.0.smithi017.stdout:6/440: truncate d0/d15/f3d 224120 0 2024-03-16T10:53:18.466 INFO:tasks.workunit.client.0.smithi017.stdout:6/441: chown d0/d9/d45/d4d/d2c/d41/d86 1574639 1 2024-03-16T10:53:18.466 INFO:tasks.workunit.client.0.smithi017.stdout:8/468: write d6/f4e [4741866,127196] 0 2024-03-16T10:53:18.466 INFO:tasks.workunit.client.0.smithi017.stdout:8/469: chown d6/d39/d35/c91 1775290 1 2024-03-16T10:53:18.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/514: creat d15/d1d/d21/d3c/d93/d40/d51/d64/d63/fac x:0 0 0 2024-03-16T10:53:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:2/363: symlink d4/dd/l72 0 2024-03-16T10:53:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:2/364: fsync d4/dd/d1e/d3e/d51/f5c 0 2024-03-16T10:53:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:8/470: read d6/d5f/f33 [1141174,36332] 0 2024-03-16T10:53:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:8/471: chown d6/d4a/c87 15383352 1 2024-03-16T10:53:18.476 INFO:tasks.workunit.client.0.smithi017.stdout:5/607: creat d0/d1/d2/d2c/d36/d51/fd0 x:0 0 0 2024-03-16T10:53:18.478 INFO:tasks.workunit.client.0.smithi017.stdout:4/515: dread d15/f59 [0,4194304] 0 2024-03-16T10:53:18.478 INFO:tasks.workunit.client.0.smithi017.stdout:8/472: dread d6/d5f/d6e/d34/f52 [0,4194304] 0 2024-03-16T10:53:18.479 INFO:tasks.workunit.client.0.smithi017.stdout:8/473: readlink d6/d16/d6c/l82 0 2024-03-16T10:53:18.479 INFO:tasks.workunit.client.0.smithi017.stdout:9/306: getdents d8/df/d46 0 2024-03-16T10:53:18.481 INFO:tasks.workunit.client.0.smithi017.stdout:3/369: truncate d8/da/f31 5602384 0 2024-03-16T10:53:18.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/370: dread d8/d1b/f29 [0,4194304] 0 2024-03-16T10:53:18.488 INFO:tasks.workunit.client.0.smithi017.stdout:8/474: dread d6/d14/f69 [0,4194304] 0 2024-03-16T10:53:18.489 INFO:tasks.workunit.client.0.smithi017.stdout:0/598: mkdir d2/d4/d90/d86/db7/dc0/dd5 0 2024-03-16T10:53:18.489 INFO:tasks.workunit.client.0.smithi017.stdout:0/599: truncate d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/fcb 151994 0 2024-03-16T10:53:18.489 INFO:tasks.workunit.client.0.smithi017.stdout:0/600: truncate d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 272321 0 2024-03-16T10:53:18.489 INFO:tasks.workunit.client.0.smithi017.stdout:0/601: readlink d2/d4/d90/d86/la8 0 2024-03-16T10:53:18.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/602: dread d2/d4/d6d/d84/dc1/dd2/d24/d3a/f60 [0,4194304] 0 2024-03-16T10:53:18.493 INFO:tasks.workunit.client.0.smithi017.stdout:3/371: creat d8/d1b/f73 x:0 0 0 2024-03-16T10:53:18.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/475: truncate d6/d5f/d6e/d34/f76 816115 0 2024-03-16T10:53:18.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/603: dread d2/d4/f82 [0,4194304] 0 2024-03-16T10:53:18.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/476: dread - d6/d14/d72/f95 zero size 2024-03-16T10:53:18.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/516: dwrite d15/d1d/f5d [0,4194304] 0 2024-03-16T10:53:18.496 INFO:tasks.workunit.client.0.smithi017.stdout:4/517: dread d15/d1d/d21/d3c/d93/f3a [0,4194304] 0 2024-03-16T10:53:18.496 INFO:tasks.workunit.client.0.smithi017.stdout:4/518: write d15/d1d/d27/f78 [152415,103363] 0 2024-03-16T10:53:18.496 INFO:tasks.workunit.client.0.smithi017.stdout:9/307: mknod d8/df/d5b/d32/d45/c5f 0 2024-03-16T10:53:18.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/372: getdents d8/d1b/d2e/d60 0 2024-03-16T10:53:18.500 INFO:tasks.workunit.client.0.smithi017.stdout:9/308: creat d8/df/f60 x:0 0 0 2024-03-16T10:53:18.501 INFO:tasks.workunit.client.0.smithi017.stdout:0/604: dread d2/d4/d6d/d84/dc1/dd2/f63 [0,4194304] 0 2024-03-16T10:53:18.502 INFO:tasks.workunit.client.0.smithi017.stdout:3/373: creat d8/d1b/d2e/d60/f74 x:0 0 0 2024-03-16T10:53:18.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/309: creat d8/df/d5b/d32/d45/f61 x:0 0 0 2024-03-16T10:53:18.506 INFO:tasks.workunit.client.0.smithi017.stdout:0/605: symlink d2/d4/d6d/d84/dc1/dd2/de/d19/ld6 0 2024-03-16T10:53:18.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/310: creat d8/df/d5b/f62 x:0 0 0 2024-03-16T10:53:18.507 INFO:tasks.workunit.client.0.smithi017.stdout:0/606: symlink d2/d4/d90/dc2/dc8/ld7 0 2024-03-16T10:53:18.508 INFO:tasks.workunit.client.0.smithi017.stdout:9/311: rmdir d8/df/d46 39 2024-03-16T10:53:18.508 INFO:tasks.workunit.client.0.smithi017.stdout:9/312: chown d8/df/d5b/d32/f50 15 1 2024-03-16T10:53:18.508 INFO:tasks.workunit.client.0.smithi017.stdout:3/374: dread d8/da/f59 [0,4194304] 0 2024-03-16T10:53:18.510 INFO:tasks.workunit.client.0.smithi017.stdout:8/477: dwrite d6/d14/d8c/f80 [0,4194304] 0 2024-03-16T10:53:18.510 INFO:tasks.workunit.client.0.smithi017.stdout:9/313: mkdir d8/df/d46/d63 0 2024-03-16T10:53:18.514 INFO:tasks.workunit.client.0.smithi017.stdout:8/478: getdents d6/d16/d6c 0 2024-03-16T10:53:18.514 INFO:tasks.workunit.client.0.smithi017.stdout:8/479: dread - d6/d16/f86 zero size 2024-03-16T10:53:18.514 INFO:tasks.workunit.client.0.smithi017.stdout:8/480: write d6/d39/f32 [5775106,104312] 0 2024-03-16T10:53:18.515 INFO:tasks.workunit.client.0.smithi017.stdout:9/314: mknod d8/df/d46/c64 0 2024-03-16T10:53:18.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/481: rmdir d6/d5f 39 2024-03-16T10:53:18.519 INFO:tasks.workunit.client.0.smithi017.stdout:1/683: rename d1/d3/dd/d72/d8f/fb3 to d1/d24/fe8 0 2024-03-16T10:53:18.519 INFO:tasks.workunit.client.0.smithi017.stdout:1/684: dread - d1/d3/dd/d31/d66/dd7/dbc/fe1 zero size 2024-03-16T10:53:18.521 INFO:tasks.workunit.client.0.smithi017.stdout:8/482: mkdir d6/d5c/d96/d98 0 2024-03-16T10:53:18.522 INFO:tasks.workunit.client.0.smithi017.stdout:9/315: mknod d8/df/d5b/d32/d45/c65 0 2024-03-16T10:53:18.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/442: rename d0/d9/c88 to d0/d21/d39/d44/c91 0 2024-03-16T10:53:18.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/443: read - d0/d9/d45/d4d/d2e/d69/f89 zero size 2024-03-16T10:53:18.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/444: dread - d0/f6a zero size 2024-03-16T10:53:18.525 INFO:tasks.workunit.client.0.smithi017.stdout:3/375: dwrite f3 [0,4194304] 0 2024-03-16T10:53:18.526 INFO:tasks.workunit.client.0.smithi017.stdout:0/607: dwrite d2/d4/f1c [0,4194304] 0 2024-03-16T10:53:18.526 INFO:tasks.workunit.client.0.smithi017.stdout:1/685: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/fe9 x:0 0 0 2024-03-16T10:53:18.528 INFO:tasks.workunit.client.0.smithi017.stdout:1/686: rmdir d1/d3/dd/d31/d66/da1/de3 39 2024-03-16T10:53:18.529 INFO:tasks.workunit.client.0.smithi017.stdout:0/608: creat d2/d4/d6d/d84/dc1/fd8 x:0 0 0 2024-03-16T10:53:18.529 INFO:tasks.workunit.client.0.smithi017.stdout:0/609: write d2/d4/f82 [2826641,72390] 0 2024-03-16T10:53:18.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/316: mkdir d8/df/d66 0 2024-03-16T10:53:18.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/317: chown d8/l3e 226901 1 2024-03-16T10:53:18.529 INFO:tasks.workunit.client.0.smithi017.stdout:0/610: write d2/d4/d90/d86/db7/fc4 [442116,33385] 0 2024-03-16T10:53:18.530 INFO:tasks.workunit.client.0.smithi017.stdout:0/611: symlink d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/ld9 0 2024-03-16T10:53:18.530 INFO:tasks.workunit.client.0.smithi017.stdout:0/612: chown d2/d4/d6d/d84/dc1/dd2/f1a 1652 1 2024-03-16T10:53:18.531 INFO:tasks.workunit.client.0.smithi017.stdout:5/608: rename d0/d1/d1f/d29/l71 to d0/d1/d2/d70/ld1 0 2024-03-16T10:53:18.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/613: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 [162298,53886] 0 2024-03-16T10:53:18.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/614: fsync d2/d4/d6d/d84/dc1/dd2/d24/d29/f8f 0 2024-03-16T10:53:18.533 INFO:tasks.workunit.client.0.smithi017.stdout:6/445: unlink d0/d22/c66 0 2024-03-16T10:53:18.533 INFO:tasks.workunit.client.0.smithi017.stdout:0/615: getdents d2/d4/d90/d86 0 2024-03-16T10:53:18.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/376: mkdir d8/d3f/d3d/d75 0 2024-03-16T10:53:18.538 INFO:tasks.workunit.client.0.smithi017.stdout:4/519: rename d15/d1d/f1e to d15/d1d/d21/d3c/d93/d40/d51/d64/d76/fad 0 2024-03-16T10:53:18.538 INFO:tasks.workunit.client.0.smithi017.stdout:4/520: dread - d15/d1d/f75 zero size 2024-03-16T10:53:18.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/483: dwrite d6/d16/f70 [0,4194304] 0 2024-03-16T10:53:18.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/484: write d6/d5c/f8f [4621486,121203] 0 2024-03-16T10:53:18.542 INFO:tasks.workunit.client.0.smithi017.stdout:6/446: link d0/d21/f7c d0/d9/d45/d4d/f92 0 2024-03-16T10:53:18.542 INFO:tasks.workunit.client.0.smithi017.stdout:6/447: chown d0/d22/c42 7795808 1 2024-03-16T10:53:18.542 INFO:tasks.workunit.client.0.smithi017.stdout:6/448: write d0/d21/d39/d44/f70 [337457,54595] 0 2024-03-16T10:53:18.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/609: dread d0/f27 [0,4194304] 0 2024-03-16T10:53:18.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/610: chown d0/d1/d2/l32 241 1 2024-03-16T10:53:18.549 INFO:tasks.workunit.client.0.smithi017.stdout:9/318: dwrite d8/df/f1a [8388608,4194304] 0 2024-03-16T10:53:18.549 INFO:tasks.workunit.client.0.smithi017.stdout:9/319: fdatasync d8/f30 0 2024-03-16T10:53:18.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/687: link d1/d50/d61/l4f d1/d3/dd/d31/d66/dd3/lea 0 2024-03-16T10:53:18.554 INFO:tasks.workunit.client.0.smithi017.stdout:5/611: dread d0/d1/d2/d2c/d36/d51/f67 [0,4194304] 0 2024-03-16T10:53:18.554 INFO:tasks.workunit.client.0.smithi017.stdout:6/449: truncate d0/f3c 4666725 0 2024-03-16T10:53:18.555 INFO:tasks.workunit.client.0.smithi017.stdout:0/616: rmdir d2/d4/d6d/d84/dc1/dd2/de/d1e 39 2024-03-16T10:53:18.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/320: creat d8/df/d5b/d32/f67 x:0 0 0 2024-03-16T10:53:18.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/321: fsync d8/df/d5b/f3b 0 2024-03-16T10:53:18.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/322: stat d8/df/d5b/d32/f39 0 2024-03-16T10:53:18.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/323: readlink d8/l27 0 2024-03-16T10:53:18.557 INFO:tasks.workunit.client.0.smithi017.stdout:0/617: creat d2/d4/d6d/fda x:0 0 0 2024-03-16T10:53:18.559 INFO:tasks.workunit.client.0.smithi017.stdout:5/612: mknod d0/d1/d1f/d29/d99/cd2 0 2024-03-16T10:53:18.561 INFO:tasks.workunit.client.0.smithi017.stdout:8/485: dwrite d6/d14/f69 [4194304,4194304] 0 2024-03-16T10:53:18.562 INFO:tasks.workunit.client.0.smithi017.stdout:3/377: dwrite d8/da/db/f19 [0,4194304] 0 2024-03-16T10:53:18.562 INFO:tasks.workunit.client.0.smithi017.stdout:3/378: write d8/d1b/d1c/f41 [575016,97651] 0 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: pgmap v425: 97 pgs: 97 active+clean; 782 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 117 MiB/s wr, 772 op/s 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:18.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.564 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:18.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: Scrub error on inode 0x10000002504 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.565 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:18 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.565 INFO:tasks.workunit.client.0.smithi017.stdout:6/450: creat d0/d9/d45/d4d/d2e/d69/d7e/f93 x:0 0 0 2024-03-16T10:53:18.565 INFO:tasks.workunit.client.0.smithi017.stdout:1/688: getdents d1/d3/dd/d31/d66/dd7 0 2024-03-16T10:53:18.566 INFO:tasks.workunit.client.0.smithi017.stdout:9/324: dwrite d8/df/d5b/d32/f67 [0,4194304] 0 2024-03-16T10:53:18.567 INFO:tasks.workunit.client.0.smithi017.stdout:5/613: getdents d0/d1/d2/d70 0 2024-03-16T10:53:18.568 INFO:tasks.workunit.client.0.smithi017.stdout:8/486: rmdir d6 39 2024-03-16T10:53:18.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/379: dread d8/f17 [0,4194304] 0 2024-03-16T10:53:18.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/380: chown d8/da/l37 10 1 2024-03-16T10:53:18.572 INFO:tasks.workunit.client.0.smithi017.stdout:6/451: link d0/d15/d1f/l52 d0/d9/d45/d4d/l94 0 2024-03-16T10:53:18.577 INFO:tasks.workunit.client.0.smithi017.stdout:1/689: mknod d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/ceb 0 2024-03-16T10:53:18.577 INFO:tasks.workunit.client.0.smithi017.stdout:5/614: dread d0/d1/d2/d2c/d38/f3b [0,4194304] 0 2024-03-16T10:53:18.582 INFO:tasks.workunit.client.0.smithi017.stdout:9/325: truncate d8/df/d5b/d32/f39 2432016 0 2024-03-16T10:53:18.583 INFO:tasks.workunit.client.0.smithi017.stdout:8/487: symlink d6/d5f/d6e/d34/l99 0 2024-03-16T10:53:18.584 INFO:tasks.workunit.client.0.smithi017.stdout:8/488: stat d6/d5f/d6e/d34/f76 0 2024-03-16T10:53:18.584 INFO:tasks.workunit.client.0.smithi017.stdout:8/489: write d6/d16/f2d [804905,95023] 0 2024-03-16T10:53:18.585 INFO:tasks.workunit.client.0.smithi017.stdout:6/452: truncate d0/d15/f1c 593651 0 2024-03-16T10:53:18.585 INFO:tasks.workunit.client.0.smithi017.stdout:6/453: dread - d0/d9/d45/d4d/d2e/d69/d7e/f8a zero size 2024-03-16T10:53:18.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/454: dread d0/d9/f7b [0,4194304] 0 2024-03-16T10:53:18.587 INFO:tasks.workunit.client.0.smithi017.stdout:3/381: dwrite d8/da/db/f50 [0,4194304] 0 2024-03-16T10:53:18.588 INFO:tasks.workunit.client.0.smithi017.stdout:5/615: creat d0/d1/fd3 x:0 0 0 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: pgmap v425: 97 pgs: 97 active+clean; 782 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 117 MiB/s wr, 772 op/s 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: Scrub error on inode 0x10000002504 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.592 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:18 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/326: mkdir d8/df/d5b/d5e/d68 0 2024-03-16T10:53:18.593 INFO:tasks.workunit.client.0.smithi017.stdout:5/616: dread d0/d1/d1f/d97/fca [0,4194304] 0 2024-03-16T10:53:18.595 INFO:tasks.workunit.client.0.smithi017.stdout:0/618: unlink d2/d4/d6d/d84/dc1/dd2/de/ff 0 2024-03-16T10:53:18.595 INFO:tasks.workunit.client.0.smithi017.stdout:0/619: write d2/d4/d90/d86/fb8 [993750,58627] 0 2024-03-16T10:53:18.595 INFO:tasks.workunit.client.0.smithi017.stdout:0/620: stat d2/f8c 0 2024-03-16T10:53:18.597 INFO:tasks.workunit.client.0.smithi017.stdout:8/490: truncate d6/d5f/d6e/d34/f3f 1833252 0 2024-03-16T10:53:18.597 INFO:tasks.workunit.client.0.smithi017.stdout:0/621: creat d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/fdb x:0 0 0 2024-03-16T10:53:18.597 INFO:tasks.workunit.client.0.smithi017.stdout:6/455: mkdir d0/d21/d39/d44/d95 0 2024-03-16T10:53:18.599 INFO:tasks.workunit.client.0.smithi017.stdout:1/690: rename d1/d3/d57/f85 to d1/d3/dd/d31/d66/dd3/fec 0 2024-03-16T10:53:18.601 INFO:tasks.workunit.client.0.smithi017.stdout:0/622: read d2/d4/d6d/f7f [3962128,55556] 0 2024-03-16T10:53:18.603 INFO:tasks.workunit.client.0.smithi017.stdout:5/617: dwrite d0/d1/d2/d2c/d36/d51/fc4 [0,4194304] 0 2024-03-16T10:53:18.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/327: mknod d8/df/c69 0 2024-03-16T10:53:18.606 INFO:tasks.workunit.client.0.smithi017.stdout:8/491: mknod d6/d5f/d6e/d43/c9a 0 2024-03-16T10:53:18.608 INFO:tasks.workunit.client.0.smithi017.stdout:6/456: mkdir d0/d9/d96 0 2024-03-16T10:53:18.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/382: rename d8/d1b/d1c/f61 to d8/d3f/d3d/f76 0 2024-03-16T10:53:18.614 INFO:tasks.workunit.client.0.smithi017.stdout:5/618: rmdir d0/d1/d2/d2c 39 2024-03-16T10:53:18.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/437: sync 2024-03-16T10:53:18.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/438: rename d7/db/dc/d50 to d7/db/dc/d50/d92 22 2024-03-16T10:53:18.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/439: write d7/db/f52 [1514558,9645] 0 2024-03-16T10:53:18.615 INFO:tasks.workunit.client.0.smithi017.stdout:9/328: symlink d8/df/d66/l6a 0 2024-03-16T10:53:18.617 INFO:tasks.workunit.client.0.smithi017.stdout:6/457: mkdir d0/d9/d45/d4d/d2c/d41/d97 0 2024-03-16T10:53:18.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/383: mknod d8/d1b/d2e/d57/c77 0 2024-03-16T10:53:18.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/619: truncate d0/d1/d2/dc/d2f/d37/d57/f8b 529133 0 2024-03-16T10:53:18.619 INFO:tasks.workunit.client.0.smithi017.stdout:5/620: fdatasync d0/d1/d2/dc/f49 0 2024-03-16T10:53:18.621 INFO:tasks.workunit.client.0.smithi017.stdout:6/458: rename d0/d9/d45/d4d/d2c/d41/c6f to d0/d22/c98 0 2024-03-16T10:53:18.622 INFO:tasks.workunit.client.0.smithi017.stdout:6/459: read - d0/d9/d38/f63 zero size 2024-03-16T10:53:18.622 INFO:tasks.workunit.client.0.smithi017.stdout:1/691: dwrite d1/d3/d57/d94/fb5 [0,4194304] 0 2024-03-16T10:53:18.622 INFO:tasks.workunit.client.0.smithi017.stdout:1/692: truncate d1/d3/dd/fc4 715610 0 2024-03-16T10:53:18.622 INFO:tasks.workunit.client.0.smithi017.stdout:1/693: chown d1/d3/de/l11 15757 1 2024-03-16T10:53:18.622 INFO:tasks.workunit.client.0.smithi017.stdout:1/694: stat d1 0 2024-03-16T10:53:18.623 INFO:tasks.workunit.client.0.smithi017.stdout:1/695: readlink d1/d3/l83 0 2024-03-16T10:53:18.625 INFO:tasks.workunit.client.0.smithi017.stdout:0/623: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 [0,4194304] 0 2024-03-16T10:53:18.625 INFO:tasks.workunit.client.0.smithi017.stdout:3/384: rename d8/d1b/f29 to d8/d1b/d1c/d62/d69/f78 0 2024-03-16T10:53:18.625 INFO:tasks.workunit.client.0.smithi017.stdout:3/385: readlink d8/d1d/l25 0 2024-03-16T10:53:18.628 INFO:tasks.workunit.client.0.smithi017.stdout:0/624: link d2/d4/d6d/d84/caf d2/d4/d6d/d84/cdc 0 2024-03-16T10:53:18.629 INFO:tasks.workunit.client.0.smithi017.stdout:5/621: write d0/d1/d2/d2c/d38/f3b [1764261,115287] 0 2024-03-16T10:53:18.629 INFO:tasks.workunit.client.0.smithi017.stdout:5/622: truncate d0/d1/d1f/f9a 119204 0 2024-03-16T10:53:18.630 INFO:tasks.workunit.client.0.smithi017.stdout:5/623: write d0/d1/d2/d2c/d38/f47 [1519281,29745] 0 2024-03-16T10:53:18.630 INFO:tasks.workunit.client.0.smithi017.stdout:1/696: dread d1/d3/dd/f77 [0,4194304] 0 2024-03-16T10:53:18.630 INFO:tasks.workunit.client.0.smithi017.stdout:6/460: dread d0/d15/d1f/f60 [0,4194304] 0 2024-03-16T10:53:18.633 INFO:tasks.workunit.client.0.smithi017.stdout:5/624: creat d0/d1/d2/d2c/d36/fd4 x:0 0 0 2024-03-16T10:53:18.633 INFO:tasks.workunit.client.0.smithi017.stdout:0/625: mkdir d2/d4/d61/ddd 0 2024-03-16T10:53:18.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/440: dwrite d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:18.635 INFO:tasks.workunit.client.0.smithi017.stdout:0/626: write d2/d4/d6d/d84/dc1/dd2/de/d19/f4c [444504,105304] 0 2024-03-16T10:53:18.635 INFO:tasks.workunit.client.0.smithi017.stdout:0/627: fsync d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd 0 2024-03-16T10:53:18.635 INFO:tasks.workunit.client.0.smithi017.stdout:0/628: fsync d2/d4/d6d/fda 0 2024-03-16T10:53:18.636 INFO:tasks.workunit.client.0.smithi017.stdout:3/386: creat d8/d1b/d2e/d60/d63/f79 x:0 0 0 2024-03-16T10:53:18.636 INFO:tasks.workunit.client.0.smithi017.stdout:3/387: chown d8/da 112904 1 2024-03-16T10:53:18.636 INFO:tasks.workunit.client.0.smithi017.stdout:3/388: write d8/f17 [4248850,59661] 0 2024-03-16T10:53:18.637 INFO:tasks.workunit.client.0.smithi017.stdout:5/625: dread d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:18.648 INFO:tasks.workunit.client.0.smithi017.stdout:1/697: link d1/d3/dd/d31/d35/f75 d1/d3/dd/d31/d66/dd7/fed 0 2024-03-16T10:53:18.648 INFO:tasks.workunit.client.0.smithi017.stdout:1/698: chown d1/d3/dd/d72/fd9 29 1 2024-03-16T10:53:18.649 INFO:tasks.workunit.client.0.smithi017.stdout:5/626: mkdir d0/d1/d1f/d29/dd5 0 2024-03-16T10:53:18.653 INFO:tasks.workunit.client.0.smithi017.stdout:3/389: dwrite d8/da/f31 [4194304,4194304] 0 2024-03-16T10:53:18.653 INFO:tasks.workunit.client.0.smithi017.stdout:3/390: stat d8/d1d/l3c 0 2024-03-16T10:53:18.654 INFO:tasks.workunit.client.0.smithi017.stdout:3/391: chown d8/da/f59 19 1 2024-03-16T10:53:18.654 INFO:tasks.workunit.client.0.smithi017.stdout:0/629: dwrite d2/d4/d90/d86/f91 [0,4194304] 0 2024-03-16T10:53:18.655 INFO:tasks.workunit.client.0.smithi017.stdout:7/441: dwrite d7/db/dc/f10 [0,4194304] 0 2024-03-16T10:53:18.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/699: creat d1/fee x:0 0 0 2024-03-16T10:53:18.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/700: fdatasync d1/d3/dd/d72/f80 0 2024-03-16T10:53:18.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/701: readlink d1/l7b 0 2024-03-16T10:53:18.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/627: symlink d0/d1/d1f/ld6 0 2024-03-16T10:53:18.657 INFO:tasks.workunit.client.0.smithi017.stdout:0/630: mkdir d2/d4/d6d/dde 0 2024-03-16T10:53:18.659 INFO:tasks.workunit.client.0.smithi017.stdout:0/631: mkdir d2/da1/ddf 0 2024-03-16T10:53:18.661 INFO:tasks.workunit.client.0.smithi017.stdout:7/442: rename f1 to d7/db/f93 0 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: pgmap v425: 97 pgs: 97 active+clean; 782 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 117 MiB/s wr, 772 op/s 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.a log and `damage ls` output for details 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c) see mds.i log and `damage ls` output for details 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] up:active 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.664 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:18.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: Scrub error on inode 0x10000002504 (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile) see mds.h log and `damage ls` output for details 2024-03-16T10:53:18.665 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:18 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:18.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/443: dread d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:18.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/444: read d7/db/d12/f8e [190984,40762] 0 2024-03-16T10:53:18.667 INFO:tasks.workunit.client.0.smithi017.stdout:5/628: rename d0/d1/d2/dc/d2f/d37/d42/d46/f69 to d0/d1/d30/d55/daf/fd7 0 2024-03-16T10:53:18.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/702: dread d1/d3/dd/d31/d35/f38 [0,4194304] 0 2024-03-16T10:53:18.668 INFO:tasks.workunit.client.0.smithi017.stdout:2/365: sync 2024-03-16T10:53:18.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/629: symlink d0/d1/d2/dc/d68/ld8 0 2024-03-16T10:53:18.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/630: chown d0/d1/d1f/c43 0 1 2024-03-16T10:53:18.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/631: stat d0/d93/f66 0 2024-03-16T10:53:18.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/632: write d0/d1/d30/d55/d6a/f7f [353915,18449] 0 2024-03-16T10:53:18.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/633: rmdir d0/d1/d2/dc 39 2024-03-16T10:53:18.671 INFO:tasks.workunit.client.0.smithi017.stdout:5/634: dread - d0/d1/fd3 zero size 2024-03-16T10:53:18.671 INFO:tasks.workunit.client.0.smithi017.stdout:2/366: rmdir d4/d6/db/d24/d39 39 2024-03-16T10:53:18.671 INFO:tasks.workunit.client.0.smithi017.stdout:2/367: truncate d4/dd/df/f15 1708308 0 2024-03-16T10:53:18.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/635: symlink d0/d1/d2/d2c/d36/d41/da5/ld9 0 2024-03-16T10:53:18.672 INFO:tasks.workunit.client.0.smithi017.stdout:1/703: dread d1/d50/d8d/fc5 [4194304,4194304] 0 2024-03-16T10:53:18.674 INFO:tasks.workunit.client.0.smithi017.stdout:3/392: dwrite d8/d1b/d1c/f54 [0,4194304] 0 2024-03-16T10:53:18.674 INFO:tasks.workunit.client.0.smithi017.stdout:3/393: chown d8/f17 266 1 2024-03-16T10:53:18.674 INFO:tasks.workunit.client.0.smithi017.stdout:5/636: mkdir d0/d1/d1f/d29/d88/d91/dda 0 2024-03-16T10:53:18.675 INFO:tasks.workunit.client.0.smithi017.stdout:1/704: mkdir d1/d3/dd/d31/d35/def 0 2024-03-16T10:53:18.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/445: link d7/db/dc/d50/d59/d34/l35 d7/db/dc/d50/d59/d34/l94 0 2024-03-16T10:53:18.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/446: fdatasync d7/db/dc/f17 0 2024-03-16T10:53:18.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/447: dread - d7/db/dc/d50/d59/f7e zero size 2024-03-16T10:53:18.677 INFO:tasks.workunit.client.0.smithi017.stdout:1/705: symlink d1/d3/dd/d31/d66/da1/de3/lf0 0 2024-03-16T10:53:18.679 INFO:tasks.workunit.client.0.smithi017.stdout:5/637: link d0/d1/d2/dc/d2f/d37/l3e d0/d1/d2/ldb 0 2024-03-16T10:53:18.679 INFO:tasks.workunit.client.0.smithi017.stdout:5/638: write d0/f9 [3027565,96727] 0 2024-03-16T10:53:18.682 INFO:tasks.workunit.client.0.smithi017.stdout:0/632: dwrite d2/d4/d90/fb1 [0,4194304] 0 2024-03-16T10:53:18.683 INFO:tasks.workunit.client.0.smithi017.stdout:3/394: rename f7 to d8/f7a 0 2024-03-16T10:53:18.685 INFO:tasks.workunit.client.0.smithi017.stdout:2/368: dwrite d4/d6/d30/d3f/f54 [0,4194304] 0 2024-03-16T10:53:18.685 INFO:tasks.workunit.client.0.smithi017.stdout:1/706: creat d1/d24/ff1 x:0 0 0 2024-03-16T10:53:18.685 INFO:tasks.workunit.client.0.smithi017.stdout:1/707: stat d1/d50/d8d/cc0 0 2024-03-16T10:53:18.686 INFO:tasks.workunit.client.0.smithi017.stdout:3/395: write d8/d1b/d1c/d62/d69/f78 [3420560,122082] 0 2024-03-16T10:53:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/639: getdents d0/d5d 0 2024-03-16T10:53:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:1/708: unlink d1/d24/d79/fdd 0 2024-03-16T10:53:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:1/709: dread - d1/d3/d88/fd4 zero size 2024-03-16T10:53:18.692 INFO:tasks.workunit.client.0.smithi017.stdout:2/369: creat d4/dd/f73 x:0 0 0 2024-03-16T10:53:18.693 INFO:tasks.workunit.client.0.smithi017.stdout:2/370: fsync d4/d6/db/d66/d29/f4e 0 2024-03-16T10:53:18.693 INFO:tasks.workunit.client.0.smithi017.stdout:5/640: dread d0/d1/f16 [0,4194304] 0 2024-03-16T10:53:18.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/633: dwrite d2/d4/d6d/d84/fa0 [0,4194304] 0 2024-03-16T10:53:18.697 INFO:tasks.workunit.client.0.smithi017.stdout:1/710: unlink d1/d3/d57/d94/fc6 0 2024-03-16T10:53:18.699 INFO:tasks.workunit.client.0.smithi017.stdout:5/641: write d0/d1/d2/dc/d2f/f89 [2909086,21399] 0 2024-03-16T10:53:18.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/396: truncate d8/f17 2548381 0 2024-03-16T10:53:18.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/397: write d8/d1b/d2e/d60/d63/f72 [35971,126378] 0 2024-03-16T10:53:18.703 INFO:tasks.workunit.client.0.smithi017.stdout:0/634: write d2/d4/d6d/d84/fa0 [3095536,65172] 0 2024-03-16T10:53:18.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/635: truncate d2/d4/d90/d86/f5a 1487188 0 2024-03-16T10:53:18.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/636: fsync d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/fa2 0 2024-03-16T10:53:18.706 INFO:tasks.workunit.client.0.smithi017.stdout:5/642: rename d0/d1/d2/d2c/f60 to d0/d1/d2/d2c/d36/d41/da5/dc6/fdc 0 2024-03-16T10:53:18.708 INFO:tasks.workunit.client.0.smithi017.stdout:2/371: truncate d4/d6/d30/d3f/f54 2711152 0 2024-03-16T10:53:18.709 INFO:tasks.workunit.client.0.smithi017.stdout:5/643: dread d0/f27 [0,4194304] 0 2024-03-16T10:53:18.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/398: getdents d8/da/db 0 2024-03-16T10:53:18.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/399: write d8/d1b/d1c/f4d [1707642,102226] 0 2024-03-16T10:53:18.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/372: rmdir d4/dd/df 39 2024-03-16T10:53:18.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/373: chown d4/dd/d1e/d3e/l4f 2 1 2024-03-16T10:53:18.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/374: fdatasync d4/d6/db/d66/d2e/f59 0 2024-03-16T10:53:18.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/375: write d4/dd/f18 [4727017,122824] 0 2024-03-16T10:53:18.722 INFO:tasks.workunit.client.0.smithi017.stdout:2/376: symlink d4/dd/df/l74 0 2024-03-16T10:53:18.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/377: chown d4/d6/d30/d3f 3107 1 2024-03-16T10:53:18.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/378: fsync d4/d6/db/d66/f5d 0 2024-03-16T10:53:18.724 INFO:tasks.workunit.client.0.smithi017.stdout:0/637: rename d2/d4/d61/dc9 to d2/d4/d61/de0 0 2024-03-16T10:53:18.724 INFO:tasks.workunit.client.0.smithi017.stdout:0/638: chown d2/d4/d6d/d84/dc1/dd2/c68 16376 1 2024-03-16T10:53:18.725 INFO:tasks.workunit.client.0.smithi017.stdout:3/400: dwrite d8/da/f36 [4194304,4194304] 0 2024-03-16T10:53:18.725 INFO:tasks.workunit.client.0.smithi017.stdout:2/379: mkdir d4/d6/d30/d75 0 2024-03-16T10:53:18.725 INFO:tasks.workunit.client.0.smithi017.stdout:5/644: dwrite d0/d1/d30/d55/d6a/da0/fa9 [0,4194304] 0 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/645: dread - d0/d1/d30/d55/f8d zero size 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/646: truncate d0/d93/fcf 243716 0 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/647: chown d0/d1/d2/dc/d68/ld8 22970948 1 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/648: dread - d0/d1/d1f/d29/d88/d91/fba zero size 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:0/639: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe1 x:0 0 0 2024-03-16T10:53:18.726 INFO:tasks.workunit.client.0.smithi017.stdout:0/640: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fba [416097,83253] 0 2024-03-16T10:53:18.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/380: unlink d4/dd/f73 0 2024-03-16T10:53:18.731 INFO:tasks.workunit.client.0.smithi017.stdout:5/649: link d0/d1/d2/lbf d0/d5d/d9f/ldd 0 2024-03-16T10:53:18.731 INFO:tasks.workunit.client.0.smithi017.stdout:5/650: write d0/d93/f66 [4267749,45636] 0 2024-03-16T10:53:18.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/401: link d8/f4e d8/d3f/d3d/d75/f7b 0 2024-03-16T10:53:18.735 INFO:tasks.workunit.client.0.smithi017.stdout:2/381: getdents d4 0 2024-03-16T10:53:18.736 INFO:tasks.workunit.client.0.smithi017.stdout:2/382: chown d4/d6/db/d24 120442822 1 2024-03-16T10:53:18.738 INFO:tasks.workunit.client.0.smithi017.stdout:2/383: read d4/d6/f16 [1361813,59154] 0 2024-03-16T10:53:18.739 INFO:tasks.workunit.client.0.smithi017.stdout:2/384: chown d4/d6/d30/d3f/f54 0 1 2024-03-16T10:53:18.739 INFO:tasks.workunit.client.0.smithi017.stdout:0/641: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/fce [0,4194304] 0 2024-03-16T10:53:18.739 INFO:tasks.workunit.client.0.smithi017.stdout:5/651: rename d0/d1/d2/dc/d2f/d37 to d0/d1/d30/dde 0 2024-03-16T10:53:18.740 INFO:tasks.workunit.client.0.smithi017.stdout:2/385: unlink d4/d6/db/d66/d2e/c57 0 2024-03-16T10:53:18.740 INFO:tasks.workunit.client.0.smithi017.stdout:0/642: dread - d2/d4/d6d/d84/dc1/dd2/de/d1e/f9f zero size 2024-03-16T10:53:18.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/652: rmdir d0/d1/d30/d55/dab 39 2024-03-16T10:53:18.742 INFO:tasks.workunit.client.0.smithi017.stdout:0/643: mknod d2/d4/d90/d86/ce2 0 2024-03-16T10:53:18.743 INFO:tasks.workunit.client.0.smithi017.stdout:0/644: creat d2/d4/d6d/d84/dc1/dd2/d24/d29/fe3 x:0 0 0 2024-03-16T10:53:18.743 INFO:tasks.workunit.client.0.smithi017.stdout:0/645: chown d2/d4/d6d/d84/dc1/dd2/d24/d29/c93 5682 1 2024-03-16T10:53:18.745 INFO:tasks.workunit.client.0.smithi017.stdout:0/646: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe4 x:0 0 0 2024-03-16T10:53:18.748 INFO:tasks.workunit.client.0.smithi017.stdout:2/386: write d4/dd/f18 [1379220,75228] 0 2024-03-16T10:53:18.749 INFO:tasks.workunit.client.0.smithi017.stdout:3/402: dwrite d8/d1b/d1c/f2f [0,4194304] 0 2024-03-16T10:53:18.749 INFO:tasks.workunit.client.0.smithi017.stdout:3/403: fdatasync d8/d1b/d2e/d60/d63/f79 0 2024-03-16T10:53:18.749 INFO:tasks.workunit.client.0.smithi017.stdout:2/387: dread - d4/f6d zero size 2024-03-16T10:53:18.752 INFO:tasks.workunit.client.0.smithi017.stdout:3/404: symlink d8/l7c 0 2024-03-16T10:53:18.754 INFO:tasks.workunit.client.0.smithi017.stdout:3/405: rename f3 to d8/d1b/d1c/d62/f7d 0 2024-03-16T10:53:18.764 INFO:tasks.workunit.client.0.smithi017.stdout:0/647: dwrite d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/fcb [0,4194304] 0 2024-03-16T10:53:18.764 INFO:tasks.workunit.client.0.smithi017.stdout:0/648: truncate d2/d4/d6d/d84/dc1/dd2/f73 916331 0 2024-03-16T10:53:18.765 INFO:tasks.workunit.client.0.smithi017.stdout:2/388: dwrite d4/d6/d30/d3f/f69 [0,4194304] 0 2024-03-16T10:53:18.766 INFO:tasks.workunit.client.0.smithi017.stdout:0/649: mknod d2/d4/ce5 0 2024-03-16T10:53:18.767 INFO:tasks.workunit.client.0.smithi017.stdout:2/389: creat d4/d6/db/d24/d39/f76 x:0 0 0 2024-03-16T10:53:18.769 INFO:tasks.workunit.client.0.smithi017.stdout:2/390: creat d4/dd/df/f77 x:0 0 0 2024-03-16T10:53:18.769 INFO:tasks.workunit.client.0.smithi017.stdout:2/391: write d4/d6/db/d24/f5b [471671,50510] 0 2024-03-16T10:53:18.769 INFO:tasks.workunit.client.0.smithi017.stdout:2/392: chown d4/d6/db/d24/f5b 820876026 1 2024-03-16T10:53:18.770 INFO:tasks.workunit.client.0.smithi017.stdout:3/406: dwrite d8/d1b/d2e/f6c [0,4194304] 0 2024-03-16T10:53:18.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/393: mkdir d4/d6/db/d66/d2e/d78 0 2024-03-16T10:53:18.772 INFO:tasks.workunit.client.0.smithi017.stdout:2/394: mknod d4/d6/db/d66/d2e/c79 0 2024-03-16T10:53:18.772 INFO:tasks.workunit.client.0.smithi017.stdout:2/395: stat d4/dd/d1e/f36 0 2024-03-16T10:53:18.772 INFO:tasks.workunit.client.0.smithi017.stdout:2/396: chown c3 71008 1 2024-03-16T10:53:18.772 INFO:tasks.workunit.client.0.smithi017.stdout:2/397: dread - d4/d6/db/d66/f5d zero size 2024-03-16T10:53:18.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/407: symlink d8/d1b/d1c/d62/l7e 0 2024-03-16T10:53:18.774 INFO:tasks.workunit.client.0.smithi017.stdout:2/398: truncate d4/dd/df/f19 960975 0 2024-03-16T10:53:18.774 INFO:tasks.workunit.client.0.smithi017.stdout:2/399: chown d4/d6/d30/d3f 324765 1 2024-03-16T10:53:18.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/408: symlink d8/d1b/d2e/d60/d63/l7f 0 2024-03-16T10:53:18.776 INFO:tasks.workunit.client.0.smithi017.stdout:3/409: fdatasync d8/d1b/d1c/f5d 0 2024-03-16T10:53:18.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/400: creat d4/d6/db/f7a x:0 0 0 2024-03-16T10:53:18.779 INFO:tasks.workunit.client.0.smithi017.stdout:3/410: creat d8/d1b/d1c/d62/d69/f80 x:0 0 0 2024-03-16T10:53:18.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/411: creat d8/d1b/d65/f81 x:0 0 0 2024-03-16T10:53:18.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/412: chown d8/d1d/l25 174 1 2024-03-16T10:53:18.783 INFO:tasks.workunit.client.0.smithi017.stdout:3/413: creat d8/d3f/d3d/d75/f82 x:0 0 0 2024-03-16T10:53:18.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/414: write d8/da/f59 [2617447,57832] 0 2024-03-16T10:53:18.801 INFO:tasks.workunit.client.0.smithi017.stdout:3/415: dwrite d8/da/db/f19 [4194304,4194304] 0 2024-03-16T10:53:18.801 INFO:tasks.workunit.client.0.smithi017.stdout:3/416: dread - d8/d1b/d65/f81 zero size 2024-03-16T10:53:18.801 INFO:tasks.workunit.client.0.smithi017.stdout:3/417: read - d8/d1b/d2e/d60/d63/f79 zero size 2024-03-16T10:53:18.801 INFO:tasks.workunit.client.0.smithi017.stdout:3/418: fdatasync d8/d3f/d3d/f76 0 2024-03-16T10:53:18.802 INFO:tasks.workunit.client.0.smithi017.stdout:3/419: creat d8/d1b/d1c/d62/d69/f83 x:0 0 0 2024-03-16T10:53:18.802 INFO:tasks.workunit.client.0.smithi017.stdout:3/420: chown d8/d1b/c22 67 1 2024-03-16T10:53:18.803 INFO:tasks.workunit.client.0.smithi017.stdout:3/421: creat d8/d1b/d2e/d60/f84 x:0 0 0 2024-03-16T10:53:18.804 INFO:tasks.workunit.client.0.smithi017.stdout:3/422: chown d8/fc 11 1 2024-03-16T10:53:18.805 INFO:tasks.workunit.client.0.smithi017.stdout:3/423: getdents d8/d1b 0 2024-03-16T10:53:18.812 INFO:tasks.workunit.client.0.smithi017.stdout:3/424: dread d8/da/f31 [0,4194304] 0 2024-03-16T10:53:18.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/425: unlink d8/d1b/d2e/f6c 0 2024-03-16T10:53:18.818 INFO:tasks.workunit.client.0.smithi017.stdout:3/426: getdents d8/d1b/d1c/d62/d69 0 2024-03-16T10:53:18.820 INFO:tasks.workunit.client.0.smithi017.stdout:3/427: getdents d8/d1b/d1c/d62 0 2024-03-16T10:53:18.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/428: dread d8/da/f31 [4194304,4194304] 0 2024-03-16T10:53:18.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/429: chown d8/d1d/l25 1857 1 2024-03-16T10:53:18.826 INFO:tasks.workunit.client.0.smithi017.stdout:3/430: creat d8/d1b/d1c/f85 x:0 0 0 2024-03-16T10:53:18.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/431: write d8/da/db/f19 [2070890,2794] 0 2024-03-16T10:53:18.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/432: readlink d8/da/db/l5c 0 2024-03-16T10:53:18.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/433: mknod d8/d1b/d65/c86 0 2024-03-16T10:53:18.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/434: write d8/d1b/d1c/f41 [1286915,80138] 0 2024-03-16T10:53:18.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/435: dread - d8/d1b/d1c/f85 zero size 2024-03-16T10:53:18.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/436: chown d8/da/f31 457341 1 2024-03-16T10:53:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/437: mkdir d8/d3f/d3d/d75/d87 0 2024-03-16T10:53:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/438: chown d8/da/l39 9170 1 2024-03-16T10:53:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/439: write d8/d1b/d1c/f41 [1883391,57241] 0 2024-03-16T10:53:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/440: dread - d8/d1d/f4b zero size 2024-03-16T10:53:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/441: truncate d8/d1b/d2e/d60/d63/f79 436145 0 2024-03-16T10:53:18.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/442: stat d8/d1b/d1c/f41 0 2024-03-16T10:53:18.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/443: truncate d8/d3f/f3b 1843599 0 2024-03-16T10:53:18.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/444: chown d8/f17 12 1 2024-03-16T10:53:18.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/445: fsync d8/d1b/d1c/f54 0 2024-03-16T10:53:18.840 INFO:tasks.workunit.client.0.smithi017.stdout:3/446: creat d8/d1b/d1c/f88 x:0 0 0 2024-03-16T10:53:18.840 INFO:tasks.workunit.client.0.smithi017.stdout:4/521: sync 2024-03-16T10:53:18.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/447: creat d8/d1b/d2e/d57/f89 x:0 0 0 2024-03-16T10:53:18.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/448: fdatasync d8/fc 0 2024-03-16T10:53:18.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/522: creat d15/d1d/d21/d26/fae x:0 0 0 2024-03-16T10:53:18.843 INFO:tasks.workunit.client.0.smithi017.stdout:4/523: read - d15/d1d/f56 zero size 2024-03-16T10:53:18.844 INFO:tasks.workunit.client.0.smithi017.stdout:3/449: creat d8/d1b/f8a x:0 0 0 2024-03-16T10:53:18.844 INFO:tasks.workunit.client.0.smithi017.stdout:3/450: chown d8/da/fe 10 1 2024-03-16T10:53:18.846 INFO:tasks.workunit.client.0.smithi017.stdout:4/524: mkdir d15/d1d/daf 0 2024-03-16T10:53:18.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/525: creat d15/d1d/d85/fb0 x:0 0 0 2024-03-16T10:53:18.851 INFO:tasks.workunit.client.0.smithi017.stdout:4/526: mkdir d15/d1d/d21/db1 0 2024-03-16T10:53:18.855 INFO:tasks.workunit.client.0.smithi017.stdout:4/527: link d15/d1d/d21/d3c/d93/d40/d51/d64/d63/f6f d15/d1d/d27/fb2 0 2024-03-16T10:53:18.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/528: truncate d15/d1d/d21/f7f 2076538 0 2024-03-16T10:53:18.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/529: fdatasync d15/d1d/d21/d26/f4d 0 2024-03-16T10:53:18.863 INFO:tasks.workunit.client.0.smithi017.stdout:4/530: link d15/d1d/d21/d3c/d93/d40/d51/d64/d63/fac d15/d1d/d21/d26/d66/d8c/dab/fb3 0 2024-03-16T10:53:18.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/531: dread d15/d1d/d27/f55 [4194304,4194304] 0 2024-03-16T10:53:18.869 INFO:tasks.workunit.client.0.smithi017.stdout:4/532: unlink d15/l2d 0 2024-03-16T10:53:18.869 INFO:tasks.workunit.client.0.smithi017.stdout:4/533: fdatasync d15/d1d/d21/d3c/f6c 0 2024-03-16T10:53:18.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/534: dread d15/d1d/d21/d26/d66/d8c/f92 [0,4194304] 0 2024-03-16T10:53:18.877 INFO:tasks.workunit.client.0.smithi017.stdout:4/535: write d15/f19 [4762884,28701] 0 2024-03-16T10:53:18.879 INFO:tasks.workunit.client.0.smithi017.stdout:4/536: rmdir d15/d1d/d21/d3c/d93/d40/d51/d64 39 2024-03-16T10:53:18.880 INFO:tasks.workunit.client.0.smithi017.stdout:4/537: dread d15/d1d/f25 [0,4194304] 0 2024-03-16T10:53:18.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/538: symlink d15/d1d/d21/d26/d66/d8c/dab/lb4 0 2024-03-16T10:53:18.884 INFO:tasks.workunit.client.0.smithi017.stdout:4/539: getdents d15/d1d/d21/d26/d66/d8c/dab 0 2024-03-16T10:53:18.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/540: mkdir d15/d1d/d21/db1/db5 0 2024-03-16T10:53:18.887 INFO:tasks.workunit.client.0.smithi017.stdout:4/541: mkdir d15/d1d/d27/db6 0 2024-03-16T10:53:18.891 INFO:tasks.workunit.client.0.smithi017.stdout:4/542: write d15/d1d/f24 [88612,83813] 0 2024-03-16T10:53:18.901 INFO:tasks.workunit.client.0.smithi017.stdout:4/543: write d15/d1d/d27/f3e [25205,11095] 0 2024-03-16T10:53:18.912 INFO:tasks.workunit.client.0.smithi017.stdout:4/544: dwrite d15/d1d/d21/d3c/d93/d40/d51/d64/d63/fac [0,4194304] 0 2024-03-16T10:53:18.915 INFO:tasks.workunit.client.0.smithi017.stdout:4/545: creat d15/d1d/d21/db1/db5/fb7 x:0 0 0 2024-03-16T10:53:18.915 INFO:tasks.workunit.client.0.smithi017.stdout:4/546: truncate d15/d1d/f5d 4536760 0 2024-03-16T10:53:18.916 INFO:tasks.workunit.client.0.smithi017.stdout:4/547: getdents d15/d1d/d21/db1 0 2024-03-16T10:53:18.916 INFO:tasks.workunit.client.0.smithi017.stdout:4/548: truncate d15/d1d/d21/f7f 2296404 0 2024-03-16T10:53:18.918 INFO:tasks.workunit.client.0.smithi017.stdout:4/549: dread fc [0,4194304] 0 2024-03-16T10:53:18.919 INFO:tasks.workunit.client.0.smithi017.stdout:4/550: creat d15/d1d/d21/d3c/d93/d40/d51/d64/da8/fb8 x:0 0 0 2024-03-16T10:53:18.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/551: creat d15/d1d/d50/fb9 x:0 0 0 2024-03-16T10:53:18.928 INFO:tasks.workunit.client.0.smithi017.stdout:4/552: dwrite d15/d1d/d21/d3c/d93/d40/faa [0,4194304] 0 2024-03-16T10:53:18.939 INFO:tasks.workunit.client.0.smithi017.stdout:4/553: write d15/d1d/d21/d3c/d93/d40/d51/d64/f58 [3314458,124225] 0 2024-03-16T10:53:18.939 INFO:tasks.workunit.client.0.smithi017.stdout:4/554: fdatasync d15/d1d/d85/fb0 0 2024-03-16T10:53:18.944 INFO:tasks.workunit.client.0.smithi017.stdout:4/555: dread d15/d1d/d21/d26/f35 [0,4194304] 0 2024-03-16T10:53:18.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/556: fdatasync d15/d1d/d27/f78 0 2024-03-16T10:53:18.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/557: write d15/d1d/d85/fb0 [590960,22536] 0 2024-03-16T10:53:18.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/558: fsync d15/f1f 0 2024-03-16T10:53:18.946 INFO:tasks.workunit.client.0.smithi017.stdout:4/559: creat d15/d1d/d85/fba x:0 0 0 2024-03-16T10:53:18.953 INFO:tasks.workunit.client.0.smithi017.stdout:4/560: dread d15/d1d/f81 [0,4194304] 0 2024-03-16T10:53:18.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/561: rename d15/d1d/d21/d26/d66/l94 to d15/d1d/d21/d26/d66/d8c/da4/lbb 0 2024-03-16T10:53:18.957 INFO:tasks.workunit.client.0.smithi017.stdout:4/562: mknod d15/d1d/d21/cbc 0 2024-03-16T10:53:18.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/563: link d15/d1d/f3d d15/d1d/d21/d26/fbd 0 2024-03-16T10:53:18.959 INFO:tasks.workunit.client.0.smithi017.stdout:4/564: truncate f4 1257859 0 2024-03-16T10:53:18.959 INFO:tasks.workunit.client.0.smithi017.stdout:4/565: chown d15/d1d/d21/d26/f42 13914 1 2024-03-16T10:53:18.961 INFO:tasks.workunit.client.0.smithi017.stdout:4/566: rename d15/d1d/d21/d3c/d93/d40/l4a to d15/d1d/lbe 0 2024-03-16T10:53:18.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/567: symlink d15/d1d/d21/d3c/d93/d40/d51/d64/d76/da3/lbf 0 2024-03-16T10:53:18.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/568: write d15/d1d/d21/d3c/d93/f86 [924628,78310] 0 2024-03-16T10:53:18.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/569: getdents d15/d1d/d21/d3c/d93/d40/d51/d64/d76 0 2024-03-16T10:53:18.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/570: write d15/d1d/d21/d3c/d93/d43/f9e [301758,61545] 0 2024-03-16T10:53:18.965 INFO:tasks.workunit.client.0.smithi017.stdout:4/571: creat d15/d1d/d21/d26/d66/fc0 x:0 0 0 2024-03-16T10:53:18.966 INFO:tasks.workunit.client.0.smithi017.stdout:4/572: getdents d15/d1d/d21/db1/db5 0 2024-03-16T10:53:18.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/573: rmdir d15/d1d/d21 39 2024-03-16T10:53:18.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/574: link d15/d1d/f5d d15/d1d/d21/d3c/d93/d40/d51/d64/d63/fc1 0 2024-03-16T10:53:18.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/575: mkdir d15/d1d/d21/d3c/d93/d43/dc2 0 2024-03-16T10:53:18.973 INFO:tasks.workunit.client.0.smithi017.stdout:4/576: mknod d15/d1d/d21/db1/cc3 0 2024-03-16T10:53:18.974 INFO:tasks.workunit.client.0.smithi017.stdout:4/577: creat d15/fc4 x:0 0 0 2024-03-16T10:53:18.975 INFO:tasks.workunit.client.0.smithi017.stdout:4/578: write d15/d1d/d21/d26/f4d [171849,15395] 0 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/579: mknod d15/d1d/d21/d3c/d93/d40/d51/d64/d63/d9f/cc5 0 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/492: sync 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/493: chown d6/d16/d6c/f6d 8207148 1 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/494: chown d6/d5f/d6e/d43/c7a 925377652 1 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/495: stat d6/f67 0 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/580: mkdir d15/d1d/d27/db6/dc6 0 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/581: write d15/d1d/d21/d26/f99 [627135,50564] 0 2024-03-16T10:53:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/582: chown d15/d1d/f25 2643493 1 2024-03-16T10:53:18.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/496: getdents d6/d14/d8c 0 2024-03-16T10:53:18.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/497: fdatasync d6/d5f/f33 0 2024-03-16T10:53:18.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/498: write d6/d16/f70 [5037861,108010] 0 2024-03-16T10:53:18.978 INFO:tasks.workunit.client.0.smithi017.stdout:4/583: unlink d15/d1d/d21/d3c/f6c 0 2024-03-16T10:53:18.979 INFO:tasks.workunit.client.0.smithi017.stdout:8/499: stat d6/d16/l20 0 2024-03-16T10:53:18.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/584: mkdir d15/d1d/d21/d26/d66/d8c/dab/dc7 0 2024-03-16T10:53:18.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/500: creat d6/d5f/f9b x:0 0 0 2024-03-16T10:53:18.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/501: dread - d6/d5f/f97 zero size 2024-03-16T10:53:18.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/502: read d6/d14/d6b/f6f [591873,71611] 0 2024-03-16T10:53:18.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/585: truncate d15/d1d/f29 3055341 0 2024-03-16T10:53:18.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/586: read - d15/f9b zero size 2024-03-16T10:53:18.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/587: write d15/f1f [2761582,5384] 0 2024-03-16T10:53:18.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/503: dread d6/d16/f2d [0,4194304] 0 2024-03-16T10:53:18.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/504: truncate d6/d4a/f4d 1660019 0 2024-03-16T10:53:18.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/588: rename d15/d1d/d21/d3c/d93/d43/f48 to d15/d1d/d21/d3c/d93/d96/fc8 0 2024-03-16T10:53:18.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/589: dread - d15/d1d/d21/d26/f88 zero size 2024-03-16T10:53:18.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/505: creat d6/d14/d8c/f9c x:0 0 0 2024-03-16T10:53:18.987 INFO:tasks.workunit.client.0.smithi017.stdout:8/506: write d6/d14/d6b/f85 [219566,2907] 0 2024-03-16T10:53:18.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/590: rename d15/d1d/d21/d26/fae to d15/d1d/d21/d3c/d93/d40/d51/d64/da8/fc9 0 2024-03-16T10:53:18.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/591: chown d15/d1d/lbe 14317 1 2024-03-16T10:53:18.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/507: unlink d6/fe 0 2024-03-16T10:53:18.992 INFO:tasks.workunit.client.0.smithi017.stdout:4/592: mkdir d15/d1d/d21/d3c/d93/d40/d51/d64/d63/dca 0 2024-03-16T10:53:18.992 INFO:tasks.workunit.client.0.smithi017.stdout:4/593: truncate d15/d1d/d21/d3c/d93/d40/d51/d64/f4e 4642591 0 2024-03-16T10:53:19.000 INFO:tasks.workunit.client.0.smithi017.stdout:8/508: write d6/d39/f30 [1620454,49162] 0 2024-03-16T10:53:19.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/509: rename d6/d16/f48 to d6/d4a/f9d 0 2024-03-16T10:53:19.008 INFO:tasks.workunit.client.0.smithi017.stdout:4/594: dwrite d15/d1d/d21/d3c/d93/d40/d51/d64/f58 [0,4194304] 0 2024-03-16T10:53:19.010 INFO:tasks.workunit.client.0.smithi017.stdout:4/595: creat d15/d1d/d21/d3c/d93/d40/d51/d64/d63/d9f/fcb x:0 0 0 2024-03-16T10:53:19.011 INFO:tasks.workunit.client.0.smithi017.stdout:8/510: write d6/f54 [2159039,106358] 0 2024-03-16T10:53:19.011 INFO:tasks.workunit.client.0.smithi017.stdout:4/596: creat d15/d1d/d21/d26/d66/d8c/dab/fcc x:0 0 0 2024-03-16T10:53:19.013 INFO:tasks.workunit.client.0.smithi017.stdout:4/597: link d15/d1d/d21/d3c/d93/d40/d51/d64/f6a d15/d1d/d21/d3c/fcd 0 2024-03-16T10:53:19.020 INFO:tasks.workunit.client.0.smithi017.stdout:8/511: write d6/d5f/d6e/d43/f2b [7150931,43155] 0 2024-03-16T10:53:19.020 INFO:tasks.workunit.client.0.smithi017.stdout:8/512: chown d6/d14/d6b 3436 1 2024-03-16T10:53:19.023 INFO:tasks.workunit.client.0.smithi017.stdout:8/513: dread - d6/d5f/d6e/f89 zero size 2024-03-16T10:53:19.023 INFO:tasks.workunit.client.0.smithi017.stdout:8/514: dread - d6/d14/d72/f95 zero size 2024-03-16T10:53:19.024 INFO:tasks.workunit.client.0.smithi017.stdout:8/515: mknod d6/d16/c9e 0 2024-03-16T10:53:19.027 INFO:tasks.workunit.client.0.smithi017.stdout:4/598: dwrite d15/d1d/d21/f72 [0,4194304] 0 2024-03-16T10:53:19.027 INFO:tasks.workunit.client.0.smithi017.stdout:4/599: truncate d15/d1d/d85/fa9 1425363 0 2024-03-16T10:53:19.032 INFO:tasks.workunit.client.0.smithi017.stdout:4/600: mknod d15/d1d/d21/d26/d66/d8c/cce 0 2024-03-16T10:53:19.034 INFO:tasks.workunit.client.0.smithi017.stdout:8/516: write d6/d5f/d6e/d43/f2b [1181495,2652] 0 2024-03-16T10:53:19.034 INFO:tasks.workunit.client.0.smithi017.stdout:4/601: dread d15/d1d/d21/d26/f42 [0,4194304] 0 2024-03-16T10:53:19.034 INFO:tasks.workunit.client.0.smithi017.stdout:4/602: read d15/d1d/d21/d3c/d93/f3a [22673,64224] 0 2024-03-16T10:53:19.037 INFO:tasks.workunit.client.0.smithi017.stdout:8/517: creat d6/d14/d6b/f9f x:0 0 0 2024-03-16T10:53:19.038 INFO:tasks.workunit.client.0.smithi017.stdout:4/603: creat d15/d1d/d21/d3c/d93/d7c/fcf x:0 0 0 2024-03-16T10:53:19.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/518: creat d6/d39/d35/d92/fa0 x:0 0 0 2024-03-16T10:53:19.042 INFO:tasks.workunit.client.0.smithi017.stdout:4/604: creat d15/d1d/d21/d3c/d93/d40/fd0 x:0 0 0 2024-03-16T10:53:19.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/605: rmdir d15/d1d/d50 39 2024-03-16T10:53:19.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/606: write d15/d1d/d21/d3c/f87 [61157,42691] 0 2024-03-16T10:53:19.044 INFO:tasks.workunit.client.0.smithi017.stdout:9/329: sync 2024-03-16T10:53:19.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/461: sync 2024-03-16T10:53:19.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/462: fsync d0/d9/f7b 0 2024-03-16T10:53:19.047 INFO:tasks.workunit.client.0.smithi017.stdout:9/330: creat d8/df/d46/d63/f6b x:0 0 0 2024-03-16T10:53:19.047 INFO:tasks.workunit.client.0.smithi017.stdout:9/331: chown d8/df/c14 31503943 1 2024-03-16T10:53:19.047 INFO:tasks.workunit.client.0.smithi017.stdout:9/332: truncate d8/df/d5b/f3b 911428 0 2024-03-16T10:53:19.047 INFO:tasks.workunit.client.0.smithi017.stdout:6/463: symlink d0/d9/d45/d4d/d2c/d41/d86/l99 0 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:7/448: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/711: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/650: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:2/401: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:3/451: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:5/653: sync 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/712: chown d1/d3/de/f9d 314 1 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/651: truncate d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe1 468027 0 2024-03-16T10:53:19.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/652: fsync d2/d4/d6d/d84/dc1/dd2/d24/d3a/fc7 0 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/607: write d15/d1d/d21/d3c/d93/d40/faa [1498837,86515] 0 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/402: creat d4/d6/db/d24/d39/f7b x:0 0 0 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/403: chown d4/d6/f21 20403 1 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/404: chown d4/dd/d1e/d3e 5626147 1 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/405: write d4/dd/f43 [961549,3775] 0 2024-03-16T10:53:19.050 INFO:tasks.workunit.client.0.smithi017.stdout:1/713: creat d1/d24/d79/d7a/ff2 x:0 0 0 2024-03-16T10:53:19.051 INFO:tasks.workunit.client.0.smithi017.stdout:6/464: mkdir d0/d21/d39/d44/d9a 0 2024-03-16T10:53:19.052 INFO:tasks.workunit.client.0.smithi017.stdout:0/653: rename d2/d4/d6d/d84/dc1/dd2/d24/d3a/f60 to d2/d4/d6d/fe6 0 2024-03-16T10:53:19.054 INFO:tasks.workunit.client.0.smithi017.stdout:3/452: mkdir d8/d1b/d1c/d62/d69/d8b 0 2024-03-16T10:53:19.055 INFO:tasks.workunit.client.0.smithi017.stdout:5/654: creat d0/d93/fdf x:0 0 0 2024-03-16T10:53:19.057 INFO:tasks.workunit.client.0.smithi017.stdout:4/608: mkdir d15/d1d/d21/d3c/d93/d43/dd1 0 2024-03-16T10:53:19.057 INFO:tasks.workunit.client.0.smithi017.stdout:4/609: truncate d15/d1d/d27/f3b 321042 0 2024-03-16T10:53:19.059 INFO:tasks.workunit.client.0.smithi017.stdout:7/449: mkdir d7/db/dc/d50/d59/d34/d95 0 2024-03-16T10:53:19.061 INFO:tasks.workunit.client.0.smithi017.stdout:0/654: unlink d2/d4/d6d/l3c 0 2024-03-16T10:53:19.062 INFO:tasks.workunit.client.0.smithi017.stdout:6/465: dwrite d0/d21/f36 [0,4194304] 0 2024-03-16T10:53:19.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/714: unlink d1/d3/fb 0 2024-03-16T10:53:19.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/715: chown d1/d3/dd/l2b 898238180 1 2024-03-16T10:53:19.063 INFO:tasks.workunit.client.0.smithi017.stdout:9/333: dwrite d8/df/f40 [0,4194304] 0 2024-03-16T10:53:19.063 INFO:tasks.workunit.client.0.smithi017.stdout:9/334: chown d8/df/d5b/f62 38 1 2024-03-16T10:53:19.065 INFO:tasks.workunit.client.0.smithi017.stdout:2/406: rename d4/dd/df/f15 to d4/d6/d30/f7c 0 2024-03-16T10:53:19.065 INFO:tasks.workunit.client.0.smithi017.stdout:9/335: dread d8/df/d46/f58 [0,4194304] 0 2024-03-16T10:53:19.067 INFO:tasks.workunit.client.0.smithi017.stdout:3/453: getdents d8/d1b/d2e/d60/d63 0 2024-03-16T10:53:19.071 INFO:tasks.workunit.client.0.smithi017.stdout:1/716: dread d1/f5c [0,4194304] 0 2024-03-16T10:53:19.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/655: link d0/d1/d2/d2c/d38/fae d0/d1/d30/dde/d42/fe0 0 2024-03-16T10:53:19.073 INFO:tasks.workunit.client.0.smithi017.stdout:4/610: symlink d15/d1d/d21/d3c/d93/d40/d51/ld2 0 2024-03-16T10:53:19.073 INFO:tasks.workunit.client.0.smithi017.stdout:4/611: write d15/d1d/d21/d26/f33 [382175,4285] 0 2024-03-16T10:53:19.077 INFO:tasks.workunit.client.0.smithi017.stdout:6/466: getdents d0/d9/d45/d4d 0 2024-03-16T10:53:19.077 INFO:tasks.workunit.client.0.smithi017.stdout:6/467: stat d0/d15/f1c 0 2024-03-16T10:53:19.077 INFO:tasks.workunit.client.0.smithi017.stdout:7/450: dwrite d7/db/dc/d50/f87 [0,4194304] 0 2024-03-16T10:53:19.081 INFO:tasks.workunit.client.0.smithi017.stdout:9/336: mknod d8/df/d5b/d32/c6c 0 2024-03-16T10:53:19.082 INFO:tasks.workunit.client.0.smithi017.stdout:5/656: unlink d0/d1/cc2 0 2024-03-16T10:53:19.084 INFO:tasks.workunit.client.0.smithi017.stdout:2/407: dwrite d4/d6/db/f7a [0,4194304] 0 2024-03-16T10:53:19.084 INFO:tasks.workunit.client.0.smithi017.stdout:6/468: truncate d0/d9/d45/d4d/d2c/f4c 2052127 0 2024-03-16T10:53:19.085 INFO:tasks.workunit.client.0.smithi017.stdout:4/612: dread d15/d1d/f24 [0,4194304] 0 2024-03-16T10:53:19.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/408: mkdir d4/d6/db/d24/d39/d7d 0 2024-03-16T10:53:19.089 INFO:tasks.workunit.client.0.smithi017.stdout:0/655: rename d2/l1f to d2/d4/d6d/d84/dc1/dd2/d24/d72/le7 0 2024-03-16T10:53:19.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/656: symlink d2/d4/d90/dc2/le8 0 2024-03-16T10:53:19.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/451: mkdir d7/db/d12/d96 0 2024-03-16T10:53:19.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/657: dread d0/d1/d2/d2c/d38/f3b [0,4194304] 0 2024-03-16T10:53:19.092 INFO:tasks.workunit.client.0.smithi017.stdout:0/657: mkdir d2/d4/d6d/d84/de9 0 2024-03-16T10:53:19.094 INFO:tasks.workunit.client.0.smithi017.stdout:1/717: dwrite d1/d3/d57/d94/fb5 [0,4194304] 0 2024-03-16T10:53:19.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/337: creat d8/df/d5b/f6d x:0 0 0 2024-03-16T10:53:19.097 INFO:tasks.workunit.client.0.smithi017.stdout:3/454: mkdir d8/d8c 0 2024-03-16T10:53:19.097 INFO:tasks.workunit.client.0.smithi017.stdout:3/455: write d8/d1b/d2e/d60/f74 [343466,120121] 0 2024-03-16T10:53:19.100 INFO:tasks.workunit.client.0.smithi017.stdout:4/613: creat d15/d1d/d21/d3c/d93/d40/d51/d64/d63/dca/fd3 x:0 0 0 2024-03-16T10:53:19.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/452: creat d7/db/d81/f97 x:0 0 0 2024-03-16T10:53:19.105 INFO:tasks.workunit.client.0.smithi017.stdout:2/409: dwrite d4/d6/db/d24/d39/f42 [0,4194304] 0 2024-03-16T10:53:19.105 INFO:tasks.workunit.client.0.smithi017.stdout:5/658: creat d0/d1/d2/dc/d2f/fe1 x:0 0 0 2024-03-16T10:53:19.105 INFO:tasks.workunit.client.0.smithi017.stdout:5/659: readlink d0/d1/d30/d55/l9d 0 2024-03-16T10:53:19.105 INFO:tasks.workunit.client.0.smithi017.stdout:5/660: fdatasync d0/d1/d2/d2c/d36/d51/fc4 0 2024-03-16T10:53:19.106 INFO:tasks.workunit.client.0.smithi017.stdout:6/469: dwrite d0/d22/f27 [0,4194304] 0 2024-03-16T10:53:19.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/470: write d0/d9/d45/d4d/d2e/d69/d7e/f8a [517655,67113] 0 2024-03-16T10:53:19.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/471: fsync d0/d9/f7b 0 2024-03-16T10:53:19.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/472: write d0/d9/d45/d4d/f25 [2281845,109119] 0 2024-03-16T10:53:19.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/473: readlink d0/d9/l12 0 2024-03-16T10:53:19.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/474: readlink d0/d9/d45/l72 0 2024-03-16T10:53:19.108 INFO:tasks.workunit.client.0.smithi017.stdout:2/410: dread d4/f56 [0,4194304] 0 2024-03-16T10:53:19.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/718: dread - d1/d3/de/f9d zero size 2024-03-16T10:53:19.111 INFO:tasks.workunit.client.0.smithi017.stdout:0/658: dwrite d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f4b [0,4194304] 0 2024-03-16T10:53:19.112 INFO:tasks.workunit.client.0.smithi017.stdout:2/411: dread d4/d6/f26 [0,4194304] 0 2024-03-16T10:53:19.112 INFO:tasks.workunit.client.0.smithi017.stdout:0/659: creat d2/d4/d6d/d84/dc1/dd2/d24/fea x:0 0 0 2024-03-16T10:53:19.113 INFO:tasks.workunit.client.0.smithi017.stdout:6/475: dread d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:19.114 INFO:tasks.workunit.client.0.smithi017.stdout:9/338: unlink d8/df/d5b/l44 0 2024-03-16T10:53:19.117 INFO:tasks.workunit.client.0.smithi017.stdout:4/614: mknod d15/d1d/d85/cd4 0 2024-03-16T10:53:19.119 INFO:tasks.workunit.client.0.smithi017.stdout:7/453: symlink d7/db/dc/d50/d73/l98 0 2024-03-16T10:53:19.121 INFO:tasks.workunit.client.0.smithi017.stdout:7/454: creat d7/db/dc/d50/d59/d34/d53/f99 x:0 0 0 2024-03-16T10:53:19.121 INFO:tasks.workunit.client.0.smithi017.stdout:7/455: readlink l4 0 2024-03-16T10:53:19.122 INFO:tasks.workunit.client.0.smithi017.stdout:5/661: dwrite d0/d1/d30/dde/d42/fe0 [0,4194304] 0 2024-03-16T10:53:19.122 INFO:tasks.workunit.client.0.smithi017.stdout:5/662: dread - d0/d1/d2/d2c/d36/d51/fc7 zero size 2024-03-16T10:53:19.126 INFO:tasks.workunit.client.0.smithi017.stdout:2/412: rename d4/d6/d30/d3f/l71 to d4/dd/l7e 0 2024-03-16T10:53:19.129 INFO:tasks.workunit.client.0.smithi017.stdout:6/476: creat d0/d9/d45/d4d/d2c/d41/d97/f9b x:0 0 0 2024-03-16T10:53:19.129 INFO:tasks.workunit.client.0.smithi017.stdout:6/477: stat d0/d9/d38/f71 0 2024-03-16T10:53:19.129 INFO:tasks.workunit.client.0.smithi017.stdout:3/456: dwrite d8/f7a [0,4194304] 0 2024-03-16T10:53:19.131 INFO:tasks.workunit.client.0.smithi017.stdout:6/478: dread d0/d21/d39/d44/f4f [0,4194304] 0 2024-03-16T10:53:19.131 INFO:tasks.workunit.client.0.smithi017.stdout:6/479: chown d0/d9/d45/l68 1 1 2024-03-16T10:53:19.133 INFO:tasks.workunit.client.0.smithi017.stdout:9/339: link d8/df/d5b/d32/f50 d8/df/d66/f6e 0 2024-03-16T10:53:19.135 INFO:tasks.workunit.client.0.smithi017.stdout:0/660: rename d2/d4/d6d/d84/dc1/dd2/de/d19/ld4 to d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/leb 0 2024-03-16T10:53:19.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/661: getdents d2/d4/d6d/dde 0 2024-03-16T10:53:19.136 INFO:tasks.workunit.client.0.smithi017.stdout:4/615: symlink d15/d1d/d21/ld5 0 2024-03-16T10:53:19.137 INFO:tasks.workunit.client.0.smithi017.stdout:4/616: stat d15/d1d/d21/d3c/d93/d40/d51/ld2 0 2024-03-16T10:53:19.139 INFO:tasks.workunit.client.0.smithi017.stdout:7/456: mknod d7/db/c9a 0 2024-03-16T10:53:19.144 INFO:tasks.workunit.client.0.smithi017.stdout:1/719: dwrite d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:19.145 INFO:tasks.workunit.client.0.smithi017.stdout:5/663: truncate d0/d1/d2/dc/d68/f92 480777 0 2024-03-16T10:53:19.146 INFO:tasks.workunit.client.0.smithi017.stdout:2/413: mknod d4/d6/db/c7f 0 2024-03-16T10:53:19.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/664: mkdir d0/d1/d2/d2c/d36/db4/de2 0 2024-03-16T10:53:19.149 INFO:tasks.workunit.client.0.smithi017.stdout:1/720: creat d1/d3/dd/ddc/ff3 x:0 0 0 2024-03-16T10:53:19.151 INFO:tasks.workunit.client.0.smithi017.stdout:5/665: mknod d0/d1/d2/d8c/ce3 0 2024-03-16T10:53:19.153 INFO:tasks.workunit.client.0.smithi017.stdout:9/340: dread d8/df/d46/f5c [0,4194304] 0 2024-03-16T10:53:19.157 INFO:tasks.workunit.client.0.smithi017.stdout:2/414: dread d4/d6/f20 [0,4194304] 0 2024-03-16T10:53:19.157 INFO:tasks.workunit.client.0.smithi017.stdout:3/457: dwrite d8/da/db/f50 [0,4194304] 0 2024-03-16T10:53:19.157 INFO:tasks.workunit.client.0.smithi017.stdout:2/415: stat d4/dd/d38/f6e 0 2024-03-16T10:53:19.158 INFO:tasks.workunit.client.0.smithi017.stdout:1/721: write d1/d3/f29 [3261740,122641] 0 2024-03-16T10:53:19.160 INFO:tasks.workunit.client.0.smithi017.stdout:2/416: getdents d4/dd/df 0 2024-03-16T10:53:19.161 INFO:tasks.workunit.client.0.smithi017.stdout:8/519: sync 2024-03-16T10:53:19.163 INFO:tasks.workunit.client.0.smithi017.stdout:1/722: rename d1/d3/dd/d31/ccb to d1/d50/cf4 0 2024-03-16T10:53:19.164 INFO:tasks.workunit.client.0.smithi017.stdout:1/723: rmdir d1/d24/d79/d7a/da9 39 2024-03-16T10:53:19.165 INFO:tasks.workunit.client.0.smithi017.stdout:2/417: link d4/dd/d38/f6e d4/dd/df/f80 0 2024-03-16T10:53:19.167 INFO:tasks.workunit.client.0.smithi017.stdout:8/520: mknod d6/d5c/d96/ca1 0 2024-03-16T10:53:19.167 INFO:tasks.workunit.client.0.smithi017.stdout:9/341: dread d8/df/d5b/d32/f34 [0,4194304] 0 2024-03-16T10:53:19.167 INFO:tasks.workunit.client.0.smithi017.stdout:8/521: write d6/d16/f66 [4933817,73954] 0 2024-03-16T10:53:19.167 INFO:tasks.workunit.client.0.smithi017.stdout:9/342: write d8/f2a [2158483,35958] 0 2024-03-16T10:53:19.167 INFO:tasks.workunit.client.0.smithi017.stdout:8/522: write d6/d5f/d6e/f59 [109443,56599] 0 2024-03-16T10:53:19.170 INFO:tasks.workunit.client.0.smithi017.stdout:9/343: creat d8/df/d5b/f6f x:0 0 0 2024-03-16T10:53:19.170 INFO:tasks.workunit.client.0.smithi017.stdout:9/344: write d8/df/d5b/f6f [992070,115695] 0 2024-03-16T10:53:19.172 INFO:tasks.workunit.client.0.smithi017.stdout:8/523: rename d6/d16/f86 to d6/d5c/d96/fa2 0 2024-03-16T10:53:19.172 INFO:tasks.workunit.client.0.smithi017.stdout:8/524: truncate d6/d5f/f97 840650 0 2024-03-16T10:53:19.174 INFO:tasks.workunit.client.0.smithi017.stdout:5/666: dwrite d0/f87 [0,4194304] 0 2024-03-16T10:53:19.174 INFO:tasks.workunit.client.0.smithi017.stdout:5/667: write d0/f98 [615646,53261] 0 2024-03-16T10:53:19.174 INFO:tasks.workunit.client.0.smithi017.stdout:9/345: mkdir d8/df/d5b/d70 0 2024-03-16T10:53:19.176 INFO:tasks.workunit.client.0.smithi017.stdout:8/525: getdents d6/d14/d8c 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/457: read d7/db/dc/f10 [2202329,9090] 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/458: stat d7/db/dc/d50/d59/d34/d53/c80 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/459: fdatasync d7/db/f52 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:5/668: link d0/d1/d2/d2c/d36/d41/f62 d0/d1/d2/dc/d68/fe4 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:4/617: dwrite d15/d1d/f56 [0,4194304] 0 2024-03-16T10:53:19.179 INFO:tasks.workunit.client.0.smithi017.stdout:2/418: read d4/d6/d30/d3f/f54 [2054894,120783] 0 2024-03-16T10:53:19.180 INFO:tasks.workunit.client.0.smithi017.stdout:9/346: rename d8/df/d5b/d32/c6c to d8/df/d5b/d5e/c71 0 2024-03-16T10:53:19.181 INFO:tasks.workunit.client.0.smithi017.stdout:2/419: write d4/d6/f26 [1048788,117086] 0 2024-03-16T10:53:19.183 INFO:tasks.workunit.client.0.smithi017.stdout:7/460: link d7/db/l40 d7/db/d81/l9b 0 2024-03-16T10:53:19.183 INFO:tasks.workunit.client.0.smithi017.stdout:7/461: readlink d7/l4a 0 2024-03-16T10:53:19.184 INFO:tasks.workunit.client.0.smithi017.stdout:1/724: dread d1/d3/dd/d31/d66/dd7/f39 [4194304,4194304] 0 2024-03-16T10:53:19.184 INFO:tasks.workunit.client.0.smithi017.stdout:1/725: chown d1/f78 21 1 2024-03-16T10:53:19.184 INFO:tasks.workunit.client.0.smithi017.stdout:5/669: creat d0/d5d/d9f/fe5 x:0 0 0 2024-03-16T10:53:19.184 INFO:tasks.workunit.client.0.smithi017.stdout:0/662: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fba [0,4194304] 0 2024-03-16T10:53:19.186 INFO:tasks.workunit.client.0.smithi017.stdout:0/663: read d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [153605,11545] 0 2024-03-16T10:53:19.187 INFO:tasks.workunit.client.0.smithi017.stdout:0/664: getdents d2/d4/d6d/d84/dc1/dd2/d24/d72/d88 0 2024-03-16T10:53:19.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/458: dwrite d8/d3f/d3d/d75/f7b [0,4194304] 0 2024-03-16T10:53:19.189 INFO:tasks.workunit.client.0.smithi017.stdout:0/665: getdents d2/d4/d6d/d84/dc1/dd2 0 2024-03-16T10:53:19.191 INFO:tasks.workunit.client.0.smithi017.stdout:4/618: link d15/f19 d15/d1d/d21/d3c/d93/d40/d51/d64/fd6 0 2024-03-16T10:53:19.192 INFO:tasks.workunit.client.0.smithi017.stdout:4/619: dread d15/d1d/d21/d3c/f97 [0,4194304] 0 2024-03-16T10:53:19.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/526: dwrite d6/d14/d8c/f8b [0,4194304] 0 2024-03-16T10:53:19.193 INFO:tasks.workunit.client.0.smithi017.stdout:2/420: mkdir d4/d6/d81 0 2024-03-16T10:53:19.201 INFO:tasks.workunit.client.0.smithi017.stdout:1/726: mknod d1/d50/d8d/cf5 0 2024-03-16T10:53:19.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/670: mkdir d0/d1/d1f/d97/de6 0 2024-03-16T10:53:19.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/671: chown d0/d1/d2/dc/f49 100281349 1 2024-03-16T10:53:19.205 INFO:tasks.workunit.client.0.smithi017.stdout:5/672: readlink d0/d1/d2/d70/ld1 0 2024-03-16T10:53:19.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/347: dwrite d8/df/d5b/d32/f57 [0,4194304] 0 2024-03-16T10:53:19.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/348: dread - d8/df/f60 zero size 2024-03-16T10:53:19.209 INFO:tasks.workunit.client.0.smithi017.stdout:4/620: dwrite d15/d1d/d21/d26/d66/d8c/dab/fcc [0,4194304] 0 2024-03-16T10:53:19.211 INFO:tasks.workunit.client.0.smithi017.stdout:4/621: dread d15/d1d/d21/d3c/d93/d96/fc8 [0,4194304] 0 2024-03-16T10:53:19.212 INFO:tasks.workunit.client.0.smithi017.stdout:3/459: rename d8/d3f/d3d/d75 to d8/d1b/d2e/d8d 0 2024-03-16T10:53:19.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/527: creat d6/d5f/d6e/fa3 x:0 0 0 2024-03-16T10:53:19.213 INFO:tasks.workunit.client.0.smithi017.stdout:3/460: dread d8/d1b/d2e/f3e [0,4194304] 0 2024-03-16T10:53:19.213 INFO:tasks.workunit.client.0.smithi017.stdout:3/461: truncate d8/d1b/d1c/d62/d69/f80 248199 0 2024-03-16T10:53:19.213 INFO:tasks.workunit.client.0.smithi017.stdout:3/462: write d8/d1b/d2e/d60/d63/f79 [632091,122462] 0 2024-03-16T10:53:19.214 INFO:tasks.workunit.client.0.smithi017.stdout:5/673: write d0/d1/d30/d55/d6a/f7e [3631049,19178] 0 2024-03-16T10:53:19.215 INFO:tasks.workunit.client.0.smithi017.stdout:2/421: rmdir d4 39 2024-03-16T10:53:19.217 INFO:tasks.workunit.client.0.smithi017.stdout:9/349: mkdir d8/df/d5b/d72 0 2024-03-16T10:53:19.230 INFO:tasks.workunit.client.0.smithi017.stdout:9/350: dwrite d8/df/d46/f5c [0,4194304] 0 2024-03-16T10:53:19.231 INFO:tasks.workunit.client.0.smithi017.stdout:4/622: creat d15/d1d/d21/db1/db5/fd7 x:0 0 0 2024-03-16T10:53:19.231 INFO:tasks.workunit.client.0.smithi017.stdout:4/623: truncate d15/d1d/d21/d26/f99 1532418 0 2024-03-16T10:53:19.233 INFO:tasks.workunit.client.0.smithi017.stdout:8/528: mkdir d6/d5f/da4 0 2024-03-16T10:53:19.235 INFO:tasks.workunit.client.0.smithi017.stdout:3/463: mkdir d8/d3f/d3d/d8e 0 2024-03-16T10:53:19.239 INFO:tasks.workunit.client.0.smithi017.stdout:5/674: link d0/d1/d2/d2c/d36/l3a d0/d1/d2/d2c/d36/db4/le7 0 2024-03-16T10:53:19.244 INFO:tasks.workunit.client.0.smithi017.stdout:0/666: symlink d2/d4/d6d/d84/dc1/dd2/de/lec 0 2024-03-16T10:53:19.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/351: creat d8/df/d5b/d32/f73 x:0 0 0 2024-03-16T10:53:19.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/352: write d8/df/d5b/f62 [318139,36660] 0 2024-03-16T10:53:19.247 INFO:tasks.workunit.client.0.smithi017.stdout:8/529: rename d6/d39/d35/c91 to d6/d16/ca5 0 2024-03-16T10:53:19.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/675: truncate d0/d1/d2/dc/d2f/f89 3384163 0 2024-03-16T10:53:19.251 INFO:tasks.workunit.client.0.smithi017.stdout:4/624: dwrite d15/d1d/d21/d26/f35 [0,4194304] 0 2024-03-16T10:53:19.251 INFO:tasks.workunit.client.0.smithi017.stdout:4/625: chown d15/d1d/d27/db6/dc6 0 1 2024-03-16T10:53:19.254 INFO:tasks.workunit.client.0.smithi017.stdout:0/667: write d2/d4/d6d/d84/dc1/dd2/d24/d72/fce [7636919,129468] 0 2024-03-16T10:53:19.255 INFO:tasks.workunit.client.0.smithi017.stdout:4/626: rename d15/d1d/d21/d3c/fcd to d15/d1d/d21/d3c/d93/d40/d51/d64/fd8 0 2024-03-16T10:53:19.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/530: read d6/f4e [3340073,100293] 0 2024-03-16T10:53:19.255 INFO:tasks.workunit.client.0.smithi017.stdout:3/464: dwrite d8/d1b/d1c/f54 [0,4194304] 0 2024-03-16T10:53:19.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/627: write d15/f17 [213285,80999] 0 2024-03-16T10:53:19.257 INFO:tasks.workunit.client.0.smithi017.stdout:3/465: symlink d8/d1b/d2e/l8f 0 2024-03-16T10:53:19.257 INFO:tasks.workunit.client.0.smithi017.stdout:3/466: chown d8/d1b 291 1 2024-03-16T10:53:19.258 INFO:tasks.workunit.client.0.smithi017.stdout:3/467: read d8/d1b/d2e/d60/d63/f79 [141659,29767] 0 2024-03-16T10:53:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:4/628: link d15/f68 d15/d1d/fd9 0 2024-03-16T10:53:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:4/629: fdatasync d15/d1d/f81 0 2024-03-16T10:53:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/676: write d0/d1/d2/d2c/d36/d51/fc4 [182481,25559] 0 2024-03-16T10:53:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/677: write d0/d1/d1f/d29/d88/d91/fa7 [940836,76915] 0 2024-03-16T10:53:19.262 INFO:tasks.workunit.client.0.smithi017.stdout:3/468: rename d8/da/db/c68 to d8/d1b/d1c/d62/d69/d8b/c90 0 2024-03-16T10:53:19.264 INFO:tasks.workunit.client.0.smithi017.stdout:9/353: fsync d8/df/d5b/d32/f73 0 2024-03-16T10:53:19.267 INFO:tasks.workunit.client.0.smithi017.stdout:1/727: dwrite d1/d3/dd/f9a [0,4194304] 0 2024-03-16T10:53:19.268 INFO:tasks.workunit.client.0.smithi017.stdout:7/462: link d7/db/dc/f10 d7/db/dc/d50/d59/d34/d53/f9c 0 2024-03-16T10:53:19.270 INFO:tasks.workunit.client.0.smithi017.stdout:1/728: chown d1/d3/d57/f9c 466201 1 2024-03-16T10:53:19.274 INFO:tasks.workunit.client.0.smithi017.stdout:1/729: mknod d1/d3/d88/cf6 0 2024-03-16T10:53:19.274 INFO:tasks.workunit.client.0.smithi017.stdout:2/422: unlink d4/d6/db/d66/c53 0 2024-03-16T10:53:19.275 INFO:tasks.workunit.client.0.smithi017.stdout:3/469: dread d8/d1b/d1c/f5d [0,4194304] 0 2024-03-16T10:53:19.276 INFO:tasks.workunit.client.0.smithi017.stdout:0/668: dwrite d2/da1/f92 [0,4194304] 0 2024-03-16T10:53:19.280 INFO:tasks.workunit.client.0.smithi017.stdout:3/470: rmdir d8/d3f/d3d/d8e 0 2024-03-16T10:53:19.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/354: dwrite d8/df/d5b/f62 [0,4194304] 0 2024-03-16T10:53:19.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/355: write d8/df/f4f [634155,107750] 0 2024-03-16T10:53:19.284 INFO:tasks.workunit.client.0.smithi017.stdout:6/480: sync 2024-03-16T10:53:19.285 INFO:tasks.workunit.client.0.smithi017.stdout:3/471: getdents d8/da 0 2024-03-16T10:53:19.285 INFO:tasks.workunit.client.0.smithi017.stdout:7/463: write d7/db/d12/d1c/f41 [1074568,116232] 0 2024-03-16T10:53:19.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/531: dwrite d6/d16/f70 [0,4194304] 0 2024-03-16T10:53:19.287 INFO:tasks.workunit.client.0.smithi017.stdout:2/423: dread d4/d6/f20 [0,4194304] 0 2024-03-16T10:53:19.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/630: dwrite d15/d1d/d21/d3c/d93/d43/f9e [0,4194304] 0 2024-03-16T10:53:19.290 INFO:tasks.workunit.client.0.smithi017.stdout:1/730: write d1/d3/d57/d94/fb5 [2338067,111929] 0 2024-03-16T10:53:19.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/356: unlink d8/df/c54 0 2024-03-16T10:53:19.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/357: truncate d8/df/d5b/f62 4784523 0 2024-03-16T10:53:19.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/358: dread - d8/df/d5b/f5d zero size 2024-03-16T10:53:19.292 INFO:tasks.workunit.client.0.smithi017.stdout:9/359: dread d8/f24 [0,4194304] 0 2024-03-16T10:53:19.296 INFO:tasks.workunit.client.0.smithi017.stdout:7/464: dread d7/db/dc/f17 [4194304,4194304] 0 2024-03-16T10:53:19.297 INFO:tasks.workunit.client.0.smithi017.stdout:6/481: rename d0/d21/l2b to d0/d15/l9c 0 2024-03-16T10:53:19.297 INFO:tasks.workunit.client.0.smithi017.stdout:2/424: write d4/f52 [3857458,61919] 0 2024-03-16T10:53:19.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/532: mknod d6/ca6 0 2024-03-16T10:53:19.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/533: dread - d6/d5c/d96/fa2 zero size 2024-03-16T10:53:19.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/678: dwrite d0/d93/fcf [0,4194304] 0 2024-03-16T10:53:19.298 INFO:tasks.workunit.client.0.smithi017.stdout:2/425: mknod d4/d6/db/d66/d29/c82 0 2024-03-16T10:53:19.301 INFO:tasks.workunit.client.0.smithi017.stdout:2/426: creat d4/d6/db/d24/d39/d7d/f83 x:0 0 0 2024-03-16T10:53:19.302 INFO:tasks.workunit.client.0.smithi017.stdout:1/731: dread d1/f78 [0,4194304] 0 2024-03-16T10:53:19.303 INFO:tasks.workunit.client.0.smithi017.stdout:4/631: symlink d15/d1d/d21/d26/d66/d8c/dab/lda 0 2024-03-16T10:53:19.303 INFO:tasks.workunit.client.0.smithi017.stdout:9/360: rmdir d8/df/d46 39 2024-03-16T10:53:19.303 INFO:tasks.workunit.client.0.smithi017.stdout:0/669: mknod d2/d4/d90/d86/db7/dc0/ced 0 2024-03-16T10:53:19.303 INFO:tasks.workunit.client.0.smithi017.stdout:7/465: rmdir d7/db/d12/d1c/d4e 39 2024-03-16T10:53:19.304 INFO:tasks.workunit.client.0.smithi017.stdout:0/670: fsync d2/d4/d90/d86/f91 0 2024-03-16T10:53:19.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/466: chown d7/db/dc/d50/d59/f61 56808 1 2024-03-16T10:53:19.311 INFO:tasks.workunit.client.0.smithi017.stdout:3/472: dwrite d8/f7a [0,4194304] 0 2024-03-16T10:53:19.311 INFO:tasks.workunit.client.0.smithi017.stdout:5/679: creat d0/d1/d1f/d29/d88/d91/fe8 x:0 0 0 2024-03-16T10:53:19.312 INFO:tasks.workunit.client.0.smithi017.stdout:4/632: read d15/d1d/d27/f55 [1231275,121420] 0 2024-03-16T10:53:19.312 INFO:tasks.workunit.client.0.smithi017.stdout:2/427: chown d4/dd/df/f5f 19 1 2024-03-16T10:53:19.313 INFO:tasks.workunit.client.0.smithi017.stdout:2/428: write d4/d6/f16 [1297007,33200] 0 2024-03-16T10:53:19.314 INFO:tasks.workunit.client.0.smithi017.stdout:1/732: symlink d1/d3/dd/lf7 0 2024-03-16T10:53:19.318 INFO:tasks.workunit.client.0.smithi017.stdout:4/633: dread d15/f68 [0,4194304] 0 2024-03-16T10:53:19.321 INFO:tasks.workunit.client.0.smithi017.stdout:6/482: dwrite d0/d9/d45/d4d/f92 [0,4194304] 0 2024-03-16T10:53:19.321 INFO:tasks.workunit.client.0.smithi017.stdout:6/483: truncate d0/d9/d45/d4d/d2c/f4c 2332058 0 2024-03-16T10:53:19.327 INFO:tasks.workunit.client.0.smithi017.stdout:0/671: write d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/fdb [467046,25584] 0 2024-03-16T10:53:19.330 INFO:tasks.workunit.client.0.smithi017.stdout:0/672: dread d2/d4/d6d/f75 [0,4194304] 0 2024-03-16T10:53:19.336 INFO:tasks.workunit.client.0.smithi017.stdout:3/473: dwrite d8/d3f/f3b [0,4194304] 0 2024-03-16T10:53:19.342 INFO:tasks.workunit.client.0.smithi017.stdout:2/429: dwrite d4/f25 [4194304,4194304] 0 2024-03-16T10:53:19.347 INFO:tasks.workunit.client.0.smithi017.stdout:9/361: symlink d8/df/d66/l74 0 2024-03-16T10:53:19.348 INFO:tasks.workunit.client.0.smithi017.stdout:0/673: dwrite d2/d4/f51 [4194304,4194304] 0 2024-03-16T10:53:19.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/362: dread d8/df/d46/f55 [0,4194304] 0 2024-03-16T10:53:19.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/363: readlink l6 0 2024-03-16T10:53:19.379 INFO:tasks.workunit.client.0.smithi017.stdout:5/680: creat d0/d1/d76/fe9 x:0 0 0 2024-03-16T10:53:19.383 INFO:tasks.workunit.client.0.smithi017.stdout:7/467: creat d7/db/f9d x:0 0 0 2024-03-16T10:53:19.388 INFO:tasks.workunit.client.0.smithi017.stdout:6/484: creat d0/d9/d45/d4d/d2c/d41/f9d x:0 0 0 2024-03-16T10:53:19.396 INFO:tasks.workunit.client.0.smithi017.stdout:5/681: dwrite d0/d1/fb3 [0,4194304] 0 2024-03-16T10:53:19.409 INFO:tasks.workunit.client.0.smithi017.stdout:3/474: unlink d8/d1b/d2e/l8f 0 2024-03-16T10:53:19.409 INFO:tasks.workunit.client.0.smithi017.stdout:3/475: readlink l5 0 2024-03-16T10:53:19.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/733: link d1/d24/fa7 d1/d3/d57/d97/ff8 0 2024-03-16T10:53:19.415 INFO:tasks.workunit.client.0.smithi017.stdout:2/430: rmdir d4/d6/d30/d3f 39 2024-03-16T10:53:19.428 INFO:tasks.workunit.client.0.smithi017.stdout:7/468: creat d7/db/d12/d1c/d30/f9e x:0 0 0 2024-03-16T10:53:19.429 INFO:tasks.workunit.client.0.smithi017.stdout:6/485: rmdir d0/d9/d45/d4d/d6d/d75/d78 39 2024-03-16T10:53:19.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/682: mkdir d0/d1/d2/d2c/d36/db4/dea 0 2024-03-16T10:53:19.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/683: fsync d0/d1/d2/dc/d2f/fe1 0 2024-03-16T10:53:19.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/684: readlink d0/d1/d30/d55/l9d 0 2024-03-16T10:53:19.442 INFO:tasks.workunit.client.0.smithi017.stdout:3/476: unlink d8/d3f/d3d/f6e 0 2024-03-16T10:53:19.447 INFO:tasks.workunit.client.0.smithi017.stdout:1/734: getdents d1/d50/d8d 0 2024-03-16T10:53:19.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/431: mknod d4/d6/db/c84 0 2024-03-16T10:53:19.453 INFO:tasks.workunit.client.0.smithi017.stdout:7/469: mkdir d7/d9f 0 2024-03-16T10:53:19.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/685: mknod d0/d1/d2/d24/ceb 0 2024-03-16T10:53:19.461 INFO:tasks.workunit.client.0.smithi017.stdout:3/477: mknod d8/d1b/d2e/c91 0 2024-03-16T10:53:19.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/735: symlink d1/d3/dd/d31/lf9 0 2024-03-16T10:53:19.467 INFO:tasks.workunit.client.0.smithi017.stdout:2/432: creat d4/d6/d30/d3f/f85 x:0 0 0 2024-03-16T10:53:19.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/686: mkdir d0/d1/d2/dec 0 2024-03-16T10:53:19.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/736: dread d1/d3/f6d [8388608,4194304] 0 2024-03-16T10:53:19.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/737: write d1/d24/d79/d7a/fba [227897,2808] 0 2024-03-16T10:53:19.479 INFO:tasks.workunit.client.0.smithi017.stdout:2/433: link d4/l1f d4/d6/d81/l86 0 2024-03-16T10:53:19.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/738: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/ffa x:0 0 0 2024-03-16T10:53:19.481 INFO:tasks.workunit.client.0.smithi017.stdout:1/739: dread d1/d3/dd/f77 [0,4194304] 0 2024-03-16T10:53:19.481 INFO:tasks.workunit.client.0.smithi017.stdout:2/434: link d4/d6/db/d66/d2e/f3c d4/d6/db/d66/d2e/f87 0 2024-03-16T10:53:19.483 INFO:tasks.workunit.client.0.smithi017.stdout:2/435: creat d4/dd/d1e/d3e/d51/f88 x:0 0 0 2024-03-16T10:53:19.488 INFO:tasks.workunit.client.0.smithi017.stdout:1/740: mknod d1/d3/dd/d31/d66/dd3/cfb 0 2024-03-16T10:53:19.490 INFO:tasks.workunit.client.0.smithi017.stdout:1/741: rmdir d1/d3/d57/d94 39 2024-03-16T10:53:19.496 INFO:tasks.workunit.client.0.smithi017.stdout:9/364: rename d8/df/d5b/d32/d45/c48 to d8/df/d5b/d72/c75 0 2024-03-16T10:53:19.496 INFO:tasks.workunit.client.0.smithi017.stdout:9/365: dread - d8/df/d5b/d32/d45/f4a zero size 2024-03-16T10:53:19.498 INFO:tasks.workunit.client.0.smithi017.stdout:2/436: rmdir d4/d6/db/d66 39 2024-03-16T10:53:19.501 INFO:tasks.workunit.client.0.smithi017.stdout:6/486: rename d0/d9/d45/c65 to d0/d15/c9e 0 2024-03-16T10:53:19.501 INFO:tasks.workunit.client.0.smithi017.stdout:0/674: link d2/d4/d6d/d84/dc1/dd2/d24/d29/cae d2/d4/d90/d86/db7/dc0/cee 0 2024-03-16T10:53:19.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/366: unlink d8/df/d5b/f6d 0 2024-03-16T10:53:19.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/367: fsync d8/f4d 0 2024-03-16T10:53:19.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/368: readlink d8/df/l2e 0 2024-03-16T10:53:19.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/369: stat d8/df/d5b/d32 0 2024-03-16T10:53:19.504 INFO:tasks.workunit.client.0.smithi017.stdout:9/370: write d8/df/d5b/f5d [1007137,28142] 0 2024-03-16T10:53:19.505 INFO:tasks.workunit.client.0.smithi017.stdout:7/470: rename d7/d8a/d66/c72 to d7/d8a/ca0 0 2024-03-16T10:53:19.507 INFO:tasks.workunit.client.0.smithi017.stdout:2/437: creat d4/dd/d1e/f89 x:0 0 0 2024-03-16T10:53:19.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/487: unlink d0/d22/c42 0 2024-03-16T10:53:19.508 INFO:tasks.workunit.client.0.smithi017.stdout:9/371: rmdir d8/df/d46 39 2024-03-16T10:53:19.510 INFO:tasks.workunit.client.0.smithi017.stdout:3/478: rename d8/da/f59 to d8/d1b/d1c/f92 0 2024-03-16T10:53:19.510 INFO:tasks.workunit.client.0.smithi017.stdout:1/742: rename d1 to d1/d3/dd/d31/d66/da1/de3/dfc 22 2024-03-16T10:53:19.512 INFO:tasks.workunit.client.0.smithi017.stdout:9/372: truncate d8/df/d5b/d32/f34 1637189 0 2024-03-16T10:53:19.512 INFO:tasks.workunit.client.0.smithi017.stdout:9/373: fsync d8/df/f11 0 2024-03-16T10:53:19.512 INFO:tasks.workunit.client.0.smithi017.stdout:1/743: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/ffd x:0 0 0 2024-03-16T10:53:19.513 INFO:tasks.workunit.client.0.smithi017.stdout:3/479: link d8/d1b/d2e/d60/d63/f72 d8/da/f93 0 2024-03-16T10:53:19.514 INFO:tasks.workunit.client.0.smithi017.stdout:0/675: rename d2/d4/d6d/d84/dc1/fd8 to d2/d4/d6d/d84/de9/fef 0 2024-03-16T10:53:19.514 INFO:tasks.workunit.client.0.smithi017.stdout:0/676: fdatasync d2/d4/d6d/d84/dc1/dd2/f1a 0 2024-03-16T10:53:19.514 INFO:tasks.workunit.client.0.smithi017.stdout:1/744: write d1/d3/dd/d72/fd9 [806225,98535] 0 2024-03-16T10:53:19.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/745: read d1/d3/dd/f77 [371140,73520] 0 2024-03-16T10:53:19.516 INFO:tasks.workunit.client.0.smithi017.stdout:9/374: symlink d8/l76 0 2024-03-16T10:53:19.516 INFO:tasks.workunit.client.0.smithi017.stdout:6/488: dwrite d0/d21/d39/d44/f70 [0,4194304] 0 2024-03-16T10:53:19.516 INFO:tasks.workunit.client.0.smithi017.stdout:6/489: write d0/d21/d39/f5a [274641,122732] 0 2024-03-16T10:53:19.518 INFO:tasks.workunit.client.0.smithi017.stdout:3/480: symlink d8/d1b/d2e/d8d/d87/l94 0 2024-03-16T10:53:19.521 INFO:tasks.workunit.client.0.smithi017.stdout:9/375: creat d8/df/d5b/d32/d45/f77 x:0 0 0 2024-03-16T10:53:19.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/746: write d1/d3/f87 [5815839,15167] 0 2024-03-16T10:53:19.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/747: chown d1/d3/dd/d72/fb2 1674792 1 2024-03-16T10:53:19.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/490: truncate d0/d9/d45/d4d/d2c/f56 2043889 0 2024-03-16T10:53:19.528 INFO:tasks.workunit.client.0.smithi017.stdout:3/481: creat d8/d8c/f95 x:0 0 0 2024-03-16T10:53:19.528 INFO:tasks.workunit.client.0.smithi017.stdout:3/482: stat d8/da/db/l51 0 2024-03-16T10:53:19.528 INFO:tasks.workunit.client.0.smithi017.stdout:3/483: chown d8/da/db/c13 9880699 1 2024-03-16T10:53:19.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/376: unlink d8/df/d5b/f62 0 2024-03-16T10:53:19.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/377: chown d8/df/c14 770868211 1 2024-03-16T10:53:19.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/484: creat d8/d1b/d1c/d62/d69/f96 x:0 0 0 2024-03-16T10:53:19.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/485: fsync d8/d1b/d1c/d62/f7d 0 2024-03-16T10:53:19.536 INFO:tasks.workunit.client.0.smithi017.stdout:3/486: symlink d8/d1d/l97 0 2024-03-16T10:53:19.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/487: chown d8/d1b/d1c/d62/l7e 4203886 1 2024-03-16T10:53:19.540 INFO:tasks.workunit.client.0.smithi017.stdout:3/488: creat d8/d3f/f98 x:0 0 0 2024-03-16T10:53:19.544 INFO:tasks.workunit.client.0.smithi017.stdout:9/378: dwrite d8/df/d46/d63/f6b [0,4194304] 0 2024-03-16T10:53:19.550 INFO:tasks.workunit.client.0.smithi017.stdout:9/379: symlink d8/df/d5b/d5e/d68/l78 0 2024-03-16T10:53:19.552 INFO:tasks.workunit.client.0.smithi017.stdout:9/380: creat d8/f79 x:0 0 0 2024-03-16T10:53:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:7/471: rename d7/db/dc/d50/d59/f68 to d7/db/dc/d50/d59/d34/fa1 0 2024-03-16T10:53:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/489: dwrite d8/fc [0,4194304] 0 2024-03-16T10:53:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/490: write d8/d1b/d2e/d60/d63/f72 [335640,5218] 0 2024-03-16T10:53:19.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/472: unlink d7/db/dc/d60/l89 0 2024-03-16T10:53:19.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/473: creat d7/db/dc/d50/d59/d34/d95/fa2 x:0 0 0 2024-03-16T10:53:19.561 INFO:tasks.workunit.client.0.smithi017.stdout:9/381: dread d8/df/d5b/d32/f50 [0,4194304] 0 2024-03-16T10:53:19.562 INFO:tasks.workunit.client.0.smithi017.stdout:7/474: mkdir d7/db/dc/d50/d59/d34/d95/da3 0 2024-03-16T10:53:19.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/491: unlink d8/l1e 0 2024-03-16T10:53:19.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/492: stat d8/d1b/d65/c86 0 2024-03-16T10:53:19.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:19 smithi174 ceph-mon[36202]: scrub summary: active paths [/] 2024-03-16T10:53:19.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:19 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:19 smithi174 ceph-mon[36202]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.584 INFO:tasks.workunit.client.0.smithi017.stdout:7/475: dwrite d7/db/dc/d50/d59/f61 [0,4194304] 0 2024-03-16T10:53:19.584 INFO:tasks.workunit.client.0.smithi017.stdout:9/382: dwrite d8/df/d46/f5a [0,4194304] 0 2024-03-16T10:53:19.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/493: dwrite d8/da/db/f23 [8388608,4194304] 0 2024-03-16T10:53:19.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/491: rename d0/d9/d45/d4d/d2e/c46 to d0/d9/d45/d4d/d2c/d41/d97/c9f 0 2024-03-16T10:53:19.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:19 smithi017 ceph-mon[32078]: scrub summary: active paths [/] 2024-03-16T10:53:19.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:19 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:19 smithi017 ceph-mon[32078]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.591 INFO:tasks.workunit.client.0.smithi017.stdout:3/494: creat d8/d1b/d1c/f99 x:0 0 0 2024-03-16T10:53:19.596 INFO:tasks.workunit.client.0.smithi017.stdout:6/492: getdents d0/d9/d45/d4d/d2c 0 2024-03-16T10:53:19.596 INFO:tasks.workunit.client.0.smithi017.stdout:6/493: stat d0/d15/f17 0 2024-03-16T10:53:19.598 INFO:tasks.workunit.client.0.smithi017.stdout:7/476: dwrite d7/db/f4b [4194304,4194304] 0 2024-03-16T10:53:19.599 INFO:tasks.workunit.client.0.smithi017.stdout:7/477: write d7/db/d12/d1c/f6e [748437,55691] 0 2024-03-16T10:53:19.599 INFO:tasks.workunit.client.0.smithi017.stdout:7/478: write d7/db/f9d [21150,66238] 0 2024-03-16T10:53:19.602 INFO:tasks.workunit.client.0.smithi017.stdout:7/479: link d7/db/d12/d1c/d4e/l5d d7/db/dc/d60/la4 0 2024-03-16T10:53:19.603 INFO:tasks.workunit.client.0.smithi017.stdout:7/480: mkdir d7/db/d32/d78/da5 0 2024-03-16T10:53:19.607 INFO:tasks.workunit.client.0.smithi017.stdout:9/383: dwrite d8/df/d5b/d32/d45/f4a [0,4194304] 0 2024-03-16T10:53:19.607 INFO:tasks.workunit.client.0.smithi017.stdout:9/384: read d8/df/f4f [5027,70602] 0 2024-03-16T10:53:19.608 INFO:tasks.workunit.client.0.smithi017.stdout:9/385: stat d8/df/d5b/c3f 0 2024-03-16T10:53:19.608 INFO:tasks.workunit.client.0.smithi017.stdout:9/386: truncate d8/df/f60 850639 0 2024-03-16T10:53:19.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/495: dwrite d8/f52 [8388608,4194304] 0 2024-03-16T10:53:19.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/496: truncate d8/d1d/f4b 820138 0 2024-03-16T10:53:19.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/497: write d8/d1b/d2e/d60/d63/f72 [499866,100759] 0 2024-03-16T10:53:19.613 INFO:tasks.workunit.client.0.smithi017.stdout:3/498: rmdir d8/d1b/d1c 39 2024-03-16T10:53:19.613 INFO:tasks.workunit.client.0.smithi017.stdout:3/499: chown d8/da/db/f2a 193493773 1 2024-03-16T10:53:19.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/500: rmdir d8/d3f/d3d 39 2024-03-16T10:53:19.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/501: mkdir d8/d1d/d9a 0 2024-03-16T10:53:19.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/502: truncate d8/da/f93 1607049 0 2024-03-16T10:53:19.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/503: creat d8/d1b/d65/f9b x:0 0 0 2024-03-16T10:53:19.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/504: getdents d8/d3f/d3d 0 2024-03-16T10:53:19.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/481: dwrite f2 [0,4194304] 0 2024-03-16T10:53:19.622 INFO:tasks.workunit.client.0.smithi017.stdout:6/494: dwrite d0/d9/d45/d4d/d2e/d69/d7e/f93 [0,4194304] 0 2024-03-16T10:53:19.623 INFO:tasks.workunit.client.0.smithi017.stdout:7/482: mknod d7/d8a/d66/ca6 0 2024-03-16T10:53:19.624 INFO:tasks.workunit.client.0.smithi017.stdout:3/505: dread d8/da/f31 [0,4194304] 0 2024-03-16T10:53:19.624 INFO:tasks.workunit.client.0.smithi017.stdout:3/506: dread - d8/d1b/f73 zero size 2024-03-16T10:53:19.624 INFO:tasks.workunit.client.0.smithi017.stdout:3/507: chown d8/da/c4f 1 1 2024-03-16T10:53:19.625 INFO:tasks.workunit.client.0.smithi017.stdout:7/483: creat d7/db/d12/d1c/d30/fa7 x:0 0 0 2024-03-16T10:53:19.625 INFO:tasks.workunit.client.0.smithi017.stdout:6/495: creat d0/d9/d45/d4d/d2c/fa0 x:0 0 0 2024-03-16T10:53:19.626 INFO:tasks.workunit.client.0.smithi017.stdout:3/508: getdents d8/d1b 0 2024-03-16T10:53:19.627 INFO:tasks.workunit.client.0.smithi017.stdout:9/387: dwrite d8/df/d5b/f3b [0,4194304] 0 2024-03-16T10:53:19.628 INFO:tasks.workunit.client.0.smithi017.stdout:3/509: unlink d8/da/f36 0 2024-03-16T10:53:19.630 INFO:tasks.workunit.client.0.smithi017.stdout:9/388: creat d8/df/d5b/d5e/d68/f7a x:0 0 0 2024-03-16T10:53:19.632 INFO:tasks.workunit.client.0.smithi017.stdout:7/484: write d7/db/dc/d50/d59/f61 [2211848,47057] 0 2024-03-16T10:53:19.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/510: mknod d8/d3f/d3d/c9c 0 2024-03-16T10:53:19.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/511: stat d8/da/c4f 0 2024-03-16T10:53:19.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/512: fsync d8/d3f/d3d/f76 0 2024-03-16T10:53:19.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/513: truncate d8/d1b/f8a 144777 0 2024-03-16T10:53:19.635 INFO:tasks.workunit.client.0.smithi017.stdout:9/389: link d8/df/d46/f5a d8/df/d46/d63/f7b 0 2024-03-16T10:53:19.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/485: rmdir d7/db/d12/d1c/d77 0 2024-03-16T10:53:19.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/514: read d8/da/db/f50 [1797078,112816] 0 2024-03-16T10:53:19.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/515: truncate d8/d1b/f27 2597827 0 2024-03-16T10:53:19.640 INFO:tasks.workunit.client.0.smithi017.stdout:7/486: mkdir d7/db/dc/d50/da8 0 2024-03-16T10:53:19.645 INFO:tasks.workunit.client.0.smithi017.stdout:4/634: sync 2024-03-16T10:53:19.645 INFO:tasks.workunit.client.0.smithi017.stdout:8/534: sync 2024-03-16T10:53:19.647 INFO:tasks.workunit.client.0.smithi017.stdout:8/535: dread d6/d5c/f73 [0,4194304] 0 2024-03-16T10:53:19.652 INFO:tasks.workunit.client.0.smithi017.stdout:4/635: creat d15/d1d/fdb x:0 0 0 2024-03-16T10:53:19.652 INFO:tasks.workunit.client.0.smithi017.stdout:4/636: stat d15/d1d/d21/db1 0 2024-03-16T10:53:19.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/637: fsync d15/d1d/d85/fba 0 2024-03-16T10:53:19.654 INFO:tasks.workunit.client.0.smithi017.stdout:8/536: creat d6/d5f/d6e/d43/fa7 x:0 0 0 2024-03-16T10:53:19.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/537: symlink d6/d5f/d6e/d43/la8 0 2024-03-16T10:53:19.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/538: chown d6/d39/d35/d92/fa0 266882 1 2024-03-16T10:53:19.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/539: chown d6/d5f/d6e/d34/f61 22 1 2024-03-16T10:53:19.657 INFO:tasks.workunit.client.0.smithi017.stdout:7/487: dwrite d7/db/dc/d50/d59/d34/d95/fa2 [0,4194304] 0 2024-03-16T10:53:19.657 INFO:tasks.workunit.client.0.smithi017.stdout:7/488: write d7/db/dc/d50/d59/d34/d53/f99 [764967,94053] 0 2024-03-16T10:53:19.657 INFO:tasks.workunit.client.0.smithi017.stdout:7/489: write d7/db/dc/d60/f6a [5155736,50877] 0 2024-03-16T10:53:19.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:19 smithi111 ceph-mon[36315]: scrub summary: active paths [/] 2024-03-16T10:53:19.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:19 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:19 smithi111 ceph-mon[36315]: scrub summary: idle+waiting paths [/] 2024-03-16T10:53:19.666 INFO:tasks.workunit.client.0.smithi017.stdout:4/638: dwrite d15/f59 [0,4194304] 0 2024-03-16T10:53:19.666 INFO:tasks.workunit.client.0.smithi017.stdout:4/639: chown d15/d1d/d21/d3c/d93/d43 4367899 1 2024-03-16T10:53:19.667 INFO:tasks.workunit.client.0.smithi017.stdout:8/540: getdents d6/d5f/d6e/d43 0 2024-03-16T10:53:19.669 INFO:tasks.workunit.client.0.smithi017.stdout:7/490: truncate d7/db/dc/d60/f6a 1382397 0 2024-03-16T10:53:19.671 INFO:tasks.workunit.client.0.smithi017.stdout:4/640: mknod d15/d1d/d21/d3c/d93/d7c/cdc 0 2024-03-16T10:53:19.671 INFO:tasks.workunit.client.0.smithi017.stdout:4/641: chown d15/c1a 0 1 2024-03-16T10:53:19.672 INFO:tasks.workunit.client.0.smithi017.stdout:8/541: mkdir d6/d39/da9 0 2024-03-16T10:53:19.675 INFO:tasks.workunit.client.0.smithi017.stdout:7/491: unlink d7/d8a/d66/c6f 0 2024-03-16T10:53:19.683 INFO:tasks.workunit.client.0.smithi017.stdout:7/492: dread d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:19.683 INFO:tasks.workunit.client.0.smithi017.stdout:4/642: dwrite d15/d1d/d21/d3c/d93/d7c/f90 [0,4194304] 0 2024-03-16T10:53:19.684 INFO:tasks.workunit.client.0.smithi017.stdout:7/493: chown d7/db/d81/f97 3698402 1 2024-03-16T10:53:19.688 INFO:tasks.workunit.client.0.smithi017.stdout:7/494: unlink d7/db/l40 0 2024-03-16T10:53:19.688 INFO:tasks.workunit.client.0.smithi017.stdout:7/495: truncate d7/db/dc/d50/d59/f7e 1044531 0 2024-03-16T10:53:19.688 INFO:tasks.workunit.client.0.smithi017.stdout:8/542: dwrite d6/d14/d72/f95 [0,4194304] 0 2024-03-16T10:53:19.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/496: unlink d7/db/ce 0 2024-03-16T10:53:19.692 INFO:tasks.workunit.client.0.smithi017.stdout:4/643: write d15/d1d/d21/d3c/d93/d40/d51/d64/f6a [2402059,66810] 0 2024-03-16T10:53:19.693 INFO:tasks.workunit.client.0.smithi017.stdout:8/543: mknod d6/d39/da9/caa 0 2024-03-16T10:53:19.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/644: fdatasync d15/d1d/d21/db1/db5/fb7 0 2024-03-16T10:53:19.694 INFO:tasks.workunit.client.0.smithi017.stdout:8/544: write d6/d5f/d6e/d34/f76 [344743,1876] 0 2024-03-16T10:53:19.694 INFO:tasks.workunit.client.0.smithi017.stdout:8/545: write d6/d5f/d6e/d43/fa7 [148093,53955] 0 2024-03-16T10:53:19.696 INFO:tasks.workunit.client.0.smithi017.stdout:4/645: link d15/d1d/d21/f72 d15/d1d/daf/fdd 0 2024-03-16T10:53:19.696 INFO:tasks.workunit.client.0.smithi017.stdout:4/646: chown d15/d1d/f91 28529268 1 2024-03-16T10:53:19.700 INFO:tasks.workunit.client.0.smithi017.stdout:4/647: mkdir d15/d1d/d21/d3c/d93/d43/dde 0 2024-03-16T10:53:19.703 INFO:tasks.workunit.client.0.smithi017.stdout:4/648: symlink d15/d1d/d21/d3c/d93/d40/d51/d64/da8/ldf 0 2024-03-16T10:53:19.707 INFO:tasks.workunit.client.0.smithi017.stdout:7/497: dwrite d7/db/d32/f54 [4194304,4194304] 0 2024-03-16T10:53:19.707 INFO:tasks.workunit.client.0.smithi017.stdout:7/498: write d7/db/dc/d50/d59/d34/f5e [1988784,23923] 0 2024-03-16T10:53:19.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/649: rmdir d15/d1d/d27 39 2024-03-16T10:53:19.708 INFO:tasks.workunit.client.0.smithi017.stdout:7/499: symlink d7/db/dc/d50/d59/la9 0 2024-03-16T10:53:19.711 INFO:tasks.workunit.client.0.smithi017.stdout:4/650: unlink d15/d1d/d21/d26/d66/d8c/dab/fcc 0 2024-03-16T10:53:19.712 INFO:tasks.workunit.client.0.smithi017.stdout:7/500: dread d7/db/f52 [0,4194304] 0 2024-03-16T10:53:19.712 INFO:tasks.workunit.client.0.smithi017.stdout:7/501: chown d7/db/dc/d50/d59/f61 2793 1 2024-03-16T10:53:19.712 INFO:tasks.workunit.client.0.smithi017.stdout:7/502: stat d7/db/c58 0 2024-03-16T10:53:19.713 INFO:tasks.workunit.client.0.smithi017.stdout:4/651: dread d15/f68 [0,4194304] 0 2024-03-16T10:53:19.713 INFO:tasks.workunit.client.0.smithi017.stdout:8/546: dwrite d6/d5f/d6e/d43/f3c [0,4194304] 0 2024-03-16T10:53:19.713 INFO:tasks.workunit.client.0.smithi017.stdout:8/547: write d6/d14/d8c/f8b [1535913,15517] 0 2024-03-16T10:53:19.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/503: write d7/db/d12/d1c/d30/f9e [789612,118096] 0 2024-03-16T10:53:19.716 INFO:tasks.workunit.client.0.smithi017.stdout:8/548: creat d6/d5f/d6e/d34/fab x:0 0 0 2024-03-16T10:53:19.717 INFO:tasks.workunit.client.0.smithi017.stdout:7/504: chown d7/db/d12/d1c/c70 106911 1 2024-03-16T10:53:19.719 INFO:tasks.workunit.client.0.smithi017.stdout:8/549: symlink d6/d14/d72/lac 0 2024-03-16T10:53:19.722 INFO:tasks.workunit.client.0.smithi017.stdout:7/505: unlink d7/db/dc/d50/l57 0 2024-03-16T10:53:19.722 INFO:tasks.workunit.client.0.smithi017.stdout:7/506: chown d7/db/d12/d96 2360464 1 2024-03-16T10:53:19.725 INFO:tasks.workunit.client.0.smithi017.stdout:4/652: dwrite d15/f9c [0,4194304] 0 2024-03-16T10:53:19.725 INFO:tasks.workunit.client.0.smithi017.stdout:4/653: fsync d15/d1d/d21/d3c/d93/d40/f7b 0 2024-03-16T10:53:19.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/654: creat d15/d1d/d21/d26/d66/d8c/dab/dc7/fe0 x:0 0 0 2024-03-16T10:53:19.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/655: chown d15/d1d/d21/d3c/d93/d40/l62 0 1 2024-03-16T10:53:19.735 INFO:tasks.workunit.client.0.smithi017.stdout:4/656: creat d15/d1d/d21/d3c/d93/d40/d51/d64/d63/d9f/fe1 x:0 0 0 2024-03-16T10:53:19.741 INFO:tasks.workunit.client.0.smithi017.stdout:8/550: dwrite d6/d14/d6b/f8e [0,4194304] 0 2024-03-16T10:53:19.741 INFO:tasks.workunit.client.0.smithi017.stdout:4/657: rmdir d15/d1d/d21/d3c 39 2024-03-16T10:53:19.741 INFO:tasks.workunit.client.0.smithi017.stdout:4/658: chown d15/d1d/d27/f49 1818084823 1 2024-03-16T10:53:19.746 INFO:tasks.workunit.client.0.smithi017.stdout:7/507: dwrite f2 [8388608,4194304] 0 2024-03-16T10:53:19.746 INFO:tasks.workunit.client.0.smithi017.stdout:7/508: write d7/db/dc/d50/f7c [449678,85114] 0 2024-03-16T10:53:19.747 INFO:tasks.workunit.client.0.smithi017.stdout:8/551: creat d6/d14/d8c/fad x:0 0 0 2024-03-16T10:53:19.748 INFO:tasks.workunit.client.0.smithi017.stdout:4/659: creat d15/d1d/d50/fe2 x:0 0 0 2024-03-16T10:53:19.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/509: link d7/db/d12/d1c/d30/c85 d7/db/dc/d50/d59/caa 0 2024-03-16T10:53:19.755 INFO:tasks.workunit.client.0.smithi017.stdout:8/552: symlink d6/d14/d6b/lae 0 2024-03-16T10:53:19.756 INFO:tasks.workunit.client.0.smithi017.stdout:4/660: dread d15/d1d/f56 [0,4194304] 0 2024-03-16T10:53:19.757 INFO:tasks.workunit.client.0.smithi017.stdout:8/553: rename d6/d5f/d6e/d34/l6a to d6/d14/laf 0 2024-03-16T10:53:19.757 INFO:tasks.workunit.client.0.smithi017.stdout:8/554: chown d6/d16/ca5 25616086 1 2024-03-16T10:53:19.759 INFO:tasks.workunit.client.0.smithi017.stdout:4/661: creat d15/d1d/daf/fe3 x:0 0 0 2024-03-16T10:53:19.759 INFO:tasks.workunit.client.0.smithi017.stdout:8/555: dread d6/d4a/f4d [0,4194304] 0 2024-03-16T10:53:19.761 INFO:tasks.workunit.client.0.smithi017.stdout:4/662: dread f4 [0,4194304] 0 2024-03-16T10:53:19.762 INFO:tasks.workunit.client.0.smithi017.stdout:8/556: mknod d6/d5f/d6e/cb0 0 2024-03-16T10:53:19.762 INFO:tasks.workunit.client.0.smithi017.stdout:8/557: chown d6/d5c/c74 1646907 1 2024-03-16T10:53:19.764 INFO:tasks.workunit.client.0.smithi017.stdout:4/663: unlink d15/d1d/d50/c69 0 2024-03-16T10:53:19.764 INFO:tasks.workunit.client.0.smithi017.stdout:4/664: chown d15/d1d/f5d 21373 1 2024-03-16T10:53:19.764 INFO:tasks.workunit.client.0.smithi017.stdout:4/665: chown d15/f9b 0 1 2024-03-16T10:53:19.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/666: mknod d15/d1d/d21/d3c/d93/d40/d51/d64/d63/dca/ce4 0 2024-03-16T10:53:19.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/667: write d15/d1d/d21/f7f [1465304,16530] 0 2024-03-16T10:53:19.768 INFO:tasks.workunit.client.0.smithi017.stdout:4/668: symlink d15/d1d/d27/le5 0 2024-03-16T10:53:19.770 INFO:tasks.workunit.client.0.smithi017.stdout:7/510: dwrite d7/d8a/f39 [0,4194304] 0 2024-03-16T10:53:19.770 INFO:tasks.workunit.client.0.smithi017.stdout:7/511: stat d7/db/dc/d50/d59/la9 0 2024-03-16T10:53:19.771 INFO:tasks.workunit.client.0.smithi017.stdout:4/669: link d15/d1d/d85/fb0 d15/d1d/d85/fe6 0 2024-03-16T10:53:19.771 INFO:tasks.workunit.client.0.smithi017.stdout:7/512: mkdir d7/db/d12/d1c/d30/dab 0 2024-03-16T10:53:19.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/670: truncate d15/d1d/fd9 600127 0 2024-03-16T10:53:19.772 INFO:tasks.workunit.client.0.smithi017.stdout:8/558: dwrite d6/d5c/f8f [4194304,4194304] 0 2024-03-16T10:53:19.773 INFO:tasks.workunit.client.0.smithi017.stdout:7/513: creat d7/db/d81/fac x:0 0 0 2024-03-16T10:53:19.774 INFO:tasks.workunit.client.0.smithi017.stdout:8/559: symlink d6/d5f/lb1 0 2024-03-16T10:53:19.777 INFO:tasks.workunit.client.0.smithi017.stdout:7/514: mkdir d7/d8a/d66/dad 0 2024-03-16T10:53:19.779 INFO:tasks.workunit.client.0.smithi017.stdout:8/560: unlink d6/d39/f32 0 2024-03-16T10:53:19.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/671: write d15/d1d/d21/d3c/d93/d43/f9e [1210075,129208] 0 2024-03-16T10:53:19.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/515: mkdir d7/db/dc/dae 0 2024-03-16T10:53:19.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/516: dread - d7/db/d81/fac zero size 2024-03-16T10:53:19.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/561: rename d6/d5f/d6e/d34/f61 to d6/d5c/d96/d98/fb2 0 2024-03-16T10:53:19.787 INFO:tasks.workunit.client.0.smithi017.stdout:4/672: symlink d15/d1d/d21/d3c/d93/le7 0 2024-03-16T10:53:19.790 INFO:tasks.workunit.client.0.smithi017.stdout:7/517: dread d7/db/d12/d1c/f6e [0,4194304] 0 2024-03-16T10:53:19.790 INFO:tasks.workunit.client.0.smithi017.stdout:4/673: dread d15/d1d/d21/f4c [0,4194304] 0 2024-03-16T10:53:19.791 INFO:tasks.workunit.client.0.smithi017.stdout:7/518: mkdir d7/db/dc/d50/d59/daf 0 2024-03-16T10:53:19.793 INFO:tasks.workunit.client.0.smithi017.stdout:4/674: symlink d15/d1d/d21/d26/d66/le8 0 2024-03-16T10:53:19.794 INFO:tasks.workunit.client.0.smithi017.stdout:7/519: creat d7/d8a/fb0 x:0 0 0 2024-03-16T10:53:19.796 INFO:tasks.workunit.client.0.smithi017.stdout:8/562: dwrite d6/d14/d72/f95 [0,4194304] 0 2024-03-16T10:53:19.811 INFO:tasks.workunit.client.0.smithi017.stdout:7/520: dwrite d7/db/d12/f4c [0,4194304] 0 2024-03-16T10:53:19.816 INFO:tasks.workunit.client.0.smithi017.stdout:7/521: getdents d7/d8a 0 2024-03-16T10:53:19.816 INFO:tasks.workunit.client.0.smithi017.stdout:7/522: readlink d7/d8a/l5f 0 2024-03-16T10:53:19.817 INFO:tasks.workunit.client.0.smithi017.stdout:7/523: read d7/db/dc/f10 [158944,102778] 0 2024-03-16T10:53:19.819 INFO:tasks.workunit.client.0.smithi017.stdout:8/563: dwrite d6/d5f/d6e/d34/fab [0,4194304] 0 2024-03-16T10:53:19.819 INFO:tasks.workunit.client.0.smithi017.stdout:7/524: creat d7/db/dc/d50/d59/d34/fb1 x:0 0 0 2024-03-16T10:53:19.819 INFO:tasks.workunit.client.0.smithi017.stdout:7/525: stat d7/db/c9a 0 2024-03-16T10:53:19.823 INFO:tasks.workunit.client.0.smithi017.stdout:4/675: rename d15/d1d/d21/d3c/d93 to d15/d1d/d21/d3c/de9 0 2024-03-16T10:53:19.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/676: mknod d15/d1d/d21/d3c/de9/d43/dc2/cea 0 2024-03-16T10:53:19.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/677: creat d15/d1d/d21/d3c/de9/d40/d51/d64/da8/feb x:0 0 0 2024-03-16T10:53:19.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/678: dread - d15/d1d/d50/f74 zero size 2024-03-16T10:53:19.830 INFO:tasks.workunit.client.0.smithi017.stdout:4/679: dread d15/d1d/d27/f78 [0,4194304] 0 2024-03-16T10:53:19.832 INFO:tasks.workunit.client.0.smithi017.stdout:4/680: dread d15/f17 [0,4194304] 0 2024-03-16T10:53:19.832 INFO:tasks.workunit.client.0.smithi017.stdout:7/526: write d7/d8a/f39 [2720370,1358] 0 2024-03-16T10:53:19.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/527: chown d7/d5a/l82 0 1 2024-03-16T10:53:19.840 INFO:tasks.workunit.client.0.smithi017.stdout:4/681: write d15/d1d/d21/fa7 [2218001,86488] 0 2024-03-16T10:53:19.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/564: dwrite d6/d5f/d6e/d34/f76 [0,4194304] 0 2024-03-16T10:53:19.844 INFO:tasks.workunit.client.0.smithi017.stdout:4/682: truncate d15/f9c 259033 0 2024-03-16T10:53:19.845 INFO:tasks.workunit.client.0.smithi017.stdout:8/565: mkdir d6/d16/db3 0 2024-03-16T10:53:19.846 INFO:tasks.workunit.client.0.smithi017.stdout:4/683: rmdir d15/d1d/d21/d26/d66/d8c/dab/dc7 39 2024-03-16T10:53:19.849 INFO:tasks.workunit.client.0.smithi017.stdout:8/566: truncate d6/d5f/f33 1159811 0 2024-03-16T10:53:19.849 INFO:tasks.workunit.client.0.smithi017.stdout:4/684: symlink d15/d1d/d21/d3c/de9/d43/dc2/lec 0 2024-03-16T10:53:19.850 INFO:tasks.workunit.client.0.smithi017.stdout:8/567: dread d6/f68 [0,4194304] 0 2024-03-16T10:53:19.853 INFO:tasks.workunit.client.0.smithi017.stdout:4/685: creat d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/fed x:0 0 0 2024-03-16T10:53:19.855 INFO:tasks.workunit.client.0.smithi017.stdout:4/686: mknod d15/d1d/d21/d3c/de9/d40/d51/d64/d63/dca/cee 0 2024-03-16T10:53:19.866 INFO:tasks.workunit.client.0.smithi017.stdout:8/568: dwrite d6/d5f/d6e/d43/fa7 [0,4194304] 0 2024-03-16T10:53:19.869 INFO:tasks.workunit.client.0.smithi017.stdout:8/569: mkdir d6/d5f/d6e/d34/db4 0 2024-03-16T10:53:19.871 INFO:tasks.workunit.client.0.smithi017.stdout:4/687: dwrite d15/d1d/d21/d26/d66/fc0 [0,4194304] 0 2024-03-16T10:53:19.873 INFO:tasks.workunit.client.0.smithi017.stdout:8/570: dread d6/f4e [0,4194304] 0 2024-03-16T10:53:19.873 INFO:tasks.workunit.client.0.smithi017.stdout:8/571: stat d6/d5f 0 2024-03-16T10:53:19.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/688: mknod d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/cef 0 2024-03-16T10:53:19.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/689: dread - d15/d1d/d21/d3c/de9/d7c/fcf zero size 2024-03-16T10:53:19.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/690: truncate d15/d1d/d21/d3c/de9/f38 1647668 0 2024-03-16T10:53:19.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/572: rename d6/d5f/d6e/fa3 to d6/d39/fb5 0 2024-03-16T10:53:19.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/573: read - d6/d5c/d96/fa2 zero size 2024-03-16T10:53:19.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/574: dread - d6/d5f/d6e/d34/f79 zero size 2024-03-16T10:53:19.878 INFO:tasks.workunit.client.0.smithi017.stdout:4/691: mknod d15/cf0 0 2024-03-16T10:53:19.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/575: creat d6/d14/d6b/fb6 x:0 0 0 2024-03-16T10:53:19.880 INFO:tasks.workunit.client.0.smithi017.stdout:4/692: getdents d15/d1d/d21/d3c/de9/d43 0 2024-03-16T10:53:19.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/693: dread d15/d1d/d21/d3c/de9/d40/d51/d64/d76/fad [0,4194304] 0 2024-03-16T10:53:19.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/576: rename d6/d5f/d6e/d43/c9a to d6/d5c/d96/d98/cb7 0 2024-03-16T10:53:19.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/577: readlink d6/d16/l20 0 2024-03-16T10:53:19.884 INFO:tasks.workunit.client.0.smithi017.stdout:4/694: mkdir d15/d1d/d21/d3c/de9/d43/dc2/df1 0 2024-03-16T10:53:19.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/578: symlink d6/d5f/d6e/lb8 0 2024-03-16T10:53:19.887 INFO:tasks.workunit.client.0.smithi017.stdout:8/579: creat d6/d5f/d6e/d34/fb9 x:0 0 0 2024-03-16T10:53:19.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/580: write d6/d16/f2d [203739,42658] 0 2024-03-16T10:53:19.901 INFO:tasks.workunit.client.0.smithi017.stdout:8/581: dwrite d6/d5f/d6e/d34/fab [0,4194304] 0 2024-03-16T10:53:19.913 INFO:tasks.workunit.client.0.smithi017.stdout:8/582: dwrite d6/d14/f51 [0,4194304] 0 2024-03-16T10:53:19.914 INFO:tasks.workunit.client.0.smithi017.stdout:8/583: dread d6/d5c/f71 [0,4194304] 0 2024-03-16T10:53:19.915 INFO:tasks.workunit.client.0.smithi017.stdout:8/584: dread d6/f68 [0,4194304] 0 2024-03-16T10:53:19.918 INFO:tasks.workunit.client.0.smithi017.stdout:8/585: rename d6/d4a/f4d to d6/fba 0 2024-03-16T10:53:19.919 INFO:tasks.workunit.client.0.smithi017.stdout:8/586: getdents d6/d39/d35/d92 0 2024-03-16T10:53:19.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/587: mknod d6/d14/d8c/cbb 0 2024-03-16T10:53:19.922 INFO:tasks.workunit.client.0.smithi017.stdout:8/588: creat d6/d5f/fbc x:0 0 0 2024-03-16T10:53:19.922 INFO:tasks.workunit.client.0.smithi017.stdout:8/589: chown d6/d14/d72/f95 151509 1 2024-03-16T10:53:19.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/590: dwrite d6/d5f/f9b [0,4194304] 0 2024-03-16T10:53:19.939 INFO:tasks.workunit.client.0.smithi017.stdout:8/591: rename d6/d5f/f57 to d6/d39/fbd 0 2024-03-16T10:53:19.942 INFO:tasks.workunit.client.0.smithi017.stdout:8/592: unlink d6/d14/d6b/f9f 0 2024-03-16T10:53:19.948 INFO:tasks.workunit.client.0.smithi017.stdout:8/593: truncate d6/d14/f51 3479476 0 2024-03-16T10:53:19.965 INFO:tasks.workunit.client.0.smithi017.stdout:8/594: dwrite d6/d5f/d6e/d43/f46 [0,4194304] 0 2024-03-16T10:53:19.969 INFO:tasks.workunit.client.0.smithi017.stdout:8/595: rename d6/d5f/d6e/d43/f3c to d6/d39/da9/fbe 0 2024-03-16T10:53:19.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/596: dread d6/d5f/d6e/d43/fa7 [0,4194304] 0 2024-03-16T10:53:19.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/597: symlink d6/d39/d35/lbf 0 2024-03-16T10:53:19.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/598: chown d6/d14/d8c 1598598 1 2024-03-16T10:53:19.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/599: getdents d6/d39/d35 0 2024-03-16T10:53:19.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/600: fsync d6/d5f/f33 0 2024-03-16T10:53:19.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/601: fsync d6/fba 0 2024-03-16T10:53:19.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/602: link d6/d5f/d6e/lb8 d6/d14/d72/lc0 0 2024-03-16T10:53:19.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/603: creat d6/d14/d8c/fc1 x:0 0 0 2024-03-16T10:53:19.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/604: write d6/d5c/d96/d98/fb2 [348415,108831] 0 2024-03-16T10:53:19.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/605: dwrite d6/d5f/d6e/d34/f79 [0,4194304] 0 2024-03-16T10:53:20.001 INFO:tasks.workunit.client.0.smithi017.stdout:8/606: rename d6/d5f/d6e/d43/la8 to d6/d5c/d96/d98/lc2 0 2024-03-16T10:53:20.005 INFO:tasks.workunit.client.0.smithi017.stdout:8/607: creat d6/d39/fc3 x:0 0 0 2024-03-16T10:53:20.006 INFO:tasks.workunit.client.0.smithi017.stdout:8/608: mknod d6/d16/db3/cc4 0 2024-03-16T10:53:20.008 INFO:tasks.workunit.client.0.smithi017.stdout:8/609: write d6/d39/f30 [5028679,23168] 0 2024-03-16T10:53:20.025 INFO:tasks.workunit.client.0.smithi017.stdout:8/610: dwrite d6/d16/f70 [0,4194304] 0 2024-03-16T10:53:20.025 INFO:tasks.workunit.client.0.smithi017.stdout:8/611: chown d6/c83 7616324 1 2024-03-16T10:53:20.026 INFO:tasks.workunit.client.0.smithi017.stdout:8/612: rmdir d6/d5f 39 2024-03-16T10:53:20.028 INFO:tasks.workunit.client.0.smithi017.stdout:8/613: mkdir d6/dc5 0 2024-03-16T10:53:20.030 INFO:tasks.workunit.client.0.smithi017.stdout:8/614: creat d6/d5f/d6e/fc6 x:0 0 0 2024-03-16T10:53:20.032 INFO:tasks.workunit.client.0.smithi017.stdout:8/615: unlink d6/d39/f5d 0 2024-03-16T10:53:20.035 INFO:tasks.workunit.client.0.smithi017.stdout:8/616: unlink d6/d16/l20 0 2024-03-16T10:53:20.035 INFO:tasks.workunit.client.0.smithi017.stdout:8/617: stat d6/d39/d35/l2a 0 2024-03-16T10:53:20.036 INFO:tasks.workunit.client.0.smithi017.stdout:8/618: creat d6/d16/fc7 x:0 0 0 2024-03-16T10:53:20.037 INFO:tasks.workunit.client.0.smithi017.stdout:8/619: creat d6/d39/d35/d92/fc8 x:0 0 0 2024-03-16T10:53:20.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/620: symlink d6/d5c/lc9 0 2024-03-16T10:53:20.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/621: fdatasync d6/d14/d6b/f6f 0 2024-03-16T10:53:20.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/622: mknod d6/d14/cca 0 2024-03-16T10:53:20.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/623: chown d6/d5f/d6e/d34/l81 353438690 1 2024-03-16T10:53:20.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/624: chown d6/fba 6092354 1 2024-03-16T10:53:20.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/625: write d6/d4a/f78 [578091,102911] 0 2024-03-16T10:53:20.040 INFO:tasks.workunit.client.0.smithi017.stdout:8/626: rename d6/d5f/d6e/d43 to d6/d16/db3/dcb 0 2024-03-16T10:53:20.041 INFO:tasks.workunit.client.0.smithi017.stdout:8/627: mkdir d6/d39/da9/dcc 0 2024-03-16T10:53:20.041 INFO:tasks.workunit.client.0.smithi017.stdout:8/628: write d6/d16/fc7 [962646,117098] 0 2024-03-16T10:53:20.042 INFO:tasks.workunit.client.0.smithi017.stdout:8/629: read d6/d16/f49 [146611,93651] 0 2024-03-16T10:53:20.042 INFO:tasks.workunit.client.0.smithi017.stdout:8/630: stat d6/d5f/d6e/d34/f3f 0 2024-03-16T10:53:20.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/631: mkdir d6/d16/dcd 0 2024-03-16T10:53:20.044 INFO:tasks.workunit.client.0.smithi017.stdout:8/632: symlink d6/d39/d35/lce 0 2024-03-16T10:53:20.045 INFO:tasks.workunit.client.0.smithi017.stdout:8/633: symlink d6/d5c/lcf 0 2024-03-16T10:53:20.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/634: dwrite d6/d5f/fbc [0,4194304] 0 2024-03-16T10:53:20.079 INFO:tasks.workunit.client.0.smithi017.stdout:8/635: dwrite d6/d5c/d96/d98/fb2 [0,4194304] 0 2024-03-16T10:53:20.090 INFO:tasks.workunit.client.0.smithi017.stdout:8/636: dwrite d6/d5f/f97 [0,4194304] 0 2024-03-16T10:53:20.093 INFO:tasks.workunit.client.0.smithi017.stdout:8/637: mknod d6/d16/dcd/cd0 0 2024-03-16T10:53:20.093 INFO:tasks.workunit.client.0.smithi017.stdout:8/638: chown d6/d39/d35/lce 67 1 2024-03-16T10:53:20.094 INFO:tasks.workunit.client.0.smithi017.stdout:8/639: symlink d6/d14/d8c/ld1 0 2024-03-16T10:53:20.096 INFO:tasks.workunit.client.0.smithi017.stdout:8/640: mkdir d6/d14/d72/dd2 0 2024-03-16T10:53:20.109 INFO:tasks.workunit.client.0.smithi017.stdout:8/641: dwrite d6/d39/f56 [0,4194304] 0 2024-03-16T10:53:20.121 INFO:tasks.workunit.client.0.smithi017.stdout:8/642: dwrite d6/d14/f69 [4194304,4194304] 0 2024-03-16T10:53:20.123 INFO:tasks.workunit.client.0.smithi017.stdout:8/643: write d6/d16/f66 [4411718,102038] 0 2024-03-16T10:53:20.124 INFO:tasks.workunit.client.0.smithi017.stdout:8/644: mknod d6/d14/d72/cd3 0 2024-03-16T10:53:20.126 INFO:tasks.workunit.client.0.smithi017.stdout:8/645: rename d6/d39/d35 to d6/d16/d6c/dd4 0 2024-03-16T10:53:20.130 INFO:tasks.workunit.client.0.smithi017.stdout:8/646: dread d6/d14/d8c/f8b [0,4194304] 0 2024-03-16T10:53:20.131 INFO:tasks.workunit.client.0.smithi017.stdout:8/647: mknod d6/d14/d6b/cd5 0 2024-03-16T10:53:20.131 INFO:tasks.workunit.client.0.smithi017.stdout:8/648: chown d6/d16/db3/dcb/l3a 723096 1 2024-03-16T10:53:20.131 INFO:tasks.workunit.client.0.smithi017.stdout:8/649: dread - d6/d39/fc3 zero size 2024-03-16T10:53:20.138 INFO:tasks.workunit.client.0.smithi017.stdout:8/650: truncate d6/d39/f30 3222874 0 2024-03-16T10:53:20.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/651: write d6/d16/d6c/dd4/f47 [1311220,59372] 0 2024-03-16T10:53:20.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/652: stat d6/d16/db3/dcb/c58 0 2024-03-16T10:53:20.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/653: read - d6/d39/fb5 zero size 2024-03-16T10:53:20.146 INFO:tasks.workunit.client.0.smithi017.stdout:8/654: link d6/d5c/c74 d6/d4a/cd6 0 2024-03-16T10:53:20.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/655: dread d6/f4e [0,4194304] 0 2024-03-16T10:53:20.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/656: chown d6/d16/d6c/dd4/l3d 3 1 2024-03-16T10:53:20.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/657: fdatasync d6/d5f/d6e/d34/fab 0 2024-03-16T10:53:20.151 INFO:tasks.workunit.client.0.smithi017.stdout:8/658: dread d6/d5c/f73 [0,4194304] 0 2024-03-16T10:53:20.151 INFO:tasks.workunit.client.0.smithi017.stdout:8/659: truncate d6/d14/d8c/f9c 741257 0 2024-03-16T10:53:20.151 INFO:tasks.workunit.client.0.smithi017.stdout:8/660: readlink d6/d5f/d6e/d34/l81 0 2024-03-16T10:53:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:20 smithi174 ceph-mon[36202]: pgmap v426: 97 pgs: 97 active+clean; 944 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s rd, 145 MiB/s wr, 1.13k op/s 2024-03-16T10:53:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:20 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:53:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:20 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:20.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:20 smithi174 ceph-mon[36202]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[32074]: 2024-03-16T10:53:20.214+0000 7f146d4f3700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:20 smithi017 ceph-mon[32078]: pgmap v426: 97 pgs: 97 active+clean; 944 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s rd, 145 MiB/s wr, 1.13k op/s 2024-03-16T10:53:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:20 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:53:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:20 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:20.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:20 smithi017 ceph-mon[32078]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:20.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:20 smithi111 ceph-mon[36315]: pgmap v426: 97 pgs: 97 active+clean; 944 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 111 MiB/s rd, 145 MiB/s wr, 1.13k op/s 2024-03-16T10:53:20.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:20 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] up:active 2024-03-16T10:53:20.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:20 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:20.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:20 smithi111 ceph-mon[36315]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-16T10:53:20.770 INFO:tasks.workunit.client.0.smithi017.stdout:4/695: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:1/748: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:7/528: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:3/516: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:6/496: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:9/390: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:3/517: truncate d8/d8c/f95 282624 0 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:2/438: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:9/391: chown d8/f2a 135 1 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:9/392: chown d8/df/d46/d63 0 1 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:8/661: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:5/687: sync 2024-03-16T10:53:20.771 INFO:tasks.workunit.client.0.smithi017.stdout:0/677: sync 2024-03-16T10:53:20.772 INFO:tasks.workunit.client.0.smithi017.stdout:5/688: dread - d0/d1/d30/dde/d42/fc5 zero size 2024-03-16T10:53:20.772 INFO:tasks.workunit.client.0.smithi017.stdout:6/497: fsync d0/d9/d45/d4d/d2e/d69/d7e/f8a 0 2024-03-16T10:53:20.772 INFO:tasks.workunit.client.0.smithi017.stdout:1/749: mkdir d1/d3/dd/d72/d8f/dfe 0 2024-03-16T10:53:20.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/696: dread d15/d1d/d21/d3c/de9/f86 [0,4194304] 0 2024-03-16T10:53:20.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/697: dread - d15/d1d/fdb zero size 2024-03-16T10:53:20.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/698: chown d15/d1d/d50/fb9 95001940 1 2024-03-16T10:53:20.775 INFO:tasks.workunit.client.0.smithi017.stdout:7/529: rename f0 to d7/d8a/fb2 0 2024-03-16T10:53:20.778 INFO:tasks.workunit.client.0.smithi017.stdout:3/518: write d8/da/db/f15 [5383576,13534] 0 2024-03-16T10:53:20.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/439: rmdir d4/d6/d30/d75 0 2024-03-16T10:53:20.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/440: write d4/dd/f1d [1881890,45068] 0 2024-03-16T10:53:20.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/393: mknod d8/c7c 0 2024-03-16T10:53:20.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/394: write d8/df/d5b/f3a [1449,106725] 0 2024-03-16T10:53:20.780 INFO:tasks.workunit.client.0.smithi017.stdout:8/662: creat d6/d5f/d6e/fd7 x:0 0 0 2024-03-16T10:53:20.782 INFO:tasks.workunit.client.0.smithi017.stdout:2/441: rename d4/dd/d1e/d3e/d51/f5c to d4/dd/d1e/d3e/d51/f8a 0 2024-03-16T10:53:20.782 INFO:tasks.workunit.client.0.smithi017.stdout:6/498: unlink d0/d15/c9e 0 2024-03-16T10:53:20.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/442: creat d4/d6/db/d66/d2e/f8b x:0 0 0 2024-03-16T10:53:20.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/443: chown d4/d6/db/d24 25 1 2024-03-16T10:53:20.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/444: chown d4/f25 444859494 1 2024-03-16T10:53:20.783 INFO:tasks.workunit.client.0.smithi017.stdout:0/678: creat d2/d4/d6d/d84/dc1/dd2/d24/ff0 x:0 0 0 2024-03-16T10:53:20.783 INFO:tasks.workunit.client.0.smithi017.stdout:4/699: mkdir d15/d1d/d21/d26/d66/d8c/dab/df2 0 2024-03-16T10:53:20.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/530: getdents d7/db/dc/d60 0 2024-03-16T10:53:20.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/531: stat d7/db/f52 0 2024-03-16T10:53:20.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/532: chown d7/d5a/f74 8 1 2024-03-16T10:53:20.786 INFO:tasks.workunit.client.0.smithi017.stdout:3/519: symlink d8/d3f/d3d/l9d 0 2024-03-16T10:53:20.786 INFO:tasks.workunit.client.0.smithi017.stdout:3/520: dread - d8/d1b/d1c/d62/d69/f83 zero size 2024-03-16T10:53:20.788 INFO:tasks.workunit.client.0.smithi017.stdout:9/395: mknod d8/df/c7d 0 2024-03-16T10:53:20.790 INFO:tasks.workunit.client.0.smithi017.stdout:6/499: mknod d0/d15/d1f/d7d/ca1 0 2024-03-16T10:53:20.790 INFO:tasks.workunit.client.0.smithi017.stdout:6/500: readlink d0/d15/d1f/l52 0 2024-03-16T10:53:20.791 INFO:tasks.workunit.client.0.smithi017.stdout:7/533: dread d7/d8a/f29 [0,4194304] 0 2024-03-16T10:53:20.791 INFO:tasks.workunit.client.0.smithi017.stdout:5/689: dwrite d0/d1/d2/d2c/d38/f47 [4194304,4194304] 0 2024-03-16T10:53:20.791 INFO:tasks.workunit.client.0.smithi017.stdout:7/534: write d7/db/d12/f8e [1305019,105784] 0 2024-03-16T10:53:20.791 INFO:tasks.workunit.client.0.smithi017.stdout:4/700: creat d15/d1d/d21/d3c/de9/d43/dde/ff3 x:0 0 0 2024-03-16T10:53:20.792 INFO:tasks.workunit.client.0.smithi017.stdout:0/679: symlink d2/lf1 0 2024-03-16T10:53:20.794 INFO:tasks.workunit.client.0.smithi017.stdout:0/680: mknod d2/da1/cf2 0 2024-03-16T10:53:20.794 INFO:tasks.workunit.client.0.smithi017.stdout:3/521: rename d8/d3f/d3d/l45 to d8/d1b/d65/l9e 0 2024-03-16T10:53:20.794 INFO:tasks.workunit.client.0.smithi017.stdout:3/522: fsync d8/d1b/d1c/f5d 0 2024-03-16T10:53:20.795 INFO:tasks.workunit.client.0.smithi017.stdout:9/396: creat d8/df/d46/d63/f7e x:0 0 0 2024-03-16T10:53:20.796 INFO:tasks.workunit.client.0.smithi017.stdout:9/397: dread d8/df/f60 [0,4194304] 0 2024-03-16T10:53:20.796 INFO:tasks.workunit.client.0.smithi017.stdout:9/398: write d8/df/f1a [7337805,81584] 0 2024-03-16T10:53:20.798 INFO:tasks.workunit.client.0.smithi017.stdout:4/701: mknod d15/d1d/d21/d26/d66/d8c/cf4 0 2024-03-16T10:53:20.798 INFO:tasks.workunit.client.0.smithi017.stdout:4/702: write d15/fc4 [653314,37011] 0 2024-03-16T10:53:20.799 INFO:tasks.workunit.client.0.smithi017.stdout:1/750: dwrite d1/d3/f3d [0,4194304] 0 2024-03-16T10:53:20.799 INFO:tasks.workunit.client.0.smithi017.stdout:1/751: dread - d1/d3/dd/d31/fc8 zero size 2024-03-16T10:53:20.799 INFO:tasks.workunit.client.0.smithi017.stdout:3/523: rmdir d8/da 39 2024-03-16T10:53:20.801 INFO:tasks.workunit.client.0.smithi017.stdout:9/399: mkdir d8/df/d5b/d5e/d68/d7f 0 2024-03-16T10:53:20.803 INFO:tasks.workunit.client.0.smithi017.stdout:9/400: dread d8/f47 [0,4194304] 0 2024-03-16T10:53:20.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/703: unlink d15/d1d/d21/d26/f42 0 2024-03-16T10:53:20.804 INFO:tasks.workunit.client.0.smithi017.stdout:2/445: dwrite d4/d6/f10 [4194304,4194304] 0 2024-03-16T10:53:20.805 INFO:tasks.workunit.client.0.smithi017.stdout:1/752: mknod d1/d3/dd/d72/d8f/dbe/cff 0 2024-03-16T10:53:20.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/524: unlink d8/l70 0 2024-03-16T10:53:20.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/525: fsync d8/f52 0 2024-03-16T10:53:20.808 INFO:tasks.workunit.client.0.smithi017.stdout:7/535: dread d7/db/d12/d1c/f36 [4194304,4194304] 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/663: dwrite d6/d16/d6c/f6d [4194304,4194304] 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/664: fdatasync d6/d5f/d6e/d34/f3f 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/665: chown d6/d14/d8c/f9c 0 1 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/666: write d6/d16/d6c/dd4/f47 [3016977,38220] 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/667: chown d6/d5f/d6e/fd7 297377766 1 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:4/704: link d15/d1d/d50/f5b d15/d1d/d21/d3c/de9/d43/dc2/df1/ff5 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:4/705: write d15/d1d/d21/d26/f88 [518873,99510] 0 2024-03-16T10:53:20.810 INFO:tasks.workunit.client.0.smithi017.stdout:4/706: fdatasync d15/d1d/d21/f4b 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/707: write d15/d1d/d27/f49 [1252260,27906] 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/708: write d15/f9b [1033926,116145] 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/709: chown d15/d1d/d50/l7d 1 1 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:0/681: dwrite d2/f9b [0,4194304] 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/710: dread d15/d1d/fd9 [0,4194304] 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/711: fsync d15/d1d/d21/d3c/de9/d40/d51/d64/fd8 0 2024-03-16T10:53:20.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/712: read - d15/d1d/d21/d26/d66/d8c/dab/dc7/fe0 zero size 2024-03-16T10:53:20.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/713: fsync d15/d1d/d21/d3c/de9/d96/fc8 0 2024-03-16T10:53:20.814 INFO:tasks.workunit.client.0.smithi017.stdout:8/668: mkdir d6/d5f/da4/dd8 0 2024-03-16T10:53:20.814 INFO:tasks.workunit.client.0.smithi017.stdout:8/669: chown d6/dc5 13 1 2024-03-16T10:53:20.814 INFO:tasks.workunit.client.0.smithi017.stdout:8/670: readlink d6/d16/d6c/l7c 0 2024-03-16T10:53:20.814 INFO:tasks.workunit.client.0.smithi017.stdout:9/401: dwrite d8/df/d5b/d32/d45/f77 [0,4194304] 0 2024-03-16T10:53:20.815 INFO:tasks.workunit.client.0.smithi017.stdout:9/402: fdatasync d8/f4d 0 2024-03-16T10:53:20.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/446: symlink d4/dd/df/l8c 0 2024-03-16T10:53:20.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/447: dread - d4/f5e zero size 2024-03-16T10:53:20.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/448: chown d4/d6/l22 24744 1 2024-03-16T10:53:20.818 INFO:tasks.workunit.client.0.smithi017.stdout:2/449: dread - d4/d6/db/d24/d39/d7d/f83 zero size 2024-03-16T10:53:20.819 INFO:tasks.workunit.client.0.smithi017.stdout:4/714: mkdir d15/d1d/d21/d3c/de9/d43/dde/df6 0 2024-03-16T10:53:20.821 INFO:tasks.workunit.client.0.smithi017.stdout:3/526: write d8/d3f/f3b [3369558,38483] 0 2024-03-16T10:53:20.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/671: creat d6/d5f/d6e/d34/fd9 x:0 0 0 2024-03-16T10:53:20.825 INFO:tasks.workunit.client.0.smithi017.stdout:9/403: link d8/df/c14 d8/c80 0 2024-03-16T10:53:20.828 INFO:tasks.workunit.client.0.smithi017.stdout:3/527: link d8/d3f/d3d/l9d d8/d1b/d2e/l9f 0 2024-03-16T10:53:20.828 INFO:tasks.workunit.client.0.smithi017.stdout:3/528: dread d8/d1b/d2e/f3e [0,4194304] 0 2024-03-16T10:53:20.829 INFO:tasks.workunit.client.0.smithi017.stdout:8/672: creat d6/d5f/d6e/d34/db4/fda x:0 0 0 2024-03-16T10:53:20.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/682: dwrite d2/d4/d6d/d84/dc1/dd2/de/fb0 [0,4194304] 0 2024-03-16T10:53:20.831 INFO:tasks.workunit.client.0.smithi017.stdout:0/683: mknod d2/d4/d6d/d84/dc1/dd2/cf3 0 2024-03-16T10:53:20.832 INFO:tasks.workunit.client.0.smithi017.stdout:0/684: chown d2/d4/d6d/d84/c97 258 1 2024-03-16T10:53:20.832 INFO:tasks.workunit.client.0.smithi017.stdout:7/536: dwrite d7/db/dc/d50/d59/f61 [0,4194304] 0 2024-03-16T10:53:20.834 INFO:tasks.workunit.client.0.smithi017.stdout:0/685: mkdir d2/d4/d90/dc2/dc8/df4 0 2024-03-16T10:53:20.836 INFO:tasks.workunit.client.0.smithi017.stdout:9/404: stat d8/df/c22 0 2024-03-16T10:53:20.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/686: dread d2/f8c [0,4194304] 0 2024-03-16T10:53:20.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/687: fdatasync d2/d4/f1c 0 2024-03-16T10:53:20.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/688: write d2/d4/d6d/d84/dc1/dd2/d24/fea [127941,125566] 0 2024-03-16T10:53:20.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/689: chown d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/ld9 3 1 2024-03-16T10:53:20.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/690: stat d2/d4/d90/dc2/le8 0 2024-03-16T10:53:20.839 INFO:tasks.workunit.client.0.smithi017.stdout:7/537: dread d7/db/dc/d50/d59/f61 [0,4194304] 0 2024-03-16T10:53:20.844 INFO:tasks.workunit.client.0.smithi017.stdout:3/529: symlink d8/d1b/d2e/d8d/d87/la0 0 2024-03-16T10:53:20.845 INFO:tasks.workunit.client.0.smithi017.stdout:9/405: dread d8/df/d5b/d32/f57 [0,4194304] 0 2024-03-16T10:53:20.847 INFO:tasks.workunit.client.0.smithi017.stdout:0/691: read d2/d4/d6d/d84/dc1/dd2/de/d1e/f36 [2551004,77535] 0 2024-03-16T10:53:20.847 INFO:tasks.workunit.client.0.smithi017.stdout:0/692: chown d2/d4/d6d/d84/dc1/dd2/de/lec 1053475 1 2024-03-16T10:53:20.849 INFO:tasks.workunit.client.0.smithi017.stdout:0/693: creat d2/d4/d6d/ff5 x:0 0 0 2024-03-16T10:53:20.854 INFO:tasks.workunit.client.0.smithi017.stdout:9/406: dread d8/df/d46/f58 [0,4194304] 0 2024-03-16T10:53:20.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/530: symlink d8/d1b/d2e/d60/d63/la1 0 2024-03-16T10:53:20.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/531: truncate d8/d1b/f73 630013 0 2024-03-16T10:53:20.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/532: read - d8/d1b/d65/f9b zero size 2024-03-16T10:53:20.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/533: fdatasync d8/d1b/f27 0 2024-03-16T10:53:20.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/694: creat d2/d4/d6d/d84/dc1/dd2/de/ff6 x:0 0 0 2024-03-16T10:53:20.865 INFO:tasks.workunit.client.0.smithi017.stdout:9/407: symlink d8/l81 0 2024-03-16T10:53:20.865 INFO:tasks.workunit.client.0.smithi017.stdout:7/538: mknod d7/db/d81/cb3 0 2024-03-16T10:53:20.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/534: readlink d8/da/db/l51 0 2024-03-16T10:53:20.868 INFO:tasks.workunit.client.0.smithi017.stdout:0/695: rmdir d2/da1/ddf 0 2024-03-16T10:53:20.869 INFO:tasks.workunit.client.0.smithi017.stdout:9/408: unlink l6 0 2024-03-16T10:53:20.870 INFO:tasks.workunit.client.0.smithi017.stdout:7/539: mknod d7/db/dc/d50/d73/cb4 0 2024-03-16T10:53:20.870 INFO:tasks.workunit.client.0.smithi017.stdout:7/540: chown d7/db/c58 865639 1 2024-03-16T10:53:20.871 INFO:tasks.workunit.client.0.smithi017.stdout:3/535: getdents d8/d1b/d2e/d60 0 2024-03-16T10:53:20.873 INFO:tasks.workunit.client.0.smithi017.stdout:9/409: mknod d8/df/d5b/d70/c82 0 2024-03-16T10:53:20.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/541: link d7/db/d12/d1c/d30/f5c d7/d8a/d66/dad/fb5 0 2024-03-16T10:53:20.878 INFO:tasks.workunit.client.0.smithi017.stdout:6/501: rename d0/d9 to d0/d21/d39/d44/da2 0 2024-03-16T10:53:20.879 INFO:tasks.workunit.client.0.smithi017.stdout:6/502: dread - d0/d21/d39/d44/da2/d45/d4d/d2c/d41/d97/f9b zero size 2024-03-16T10:53:20.880 INFO:tasks.workunit.client.0.smithi017.stdout:3/536: getdents d8/d1b/d1c 0 2024-03-16T10:53:20.880 INFO:tasks.workunit.client.0.smithi017.stdout:9/410: read d8/df/d46/d63/f6b [806027,59002] 0 2024-03-16T10:53:20.880 INFO:tasks.workunit.client.0.smithi017.stdout:9/411: truncate d8/df/d46/f5a 5203296 0 2024-03-16T10:53:20.885 INFO:tasks.workunit.client.0.smithi017.stdout:9/412: creat d8/df/d5b/d32/d45/f83 x:0 0 0 2024-03-16T10:53:20.886 INFO:tasks.workunit.client.0.smithi017.stdout:7/542: creat d7/db/dc/d50/d73/fb6 x:0 0 0 2024-03-16T10:53:20.886 INFO:tasks.workunit.client.0.smithi017.stdout:9/413: dread d8/df/f4f [0,4194304] 0 2024-03-16T10:53:20.888 INFO:tasks.workunit.client.0.smithi017.stdout:6/503: truncate d0/d21/d39/d44/da2/d38/f71 105019 0 2024-03-16T10:53:20.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/537: rmdir d8/d3f/d3d 39 2024-03-16T10:53:20.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/538: write d8/d3f/d3d/f48 [151752,122236] 0 2024-03-16T10:53:20.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/539: read d8/da/db/f50 [1357669,46176] 0 2024-03-16T10:53:20.891 INFO:tasks.workunit.client.0.smithi017.stdout:9/414: symlink d8/df/d5b/d32/d45/l84 0 2024-03-16T10:53:20.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/690: rename d0/d1/d30/d55 to d0/ded 0 2024-03-16T10:53:20.894 INFO:tasks.workunit.client.0.smithi017.stdout:9/415: rmdir d8/df/d46 39 2024-03-16T10:53:20.895 INFO:tasks.workunit.client.0.smithi017.stdout:5/691: truncate d0/d1/d30/dde/d42/f4a 485196 0 2024-03-16T10:53:20.895 INFO:tasks.workunit.client.0.smithi017.stdout:5/692: chown d0/ded 495322487 1 2024-03-16T10:53:20.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/543: dwrite d7/db/dc/d50/d59/d34/d53/f99 [0,4194304] 0 2024-03-16T10:53:20.901 INFO:tasks.workunit.client.0.smithi017.stdout:7/544: creat d7/d8a/fb7 x:0 0 0 2024-03-16T10:53:20.902 INFO:tasks.workunit.client.0.smithi017.stdout:3/540: dwrite d8/d1b/d65/f9b [0,4194304] 0 2024-03-16T10:53:20.903 INFO:tasks.workunit.client.0.smithi017.stdout:3/541: write d8/d1d/f4b [480427,130377] 0 2024-03-16T10:53:20.907 INFO:tasks.workunit.client.0.smithi017.stdout:7/545: read d7/db/f52 [1024811,124479] 0 2024-03-16T10:53:20.908 INFO:tasks.workunit.client.0.smithi017.stdout:7/546: fdatasync d7/db/f18 0 2024-03-16T10:53:20.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/416: dwrite d8/df/f11 [0,4194304] 0 2024-03-16T10:53:20.914 INFO:tasks.workunit.client.0.smithi017.stdout:7/547: dread d7/db/dc/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:20.921 INFO:tasks.workunit.client.0.smithi017.stdout:7/548: truncate d7/db/dc/d50/f87 2557849 0 2024-03-16T10:53:20.933 INFO:tasks.workunit.client.0.smithi017.stdout:9/417: getdents d8/df/d5b/d32/d45 0 2024-03-16T10:53:20.933 INFO:tasks.workunit.client.0.smithi017.stdout:9/418: fsync d8/df/d5b/d32/f4b 0 2024-03-16T10:53:20.937 INFO:tasks.workunit.client.0.smithi017.stdout:1/753: rename d1/d3/d57 to d1/d24/d79/dd2/d100 0 2024-03-16T10:53:20.938 INFO:tasks.workunit.client.0.smithi017.stdout:1/754: rmdir d1/d3/dd/d31/d66/da1/de3 39 2024-03-16T10:53:20.939 INFO:tasks.workunit.client.0.smithi017.stdout:1/755: getdents d1/d3/dd/d31/d66/da1 0 2024-03-16T10:53:20.941 INFO:tasks.workunit.client.0.smithi017.stdout:1/756: symlink d1/d24/d79/dd2/l101 0 2024-03-16T10:53:20.946 INFO:tasks.workunit.client.0.smithi017.stdout:9/419: dwrite d8/df/d46/d63/f6b [4194304,4194304] 0 2024-03-16T10:53:20.948 INFO:tasks.workunit.client.0.smithi017.stdout:9/420: creat d8/df/d5b/d70/f85 x:0 0 0 2024-03-16T10:53:20.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/757: dwrite d1/d3/f23 [0,4194304] 0 2024-03-16T10:53:20.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/758: write d1/d3/f6f [1001736,75983] 0 2024-03-16T10:53:20.957 INFO:tasks.workunit.client.0.smithi017.stdout:2/450: rename d4/d6/db/d66/d2e/f87 to d4/d6/d30/f8d 0 2024-03-16T10:53:20.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/451: symlink d4/l8e 0 2024-03-16T10:53:20.960 INFO:tasks.workunit.client.0.smithi017.stdout:2/452: mkdir d4/d6/d81/d8f 0 2024-03-16T10:53:20.960 INFO:tasks.workunit.client.0.smithi017.stdout:2/453: write d4/dd/df/f80 [948237,53019] 0 2024-03-16T10:53:20.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/759: dread d1/d3/dd/d31/d66/dd7/f52 [0,4194304] 0 2024-03-16T10:53:20.962 INFO:tasks.workunit.client.0.smithi017.stdout:2/454: symlink d4/d6/db/d66/l90 0 2024-03-16T10:53:20.964 INFO:tasks.workunit.client.0.smithi017.stdout:1/760: creat d1/d3/d88/f102 x:0 0 0 2024-03-16T10:53:20.965 INFO:tasks.workunit.client.0.smithi017.stdout:2/455: creat d4/f91 x:0 0 0 2024-03-16T10:53:20.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/761: getdents d1/d3/dd/d72 0 2024-03-16T10:53:20.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/762: chown d1/d3/dd/d31/d35/fac 72095 1 2024-03-16T10:53:20.969 INFO:tasks.workunit.client.0.smithi017.stdout:2/456: dread d4/d6/d30/d3f/f54 [0,4194304] 0 2024-03-16T10:53:20.969 INFO:tasks.workunit.client.0.smithi017.stdout:2/457: write d4/d6/db/d24/f5b [931714,47211] 0 2024-03-16T10:53:20.971 INFO:tasks.workunit.client.0.smithi017.stdout:2/458: mknod d4/d6/d30/d3f/c92 0 2024-03-16T10:53:20.971 INFO:tasks.workunit.client.0.smithi017.stdout:2/459: truncate d4/d6/db/d66/d29/f4e 837862 0 2024-03-16T10:53:20.974 INFO:tasks.workunit.client.0.smithi017.stdout:2/460: stat d4/dd/df/l44 0 2024-03-16T10:53:20.974 INFO:tasks.workunit.client.0.smithi017.stdout:2/461: write d4/d6/db/d66/d29/f6a [457497,35808] 0 2024-03-16T10:53:20.985 INFO:tasks.workunit.client.0.smithi017.stdout:2/462: rename d4/d6/db/d66/d29 to d4/d6/db/d66/d93 0 2024-03-16T10:53:20.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/763: dwrite d1/d3/dd/d31/d66/dd7/fb0 [0,4194304] 0 2024-03-16T10:53:20.988 INFO:tasks.workunit.client.0.smithi017.stdout:2/463: creat d4/d6/db/d66/f94 x:0 0 0 2024-03-16T10:53:20.988 INFO:tasks.workunit.client.0.smithi017.stdout:2/464: symlink d4/d6/db/d24/d39/l95 0 2024-03-16T10:53:20.991 INFO:tasks.workunit.client.0.smithi017.stdout:1/764: rmdir d1/d3/dd 39 2024-03-16T10:53:20.995 INFO:tasks.workunit.client.0.smithi017.stdout:2/465: write d4/f25 [4166874,127252] 0 2024-03-16T10:53:20.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/504: rename d0/d15/l20 to d0/d21/d39/d44/da2/d45/d4d/d2c/d41/d97/la3 0 2024-03-16T10:53:20.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/505: fdatasync d0/d21/d39/f5a 0 2024-03-16T10:53:20.997 INFO:tasks.workunit.client.0.smithi017.stdout:2/466: unlink d4/d6/f10 0 2024-03-16T10:53:21.000 INFO:tasks.workunit.client.0.smithi017.stdout:5/693: rename d0/d1/d30/l77 to d0/d1/d2/dc/lee 0 2024-03-16T10:53:21.000 INFO:tasks.workunit.client.0.smithi017.stdout:2/467: mknod d4/dd/d1e/c96 0 2024-03-16T10:53:21.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/549: rename d7/db/d12/f62 to d7/d5a/fb8 0 2024-03-16T10:53:21.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/694: symlink d0/d1/d1f/lef 0 2024-03-16T10:53:21.004 INFO:tasks.workunit.client.0.smithi017.stdout:9/421: rename d8/df/l53 to d8/df/d46/l86 0 2024-03-16T10:53:21.006 INFO:tasks.workunit.client.0.smithi017.stdout:7/550: truncate d7/db/d12/d1c/f36 6679417 0 2024-03-16T10:53:21.007 INFO:tasks.workunit.client.0.smithi017.stdout:5/695: creat d0/d1/d1f/d29/d88/ff0 x:0 0 0 2024-03-16T10:53:21.009 INFO:tasks.workunit.client.0.smithi017.stdout:2/468: dread d4/d6/db/f7a [0,4194304] 0 2024-03-16T10:53:21.009 INFO:tasks.workunit.client.0.smithi017.stdout:9/422: mknod d8/df/d66/c87 0 2024-03-16T10:53:21.009 INFO:tasks.workunit.client.0.smithi017.stdout:6/506: dwrite d0/d21/d39/d44/da2/d45/d4d/d2c/d41/f9d [0,4194304] 0 2024-03-16T10:53:21.009 INFO:tasks.workunit.client.0.smithi017.stdout:2/469: dread d4/f2c [0,4194304] 0 2024-03-16T10:53:21.011 INFO:tasks.workunit.client.0.smithi017.stdout:7/551: creat d7/db/d12/d1c/d30/fb9 x:0 0 0 2024-03-16T10:53:21.013 INFO:tasks.workunit.client.0.smithi017.stdout:5/696: rmdir d0/d1/d2/d2c/d36/db4 39 2024-03-16T10:53:21.020 INFO:tasks.workunit.client.0.smithi017.stdout:9/423: write d8/df/d5b/d32/d45/f4a [3756015,44163] 0 2024-03-16T10:53:21.021 INFO:tasks.workunit.client.0.smithi017.stdout:6/507: mkdir d0/d21/d39/d44/da2/d96/da4 0 2024-03-16T10:53:21.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/470: mkdir d4/d97 0 2024-03-16T10:53:21.025 INFO:tasks.workunit.client.0.smithi017.stdout:5/697: symlink d0/d1/d2/d2c/d36/db4/lf1 0 2024-03-16T10:53:21.025 INFO:tasks.workunit.client.0.smithi017.stdout:5/698: chown d0/d1/d2/d8c 243852 1 2024-03-16T10:53:21.025 INFO:tasks.workunit.client.0.smithi017.stdout:5/699: fsync d0/ded/daf/fd7 0 2024-03-16T10:53:21.029 INFO:tasks.workunit.client.0.smithi017.stdout:6/508: dread d0/d21/d39/d44/da2/d45/d4d/f25 [0,4194304] 0 2024-03-16T10:53:21.029 INFO:tasks.workunit.client.0.smithi017.stdout:7/552: dwrite d7/d8a/f29 [4194304,4194304] 0 2024-03-16T10:53:21.029 INFO:tasks.workunit.client.0.smithi017.stdout:7/553: read d7/db/d12/f3f [2820934,118116] 0 2024-03-16T10:53:21.029 INFO:tasks.workunit.client.0.smithi017.stdout:9/424: mkdir d8/df/d46/d63/d88 0 2024-03-16T10:53:21.032 INFO:tasks.workunit.client.0.smithi017.stdout:2/471: unlink d4/d6/db/f11 0 2024-03-16T10:53:21.032 INFO:tasks.workunit.client.0.smithi017.stdout:2/472: readlink d4/dd/d1e/d3e/l4f 0 2024-03-16T10:53:21.032 INFO:tasks.workunit.client.0.smithi017.stdout:2/473: write d4/dd/f43 [1567951,40400] 0 2024-03-16T10:53:21.033 INFO:tasks.workunit.client.0.smithi017.stdout:2/474: dread d4/f2c [0,4194304] 0 2024-03-16T10:53:21.038 INFO:tasks.workunit.client.0.smithi017.stdout:5/700: symlink d0/ded/d6a/da0/lf2 0 2024-03-16T10:53:21.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/425: dread d8/df/d46/f5c [0,4194304] 0 2024-03-16T10:53:21.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/426: readlink d8/df/d5b/d32/l41 0 2024-03-16T10:53:21.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/554: dread - d7/db/d12/d1c/f2e zero size 2024-03-16T10:53:21.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/555: read - d7/db/dc/d50/d59/d34/fb1 zero size 2024-03-16T10:53:21.043 INFO:tasks.workunit.client.0.smithi017.stdout:2/475: symlink d4/d6/db/l98 0 2024-03-16T10:53:21.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/701: truncate d0/f8 1493816 0 2024-03-16T10:53:21.047 INFO:tasks.workunit.client.0.smithi017.stdout:5/702: write d0/d1/d1f/d29/f5e [195829,115864] 0 2024-03-16T10:53:21.048 INFO:tasks.workunit.client.0.smithi017.stdout:9/427: mkdir d8/df/d5b/d70/d89 0 2024-03-16T10:53:21.050 INFO:tasks.workunit.client.0.smithi017.stdout:7/556: creat d7/db/dc/d50/d73/fba x:0 0 0 2024-03-16T10:53:21.050 INFO:tasks.workunit.client.0.smithi017.stdout:7/557: write d7/db/dc/d50/d59/d34/f47 [1154777,85709] 0 2024-03-16T10:53:21.052 INFO:tasks.workunit.client.0.smithi017.stdout:9/428: mknod d8/df/d5b/d5e/d68/d7f/c8a 0 2024-03-16T10:53:21.052 INFO:tasks.workunit.client.0.smithi017.stdout:9/429: chown d8/df/d5b/d32/f39 57653490 1 2024-03-16T10:53:21.053 INFO:tasks.workunit.client.0.smithi017.stdout:9/430: chown d8/df/d5b/d32/d45/f83 8235475 1 2024-03-16T10:53:21.055 INFO:tasks.workunit.client.0.smithi017.stdout:9/431: chown d8/f47 458 1 2024-03-16T10:53:21.055 INFO:tasks.workunit.client.0.smithi017.stdout:7/558: rmdir d7/db/d12/d1c/d4e 39 2024-03-16T10:53:21.059 INFO:tasks.workunit.client.0.smithi017.stdout:7/559: mkdir d7/db/dc/d50/d59/d34/dbb 0 2024-03-16T10:53:21.059 INFO:tasks.workunit.client.0.smithi017.stdout:7/560: fsync d7/db/f9d 0 2024-03-16T10:53:21.065 INFO:tasks.workunit.client.0.smithi017.stdout:2/476: dwrite d4/dd/d38/f6e [0,4194304] 0 2024-03-16T10:53:21.065 INFO:tasks.workunit.client.0.smithi017.stdout:9/432: dread d8/df/d46/f55 [0,4194304] 0 2024-03-16T10:53:21.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/477: creat d4/d6/d81/d8f/f99 x:0 0 0 2024-03-16T10:53:21.069 INFO:tasks.workunit.client.0.smithi017.stdout:2/478: dread - d4/d6/db/d66/d93/f70 zero size 2024-03-16T10:53:21.070 INFO:tasks.workunit.client.0.smithi017.stdout:1/765: rename d1/d3/f87 to d1/d3/dd/d31/d66/de0/f103 0 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:4/715: sync 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:8/673: sync 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:0/696: sync 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/542: sync 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/543: read - d8/d1b/d65/f81 zero size 2024-03-16T10:53:21.071 INFO:tasks.workunit.client.0.smithi017.stdout:5/703: dwrite d0/d1/d1f/d97/fca [0,4194304] 0 2024-03-16T10:53:21.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/704: write d0/d1/d2/d8c/fc0 [137532,46516] 0 2024-03-16T10:53:21.072 INFO:tasks.workunit.client.0.smithi017.stdout:8/674: getdents d6/d16 0 2024-03-16T10:53:21.074 INFO:tasks.workunit.client.0.smithi017.stdout:4/716: dread d15/d1d/f24 [0,4194304] 0 2024-03-16T10:53:21.074 INFO:tasks.workunit.client.0.smithi017.stdout:3/544: symlink d8/d3f/d3d/la2 0 2024-03-16T10:53:21.075 INFO:tasks.workunit.client.0.smithi017.stdout:4/717: read d15/d1d/d21/d26/f4d [1173942,70236] 0 2024-03-16T10:53:21.076 INFO:tasks.workunit.client.0.smithi017.stdout:4/718: write d15/d1d/d21/db1/db5/fb7 [881252,58662] 0 2024-03-16T10:53:21.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/766: creat d1/d24/f104 x:0 0 0 2024-03-16T10:53:21.078 INFO:tasks.workunit.client.0.smithi017.stdout:8/675: rename d6/d14/d72/dd2 to d6/d39/da9/ddb 0 2024-03-16T10:53:21.079 INFO:tasks.workunit.client.0.smithi017.stdout:3/545: write d8/d1b/f27 [1426228,1011] 0 2024-03-16T10:53:21.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/561: dwrite d7/db/f14 [4194304,4194304] 0 2024-03-16T10:53:21.080 INFO:tasks.workunit.client.0.smithi017.stdout:9/433: mkdir d8/df/d5b/d32/d45/d8b 0 2024-03-16T10:53:21.081 INFO:tasks.workunit.client.0.smithi017.stdout:4/719: rename d15/d1d/d21/d3c/de9/d40/d51/ld2 to d15/d1d/d21/d3c/de9/d96/lf7 0 2024-03-16T10:53:21.081 INFO:tasks.workunit.client.0.smithi017.stdout:4/720: dread - d15/d1d/d21/d3c/de9/d7c/f9a zero size 2024-03-16T10:53:21.081 INFO:tasks.workunit.client.0.smithi017.stdout:4/721: write d15/d1d/fa2 [5169690,110826] 0 2024-03-16T10:53:21.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/546: getdents d8/d1b/d2e 0 2024-03-16T10:53:21.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/547: write d8/d1b/d1c/f88 [705666,32712] 0 2024-03-16T10:53:21.083 INFO:tasks.workunit.client.0.smithi017.stdout:4/722: creat d15/d1d/d21/d3c/de9/d43/dc2/ff8 x:0 0 0 2024-03-16T10:53:21.084 INFO:tasks.workunit.client.0.smithi017.stdout:4/723: write d15/d1d/d21/d26/d66/f70 [4747311,84238] 0 2024-03-16T10:53:21.085 INFO:tasks.workunit.client.0.smithi017.stdout:5/705: dwrite d0/d1/d2/d70/f82 [0,4194304] 0 2024-03-16T10:53:21.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/697: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fba [1034783,33356] 0 2024-03-16T10:53:21.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/698: dread - d2/d4/d6d/ff5 zero size 2024-03-16T10:53:21.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/699: chown d2/d4/f1c 210924406 1 2024-03-16T10:53:21.086 INFO:tasks.workunit.client.0.smithi017.stdout:1/767: dread d1/d3/dd/d31/d66/dd3/f6e [0,4194304] 0 2024-03-16T10:53:21.086 INFO:tasks.workunit.client.0.smithi017.stdout:1/768: chown d1/d50/cf4 31338946 1 2024-03-16T10:53:21.086 INFO:tasks.workunit.client.0.smithi017.stdout:1/769: write d1/d3/dd/d31/d66/dd7/dbc/fe1 [915073,29188] 0 2024-03-16T10:53:21.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/770: write d1/d24/ff1 [570127,90287] 0 2024-03-16T10:53:21.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/771: chown d1/d3/dd/d31/d66/c68 34101417 1 2024-03-16T10:53:21.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/772: chown d1/d3/dd/d72/f74 3069245 1 2024-03-16T10:53:21.087 INFO:tasks.workunit.client.0.smithi017.stdout:1/773: write d1/d3/dd/d31/d66/de0/f103 [5851835,53410] 0 2024-03-16T10:53:21.093 INFO:tasks.workunit.client.0.smithi017.stdout:2/479: dwrite d4/dd/d1e/d3e/f4d [0,4194304] 0 2024-03-16T10:53:21.096 INFO:tasks.workunit.client.0.smithi017.stdout:2/480: creat d4/d6/db/d66/d93/f9a x:0 0 0 2024-03-16T10:53:21.100 INFO:tasks.workunit.client.0.smithi017.stdout:1/774: rename d1/d50/cf4 to d1/d24/d79/dd2/d100/c105 0 2024-03-16T10:53:21.100 INFO:tasks.workunit.client.0.smithi017.stdout:1/775: dread - d1/d24/fe8 zero size 2024-03-16T10:53:21.102 INFO:tasks.workunit.client.0.smithi017.stdout:1/776: creat d1/d3/dd/d72/d8f/dbe/f106 x:0 0 0 2024-03-16T10:53:21.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/676: dwrite d6/d5f/d6e/d34/fab [0,4194304] 0 2024-03-16T10:53:21.103 INFO:tasks.workunit.client.0.smithi017.stdout:1/777: write d1/d3/dd/d31/d66/dd7/d67/fbf [324087,1269] 0 2024-03-16T10:53:21.103 INFO:tasks.workunit.client.0.smithi017.stdout:3/548: dread d8/d3f/d3d/f48 [0,4194304] 0 2024-03-16T10:53:21.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/434: dwrite d8/f1c [0,4194304] 0 2024-03-16T10:53:21.111 INFO:tasks.workunit.client.0.smithi017.stdout:3/549: dread d8/d1b/d1c/f2f [0,4194304] 0 2024-03-16T10:53:21.111 INFO:tasks.workunit.client.0.smithi017.stdout:3/550: rename d8/d1b/d1c to d8/d1b/d1c/d62/d69/da3 22 2024-03-16T10:53:21.111 INFO:tasks.workunit.client.0.smithi017.stdout:3/551: readlink d8/d1b/d2e/d57/l5a 0 2024-03-16T10:53:21.113 INFO:tasks.workunit.client.0.smithi017.stdout:9/435: creat d8/df/d5b/f8c x:0 0 0 2024-03-16T10:53:21.115 INFO:tasks.workunit.client.0.smithi017.stdout:0/700: dwrite d2/d4/f51 [0,4194304] 0 2024-03-16T10:53:21.116 INFO:tasks.workunit.client.0.smithi017.stdout:5/706: dwrite d0/d93/fcf [4194304,4194304] 0 2024-03-16T10:53:21.117 INFO:tasks.workunit.client.0.smithi017.stdout:3/552: creat d8/da/fa4 x:0 0 0 2024-03-16T10:53:21.117 INFO:tasks.workunit.client.0.smithi017.stdout:3/553: truncate d8/d1b/d65/f9b 5208670 0 2024-03-16T10:53:21.121 INFO:tasks.workunit.client.0.smithi017.stdout:7/562: dwrite d7/db/dc/f83 [0,4194304] 0 2024-03-16T10:53:21.121 INFO:tasks.workunit.client.0.smithi017.stdout:3/554: dread d8/f17 [0,4194304] 0 2024-03-16T10:53:21.122 INFO:tasks.workunit.client.0.smithi017.stdout:9/436: unlink d8/df/f40 0 2024-03-16T10:53:21.122 INFO:tasks.workunit.client.0.smithi017.stdout:3/555: write d8/da/fe [8563808,84311] 0 2024-03-16T10:53:21.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/556: fsync d8/d1b/d2e/f3e 0 2024-03-16T10:53:21.124 INFO:tasks.workunit.client.0.smithi017.stdout:1/778: getdents d1/d3/dd/d72/d8f/dbe 0 2024-03-16T10:53:21.129 INFO:tasks.workunit.client.0.smithi017.stdout:4/724: dwrite d15/d1d/f91 [4194304,4194304] 0 2024-03-16T10:53:21.129 INFO:tasks.workunit.client.0.smithi017.stdout:0/701: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d29/f6a [0,4194304] 0 2024-03-16T10:53:21.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/563: mkdir d7/db/d12/d1c/d4e/dbc 0 2024-03-16T10:53:21.132 INFO:tasks.workunit.client.0.smithi017.stdout:9/437: write d8/f59 [337325,80637] 0 2024-03-16T10:53:21.132 INFO:tasks.workunit.client.0.smithi017.stdout:9/438: stat d8/df/c7d 0 2024-03-16T10:53:21.134 INFO:tasks.workunit.client.0.smithi017.stdout:0/702: mknod d2/d4/d6d/d84/dc1/dd2/de/d19/cf7 0 2024-03-16T10:53:21.134 INFO:tasks.workunit.client.0.smithi017.stdout:5/707: dwrite d0/f98 [0,4194304] 0 2024-03-16T10:53:21.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/481: dwrite d4/d6/db/d66/d2e/f3d [0,4194304] 0 2024-03-16T10:53:21.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/482: dread - d4/f91 zero size 2024-03-16T10:53:21.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/483: chown d4/dd/d1e/f36 16224386 1 2024-03-16T10:53:21.136 INFO:tasks.workunit.client.0.smithi017.stdout:3/557: mknod d8/d1b/d1c/ca5 0 2024-03-16T10:53:21.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/703: symlink d2/d4/d61/ddd/lf8 0 2024-03-16T10:53:21.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/704: fsync d2/da1/f92 0 2024-03-16T10:53:21.136 INFO:tasks.workunit.client.0.smithi017.stdout:3/558: dread d8/d1b/f73 [0,4194304] 0 2024-03-16T10:53:21.137 INFO:tasks.workunit.client.0.smithi017.stdout:1/779: creat d1/d3/dd/d72/f107 x:0 0 0 2024-03-16T10:53:21.137 INFO:tasks.workunit.client.0.smithi017.stdout:1/780: write d1/d3/dd/ddc/ff3 [145256,45162] 0 2024-03-16T10:53:21.138 INFO:tasks.workunit.client.0.smithi017.stdout:7/564: write d7/db/dc/d50/d59/d34/f5e [7197460,23470] 0 2024-03-16T10:53:21.139 INFO:tasks.workunit.client.0.smithi017.stdout:4/725: creat d15/d1d/d21/ff9 x:0 0 0 2024-03-16T10:53:21.141 INFO:tasks.workunit.client.0.smithi017.stdout:0/705: dread d2/d4/d6d/d84/dc1/dd2/f63 [0,4194304] 0 2024-03-16T10:53:21.141 INFO:tasks.workunit.client.0.smithi017.stdout:0/706: readlink d2/d4/d90/dc2/le8 0 2024-03-16T10:53:21.143 INFO:tasks.workunit.client.0.smithi017.stdout:5/708: link d0/d1/d2/l63 d0/d1/d30/dde/d42/lf3 0 2024-03-16T10:53:21.143 INFO:tasks.workunit.client.0.smithi017.stdout:5/709: fdatasync d0/d1/d30/f83 0 2024-03-16T10:53:21.146 INFO:tasks.workunit.client.0.smithi017.stdout:2/484: mknod d4/d6/d30/c9b 0 2024-03-16T10:53:21.148 INFO:tasks.workunit.client.0.smithi017.stdout:2/485: creat d4/dd/d1e/d3e/f9c x:0 0 0 2024-03-16T10:53:21.149 INFO:tasks.workunit.client.0.smithi017.stdout:2/486: symlink d4/dd/d1e/d4a/l9d 0 2024-03-16T10:53:21.150 INFO:tasks.workunit.client.0.smithi017.stdout:2/487: write d4/d6/fa [1418867,93988] 0 2024-03-16T10:53:21.150 INFO:tasks.workunit.client.0.smithi017.stdout:7/565: symlink d7/db/d12/lbd 0 2024-03-16T10:53:21.151 INFO:tasks.workunit.client.0.smithi017.stdout:4/726: symlink d15/d1d/d21/d26/d66/d8c/lfa 0 2024-03-16T10:53:21.154 INFO:tasks.workunit.client.0.smithi017.stdout:5/710: symlink d0/d1/d2/d24/lf4 0 2024-03-16T10:53:21.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/707: rename d2/d4/d90/dc2/dc8 to d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9 0 2024-03-16T10:53:21.164 INFO:tasks.workunit.client.0.smithi017.stdout:2/488: stat d4/d6/d30/d3f/c40 0 2024-03-16T10:53:21.165 INFO:tasks.workunit.client.0.smithi017.stdout:2/489: chown d4/d6/d30/f8d 1 1 2024-03-16T10:53:21.165 INFO:tasks.workunit.client.0.smithi017.stdout:2/490: stat d4/dd/f67 0 2024-03-16T10:53:21.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/566: rmdir d7/db/d32/d78 39 2024-03-16T10:53:21.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/567: dread - d7/db/dc/d50/d59/d34/fa1 zero size 2024-03-16T10:53:21.167 INFO:tasks.workunit.client.0.smithi017.stdout:4/727: dwrite d15/d1d/d21/d26/d66/d8c/f92 [0,4194304] 0 2024-03-16T10:53:21.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/711: mknod d0/d1/d30/dde/d42/d46/cf5 0 2024-03-16T10:53:21.169 INFO:tasks.workunit.client.0.smithi017.stdout:2/491: chown d4/dd/df/f77 477 1 2024-03-16T10:53:21.170 INFO:tasks.workunit.client.0.smithi017.stdout:2/492: chown d4/dd/f67 2 1 2024-03-16T10:53:21.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/712: dread d0/d1/d30/dde/d57/f74 [0,4194304] 0 2024-03-16T10:53:21.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/713: write d0/d1/d2/d2c/d36/d51/fc4 [905232,128229] 0 2024-03-16T10:53:21.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/714: chown d0/d1/d1f/c33 1471021 1 2024-03-16T10:53:21.171 INFO:tasks.workunit.client.0.smithi017.stdout:2/493: creat d4/dd/d1e/d3e/f9e x:0 0 0 2024-03-16T10:53:21.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/708: rename d2/d4/d6d/d84/dc1/dd2/f1a to d2/d4/d6d/d84/de9/ffa 0 2024-03-16T10:53:21.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/709: chown d2/d4/d6d/d84/dc1/dd2/de 38264946 1 2024-03-16T10:53:21.173 INFO:tasks.workunit.client.0.smithi017.stdout:4/728: creat d15/d1d/d21/d3c/de9/d40/d51/d64/ffb x:0 0 0 2024-03-16T10:53:21.176 INFO:tasks.workunit.client.0.smithi017.stdout:7/568: rename d7/d8a/d66/l6b to d7/db/d12/d1c/d30/lbe 0 2024-03-16T10:53:21.176 INFO:tasks.workunit.client.0.smithi017.stdout:7/569: dread - d7/db/dc/d50/d59/d34/fa1 zero size 2024-03-16T10:53:21.178 INFO:tasks.workunit.client.0.smithi017.stdout:4/729: truncate d15/f1f 429683 0 2024-03-16T10:53:21.178 INFO:tasks.workunit.client.0.smithi017.stdout:5/715: rmdir d0/d1/d2/d2c/d36 39 2024-03-16T10:53:21.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/494: write d4/d6/db/d66/d2e/f3d [1661407,33221] 0 2024-03-16T10:53:21.181 INFO:tasks.workunit.client.0.smithi017.stdout:2/495: truncate d4/dd/d1e/d3e/d51/f88 966671 0 2024-03-16T10:53:21.181 INFO:tasks.workunit.client.0.smithi017.stdout:2/496: write d4/d6/db/d24/d39/f7b [529778,97550] 0 2024-03-16T10:53:21.181 INFO:tasks.workunit.client.0.smithi017.stdout:0/710: dread d2/d4/d6d/d84/dc1/dd2/de/d19/f4c [0,4194304] 0 2024-03-16T10:53:21.182 INFO:tasks.workunit.client.0.smithi017.stdout:2/497: mkdir d4/d97/d9f 0 2024-03-16T10:53:21.182 INFO:tasks.workunit.client.0.smithi017.stdout:2/498: chown d4/d6/db/d66/d2e/c79 125 1 2024-03-16T10:53:21.182 INFO:tasks.workunit.client.0.smithi017.stdout:1/781: link d1/d24/ff1 d1/d3/dd/d72/d8f/dbe/f108 0 2024-03-16T10:53:21.183 INFO:tasks.workunit.client.0.smithi017.stdout:0/711: symlink d2/da1/lfb 0 2024-03-16T10:53:21.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/716: mkdir d0/d1/d2/d2c/d36/d41/da5/dc6/df6 0 2024-03-16T10:53:21.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/717: fsync d0/d1/d1f/f7b 0 2024-03-16T10:53:21.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/718: write d0/d1/d30/dde/d42/d4c/f4e [901035,123206] 0 2024-03-16T10:53:21.186 INFO:tasks.workunit.client.0.smithi017.stdout:2/499: unlink d4/dd/df/l44 0 2024-03-16T10:53:21.186 INFO:tasks.workunit.client.0.smithi017.stdout:2/500: chown d4/d6/db/d66/d93/c82 1863408 1 2024-03-16T10:53:21.187 INFO:tasks.workunit.client.0.smithi017.stdout:2/501: write d4/dd/d1e/d3e/f9e [254959,33271] 0 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/712: creat d2/d4/d90/ffc x:0 0 0 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/713: readlink d2/d4/d6d/d84/dc1/dd2/d24/d72/le7 0 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/714: chown d2/d4/l8 96656635 1 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/715: chown d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f4b 355283 1 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:2/502: fsync d4/d6/d30/d3f/f69 0 2024-03-16T10:53:21.188 INFO:tasks.workunit.client.0.smithi017.stdout:2/503: chown d4/d6/fa 239698 1 2024-03-16T10:53:21.190 INFO:tasks.workunit.client.0.smithi017.stdout:0/716: write d2/d4/d6d/f75 [321632,48547] 0 2024-03-16T10:53:21.194 INFO:tasks.workunit.client.0.smithi017.stdout:0/717: mknod d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/cfd 0 2024-03-16T10:53:21.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/570: dwrite d7/db/f93 [4194304,4194304] 0 2024-03-16T10:53:21.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/571: chown d7/db/l7b 898 1 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/572: creat d7/db/d32/d78/fbf x:0 0 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/573: truncate d7/db/d12/d1c/d30/f9e 1928035 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/574: dread - d7/db/dc/d50/d59/f8f zero size 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/575: fsync d7/db/dc/d50/d59/d34/f43 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/576: readlink d7/db/dc/d50/d59/d34/l94 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/577: fdatasync d7/d8a/f29 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/578: write d7/db/d12/d1c/d30/fa7 [668116,113211] 0 2024-03-16T10:53:21.203 INFO:tasks.workunit.client.0.smithi017.stdout:4/730: dwrite d15/d1d/d21/f7f [0,4194304] 0 2024-03-16T10:53:21.204 INFO:tasks.workunit.client.0.smithi017.stdout:4/731: truncate d15/d1d/d21/d3c/de9/d40/fd0 982460 0 2024-03-16T10:53:21.204 INFO:tasks.workunit.client.0.smithi017.stdout:4/732: truncate d15/d1d/d21/d3c/de9/d40/d51/d64/d63/fac 4959967 0 2024-03-16T10:53:21.204 INFO:tasks.workunit.client.0.smithi017.stdout:4/733: chown d15/d1d/d21/d26/d66/le8 26663 1 2024-03-16T10:53:21.204 INFO:tasks.workunit.client.0.smithi017.stdout:4/734: dread - d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/fed zero size 2024-03-16T10:53:21.204 INFO:tasks.workunit.client.0.smithi017.stdout:0/718: mkdir d2/d4/d90/d86/db7/dc0/dfe 0 2024-03-16T10:53:21.206 INFO:tasks.workunit.client.0.smithi017.stdout:0/719: dread d2/d4/d6d/d84/dc1/dd2/f94 [0,4194304] 0 2024-03-16T10:53:21.210 INFO:tasks.workunit.client.0.smithi017.stdout:4/735: link d15/d1d/f24 d15/d1d/d21/d3c/de9/d96/ffc 0 2024-03-16T10:53:21.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/736: creat d15/d1d/d21/d3c/de9/d40/d51/d64/da8/ffd x:0 0 0 2024-03-16T10:53:21.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/737: getdents d15/d1d/d21/db1/db5 0 2024-03-16T10:53:21.215 INFO:tasks.workunit.client.0.smithi017.stdout:4/738: truncate d15/d1d/d50/fb9 804133 0 2024-03-16T10:53:21.215 INFO:tasks.workunit.client.0.smithi017.stdout:4/739: fsync d15/d1d/f25 0 2024-03-16T10:53:21.216 INFO:tasks.workunit.client.0.smithi017.stdout:0/720: dwrite d2/d4/d6d/d84/dc1/dd2/de/d19/f62 [0,4194304] 0 2024-03-16T10:53:21.220 INFO:tasks.workunit.client.0.smithi017.stdout:0/721: symlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d88/lff 0 2024-03-16T10:53:21.232 INFO:tasks.workunit.client.0.smithi017.stdout:0/722: dwrite d2/d4/d6d/fe6 [0,4194304] 0 2024-03-16T10:53:21.267 INFO:tasks.workunit.client.0.smithi017.stdout:5/719: dwrite d0/d1/d30/dde/d42/fc5 [0,4194304] 0 2024-03-16T10:53:21.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/720: mknod d0/d1/d30/dde/d42/db6/cf7 0 2024-03-16T10:53:21.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/721: stat d0/d1/d2/c5b 0 2024-03-16T10:53:21.273 INFO:tasks.workunit.client.0.smithi017.stdout:6/509: sync 2024-03-16T10:53:21.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/722: write d0/d1/d2/ff [4575225,68412] 0 2024-03-16T10:53:21.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/723: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/f9c [0,4194304] 0 2024-03-16T10:53:21.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/724: chown d2/d4/d6d/d84/dc1/dd2/d24/c9e 137057808 1 2024-03-16T10:53:21.274 INFO:tasks.workunit.client.0.smithi017.stdout:4/740: dwrite d15/d1d/d21/d3c/de9/d43/dc2/ff8 [0,4194304] 0 2024-03-16T10:53:21.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/725: dread - d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe4 zero size 2024-03-16T10:53:21.275 INFO:tasks.workunit.client.0.smithi017.stdout:7/579: dwrite d7/db/dc/d50/f7c [0,4194304] 0 2024-03-16T10:53:21.275 INFO:tasks.workunit.client.0.smithi017.stdout:0/726: chown d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/fcb 15703 1 2024-03-16T10:53:21.277 INFO:tasks.workunit.client.0.smithi017.stdout:0/727: creat d2/d4/f100 x:0 0 0 2024-03-16T10:53:21.281 INFO:tasks.workunit.client.0.smithi017.stdout:5/723: unlink d0/f9 0 2024-03-16T10:53:21.283 INFO:tasks.workunit.client.0.smithi017.stdout:6/510: dwrite d0/d21/f36 [0,4194304] 0 2024-03-16T10:53:21.284 INFO:tasks.workunit.client.0.smithi017.stdout:6/511: read - d0/d15/d1f/d7d/f7f zero size 2024-03-16T10:53:21.287 INFO:tasks.workunit.client.0.smithi017.stdout:7/580: unlink d7/db/dc/d50/d59/l8b 0 2024-03-16T10:53:21.288 INFO:tasks.workunit.client.0.smithi017.stdout:0/728: dwrite d2/d4/d6d/f7f [0,4194304] 0 2024-03-16T10:53:21.290 INFO:tasks.workunit.client.0.smithi017.stdout:0/729: mkdir d2/d4/d6d/d84/dc1/dd2/d24/d72/d101 0 2024-03-16T10:53:21.291 INFO:tasks.workunit.client.0.smithi017.stdout:5/724: rename d0/d1/d2/dc/f1d to d0/d1/d1f/d29/dd5/ff8 0 2024-03-16T10:53:21.293 INFO:tasks.workunit.client.0.smithi017.stdout:7/581: rename d7/c8c to d7/d8a/cc0 0 2024-03-16T10:53:21.296 INFO:tasks.workunit.client.0.smithi017.stdout:7/582: creat d7/db/d32/d78/fc1 x:0 0 0 2024-03-16T10:53:21.300 INFO:tasks.workunit.client.0.smithi017.stdout:7/583: symlink d7/db/dc/d50/d59/d34/d53/lc2 0 2024-03-16T10:53:21.300 INFO:tasks.workunit.client.0.smithi017.stdout:7/584: fsync d7/db/d12/d1c/f41 0 2024-03-16T10:53:21.301 INFO:tasks.workunit.client.0.smithi017.stdout:6/512: dwrite d0/d21/d39/d44/da2/d45/d4d/d2e/d69/f82 [0,4194304] 0 2024-03-16T10:53:21.301 INFO:tasks.workunit.client.0.smithi017.stdout:6/513: dread - d0/d21/d39/d44/da2/d45/d4d/d2c/d41/d97/f9b zero size 2024-03-16T10:53:21.302 INFO:tasks.workunit.client.0.smithi017.stdout:7/585: rename d7/db/d12/d1c/f6e to d7/db/dc/d50/d59/daf/fc3 0 2024-03-16T10:53:21.306 INFO:tasks.workunit.client.0.smithi017.stdout:6/514: link d0/d21/d39/d44/da2/l12 d0/d21/d39/d44/da2/d45/d4d/d2e/la5 0 2024-03-16T10:53:21.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/730: dread d2/d4/d6d/d84/faa [4194304,4194304] 0 2024-03-16T10:53:21.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/731: fdatasync d2/d4/d90/d86/db7/fc4 0 2024-03-16T10:53:21.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/732: write d2/d4/d6d/d84/dc1/dd2/de/d19/f56 [4744806,33965] 0 2024-03-16T10:53:21.311 INFO:tasks.workunit.client.0.smithi017.stdout:6/515: mkdir d0/d21/d39/d44/da2/d45/d4d/d6d/d75/d84/da6 0 2024-03-16T10:53:21.314 INFO:tasks.workunit.client.0.smithi017.stdout:0/733: creat d2/d4/d90/d86/db7/dc0/dd5/f102 x:0 0 0 2024-03-16T10:53:21.322 INFO:tasks.workunit.client.0.smithi017.stdout:0/734: dread d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 [0,4194304] 0 2024-03-16T10:53:21.324 INFO:tasks.workunit.client.0.smithi017.stdout:0/735: link d2/d4/d6d/d84/dc1/dd2/d24/d29/c70 d2/d4/d6d/d84/dc1/dd2/d24/c103 0 2024-03-16T10:53:21.325 INFO:tasks.workunit.client.0.smithi017.stdout:5/725: unlink d0/d5d/d9f/ldd 0 2024-03-16T10:53:21.325 INFO:tasks.workunit.client.0.smithi017.stdout:5/726: chown d0/d1/d2/d2c/d36/d41/f8e 0 1 2024-03-16T10:53:21.326 INFO:tasks.workunit.client.0.smithi017.stdout:5/727: write d0/d5d/f90 [172007,110279] 0 2024-03-16T10:53:21.326 INFO:tasks.workunit.client.0.smithi017.stdout:5/728: stat d0/ded/d6a/c79 0 2024-03-16T10:53:21.332 INFO:tasks.workunit.client.0.smithi017.stdout:8/677: sync 2024-03-16T10:53:21.332 INFO:tasks.workunit.client.0.smithi017.stdout:6/516: rename d0/d21/d39/d44/da2 to d0/d21/d39/d44/d9a/da7 0 2024-03-16T10:53:21.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/517: unlink d0/d15/c31 0 2024-03-16T10:53:21.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/518: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c [1344466,124700] 0 2024-03-16T10:53:21.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/519: dread - d0/f74 zero size 2024-03-16T10:53:21.335 INFO:tasks.workunit.client.0.smithi017.stdout:8/678: mknod d6/d16/d6c/dd4/cdc 0 2024-03-16T10:53:21.336 INFO:tasks.workunit.client.0.smithi017.stdout:0/736: dread d2/d4/d6d/fe6 [0,4194304] 0 2024-03-16T10:53:21.336 INFO:tasks.workunit.client.0.smithi017.stdout:8/679: creat d6/d16/d6c/dd4/d92/fdd x:0 0 0 2024-03-16T10:53:21.337 INFO:tasks.workunit.client.0.smithi017.stdout:8/680: stat d6/d14/d6b/f85 0 2024-03-16T10:53:21.337 INFO:tasks.workunit.client.0.smithi017.stdout:8/681: write d6/d14/d6b/fb6 [783731,75050] 0 2024-03-16T10:53:21.339 INFO:tasks.workunit.client.0.smithi017.stdout:0/737: mkdir d2/d4/d6d/d84/dc1/d104 0 2024-03-16T10:53:21.342 INFO:tasks.workunit.client.0.smithi017.stdout:8/682: dread d6/d16/db3/dcb/fa7 [0,4194304] 0 2024-03-16T10:53:21.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/729: dwrite d0/d1/fd3 [0,4194304] 0 2024-03-16T10:53:21.345 INFO:tasks.workunit.client.0.smithi017.stdout:8/683: link d6/f4e d6/d39/fde 0 2024-03-16T10:53:21.345 INFO:tasks.workunit.client.0.smithi017.stdout:8/684: write d6/f68 [4641697,13612] 0 2024-03-16T10:53:21.346 INFO:tasks.workunit.client.0.smithi017.stdout:8/685: write d6/d16/f2d [1244516,121214] 0 2024-03-16T10:53:21.350 INFO:tasks.workunit.client.0.smithi017.stdout:6/520: dwrite d0/f74 [0,4194304] 0 2024-03-16T10:53:21.350 INFO:tasks.workunit.client.0.smithi017.stdout:6/521: chown d0/d21/d39/d44/d9a/da7/d38/f71 0 1 2024-03-16T10:53:21.350 INFO:tasks.workunit.client.0.smithi017.stdout:6/522: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 0 2024-03-16T10:53:21.350 INFO:tasks.workunit.client.0.smithi017.stdout:0/738: read d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f48 [109906,97566] 0 2024-03-16T10:53:21.352 INFO:tasks.workunit.client.0.smithi017.stdout:0/739: creat d2/d4/d6d/d84/dc1/f105 x:0 0 0 2024-03-16T10:53:21.353 INFO:tasks.workunit.client.0.smithi017.stdout:0/740: creat d2/da1/f106 x:0 0 0 2024-03-16T10:53:21.354 INFO:tasks.workunit.client.0.smithi017.stdout:5/730: dread d0/d1/fd3 [0,4194304] 0 2024-03-16T10:53:21.358 INFO:tasks.workunit.client.0.smithi017.stdout:0/741: unlink d2/d4/c71 0 2024-03-16T10:53:21.360 INFO:tasks.workunit.client.0.smithi017.stdout:5/731: getdents d0/d1/d2/d24 0 2024-03-16T10:53:21.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/742: creat d2/d4/d90/d86/db7/f107 x:0 0 0 2024-03-16T10:53:21.363 INFO:tasks.workunit.client.0.smithi017.stdout:0/743: mkdir d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/d108 0 2024-03-16T10:53:21.367 INFO:tasks.workunit.client.0.smithi017.stdout:5/732: dread d0/f87 [0,4194304] 0 2024-03-16T10:53:21.370 INFO:tasks.workunit.client.0.smithi017.stdout:5/733: getdents d0/d1/d2/d8c 0 2024-03-16T10:53:21.370 INFO:tasks.workunit.client.0.smithi017.stdout:0/744: dread d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f4b [0,4194304] 0 2024-03-16T10:53:21.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/734: mknod d0/d1/d1f/d97/de6/cf9 0 2024-03-16T10:53:21.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/735: readlink d0/d1/d1f/ld6 0 2024-03-16T10:53:21.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/736: truncate d0/d1/d2/dc/d68/fb1 1048450 0 2024-03-16T10:53:21.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/737: truncate d0/d1/d30/dde/f64 1037113 0 2024-03-16T10:53:21.372 INFO:tasks.workunit.client.0.smithi017.stdout:5/738: creat d0/d1/d30/dde/d42/d4c/ffa x:0 0 0 2024-03-16T10:53:21.373 INFO:tasks.workunit.client.0.smithi017.stdout:6/523: rename d0/d22 to d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8 0 2024-03-16T10:53:21.373 INFO:tasks.workunit.client.0.smithi017.stdout:5/739: symlink d0/d1/d2/d2c/d36/db4/lfb 0 2024-03-16T10:53:21.373 INFO:tasks.workunit.client.0.smithi017.stdout:5/740: write d0/ded/daf/fd7 [1062767,15684] 0 2024-03-16T10:53:21.374 INFO:tasks.workunit.client.0.smithi017.stdout:6/524: truncate d0/d15/d1f/f5e 3901789 0 2024-03-16T10:53:21.374 INFO:tasks.workunit.client.0.smithi017.stdout:6/525: dread - d0/f6a zero size 2024-03-16T10:53:21.375 INFO:tasks.workunit.client.0.smithi017.stdout:5/741: mknod d0/d1/d1f/d29/dd5/cfc 0 2024-03-16T10:53:21.382 INFO:tasks.workunit.client.0.smithi017.stdout:6/526: read d0/d21/d39/d44/d9a/da7/f13 [2320091,55079] 0 2024-03-16T10:53:21.382 INFO:tasks.workunit.client.0.smithi017.stdout:6/527: read d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c [1618784,3138] 0 2024-03-16T10:53:21.384 INFO:tasks.workunit.client.0.smithi017.stdout:6/528: link d0/d15/f55 d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fa9 0 2024-03-16T10:53:21.387 INFO:tasks.workunit.client.0.smithi017.stdout:6/529: unlink d0/d15/d1f/d7d/ca1 0 2024-03-16T10:53:21.387 INFO:tasks.workunit.client.0.smithi017.stdout:5/742: dwrite d0/d1/d30/dde/d42/f4a [0,4194304] 0 2024-03-16T10:53:21.390 INFO:tasks.workunit.client.0.smithi017.stdout:5/743: mknod d0/d1/d1f/d29/d88/d91/dda/cfd 0 2024-03-16T10:53:21.391 INFO:tasks.workunit.client.0.smithi017.stdout:5/744: read d0/d1/d2/d8c/fc0 [132577,94108] 0 2024-03-16T10:53:21.391 INFO:tasks.workunit.client.0.smithi017.stdout:6/530: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d2c 0 2024-03-16T10:53:21.392 INFO:tasks.workunit.client.0.smithi017.stdout:5/745: mknod d0/d93/cfe 0 2024-03-16T10:53:21.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/746: unlink d0/d1/d1f/d29/d88/d91/fe8 0 2024-03-16T10:53:21.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/747: write d0/d1/d2/dc/d68/f92 [961924,66440] 0 2024-03-16T10:53:21.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/748: link d0/d1/d2/d2c/d36/d41/f62 d0/d1/d1f/d29/d88/d91/dda/fff 0 2024-03-16T10:53:21.396 INFO:tasks.workunit.client.0.smithi017.stdout:5/749: creat d0/d1/d1f/d29/d88/d91/dda/f100 x:0 0 0 2024-03-16T10:53:21.400 INFO:tasks.workunit.client.0.smithi017.stdout:6/531: dwrite d0/f6a [0,4194304] 0 2024-03-16T10:53:21.404 INFO:tasks.workunit.client.0.smithi017.stdout:6/532: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/faa x:0 0 0 2024-03-16T10:53:21.405 INFO:tasks.workunit.client.0.smithi017.stdout:6/533: truncate d0/f8e 722411 0 2024-03-16T10:53:21.405 INFO:tasks.workunit.client.0.smithi017.stdout:6/534: chown d0/d21/d39/f5a 542682 1 2024-03-16T10:53:21.407 INFO:tasks.workunit.client.0.smithi017.stdout:6/535: creat d0/d21/d39/d44/d9a/da7/fab x:0 0 0 2024-03-16T10:53:21.407 INFO:tasks.workunit.client.0.smithi017.stdout:6/536: write d0/d21/d39/d44/d9a/da7/f18 [4326018,8392] 0 2024-03-16T10:53:21.407 INFO:tasks.workunit.client.0.smithi017.stdout:6/537: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f89 [441002,6726] 0 2024-03-16T10:53:21.413 INFO:tasks.workunit.client.0.smithi017.stdout:6/538: read d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f79 [2709263,97249] 0 2024-03-16T10:53:21.422 INFO:tasks.workunit.client.0.smithi017.stdout:6/539: dread d0/d21/f7c [0,4194304] 0 2024-03-16T10:53:21.428 INFO:tasks.workunit.client.0.smithi017.stdout:6/540: write d0/d3e/f57 [3647337,119604] 0 2024-03-16T10:53:21.428 INFO:tasks.workunit.client.0.smithi017.stdout:6/541: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f56 0 2024-03-16T10:53:21.429 INFO:tasks.workunit.client.0.smithi017.stdout:6/542: mknod d0/d21/cac 0 2024-03-16T10:53:21.430 INFO:tasks.workunit.client.0.smithi017.stdout:6/543: rmdir d0/d15 39 2024-03-16T10:53:21.431 INFO:tasks.workunit.client.0.smithi017.stdout:6/544: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/d41/d86/dad 0 2024-03-16T10:53:21.432 INFO:tasks.workunit.client.0.smithi017.stdout:6/545: read d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f8a [359270,69017] 0 2024-03-16T10:53:21.434 INFO:tasks.workunit.client.0.smithi017.stdout:6/546: unlink d0/d21/d39/d44/d9a/da7/d45/d4d/l47 0 2024-03-16T10:53:21.434 INFO:tasks.workunit.client.0.smithi017.stdout:6/547: chown d0/d21/d39/d44/d9a/da7/f18 5213 1 2024-03-16T10:53:21.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/548: rmdir d0/d21/d39/d44/d9a/da7/d96/da4 0 2024-03-16T10:53:21.437 INFO:tasks.workunit.client.0.smithi017.stdout:6/549: rename d0/d21/f7c to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fae 0 2024-03-16T10:53:21.511 INFO:tasks.workunit.client.0.smithi017.stdout:9/439: sync 2024-03-16T10:53:21.511 INFO:tasks.workunit.client.0.smithi017.stdout:9/440: write d8/df/f60 [1308106,10309] 0 2024-03-16T10:53:21.511 INFO:tasks.workunit.client.0.smithi017.stdout:9/441: dread - d8/df/d5b/d32/d45/f83 zero size 2024-03-16T10:53:21.516 INFO:tasks.workunit.client.0.smithi017.stdout:9/442: dread d8/df/f1a [4194304,4194304] 0 2024-03-16T10:53:21.517 INFO:tasks.workunit.client.0.smithi017.stdout:9/443: dread - d8/f4d zero size 2024-03-16T10:53:21.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/444: creat d8/df/d5b/f8d x:0 0 0 2024-03-16T10:53:21.519 INFO:tasks.workunit.client.0.smithi017.stdout:9/445: rmdir d8/df/d5b/d32 39 2024-03-16T10:53:21.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/446: dread d8/df/d5b/f3a [0,4194304] 0 2024-03-16T10:53:21.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/447: write d8/df/d46/d63/f7e [30057,54700] 0 2024-03-16T10:53:21.521 INFO:tasks.workunit.client.0.smithi017.stdout:9/448: symlink d8/df/d5b/d5e/d68/d7f/l8e 0 2024-03-16T10:53:21.522 INFO:tasks.workunit.client.0.smithi017.stdout:9/449: symlink d8/df/d5b/d5e/l8f 0 2024-03-16T10:53:21.522 INFO:tasks.workunit.client.0.smithi017.stdout:9/450: mknod d8/df/d5b/d72/c90 0 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/451: mkdir d8/df/d5b/d5e/d91 0 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/452: dread - d8/df/d5b/d5e/d68/f7a zero size 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/453: fdatasync d8/df/d46/f56 0 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/454: chown d8/df/d5b/d72/c90 0 1 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/455: fdatasync d8/df/d5b/d5e/d68/f7a 0 2024-03-16T10:53:21.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/456: stat d8/df/d5b/f6f 0 2024-03-16T10:53:21.541 INFO:tasks.workunit.client.0.smithi017.stdout:9/457: dwrite d8/df/d46/d63/f7e [0,4194304] 0 2024-03-16T10:53:21.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/458: mknod d8/df/d5b/d5e/d91/c92 0 2024-03-16T10:53:21.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/459: dread - d8/df/d5b/d32/d45/f61 zero size 2024-03-16T10:53:21.544 INFO:tasks.workunit.client.0.smithi017.stdout:9/460: symlink d8/df/d5b/d70/l93 0 2024-03-16T10:53:21.554 INFO:tasks.workunit.client.0.smithi017.stdout:9/461: dread d8/df/d46/d63/f7e [0,4194304] 0 2024-03-16T10:53:21.554 INFO:tasks.workunit.client.0.smithi017.stdout:9/462: truncate d8/df/d46/d63/f7b 6006511 0 2024-03-16T10:53:21.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/463: mkdir d8/df/d46/d63/d94 0 2024-03-16T10:53:21.556 INFO:tasks.workunit.client.0.smithi017.stdout:9/464: dread - d8/f4d zero size 2024-03-16T10:53:21.559 INFO:tasks.workunit.client.0.smithi017.stdout:9/465: dread d8/df/d46/d63/f6b [0,4194304] 0 2024-03-16T10:53:21.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/466: dwrite d8/f79 [0,4194304] 0 2024-03-16T10:53:21.577 INFO:tasks.workunit.client.0.smithi017.stdout:9/467: write d8/df/d46/f5c [586455,10127] 0 2024-03-16T10:53:21.579 INFO:tasks.workunit.client.0.smithi017.stdout:9/468: mkdir d8/d95 0 2024-03-16T10:53:21.582 INFO:tasks.workunit.client.0.smithi017.stdout:9/469: rename d8/c7c to d8/df/d5b/d5e/c96 0 2024-03-16T10:53:21.585 INFO:tasks.workunit.client.0.smithi017.stdout:9/470: dread d8/df/d5b/d32/f34 [0,4194304] 0 2024-03-16T10:53:21.585 INFO:tasks.workunit.client.0.smithi017.stdout:9/471: dread - d8/df/d5b/d32/d45/f61 zero size 2024-03-16T10:53:21.585 INFO:tasks.workunit.client.0.smithi017.stdout:3/559: sync 2024-03-16T10:53:21.587 INFO:tasks.workunit.client.0.smithi017.stdout:3/560: dread d8/d1b/d2e/d60/f74 [0,4194304] 0 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:9/472: dread d8/df/d46/f58 [0,4194304] 0 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:9/473: write d8/df/d46/f58 [6330846,57263] 0 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:5/750: sync 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:0/745: sync 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:1/782: sync 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/504: sync 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/505: chown d4/dd/d1e 3 1 2024-03-16T10:53:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:6/550: sync 2024-03-16T10:53:21.592 INFO:tasks.workunit.client.0.smithi017.stdout:4/741: sync 2024-03-16T10:53:21.592 INFO:tasks.workunit.client.0.smithi017.stdout:4/742: chown d15/d1d/d21/d3c/de9/d40/d51/d64/d63/dca/fd3 308341388 1 2024-03-16T10:53:21.592 INFO:tasks.workunit.client.0.smithi017.stdout:8/686: sync 2024-03-16T10:53:21.592 INFO:tasks.workunit.client.0.smithi017.stdout:7/586: sync 2024-03-16T10:53:21.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/551: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/faf x:0 0 0 2024-03-16T10:53:21.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/743: mkdir d15/d1d/d21/d26/dfe 0 2024-03-16T10:53:21.595 INFO:tasks.workunit.client.0.smithi017.stdout:8/687: mknod d6/d5f/d6e/d34/cdf 0 2024-03-16T10:53:21.595 INFO:tasks.workunit.client.0.smithi017.stdout:8/688: truncate d6/d5f/d6e/d34/f52 885051 0 2024-03-16T10:53:21.596 INFO:tasks.workunit.client.0.smithi017.stdout:0/746: symlink d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/l109 0 2024-03-16T10:53:21.596 INFO:tasks.workunit.client.0.smithi017.stdout:0/747: write d2/d4/d6d/f75 [173700,126688] 0 2024-03-16T10:53:21.596 INFO:tasks.workunit.client.0.smithi017.stdout:0/748: write d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [1237323,110826] 0 2024-03-16T10:53:21.597 INFO:tasks.workunit.client.0.smithi017.stdout:7/587: symlink d7/db/d32/d78/da5/lc4 0 2024-03-16T10:53:21.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/744: creat d15/d1d/d21/d26/d66/d8c/dab/fff x:0 0 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:7/588: mkdir d7/db/d32/dc5 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:0/749: creat d2/d4/d6d/dde/f10a x:0 0 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:7/589: truncate d7/db/dc/d50/d59/daf/fc3 953266 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:9/474: write d8/df/d5b/d32/d45/f77 [2001170,32682] 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:9/475: getdents d8/df/d46/d63/d88 0 2024-03-16T10:53:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:9/476: read - d8/df/d5b/d32/f73 zero size 2024-03-16T10:53:21.602 INFO:tasks.workunit.client.0.smithi017.stdout:0/750: chown d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/ccc 146345903 1 2024-03-16T10:53:21.602 INFO:tasks.workunit.client.0.smithi017.stdout:0/751: dread - d2/d4/f100 zero size 2024-03-16T10:53:21.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/745: mknod d15/d1d/d21/d3c/de9/d43/dc2/df1/c100 0 2024-03-16T10:53:21.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/746: chown d15/d1d/d50 23151050 1 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:0/752: truncate d2/d4/d6d/d84/fa0 855161 0 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:2/506: write d4/d6/db/d66/d2e/f31 [2571498,36927] 0 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:0/753: write d2/d4/d6d/d84/dc1/dd2/d24/d29/f98 [536436,48824] 0 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:0/754: chown d2/d4/d6d/d84/dc1/dd2/d24/ff0 1 1 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:0/755: chown d2/d4/f43 92529 1 2024-03-16T10:53:21.605 INFO:tasks.workunit.client.0.smithi017.stdout:2/507: getdents d4/dd/d1e/d4a 0 2024-03-16T10:53:21.606 INFO:tasks.workunit.client.0.smithi017.stdout:4/747: creat d15/d1d/d21/d3c/de9/d40/d51/f101 x:0 0 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:4/748: stat d15/d1d/d21/d3c/de9/d40/c60 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:4/749: fdatasync d15/d1d/d21/d3c/de9/d40/d51/d64/da8/fc9 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:7/590: write d7/db/dc/d50/d59/f61 [3752371,19627] 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:7/591: fdatasync d7/db/d12/d1c/f36 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:7/592: chown d7/db/d12/d1c/d30/lbe 596 1 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:0/756: mkdir d2/d4/d90/d10b 0 2024-03-16T10:53:21.607 INFO:tasks.workunit.client.0.smithi017.stdout:2/508: mknod d4/d6/db/d66/d2e/d78/ca0 0 2024-03-16T10:53:21.609 INFO:tasks.workunit.client.0.smithi017.stdout:5/751: dwrite d0/d1/f11 [0,4194304] 0 2024-03-16T10:53:21.609 INFO:tasks.workunit.client.0.smithi017.stdout:5/752: dread - d0/d1/d2/f80 zero size 2024-03-16T10:53:21.609 INFO:tasks.workunit.client.0.smithi017.stdout:5/753: stat d0/d1/d2/d2c/d36/db4/dea 0 2024-03-16T10:53:21.609 INFO:tasks.workunit.client.0.smithi017.stdout:4/750: symlink d15/d1d/d27/db6/l102 0 2024-03-16T10:53:21.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/757: creat d2/d4/d6d/d84/dc1/dd2/de/d1e/db4/f10c x:0 0 0 2024-03-16T10:53:21.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/593: rename d7/db/c58 to d7/d8a/cc6 0 2024-03-16T10:53:21.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/561: dwrite d8/da/db/f50 [0,4194304] 0 2024-03-16T10:53:21.613 INFO:tasks.workunit.client.0.smithi017.stdout:8/689: dwrite d6/d16/d6c/dd4/d92/fc8 [0,4194304] 0 2024-03-16T10:53:21.614 INFO:tasks.workunit.client.0.smithi017.stdout:5/754: truncate d0/d1/d1f/d29/f2a 5080465 0 2024-03-16T10:53:21.614 INFO:tasks.workunit.client.0.smithi017.stdout:5/755: dread - d0/d1/d2/d2c/fbd zero size 2024-03-16T10:53:21.614 INFO:tasks.workunit.client.0.smithi017.stdout:1/783: dwrite d1/d3/dd/d31/d66/dd7/d67/fbf [0,4194304] 0 2024-03-16T10:53:21.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/784: fsync d1/d3/dd/f77 0 2024-03-16T10:53:21.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/785: chown d1/d3/dd/l10 881883 1 2024-03-16T10:53:21.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/786: fdatasync d1/d3/dd/d31/fc8 0 2024-03-16T10:53:21.616 INFO:tasks.workunit.client.0.smithi017.stdout:6/552: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/f92 [0,4194304] 0 2024-03-16T10:53:21.616 INFO:tasks.workunit.client.0.smithi017.stdout:6/553: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 0 2024-03-16T10:53:21.616 INFO:tasks.workunit.client.0.smithi017.stdout:3/562: mkdir d8/d1b/d65/da6 0 2024-03-16T10:53:21.616 INFO:tasks.workunit.client.0.smithi017.stdout:3/563: fdatasync d8/da/db/f50 0 2024-03-16T10:53:21.616 INFO:tasks.workunit.client.0.smithi017.stdout:3/564: chown d8/d1b/d1c/d62/d69/d8b 16775695 1 2024-03-16T10:53:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:7/594: symlink d7/db/dc/d50/d59/d34/d53/lc7 0 2024-03-16T10:53:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:8/690: unlink d6/d5f/d6e/d34/db4/fda 0 2024-03-16T10:53:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:8/691: truncate d6/d4a/f9d 1132199 0 2024-03-16T10:53:21.623 INFO:tasks.workunit.client.0.smithi017.stdout:6/554: dread d0/d21/d39/d44/d9a/da7/f18 [0,4194304] 0 2024-03-16T10:53:21.623 INFO:tasks.workunit.client.0.smithi017.stdout:6/555: fdatasync d0/f74 0 2024-03-16T10:53:21.624 INFO:tasks.workunit.client.0.smithi017.stdout:1/787: mknod d1/d3/dd/d72/c109 0 2024-03-16T10:53:21.625 INFO:tasks.workunit.client.0.smithi017.stdout:6/556: dread d0/d15/f1c [0,4194304] 0 2024-03-16T10:53:21.625 INFO:tasks.workunit.client.0.smithi017.stdout:0/758: dwrite d2/d4/d6d/d84/dc1/dd2/f87 [0,4194304] 0 2024-03-16T10:53:21.628 INFO:tasks.workunit.client.0.smithi017.stdout:2/509: dwrite d4/dd/d1e/d3e/d51/f8a [0,4194304] 0 2024-03-16T10:53:21.628 INFO:tasks.workunit.client.0.smithi017.stdout:3/565: mkdir d8/da/da7 0 2024-03-16T10:53:21.632 INFO:tasks.workunit.client.0.smithi017.stdout:7/595: creat d7/db/d12/d1c/d4e/dbc/fc8 x:0 0 0 2024-03-16T10:53:21.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/510: dread d4/dd/f1d [0,4194304] 0 2024-03-16T10:53:21.633 INFO:tasks.workunit.client.0.smithi017.stdout:8/692: rmdir d6/d5c/d96/d98 39 2024-03-16T10:53:21.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/566: rename d8/d1b/f73 to d8/d1b/d1c/d62/fa8 0 2024-03-16T10:53:21.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/567: dread - d8/d1b/d2e/d8d/f82 zero size 2024-03-16T10:53:21.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/596: dread f2 [4194304,4194304] 0 2024-03-16T10:53:21.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/597: stat d7/db/d12/f8e 0 2024-03-16T10:53:21.643 INFO:tasks.workunit.client.0.smithi017.stdout:2/511: rename d4/d6/d81/l86 to d4/d97/la1 0 2024-03-16T10:53:21.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/512: unlink d4/dd/d1e/d4a/c62 0 2024-03-16T10:53:21.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/598: readlink d7/db/d12/d1c/l2f 0 2024-03-16T10:53:21.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/599: chown d7/db/d12/d1c/d30/fb9 5774173 1 2024-03-16T10:53:21.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/693: rename d6/d5f/d6e/f50 to d6/d39/fe0 0 2024-03-16T10:53:21.649 INFO:tasks.workunit.client.0.smithi017.stdout:1/788: dwrite d1/f41 [4194304,4194304] 0 2024-03-16T10:53:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:2/513: creat d4/d6/d81/fa2 x:0 0 0 2024-03-16T10:53:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:1/789: rmdir d1/d3/dd/d31/d66/dd7/dbc/ddb/de2 39 2024-03-16T10:53:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:1/790: dread - d1/d3/dd/ddc/fdf zero size 2024-03-16T10:53:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:1/791: readlink d1/l7b 0 2024-03-16T10:53:21.656 INFO:tasks.workunit.client.0.smithi017.stdout:6/557: dwrite d0/d15/d1f/d7d/d87/f90 [0,4194304] 0 2024-03-16T10:53:21.656 INFO:tasks.workunit.client.0.smithi017.stdout:6/558: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fa9 0 2024-03-16T10:53:21.658 INFO:tasks.workunit.client.0.smithi017.stdout:0/759: dwrite d2/d4/d6d/f7f [0,4194304] 0 2024-03-16T10:53:21.661 INFO:tasks.workunit.client.0.smithi017.stdout:4/751: link d15/d1d/d21/db1/db5/fd7 d15/d1d/d21/d26/d66/d8c/da4/f103 0 2024-03-16T10:53:21.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/756: dwrite d0/d1/d1f/d29/f2a [0,4194304] 0 2024-03-16T10:53:21.668 INFO:tasks.workunit.client.0.smithi017.stdout:3/568: dwrite d8/d1d/f4b [0,4194304] 0 2024-03-16T10:53:21.670 INFO:tasks.workunit.client.0.smithi017.stdout:6/559: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0 0 2024-03-16T10:53:21.672 INFO:tasks.workunit.client.0.smithi017.stdout:8/694: dwrite d6/d4a/f9d [0,4194304] 0 2024-03-16T10:53:21.672 INFO:tasks.workunit.client.0.smithi017.stdout:7/600: dwrite d7/db/dc/d50/d73/fb6 [0,4194304] 0 2024-03-16T10:53:21.672 INFO:tasks.workunit.client.0.smithi017.stdout:8/695: write d6/d5f/d6e/d34/f52 [231650,115968] 0 2024-03-16T10:53:21.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/752: rmdir d15/d1d/d21/d3c/de9/d43/dc2 39 2024-03-16T10:53:21.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/753: chown d15/d1d/d21/d3c/de9/d40/d51/d64/da8/ffd 86 1 2024-03-16T10:53:21.675 INFO:tasks.workunit.client.0.smithi017.stdout:9/477: link d8/l3e d8/df/d5b/d32/d45/l97 0 2024-03-16T10:53:21.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/478: write d8/df/d5b/d32/f67 [413115,44322] 0 2024-03-16T10:53:21.683 INFO:tasks.workunit.client.0.smithi017.stdout:3/569: getdents d8/d1b/d1c 0 2024-03-16T10:53:21.685 INFO:tasks.workunit.client.0.smithi017.stdout:6/560: unlink d0/d21/c29 0 2024-03-16T10:53:21.686 INFO:tasks.workunit.client.0.smithi017.stdout:8/696: read d6/d39/da9/fbe [2589014,101435] 0 2024-03-16T10:53:21.686 INFO:tasks.workunit.client.0.smithi017.stdout:7/601: write d7/db/dc/d50/d59/d34/d95/fa2 [2835951,45880] 0 2024-03-16T10:53:21.686 INFO:tasks.workunit.client.0.smithi017.stdout:7/602: chown d7/db/d12 234 1 2024-03-16T10:53:21.686 INFO:tasks.workunit.client.0.smithi017.stdout:7/603: chown d7/db/d12/d1c/d30/c88 722710 1 2024-03-16T10:53:21.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/760: rmdir d2 39 2024-03-16T10:53:21.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/757: dwrite d0/d1/d30/dde/d42/d4c/ffa [0,4194304] 0 2024-03-16T10:53:21.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/754: unlink d15/d1d/d21/d26/d66/d8c/dab/fb3 0 2024-03-16T10:53:21.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/755: fsync f4 0 2024-03-16T10:53:21.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/561: write d0/d15/d1f/f5e [2459050,21597] 0 2024-03-16T10:53:21.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/562: fdatasync d0/d3e/f57 0 2024-03-16T10:53:21.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/563: write d0/d21/d39/d44/d9a/da7/f13 [4100139,9954] 0 2024-03-16T10:53:21.696 INFO:tasks.workunit.client.0.smithi017.stdout:9/479: mkdir d8/df/d5b/d5e/d68/d98 0 2024-03-16T10:53:21.696 INFO:tasks.workunit.client.0.smithi017.stdout:9/480: dread - d8/f4d zero size 2024-03-16T10:53:21.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/697: unlink d6/d14/d72/lc0 0 2024-03-16T10:53:21.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/698: readlink d6/d16/d6c/dd4/lbf 0 2024-03-16T10:53:21.697 INFO:tasks.workunit.client.0.smithi017.stdout:7/604: truncate d7/db/f28 2192580 0 2024-03-16T10:53:21.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/761: readlink d2/d4/d6d/d84/dc1/dd2/de/d19/l69 0 2024-03-16T10:53:21.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/758: link d0/d1/d2/f80 d0/d1/d1f/d29/d88/f101 0 2024-03-16T10:53:21.705 INFO:tasks.workunit.client.0.smithi017.stdout:4/756: creat d15/d1d/d21/d3c/f104 x:0 0 0 2024-03-16T10:53:21.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/762: read d2/d4/d90/f74 [3993743,68723] 0 2024-03-16T10:53:21.710 INFO:tasks.workunit.client.0.smithi017.stdout:8/699: write d6/d14/f51 [2749910,118325] 0 2024-03-16T10:53:21.710 INFO:tasks.workunit.client.0.smithi017.stdout:9/481: unlink d8/df/f60 0 2024-03-16T10:53:21.710 INFO:tasks.workunit.client.0.smithi017.stdout:9/482: readlink d8/df/d5b/d32/l41 0 2024-03-16T10:53:21.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/605: rmdir d7/db/d12/d1c/d30/dab 0 2024-03-16T10:53:21.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/606: fdatasync d7/db/d12/f4c 0 2024-03-16T10:53:21.714 INFO:tasks.workunit.client.0.smithi017.stdout:5/759: rmdir d0/d1/d1f/d29/d88/d91/dda 39 2024-03-16T10:53:21.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/564: dwrite d0/f3c [0,4194304] 0 2024-03-16T10:53:21.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/565: chown d0/d21/d39/d44/d9a/da7/d45/d4d 800367591 1 2024-03-16T10:53:21.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/566: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69 0 2024-03-16T10:53:21.716 INFO:tasks.workunit.client.0.smithi017.stdout:4/757: mknod d15/d1d/d21/d3c/de9/d43/dc2/c105 0 2024-03-16T10:53:21.719 INFO:tasks.workunit.client.0.smithi017.stdout:8/700: truncate d6/d39/fe0 399299 0 2024-03-16T10:53:21.723 INFO:tasks.workunit.client.0.smithi017.stdout:6/567: creat d0/d21/d39/d44/d9a/da7/d96/fb1 x:0 0 0 2024-03-16T10:53:21.723 INFO:tasks.workunit.client.0.smithi017.stdout:6/568: stat d0/d21/d39/d44/d9a/da7/d45/l72 0 2024-03-16T10:53:21.725 INFO:tasks.workunit.client.0.smithi017.stdout:8/701: dread d6/d5f/d6e/d34/f3f [0,4194304] 0 2024-03-16T10:53:21.725 INFO:tasks.workunit.client.0.smithi017.stdout:8/702: chown d6/d5c/d96/d98/cb7 890 1 2024-03-16T10:53:21.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/760: symlink d0/d5d/d9f/l102 0 2024-03-16T10:53:21.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/763: mknod d2/d4/d90/d86/db7/dc0/c10d 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/703: mknod d6/d16/d6c/dd4/ce1 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/704: truncate d6/d14/d6b/f6f 1614322 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/705: truncate d6/d14/d6b/fb6 1222868 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/706: write d6/d39/fbd [862086,64649] 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/707: truncate d6/d16/fc7 1502328 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/708: fdatasync d6/d39/fe0 0 2024-03-16T10:53:21.730 INFO:tasks.workunit.client.0.smithi017.stdout:2/514: rename d4/dd/df/l2f to d4/dd/d1e/d4a/la3 0 2024-03-16T10:53:21.731 INFO:tasks.workunit.client.0.smithi017.stdout:8/709: mknod d6/d5f/ce2 0 2024-03-16T10:53:21.731 INFO:tasks.workunit.client.0.smithi017.stdout:8/710: fsync d6/d39/da9/fbe 0 2024-03-16T10:53:21.732 INFO:tasks.workunit.client.0.smithi017.stdout:2/515: dread d4/d6/db/d66/d93/f4e [0,4194304] 0 2024-03-16T10:53:21.732 INFO:tasks.workunit.client.0.smithi017.stdout:3/570: dread - d8/d1b/d2e/d57/f6a zero size 2024-03-16T10:53:21.732 INFO:tasks.workunit.client.0.smithi017.stdout:3/571: write d8/d1b/d1c/f99 [516279,62178] 0 2024-03-16T10:53:21.732 INFO:tasks.workunit.client.0.smithi017.stdout:2/516: fsync d4/d6/f21 0 2024-03-16T10:53:21.732 INFO:tasks.workunit.client.0.smithi017.stdout:2/517: chown d4/dd/d1e/d4a 1742074987 1 2024-03-16T10:53:21.733 INFO:tasks.workunit.client.0.smithi017.stdout:8/711: mknod d6/d16/d6c/dd4/ce3 0 2024-03-16T10:53:21.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/483: dwrite d8/df/d5b/f3b [0,4194304] 0 2024-03-16T10:53:21.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/484: chown d8/df/d66 551787 1 2024-03-16T10:53:21.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/485: chown d8/df/d5b/d32/f57 628606789 1 2024-03-16T10:53:21.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/486: write d8/df/f4f [152293,108104] 0 2024-03-16T10:53:21.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/572: creat d8/da/fa9 x:0 0 0 2024-03-16T10:53:21.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/573: chown d8/da/db/l51 9291 1 2024-03-16T10:53:21.736 INFO:tasks.workunit.client.0.smithi017.stdout:0/764: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/f9c [9219429,110384] 0 2024-03-16T10:53:21.736 INFO:tasks.workunit.client.0.smithi017.stdout:0/765: readlink d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/leb 0 2024-03-16T10:53:21.737 INFO:tasks.workunit.client.0.smithi017.stdout:4/758: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/d63/dca/fd3 [0,4194304] 0 2024-03-16T10:53:21.737 INFO:tasks.workunit.client.0.smithi017.stdout:0/766: creat d2/d4/d90/dc2/f10e x:0 0 0 2024-03-16T10:53:21.738 INFO:tasks.workunit.client.0.smithi017.stdout:8/712: rename d6/d14/d6b/cd5 to d6/d14/d6b/ce4 0 2024-03-16T10:53:21.738 INFO:tasks.workunit.client.0.smithi017.stdout:0/767: symlink d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/l10f 0 2024-03-16T10:53:21.739 INFO:tasks.workunit.client.0.smithi017.stdout:8/713: dread d6/d5c/f71 [0,4194304] 0 2024-03-16T10:53:21.739 INFO:tasks.workunit.client.0.smithi017.stdout:0/768: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f110 x:0 0 0 2024-03-16T10:53:21.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/518: rmdir d4/dd/d1e/d3e 39 2024-03-16T10:53:21.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/519: fdatasync d4/f5e 0 2024-03-16T10:53:21.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/487: creat d8/df/d5b/d5e/d91/f99 x:0 0 0 2024-03-16T10:53:21.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/488: chown d8/df/d5b/d5e/d68/d7f/c8a 15733 1 2024-03-16T10:53:21.743 INFO:tasks.workunit.client.0.smithi017.stdout:5/761: write d0/f27 [874298,106846] 0 2024-03-16T10:53:21.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/489: dread d8/df/d5b/d32/f39 [0,4194304] 0 2024-03-16T10:53:21.751 INFO:tasks.workunit.client.0.smithi017.stdout:0/769: dread f0 [0,4194304] 0 2024-03-16T10:53:21.752 INFO:tasks.workunit.client.0.smithi017.stdout:4/759: mkdir d15/d1d/d21/d3c/de9/d40/d51/d64/d106 0 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:6/569: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f82 [0,4194304] 0 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/714: truncate d6/d39/da9/fbe 1514355 0 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:6/570: chown d0/d21/d39/d44/l67 870853872 1 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/715: truncate d6/d5f/d6e/f89 236321 0 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/716: stat d6/d16/db3/dcb 0 2024-03-16T10:53:21.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/717: getdents d6/d39/da9/dcc 0 2024-03-16T10:53:21.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/520: dread d4/dd/d38/f6e [0,4194304] 0 2024-03-16T10:53:21.755 INFO:tasks.workunit.client.0.smithi017.stdout:8/718: dread d6/d5c/f73 [0,4194304] 0 2024-03-16T10:53:21.756 INFO:tasks.workunit.client.0.smithi017.stdout:2/521: symlink d4/dd/d1e/d3e/d51/la4 0 2024-03-16T10:53:21.757 INFO:tasks.workunit.client.0.smithi017.stdout:2/522: chown d4/d6/d30/d3f 124177 1 2024-03-16T10:53:21.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/523: creat d4/d6/db/d24/d39/fa5 x:0 0 0 2024-03-16T10:53:21.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/524: chown d4/d6/db/d66/d2e/c5a 40135 1 2024-03-16T10:53:21.760 INFO:tasks.workunit.client.0.smithi017.stdout:8/719: dread d6/d5f/d6e/d34/f52 [0,4194304] 0 2024-03-16T10:53:21.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/762: mknod d0/d1/d1f/d29/dd5/c103 0 2024-03-16T10:53:21.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/763: write d0/d5d/fcd [588797,117208] 0 2024-03-16T10:53:21.761 INFO:tasks.workunit.client.0.smithi017.stdout:6/571: dread d0/f6a [0,4194304] 0 2024-03-16T10:53:21.764 INFO:tasks.workunit.client.0.smithi017.stdout:9/490: dwrite d8/df/d5b/d32/d45/f83 [0,4194304] 0 2024-03-16T10:53:21.767 INFO:tasks.workunit.client.0.smithi017.stdout:2/525: symlink d4/d97/la6 0 2024-03-16T10:53:21.767 INFO:tasks.workunit.client.0.smithi017.stdout:2/526: write d4/d6/f16 [738603,62911] 0 2024-03-16T10:53:21.769 INFO:tasks.workunit.client.0.smithi017.stdout:8/720: mknod d6/d16/db3/ce5 0 2024-03-16T10:53:21.769 INFO:tasks.workunit.client.0.smithi017.stdout:8/721: stat d6/d39/fde 0 2024-03-16T10:53:21.769 INFO:tasks.workunit.client.0.smithi017.stdout:4/760: dwrite d15/d1d/d27/fb2 [0,4194304] 0 2024-03-16T10:53:21.771 INFO:tasks.workunit.client.0.smithi017.stdout:5/764: creat d0/d1/d2/d2c/d36/f104 x:0 0 0 2024-03-16T10:53:21.773 INFO:tasks.workunit.client.0.smithi017.stdout:9/491: truncate d8/df/d46/f58 3181696 0 2024-03-16T10:53:21.777 INFO:tasks.workunit.client.0.smithi017.stdout:8/722: link d6/d14/d6b/fb6 d6/d14/d6b/fe6 0 2024-03-16T10:53:21.781 INFO:tasks.workunit.client.0.smithi017.stdout:4/761: stat lf 0 2024-03-16T10:53:21.781 INFO:tasks.workunit.client.0.smithi017.stdout:2/527: mkdir d4/dd/d1e/da7 0 2024-03-16T10:53:21.783 INFO:tasks.workunit.client.0.smithi017.stdout:5/765: creat d0/d1/d1f/d29/d88/d91/dda/f105 x:0 0 0 2024-03-16T10:53:21.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/492: getdents d8/df/d5b/d5e/d68 0 2024-03-16T10:53:21.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/493: write d8/df/d5b/d32/d45/f77 [3321835,5479] 0 2024-03-16T10:53:21.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/528: unlink d4/d6/db/c7f 0 2024-03-16T10:53:21.791 INFO:tasks.workunit.client.0.smithi017.stdout:2/529: write d4/d6/db/d66/d2e/f8b [41601,5739] 0 2024-03-16T10:53:21.791 INFO:tasks.workunit.client.0.smithi017.stdout:2/530: fdatasync d4/f5e 0 2024-03-16T10:53:21.792 INFO:tasks.workunit.client.0.smithi017.stdout:9/494: mknod d8/df/d5b/d5e/d68/d98/c9a 0 2024-03-16T10:53:21.792 INFO:tasks.workunit.client.0.smithi017.stdout:9/495: dread - d8/f4d zero size 2024-03-16T10:53:21.795 INFO:tasks.workunit.client.0.smithi017.stdout:8/723: dwrite d6/d14/d8c/f9c [0,4194304] 0 2024-03-16T10:53:21.796 INFO:tasks.workunit.client.0.smithi017.stdout:9/496: symlink d8/df/d5b/d70/l9b 0 2024-03-16T10:53:21.799 INFO:tasks.workunit.client.0.smithi017.stdout:1/792: sync 2024-03-16T10:53:21.800 INFO:tasks.workunit.client.0.smithi017.stdout:7/607: rename d7/db/d12/c49 to d7/db/dc/d50/d59/d34/d95/da3/cc9 0 2024-03-16T10:53:21.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/793: rmdir d1/d3/dd/d31/d66/dd7/dbc/ddb/de2 39 2024-03-16T10:53:21.801 INFO:tasks.workunit.client.0.smithi017.stdout:8/724: creat d6/d5c/d96/d98/fe7 x:0 0 0 2024-03-16T10:53:21.801 INFO:tasks.workunit.client.0.smithi017.stdout:9/497: creat d8/df/d5b/d32/d45/f9c x:0 0 0 2024-03-16T10:53:21.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/531: dwrite d4/d6/fa [4194304,4194304] 0 2024-03-16T10:53:21.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/762: read d15/d1d/d21/d3c/de9/d40/d51/d64/d63/fac [853944,23241] 0 2024-03-16T10:53:21.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/763: chown d15/d1d/d21/d3c/de9/d43/dc2/df1/ff5 10691359 1 2024-03-16T10:53:21.805 INFO:tasks.workunit.client.0.smithi017.stdout:3/574: rename d8/d1b/l44 to d8/d1b/d2e/laa 0 2024-03-16T10:53:21.807 INFO:tasks.workunit.client.0.smithi017.stdout:7/608: mkdir d7/db/dc/d50/da8/dca 0 2024-03-16T10:53:21.808 INFO:tasks.workunit.client.0.smithi017.stdout:0/770: rename d2/d4/d90/d86/c5f to d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/df4/c111 0 2024-03-16T10:53:21.810 INFO:tasks.workunit.client.0.smithi017.stdout:9/498: mkdir d8/df/d46/d63/d94/d9d 0 2024-03-16T10:53:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:7/609: mknod d7/db/dc/d50/d59/d34/d53/ccb 0 2024-03-16T10:53:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:7/610: chown d7/db/d81/cb3 370236305 1 2024-03-16T10:53:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:7/611: chown d7/c3b 1883437 1 2024-03-16T10:53:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/764: truncate d15/d1d/d21/d3c/de9/d40/d51/d64/fd6 778047 0 2024-03-16T10:53:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:9/499: dread d8/df/d5b/d32/f4b [0,4194304] 0 2024-03-16T10:53:21.813 INFO:tasks.workunit.client.0.smithi017.stdout:4/765: write d15/d1d/d21/d3c/de9/d40/fd0 [824311,105965] 0 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:5/766: dwrite d0/d1/d2/d2c/d36/d51/fd0 [0,4194304] 0 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:5/767: chown d0/d1/d2/dc/d68/ld8 17610550 1 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:5/768: readlink d0/d1/l1e 0 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:5/769: readlink d0/d1/d2/d2c/d36/l52 0 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/575: unlink d8/d1b/d1c/f4d 0 2024-03-16T10:53:21.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/576: write d8/d1b/d1c/f85 [895780,15590] 0 2024-03-16T10:53:21.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/577: stat d8/d1d 0 2024-03-16T10:53:21.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/578: chown d8/da/fa9 0 1 2024-03-16T10:53:21.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/579: fdatasync d8/d1b/d2e/d60/f84 0 2024-03-16T10:53:21.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/794: dwrite d1/d3/dd/d72/d8f/dbe/f108 [0,4194304] 0 2024-03-16T10:53:21.819 INFO:tasks.workunit.client.0.smithi017.stdout:0/771: dread d2/d4/d6d/f6e [0,4194304] 0 2024-03-16T10:53:21.820 INFO:tasks.workunit.client.0.smithi017.stdout:0/772: fsync d2/d4/d90/dc2/f10e 0 2024-03-16T10:53:21.820 INFO:tasks.workunit.client.0.smithi017.stdout:7/612: creat d7/db/d12/d1c/d4e/dbc/fcc x:0 0 0 2024-03-16T10:53:21.820 INFO:tasks.workunit.client.0.smithi017.stdout:7/613: chown d7/db/dc/d50/d59/d34/d53 7 1 2024-03-16T10:53:21.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/614: chown d7/db/d12/d1c/f41 9896972 1 2024-03-16T10:53:21.822 INFO:tasks.workunit.client.0.smithi017.stdout:9/500: mkdir d8/df/d5b/d72/d9e 0 2024-03-16T10:53:21.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/725: dwrite d6/d14/d6b/f8e [0,4194304] 0 2024-03-16T10:53:21.823 INFO:tasks.workunit.client.0.smithi017.stdout:0/773: link d2/d4/d6d/ff5 d2/d4/d61/de0/f112 0 2024-03-16T10:53:21.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/726: fdatasync d6/d5f/d6e/d34/fab 0 2024-03-16T10:53:21.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/532: dwrite d4/d6/db/d66/d93/f64 [0,4194304] 0 2024-03-16T10:53:21.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/774: link d2/d4/d6d/d84/dc1/dd2/f87 d2/d4/d6d/d84/dc1/dd2/d24/f113 0 2024-03-16T10:53:21.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/775: chown d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/l5d 118075 1 2024-03-16T10:53:21.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/776: readlink d2/d4/d6d/d84/dc1/dd2/d24/lad 0 2024-03-16T10:53:21.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/777: dread - d2/d4/d6d/d84/dc1/f105 zero size 2024-03-16T10:53:21.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/766: link d15/d1d/d50/fb9 d15/d1d/d21/d3c/de9/d40/d51/f107 0 2024-03-16T10:53:21.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/767: chown d15/d1d/d21/d26/d66/d8c/da4/lbb 16007710 1 2024-03-16T10:53:21.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/768: dread - d15/d1d/d21/d3c/de9/d43/dde/ff3 zero size 2024-03-16T10:53:21.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/778: dread d2/d4/d6d/d84/fa0 [0,4194304] 0 2024-03-16T10:53:21.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/770: stat d0/d1/d2/ldb 0 2024-03-16T10:53:21.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/771: stat d0/d1/d30/dde/d42/d46/cf5 0 2024-03-16T10:53:21.835 INFO:tasks.workunit.client.0.smithi017.stdout:7/615: unlink d7/db/c6d 0 2024-03-16T10:53:21.836 INFO:tasks.workunit.client.0.smithi017.stdout:9/501: dread d8/f79 [0,4194304] 0 2024-03-16T10:53:21.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/727: creat d6/d39/da9/dcc/fe8 x:0 0 0 2024-03-16T10:53:21.841 INFO:tasks.workunit.client.0.smithi017.stdout:2/533: getdents d4/dd/d38 0 2024-03-16T10:53:21.841 INFO:tasks.workunit.client.0.smithi017.stdout:2/534: dread - d4/f91 zero size 2024-03-16T10:53:21.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/580: dwrite d8/d1b/d2e/d60/f74 [0,4194304] 0 2024-03-16T10:53:21.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/581: fdatasync d8/d1b/d1c/d62/d69/f78 0 2024-03-16T10:53:21.843 INFO:tasks.workunit.client.0.smithi017.stdout:4/769: creat d15/d1d/d27/f108 x:0 0 0 2024-03-16T10:53:21.844 INFO:tasks.workunit.client.0.smithi017.stdout:1/795: dwrite d1/d3/f23 [0,4194304] 0 2024-03-16T10:53:21.845 INFO:tasks.workunit.client.0.smithi017.stdout:1/796: write d1/d3/de/f8b [469569,54975] 0 2024-03-16T10:53:21.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/772: unlink d0/d1/d2/ldb 0 2024-03-16T10:53:21.847 INFO:tasks.workunit.client.0.smithi017.stdout:8/728: symlink d6/d14/d72/le9 0 2024-03-16T10:53:21.847 INFO:tasks.workunit.client.0.smithi017.stdout:8/729: chown d6/d5f/d6e/lb8 15814291 1 2024-03-16T10:53:21.852 INFO:tasks.workunit.client.0.smithi017.stdout:3/582: mkdir d8/d1d/dab 0 2024-03-16T10:53:21.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/779: dwrite d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/f9d [0,4194304] 0 2024-03-16T10:53:21.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/797: getdents d1/d3/d88 0 2024-03-16T10:53:21.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/535: dwrite d4/dd/df/f80 [0,4194304] 0 2024-03-16T10:53:21.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/536: fsync d4/f6d 0 2024-03-16T10:53:21.861 INFO:tasks.workunit.client.0.smithi017.stdout:5/773: truncate d0/d1/d30/dde/d42/d4c/f53 549992 0 2024-03-16T10:53:21.862 INFO:tasks.workunit.client.0.smithi017.stdout:5/774: chown d0/d1/d1f/lef 4 1 2024-03-16T10:53:21.862 INFO:tasks.workunit.client.0.smithi017.stdout:9/502: dwrite d8/f59 [0,4194304] 0 2024-03-16T10:53:21.862 INFO:tasks.workunit.client.0.smithi017.stdout:2/537: creat d4/dd/d1e/d4a/fa8 x:0 0 0 2024-03-16T10:53:21.863 INFO:tasks.workunit.client.0.smithi017.stdout:8/730: link d6/d14/d8c/ld1 d6/d16/dcd/lea 0 2024-03-16T10:53:21.863 INFO:tasks.workunit.client.0.smithi017.stdout:8/731: write d6/d16/f2d [240048,119541] 0 2024-03-16T10:53:21.865 INFO:tasks.workunit.client.0.smithi017.stdout:3/583: creat d8/d1d/d9a/fac x:0 0 0 2024-03-16T10:53:21.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/538: creat d4/d6/db/d66/d2e/fa9 x:0 0 0 2024-03-16T10:53:21.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/798: write d1/d3/dd/d72/d8f/dbe/f108 [2581380,106800] 0 2024-03-16T10:53:21.866 INFO:tasks.workunit.client.0.smithi017.stdout:2/539: symlink d4/d6/db/d66/d93/d63/laa 0 2024-03-16T10:53:21.866 INFO:tasks.workunit.client.0.smithi017.stdout:2/540: write d4/f6d [493448,118915] 0 2024-03-16T10:53:21.866 INFO:tasks.workunit.client.0.smithi017.stdout:2/541: fdatasync d4/d6/db/d24/d39/f42 0 2024-03-16T10:53:21.866 INFO:tasks.workunit.client.0.smithi017.stdout:2/542: write d4/d6/d81/d8f/f99 [549555,88555] 0 2024-03-16T10:53:21.867 INFO:tasks.workunit.client.0.smithi017.stdout:0/780: dwrite d2/d4/d6d/d84/fa0 [0,4194304] 0 2024-03-16T10:53:21.869 INFO:tasks.workunit.client.0.smithi017.stdout:0/781: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/f114 x:0 0 0 2024-03-16T10:53:21.870 INFO:tasks.workunit.client.0.smithi017.stdout:8/732: dread d6/d14/d72/f95 [0,4194304] 0 2024-03-16T10:53:21.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/782: truncate d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/f9c 9561369 0 2024-03-16T10:53:21.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/783: write d2/d4/f100 [54675,818] 0 2024-03-16T10:53:21.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/784: readlink d2/d4/d90/dc2/le8 0 2024-03-16T10:53:21.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/785: write d2/f8c [4884973,13394] 0 2024-03-16T10:53:21.877 INFO:tasks.workunit.client.0.smithi017.stdout:9/503: mkdir d8/df/d46/d9f 0 2024-03-16T10:53:21.879 INFO:tasks.workunit.client.0.smithi017.stdout:1/799: mkdir d1/d50/d8d/d10a 0 2024-03-16T10:53:21.879 INFO:tasks.workunit.client.0.smithi017.stdout:1/800: chown d1/d3/dd/l95 1328963 1 2024-03-16T10:53:21.881 INFO:tasks.workunit.client.0.smithi017.stdout:2/543: mknod d4/d6/d81/d8f/cab 0 2024-03-16T10:53:21.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/786: write d2/f8c [263661,103918] 0 2024-03-16T10:53:21.882 INFO:tasks.workunit.client.0.smithi017.stdout:9/504: symlink d8/df/d5b/d70/d89/la0 0 2024-03-16T10:53:21.883 INFO:tasks.workunit.client.0.smithi017.stdout:3/584: dwrite d8/fc [0,4194304] 0 2024-03-16T10:53:21.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/544: creat d4/dd/d38/fac x:0 0 0 2024-03-16T10:53:21.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/545: chown d4/d6/d30/f8d 2 1 2024-03-16T10:53:21.885 INFO:tasks.workunit.client.0.smithi017.stdout:2/546: truncate d4/dd/d1e/f36 2779435 0 2024-03-16T10:53:21.885 INFO:tasks.workunit.client.0.smithi017.stdout:2/547: chown d4/d6 29423807 1 2024-03-16T10:53:21.887 INFO:tasks.workunit.client.0.smithi017.stdout:0/787: truncate d2/d4/d6d/d84/faa 1716715 0 2024-03-16T10:53:21.888 INFO:tasks.workunit.client.0.smithi017.stdout:1/801: write d1/d3/dd/d9f/f1a [1126844,3287] 0 2024-03-16T10:53:21.888 INFO:tasks.workunit.client.0.smithi017.stdout:3/585: read d8/d1b/d1c/d62/d69/f80 [68022,84711] 0 2024-03-16T10:53:21.888 INFO:tasks.workunit.client.0.smithi017.stdout:0/788: mkdir d2/d4/d6d/d115 0 2024-03-16T10:53:21.888 INFO:tasks.workunit.client.0.smithi017.stdout:0/789: fsync d2/d4/d61/fb2 0 2024-03-16T10:53:21.889 INFO:tasks.workunit.client.0.smithi017.stdout:2/548: unlink d4/d6/db/l98 0 2024-03-16T10:53:21.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/790: truncate d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f48 3361166 0 2024-03-16T10:53:21.890 INFO:tasks.workunit.client.0.smithi017.stdout:1/802: symlink d1/d3/dd/d31/d66/dd7/d67/l10b 0 2024-03-16T10:53:21.892 INFO:tasks.workunit.client.0.smithi017.stdout:0/791: mknod d2/d4/d6d/d115/c116 0 2024-03-16T10:53:21.892 INFO:tasks.workunit.client.0.smithi017.stdout:1/803: creat d1/d3/dd/d31/d66/da1/de3/f10c x:0 0 0 2024-03-16T10:53:21.894 INFO:tasks.workunit.client.0.smithi017.stdout:9/505: write d8/df/d5b/d32/f57 [258767,8330] 0 2024-03-16T10:53:21.895 INFO:tasks.workunit.client.0.smithi017.stdout:3/586: dread d8/d1b/d1c/f5d [0,4194304] 0 2024-03-16T10:53:21.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/792: mkdir d2/d4/d6d/d115/d117 0 2024-03-16T10:53:21.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/804: creat d1/d24/d79/dd2/d100/f10d x:0 0 0 2024-03-16T10:53:21.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/805: stat d1/d3/dd/d31/d66/dd7/d67/fbf 0 2024-03-16T10:53:21.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/806: chown d1/d3/dd/d9f/f1a 3 1 2024-03-16T10:53:21.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/807: write d1/d3/dd/f77 [877543,98458] 0 2024-03-16T10:53:21.904 INFO:tasks.workunit.client.0.smithi017.stdout:0/793: dread d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 [0,4194304] 0 2024-03-16T10:53:21.911 INFO:tasks.workunit.client.0.smithi017.stdout:3/587: dwrite d8/da/fa4 [0,4194304] 0 2024-03-16T10:53:21.913 INFO:tasks.workunit.client.0.smithi017.stdout:2/549: dwrite d4/d6/f26 [0,4194304] 0 2024-03-16T10:53:21.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/808: dread d1/f78 [0,4194304] 0 2024-03-16T10:53:21.914 INFO:tasks.workunit.client.0.smithi017.stdout:0/794: dread d2/d4/f1c [0,4194304] 0 2024-03-16T10:53:21.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/588: dread d8/d1b/d2e/d60/d63/f79 [0,4194304] 0 2024-03-16T10:53:21.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/589: write d8/d3f/d3d/f48 [490325,14548] 0 2024-03-16T10:53:21.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/590: dread - d8/d1b/d1c/d62/d69/f96 zero size 2024-03-16T10:53:21.916 INFO:tasks.workunit.client.0.smithi017.stdout:8/733: dwrite d6/d16/f49 [0,4194304] 0 2024-03-16T10:53:21.918 INFO:tasks.workunit.client.0.smithi017.stdout:3/591: mknod d8/d1b/d65/da6/cad 0 2024-03-16T10:53:21.923 INFO:tasks.workunit.client.0.smithi017.stdout:2/550: write d4/dd/d1e/f36 [1672731,43815] 0 2024-03-16T10:53:21.923 INFO:tasks.workunit.client.0.smithi017.stdout:9/506: dwrite d8/df/d46/f56 [0,4194304] 0 2024-03-16T10:53:21.927 INFO:tasks.workunit.client.0.smithi017.stdout:0/795: rmdir d2/d4/d6d/d84/dc1/dd2/de/d19 39 2024-03-16T10:53:21.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/592: creat d8/d1b/d2e/fae x:0 0 0 2024-03-16T10:53:21.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/507: creat d8/df/d5b/d32/d45/fa1 x:0 0 0 2024-03-16T10:53:21.936 INFO:tasks.workunit.client.0.smithi017.stdout:2/551: dwrite d4/d6/db/d66/d2e/f8b [0,4194304] 0 2024-03-16T10:53:21.936 INFO:tasks.workunit.client.0.smithi017.stdout:2/552: chown d4/dd/d1e/d3e/d51 155690 1 2024-03-16T10:53:21.941 INFO:tasks.workunit.client.0.smithi017.stdout:4/770: rename d15/f19 to d15/d1d/d85/f109 0 2024-03-16T10:53:21.947 INFO:tasks.workunit.client.0.smithi017.stdout:3/593: truncate d8/da/fe 2114060 0 2024-03-16T10:53:21.949 INFO:tasks.workunit.client.0.smithi017.stdout:9/508: mknod d8/df/d5b/d5e/d91/ca2 0 2024-03-16T10:53:21.954 INFO:tasks.workunit.client.0.smithi017.stdout:4/771: symlink d15/d1d/l10a 0 2024-03-16T10:53:21.954 INFO:tasks.workunit.client.0.smithi017.stdout:9/509: read d8/f38 [3460306,90609] 0 2024-03-16T10:53:21.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/772: mkdir d15/d1d/d21/d10b 0 2024-03-16T10:53:21.956 INFO:tasks.workunit.client.0.smithi017.stdout:2/553: dread d4/d6/d30/f7c [0,4194304] 0 2024-03-16T10:53:21.956 INFO:tasks.workunit.client.0.smithi017.stdout:2/554: dread - d4/d6/db/d24/d39/d7d/f83 zero size 2024-03-16T10:53:21.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/594: read d8/d1b/d2e/d60/f74 [3419594,62386] 0 2024-03-16T10:53:21.958 INFO:tasks.workunit.client.0.smithi017.stdout:9/510: mknod d8/df/d46/ca3 0 2024-03-16T10:53:21.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/595: mkdir d8/d1b/d1c/daf 0 2024-03-16T10:53:21.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/511: truncate d8/df/d5b/d32/f3c 3174605 0 2024-03-16T10:53:21.963 INFO:tasks.workunit.client.0.smithi017.stdout:2/555: mknod d4/dd/d1e/cad 0 2024-03-16T10:53:21.964 INFO:tasks.workunit.client.0.smithi017.stdout:2/556: creat d4/d6/db/d66/d93/fae x:0 0 0 2024-03-16T10:53:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/557: mkdir d4/d6/db/d66/daf 0 2024-03-16T10:53:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/558: chown d4/d97/d9f 662778053 1 2024-03-16T10:53:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/559: write d4/d6/fa [3448642,76800] 0 2024-03-16T10:53:21.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/596: dread d8/da/db/f19 [4194304,4194304] 0 2024-03-16T10:53:21.968 INFO:tasks.workunit.client.0.smithi017.stdout:2/560: mkdir d4/d6/db/d66/d93/d63/db0 0 2024-03-16T10:53:21.971 INFO:tasks.workunit.client.0.smithi017.stdout:2/561: symlink d4/d6/db/d24/d39/d7d/lb1 0 2024-03-16T10:53:21.972 INFO:tasks.workunit.client.0.smithi017.stdout:2/562: truncate d4/dd/d38/fac 483563 0 2024-03-16T10:53:21.972 INFO:tasks.workunit.client.0.smithi017.stdout:2/563: write d4/d6/db/d66/d2e/f3d [3410411,19887] 0 2024-03-16T10:53:21.973 INFO:tasks.workunit.client.0.smithi017.stdout:2/564: creat d4/d6/d30/fb2 x:0 0 0 2024-03-16T10:53:21.975 INFO:tasks.workunit.client.0.smithi017.stdout:2/565: dread d4/dd/d1e/d3e/f45 [0,4194304] 0 2024-03-16T10:53:21.975 INFO:tasks.workunit.client.0.smithi017.stdout:2/566: chown d4/d6/db/d66/d2e/f3a 718 1 2024-03-16T10:53:21.976 INFO:tasks.workunit.client.0.smithi017.stdout:9/512: dwrite d8/df/f4f [0,4194304] 0 2024-03-16T10:53:21.982 INFO:tasks.workunit.client.0.smithi017.stdout:3/597: dwrite d8/d3f/d3d/f76 [0,4194304] 0 2024-03-16T10:53:21.983 INFO:tasks.workunit.client.0.smithi017.stdout:2/567: rmdir d4 39 2024-03-16T10:53:21.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/775: rename d0/d1/d30/dde/d57/l6f to d0/d1/d2/d8c/l106 0 2024-03-16T10:53:21.985 INFO:tasks.workunit.client.0.smithi017.stdout:9/513: truncate d8/df/f11 588211 0 2024-03-16T10:53:21.985 INFO:tasks.workunit.client.0.smithi017.stdout:9/514: dread - d8/df/d5b/f8c zero size 2024-03-16T10:53:21.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/515: chown d8/df/d5b/d32/d45/c65 1389 1 2024-03-16T10:53:21.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/776: write d0/d1/d2/d2c/d36/d41/f62 [2690999,109174] 0 2024-03-16T10:53:21.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/777: write d0/d1/d76/f96 [1156475,123660] 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/598: truncate d8/d1b/d1c/f88 510227 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/599: chown d8/d1b/d1c/f5d 6682 1 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/600: fsync d8/da/db/f23 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/601: write d8/d1b/d2e/fae [816171,51020] 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/602: write d8/da/fa9 [693541,52171] 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/603: write d8/d1b/d2e/d60/f74 [4330481,10905] 0 2024-03-16T10:53:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/604: chown d8/d8c/f95 291 1 2024-03-16T10:53:21.997 INFO:tasks.workunit.client.0.smithi017.stdout:3/605: creat d8/fb0 x:0 0 0 2024-03-16T10:53:21.999 INFO:tasks.workunit.client.0.smithi017.stdout:3/606: creat d8/d1b/d1c/daf/fb1 x:0 0 0 2024-03-16T10:53:22.000 INFO:tasks.workunit.client.0.smithi017.stdout:9/516: dwrite d8/f38 [0,4194304] 0 2024-03-16T10:53:22.001 INFO:tasks.workunit.client.0.smithi017.stdout:3/607: mkdir d8/d1d/db2 0 2024-03-16T10:53:22.004 INFO:tasks.workunit.client.0.smithi017.stdout:3/608: symlink d8/d1b/d2e/d8d/lb3 0 2024-03-16T10:53:22.004 INFO:tasks.workunit.client.0.smithi017.stdout:9/517: unlink d8/df/d5b/d32/d45/f4a 0 2024-03-16T10:53:22.005 INFO:tasks.workunit.client.0.smithi017.stdout:9/518: rmdir d8/df/d5b/d5e/d68/d98 39 2024-03-16T10:53:22.007 INFO:tasks.workunit.client.0.smithi017.stdout:5/778: dwrite d0/d1/f16 [0,4194304] 0 2024-03-16T10:53:22.007 INFO:tasks.workunit.client.0.smithi017.stdout:9/519: dread d8/df/d5b/d32/f50 [0,4194304] 0 2024-03-16T10:53:22.008 INFO:tasks.workunit.client.0.smithi017.stdout:5/779: write d0/d1/d1f/d29/d88/d91/fa7 [440842,105502] 0 2024-03-16T10:53:22.011 INFO:tasks.workunit.client.0.smithi017.stdout:9/520: symlink d8/df/d5b/la4 0 2024-03-16T10:53:22.018 INFO:tasks.workunit.client.0.smithi017.stdout:1/809: rename d1/d3/dd/d31/d66/dd3/c65 to d1/d24/d79/d7a/c10e 0 2024-03-16T10:53:22.020 INFO:tasks.workunit.client.0.smithi017.stdout:0/796: rename d2/d4/d6d/d84/dc1/dd2/f94 to d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f118 0 2024-03-16T10:53:22.023 INFO:tasks.workunit.client.0.smithi017.stdout:4/773: rename d15/d1d/d21/db1/cc3 to d15/d1d/d21/d3c/de9/d43/dde/df6/c10c 0 2024-03-16T10:53:22.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/521: dwrite d8/df/d5b/d5e/d91/f99 [0,4194304] 0 2024-03-16T10:53:22.026 INFO:tasks.workunit.client.0.smithi017.stdout:5/780: rename d0/d93 to d0/d1/d107 0 2024-03-16T10:53:22.028 INFO:tasks.workunit.client.0.smithi017.stdout:5/781: getdents d0/d1/d2/dc/d2f 0 2024-03-16T10:53:22.028 INFO:tasks.workunit.client.0.smithi017.stdout:5/782: write d0/d1/d1f/f9a [783481,84840] 0 2024-03-16T10:53:22.029 INFO:tasks.workunit.client.0.smithi017.stdout:5/783: stat d0/d1/fd3 0 2024-03-16T10:53:22.029 INFO:tasks.workunit.client.0.smithi017.stdout:5/784: truncate d0/ded/f8d 410982 0 2024-03-16T10:53:22.030 INFO:tasks.workunit.client.0.smithi017.stdout:5/785: mkdir d0/d1/d2/d8c/d108 0 2024-03-16T10:53:22.031 INFO:tasks.workunit.client.0.smithi017.stdout:5/786: dread - d0/d5d/d9f/fe5 zero size 2024-03-16T10:53:22.033 INFO:tasks.workunit.client.0.smithi017.stdout:4/774: dread d15/d1d/d21/d3c/de9/d40/d51/f71 [0,4194304] 0 2024-03-16T10:53:22.033 INFO:tasks.workunit.client.0.smithi017.stdout:4/775: readlink d15/d1d/d21/d26/d66/d8c/lfa 0 2024-03-16T10:53:22.034 INFO:tasks.workunit.client.0.smithi017.stdout:4/776: dread d15/d1d/d27/f3b [0,4194304] 0 2024-03-16T10:53:22.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/797: dread d2/d4/d6d/d84/dc1/dd2/d24/d29/f6a [4194304,4194304] 0 2024-03-16T10:53:22.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/798: fdatasync d2/d4/f82 0 2024-03-16T10:53:22.045 INFO:tasks.workunit.client.0.smithi017.stdout:9/522: dwrite d8/df/d5b/f5d [0,4194304] 0 2024-03-16T10:53:22.050 INFO:tasks.workunit.client.0.smithi017.stdout:1/810: dwrite d1/d3/dd/d72/f80 [0,4194304] 0 2024-03-16T10:53:22.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/777: dwrite d15/d1d/d85/fa9 [0,4194304] 0 2024-03-16T10:53:22.051 INFO:tasks.workunit.client.0.smithi017.stdout:4/778: fsync d15/d1d/d21/d3c/f104 0 2024-03-16T10:53:22.052 INFO:tasks.workunit.client.0.smithi017.stdout:9/523: getdents d8 0 2024-03-16T10:53:22.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/811: read - d1/d24/d79/dd2/d100/d97/ff8 zero size 2024-03-16T10:53:22.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/524: mknod d8/df/d5b/d32/ca5 0 2024-03-16T10:53:22.060 INFO:tasks.workunit.client.0.smithi017.stdout:9/525: symlink d8/df/d5b/d72/la6 0 2024-03-16T10:53:22.060 INFO:tasks.workunit.client.0.smithi017.stdout:9/526: fdatasync d8/df/d46/f58 0 2024-03-16T10:53:22.062 INFO:tasks.workunit.client.0.smithi017.stdout:5/787: getdents d0/d1/d2/d8c 0 2024-03-16T10:53:22.064 INFO:tasks.workunit.client.0.smithi017.stdout:4/779: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/da8/feb [0,4194304] 0 2024-03-16T10:53:22.064 INFO:tasks.workunit.client.0.smithi017.stdout:1/812: dread d1/d3/dd/d31/d66/dd7/fb0 [0,4194304] 0 2024-03-16T10:53:22.067 INFO:tasks.workunit.client.0.smithi017.stdout:4/780: dread f4 [0,4194304] 0 2024-03-16T10:53:22.067 INFO:tasks.workunit.client.0.smithi017.stdout:4/781: dread - d15/d1d/fdb zero size 2024-03-16T10:53:22.067 INFO:tasks.workunit.client.0.smithi017.stdout:9/527: dread d8/df/d46/f5a [0,4194304] 0 2024-03-16T10:53:22.068 INFO:tasks.workunit.client.0.smithi017.stdout:4/782: mknod d15/d1d/d21/d26/d66/d8c/da4/c10d 0 2024-03-16T10:53:22.068 INFO:tasks.workunit.client.0.smithi017.stdout:4/783: write d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fe1 [113251,51990] 0 2024-03-16T10:53:22.068 INFO:tasks.workunit.client.0.smithi017.stdout:4/784: fdatasync d15/d1d/f91 0 2024-03-16T10:53:22.070 INFO:tasks.workunit.client.0.smithi017.stdout:9/528: creat d8/df/d5b/d72/d9e/fa7 x:0 0 0 2024-03-16T10:53:22.073 INFO:tasks.workunit.client.0.smithi017.stdout:4/785: rename d15/d1d/d21/d3c/de9/d40/d51/d64/f6a to d15/d1d/d21/d3c/de9/d40/f10e 0 2024-03-16T10:53:22.073 INFO:tasks.workunit.client.0.smithi017.stdout:9/529: truncate d8/f59 3666983 0 2024-03-16T10:53:22.074 INFO:tasks.workunit.client.0.smithi017.stdout:4/786: write d15/d1d/d21/db1/db5/fb7 [694411,104946] 0 2024-03-16T10:53:22.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/530: link d8/l27 d8/df/d5b/d5e/d68/d7f/la8 0 2024-03-16T10:53:22.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/531: stat d8/df/d5b/d5e/d68/d7f/l8e 0 2024-03-16T10:53:22.078 INFO:tasks.workunit.client.0.smithi017.stdout:9/532: rename d8/df/d5b/la4 to d8/df/d5b/d32/la9 0 2024-03-16T10:53:22.078 INFO:tasks.workunit.client.0.smithi017.stdout:9/533: chown d8/l76 6675 1 2024-03-16T10:53:22.080 INFO:tasks.workunit.client.0.smithi017.stdout:5/788: dwrite d0/d1/d30/dde/d42/d4c/ffa [0,4194304] 0 2024-03-16T10:53:22.084 INFO:tasks.workunit.client.0.smithi017.stdout:5/789: dread d0/ded/daf/fd7 [0,4194304] 0 2024-03-16T10:53:22.086 INFO:tasks.workunit.client.0.smithi017.stdout:5/790: truncate d0/d1/d2/d2c/d38/f61 654036 0 2024-03-16T10:53:22.092 INFO:tasks.workunit.client.0.smithi017.stdout:4/787: dwrite d15/d1d/d21/db1/db5/fb7 [0,4194304] 0 2024-03-16T10:53:22.092 INFO:tasks.workunit.client.0.smithi017.stdout:4/788: chown d15/d1d/d21/d3c/de9/d40/d51/d64/f4e 21938 1 2024-03-16T10:53:22.093 INFO:tasks.workunit.client.0.smithi017.stdout:1/813: link d1/d3/dd/d31/d66/dd7/dbc/fe1 d1/d3/dd/f10f 0 2024-03-16T10:53:22.093 INFO:tasks.workunit.client.0.smithi017.stdout:1/814: write d1/d3/dd/d31/d66/dd7/dbc/fd1 [1448390,11078] 0 2024-03-16T10:53:22.093 INFO:tasks.workunit.client.0.smithi017.stdout:4/789: write d15/d1d/d85/fa6 [4634331,80288] 0 2024-03-16T10:53:22.096 INFO:tasks.workunit.client.0.smithi017.stdout:1/815: mkdir d1/d3/dd/d31/d110 0 2024-03-16T10:53:22.097 INFO:tasks.workunit.client.0.smithi017.stdout:1/816: chown d1/fda 1125667668 1 2024-03-16T10:53:22.098 INFO:tasks.workunit.client.0.smithi017.stdout:4/790: truncate d15/d1d/d21/d26/d66/d8c/f92 1016645 0 2024-03-16T10:53:22.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/534: dwrite d8/df/d5b/f42 [0,4194304] 0 2024-03-16T10:53:22.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/535: readlink d8/df/d5b/d5e/d68/d7f/la8 0 2024-03-16T10:53:22.099 INFO:tasks.workunit.client.0.smithi017.stdout:1/817: mkdir d1/d3/dd/d9f/d111 0 2024-03-16T10:53:22.102 INFO:tasks.workunit.client.0.smithi017.stdout:9/536: rename d8/df/d46/f56 to d8/df/d46/d63/d88/faa 0 2024-03-16T10:53:22.103 INFO:tasks.workunit.client.0.smithi017.stdout:4/791: dread d15/d1d/d21/d3c/de9/d43/f9e [0,4194304] 0 2024-03-16T10:53:22.106 INFO:tasks.workunit.client.0.smithi017.stdout:1/818: creat d1/d3/f112 x:0 0 0 2024-03-16T10:53:22.107 INFO:tasks.workunit.client.0.smithi017.stdout:5/791: dwrite d0/d1/d30/dde/f64 [0,4194304] 0 2024-03-16T10:53:22.107 INFO:tasks.workunit.client.0.smithi017.stdout:5/792: write d0/d1/d1f/d29/d88/d91/dda/fff [3447558,32311] 0 2024-03-16T10:53:22.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/537: mknod d8/df/d5b/cab 0 2024-03-16T10:53:22.109 INFO:tasks.workunit.client.0.smithi017.stdout:4/792: creat d15/d1d/d27/f10f x:0 0 0 2024-03-16T10:53:22.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/819: dread d1/d3/dd/d31/d66/dd7/dbc/fe1 [0,4194304] 0 2024-03-16T10:53:22.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/820: stat d1/d24/d79/d7a/da9 0 2024-03-16T10:53:22.112 INFO:tasks.workunit.client.0.smithi017.stdout:9/538: creat d8/df/d46/d63/d94/d9d/fac x:0 0 0 2024-03-16T10:53:22.112 INFO:tasks.workunit.client.0.smithi017.stdout:9/539: chown d8/df/d5b/d32/d45/c5f 64 1 2024-03-16T10:53:22.112 INFO:tasks.workunit.client.0.smithi017.stdout:1/821: mkdir d1/d24/d79/d7a/da9/d113 0 2024-03-16T10:53:22.112 INFO:tasks.workunit.client.0.smithi017.stdout:9/540: write d8/df/f1a [2174666,113525] 0 2024-03-16T10:53:22.113 INFO:tasks.workunit.client.0.smithi017.stdout:1/822: chown d1/d3/dd/d31/d66/dd3/c51 253937 1 2024-03-16T10:53:22.113 INFO:tasks.workunit.client.0.smithi017.stdout:1/823: fdatasync d1/d3/d88/f102 0 2024-03-16T10:53:22.115 INFO:tasks.workunit.client.0.smithi017.stdout:9/541: rmdir d8/df/d5b/d5e/d68 39 2024-03-16T10:53:22.116 INFO:tasks.workunit.client.0.smithi017.stdout:9/542: mkdir d8/df/d46/d63/d94/dad 0 2024-03-16T10:53:22.118 INFO:tasks.workunit.client.0.smithi017.stdout:1/824: unlink d1/d3/c6 0 2024-03-16T10:53:22.119 INFO:tasks.workunit.client.0.smithi017.stdout:1/825: symlink d1/l114 0 2024-03-16T10:53:22.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/793: dwrite d0/f22 [0,4194304] 0 2024-03-16T10:53:22.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/794: fdatasync d0/d1/d30/dde/d42/fc5 0 2024-03-16T10:53:22.121 INFO:tasks.workunit.client.0.smithi017.stdout:4/793: stat d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3 0 2024-03-16T10:53:22.123 INFO:tasks.workunit.client.0.smithi017.stdout:5/795: symlink d0/d1/d1f/d29/d88/d91/l109 0 2024-03-16T10:53:22.125 INFO:tasks.workunit.client.0.smithi017.stdout:5/796: symlink d0/d1/d1f/d29/d88/d91/l10a 0 2024-03-16T10:53:22.125 INFO:tasks.workunit.client.0.smithi017.stdout:5/797: write d0/d1/d2/dc/d2f/fe1 [584276,92212] 0 2024-03-16T10:53:22.143 INFO:tasks.workunit.client.0.smithi017.stdout:9/543: dwrite d8/f59 [0,4194304] 0 2024-03-16T10:53:22.143 INFO:tasks.workunit.client.0.smithi017.stdout:9/544: fsync d8/df/d5b/d32/f50 0 2024-03-16T10:53:22.143 INFO:tasks.workunit.client.0.smithi017.stdout:1/826: dread d1/d3/dd/d72/fb1 [0,4194304] 0 2024-03-16T10:53:22.143 INFO:tasks.workunit.client.0.smithi017.stdout:1/827: fsync d1/d3/dd/fe6 0 2024-03-16T10:53:22.144 INFO:tasks.workunit.client.0.smithi017.stdout:4/794: dwrite d15/d1d/d21/db1/db5/fb7 [4194304,4194304] 0 2024-03-16T10:53:22.146 INFO:tasks.workunit.client.0.smithi017.stdout:5/798: dwrite d0/d1/d2/d2c/d38/fae [0,4194304] 0 2024-03-16T10:53:22.148 INFO:tasks.workunit.client.0.smithi017.stdout:1/828: dread d1/d3/dd/d31/d66/dd7/dbc/fd1 [0,4194304] 0 2024-03-16T10:53:22.148 INFO:tasks.workunit.client.0.smithi017.stdout:1/829: fsync d1/d3/dd/f10f 0 2024-03-16T10:53:22.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/799: symlink d0/d1/d1f/d97/l10b 0 2024-03-16T10:53:22.149 INFO:tasks.workunit.client.0.smithi017.stdout:1/830: symlink d1/d50/l115 0 2024-03-16T10:53:22.151 INFO:tasks.workunit.client.0.smithi017.stdout:5/800: rename d0/d1/d107/fdf to d0/d1/d2/d2c/d36/d41/da5/f10c 0 2024-03-16T10:53:22.155 INFO:tasks.workunit.client.0.smithi017.stdout:5/801: unlink d0/d1/d30/dde/d57/f8b 0 2024-03-16T10:53:22.157 INFO:tasks.workunit.client.0.smithi017.stdout:1/831: creat d1/d24/d79/dd2/d100/d93/f116 x:0 0 0 2024-03-16T10:53:22.158 INFO:tasks.workunit.client.0.smithi017.stdout:5/802: mknod d0/d1/d30/dde/d57/c10d 0 2024-03-16T10:53:22.159 INFO:tasks.workunit.client.0.smithi017.stdout:4/795: dwrite d15/d1d/d21/d3c/f97 [0,4194304] 0 2024-03-16T10:53:22.159 INFO:tasks.workunit.client.0.smithi017.stdout:9/545: dwrite d8/df/d46/f55 [0,4194304] 0 2024-03-16T10:53:22.159 INFO:tasks.workunit.client.0.smithi017.stdout:1/832: dread d1/d3/dd/d72/fd9 [0,4194304] 0 2024-03-16T10:53:22.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/833: dread - d1/d3/dd/d31/d66/dd7/dbc/ddb/fde zero size 2024-03-16T10:53:22.162 INFO:tasks.workunit.client.0.smithi017.stdout:4/796: creat d15/d1d/d21/d3c/de9/d40/d51/d64/da8/f110 x:0 0 0 2024-03-16T10:53:22.162 INFO:tasks.workunit.client.0.smithi017.stdout:4/797: truncate d15/d1d/d21/f4c 1980487 0 2024-03-16T10:53:22.165 INFO:tasks.workunit.client.0.smithi017.stdout:9/546: write d8/f79 [1923848,28575] 0 2024-03-16T10:53:22.165 INFO:tasks.workunit.client.0.smithi017.stdout:9/547: write d8/f4d [750000,79281] 0 2024-03-16T10:53:22.166 INFO:tasks.workunit.client.0.smithi017.stdout:1/834: unlink d1/d3/de/f9d 0 2024-03-16T10:53:22.167 INFO:tasks.workunit.client.0.smithi017.stdout:1/835: mknod d1/d24/d79/d7a/da9/d113/c117 0 2024-03-16T10:53:22.167 INFO:tasks.workunit.client.0.smithi017.stdout:1/836: write d1/d3/dd/d31/d66/da1/de3/f10c [1026735,130363] 0 2024-03-16T10:53:22.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/803: read d0/d1/d2/d2c/d38/f47 [4997103,36415] 0 2024-03-16T10:53:22.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/804: truncate d0/d1/d30/dde/d57/f74 790044 0 2024-03-16T10:53:22.168 INFO:tasks.workunit.client.0.smithi017.stdout:6/572: sync 2024-03-16T10:53:22.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/573: chown d0/d21/d39/d44/d9a/da7/d45/d4d/f25 42675009 1 2024-03-16T10:53:22.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/574: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f79 [2171817,40830] 0 2024-03-16T10:53:22.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/575: chown d0/d15/f17 402152529 1 2024-03-16T10:53:22.170 INFO:tasks.workunit.client.0.smithi017.stdout:9/548: link d8/df/l2f d8/df/d5b/d70/d89/lae 0 2024-03-16T10:53:22.170 INFO:tasks.workunit.client.0.smithi017.stdout:9/549: fdatasync d8/df/d5b/d5e/d68/f7a 0 2024-03-16T10:53:22.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/837: creat d1/d3/dd/d31/d66/f118 x:0 0 0 2024-03-16T10:53:22.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/838: truncate d1/fee 234816 0 2024-03-16T10:53:22.172 INFO:tasks.workunit.client.0.smithi017.stdout:5/805: rmdir d0/d1/d76 39 2024-03-16T10:53:22.174 INFO:tasks.workunit.client.0.smithi017.stdout:9/550: mkdir d8/df/d5b/daf 0 2024-03-16T10:53:22.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/806: mknod d0/d1/d1f/d29/c10e 0 2024-03-16T10:53:22.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/807: write d0/d1/d2/dc/f45 [325422,46563] 0 2024-03-16T10:53:22.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/808: chown d0/d1/d2/d2c/d36/l52 579310 1 2024-03-16T10:53:22.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/551: write d8/df/d5b/f6f [22317,81700] 0 2024-03-16T10:53:22.177 INFO:tasks.workunit.client.0.smithi017.stdout:6/576: dwrite d0/d21/d39/d44/f70 [0,4194304] 0 2024-03-16T10:53:22.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/552: dread d8/df/d5b/d32/f34 [0,4194304] 0 2024-03-16T10:53:22.179 INFO:tasks.workunit.client.0.smithi017.stdout:5/809: read d0/d1/d2/d2c/d36/d41/da5/dc6/fdc [133233,4102] 0 2024-03-16T10:53:22.180 INFO:tasks.workunit.client.0.smithi017.stdout:6/577: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/lb2 0 2024-03-16T10:53:22.180 INFO:tasks.workunit.client.0.smithi017.stdout:6/578: read d0/d21/d39/d44/d9a/da7/f13 [122709,95473] 0 2024-03-16T10:53:22.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/553: mknod d8/df/d5b/d5e/d68/d98/cb0 0 2024-03-16T10:53:22.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/579: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/fb3 x:0 0 0 2024-03-16T10:53:22.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/580: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f8f zero size 2024-03-16T10:53:22.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/581: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78 0 2024-03-16T10:53:22.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/582: dread - d0/d21/d39/d44/d9a/da7/d38/f63 zero size 2024-03-16T10:53:22.190 INFO:tasks.workunit.client.0.smithi017.stdout:9/554: write d8/f59 [1347694,47911] 0 2024-03-16T10:53:22.197 INFO:tasks.workunit.client.0.smithi017.stdout:6/583: dwrite d0/f74 [0,4194304] 0 2024-03-16T10:53:22.197 INFO:tasks.workunit.client.0.smithi017.stdout:9/555: dread d8/df/d5b/f3b [0,4194304] 0 2024-03-16T10:53:22.198 INFO:tasks.workunit.client.0.smithi017.stdout:1/839: rename d1/d24/l27 to d1/d3/dd/d31/d35/def/l119 0 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/810: link d0/d1/d30/l6e d0/d1/d2/d8c/db9/l10f 0 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/811: chown d0/d1/d2/cd 1 1 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/812: readlink d0/d1/d1f/l26 0 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/813: dread - d0/d1/d30/dde/d42/d46/f86 zero size 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/814: chown d0/d1/d2/d2c/c81 4425 1 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:1/840: symlink d1/d3/dd/d31/l11a 0 2024-03-16T10:53:22.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/556: dread d8/df/d5b/d32/d45/f77 [0,4194304] 0 2024-03-16T10:53:22.203 INFO:tasks.workunit.client.0.smithi017.stdout:9/557: symlink d8/df/d5b/d5e/d68/d98/lb1 0 2024-03-16T10:53:22.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/815: symlink d0/l110 0 2024-03-16T10:53:22.209 INFO:tasks.workunit.client.0.smithi017.stdout:9/558: creat d8/df/d5b/fb2 x:0 0 0 2024-03-16T10:53:22.212 INFO:tasks.workunit.client.0.smithi017.stdout:9/559: mknod d8/df/d5b/d72/cb3 0 2024-03-16T10:53:22.219 INFO:tasks.workunit.client.0.smithi017.stdout:1/841: dwrite d1/d3/dd/d31/d66/dd7/dbc/fd1 [0,4194304] 0 2024-03-16T10:53:22.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/560: dread d8/f30 [0,4194304] 0 2024-03-16T10:53:22.221 INFO:tasks.workunit.client.0.smithi017.stdout:9/561: mkdir d8/df/d46/d63/db4 0 2024-03-16T10:53:22.222 INFO:tasks.workunit.client.0.smithi017.stdout:9/562: chown d8/df/d5b/d5e/d68 1634675 1 2024-03-16T10:53:22.223 INFO:tasks.workunit.client.0.smithi017.stdout:9/563: symlink d8/df/d5b/d5e/d68/d98/lb5 0 2024-03-16T10:53:22.223 INFO:tasks.workunit.client.0.smithi017.stdout:9/564: chown d8/df/d5b/f6f 51 1 2024-03-16T10:53:22.226 INFO:tasks.workunit.client.0.smithi017.stdout:6/584: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/d41/d97/la3 to d0/d21/lb4 0 2024-03-16T10:53:22.227 INFO:tasks.workunit.client.0.smithi017.stdout:1/842: dread d1/d3/dd/d31/d66/dd7/d67/fbf [0,4194304] 0 2024-03-16T10:53:22.229 INFO:tasks.workunit.client.0.smithi017.stdout:1/843: unlink d1/d3/dd/d31/d35/f38 0 2024-03-16T10:53:22.229 INFO:tasks.workunit.client.0.smithi017.stdout:1/844: write d1/d3/dd/d9f/fad [5192440,59583] 0 2024-03-16T10:53:22.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/845: chown d1/d24/d79/dd2/d100/d94/cd5 119613 1 2024-03-16T10:53:22.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/846: fdatasync d1/d3/dd/d31/d35/fac 0 2024-03-16T10:53:22.237 INFO:tasks.workunit.client.0.smithi017.stdout:9/565: dwrite d8/df/d46/d63/d88/faa [0,4194304] 0 2024-03-16T10:53:22.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/566: mknod d8/df/d5b/d5e/cb6 0 2024-03-16T10:53:22.240 INFO:tasks.workunit.client.0.smithi017.stdout:9/567: mkdir d8/df/d5b/daf/db7 0 2024-03-16T10:53:22.247 INFO:tasks.workunit.client.0.smithi017.stdout:6/585: dwrite d0/d15/f1c [0,4194304] 0 2024-03-16T10:53:22.247 INFO:tasks.workunit.client.0.smithi017.stdout:6/586: write d0/d21/d39/f5a [381230,50386] 0 2024-03-16T10:53:22.248 INFO:tasks.workunit.client.0.smithi017.stdout:6/587: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f82 0 2024-03-16T10:53:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/588: symlink d0/d15/d1f/lb5 0 2024-03-16T10:53:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/589: read - d0/d21/d39/d44/d9a/da7/d45/d4d/f83 zero size 2024-03-16T10:53:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/590: readlink d0/d15/l34 0 2024-03-16T10:53:22.254 INFO:tasks.workunit.client.0.smithi017.stdout:1/847: rename d1/d3/f112 to d1/d24/d79/dd2/f11b 0 2024-03-16T10:53:22.256 INFO:tasks.workunit.client.0.smithi017.stdout:9/568: dwrite d8/df/d5b/f3a [0,4194304] 0 2024-03-16T10:53:22.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/591: unlink d0/d15/l9c 0 2024-03-16T10:53:22.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/592: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f27 0 2024-03-16T10:53:22.260 INFO:tasks.workunit.client.0.smithi017.stdout:1/848: creat d1/d50/d61/f11c x:0 0 0 2024-03-16T10:53:22.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/569: write d8/df/d5b/f42 [3431865,16757] 0 2024-03-16T10:53:22.264 INFO:tasks.workunit.client.0.smithi017.stdout:1/849: unlink d1/d24/d79/dd2/d100/d97/ca3 0 2024-03-16T10:53:22.266 INFO:tasks.workunit.client.0.smithi017.stdout:9/570: symlink d8/df/d5b/lb8 0 2024-03-16T10:53:22.269 INFO:tasks.workunit.client.0.smithi017.stdout:9/571: truncate d8/df/d5b/f5d 3149502 0 2024-03-16T10:53:22.275 INFO:tasks.workunit.client.0.smithi017.stdout:6/593: dwrite d0/f3c [0,4194304] 0 2024-03-16T10:53:22.276 INFO:tasks.workunit.client.0.smithi017.stdout:6/594: chown d0/d15/d1f/d7d/d87 5 1 2024-03-16T10:53:22.277 INFO:tasks.workunit.client.0.smithi017.stdout:1/850: dwrite d1/d3/dd/ddc/fdf [0,4194304] 0 2024-03-16T10:53:22.279 INFO:tasks.workunit.client.0.smithi017.stdout:9/572: getdents d8/df/d5b/d32/d45 0 2024-03-16T10:53:22.282 INFO:tasks.workunit.client.0.smithi017.stdout:1/851: mknod d1/d3/dd/d31/d35/c11d 0 2024-03-16T10:53:22.283 INFO:tasks.workunit.client.0.smithi017.stdout:1/852: read - d1/d24/fe8 zero size 2024-03-16T10:53:22.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/573: truncate d8/df/d46/d63/f7b 1399176 0 2024-03-16T10:53:22.285 INFO:tasks.workunit.client.0.smithi017.stdout:6/595: link d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f82 d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/fb6 0 2024-03-16T10:53:22.286 INFO:tasks.workunit.client.0.smithi017.stdout:9/574: mknod d8/df/d5b/d5e/cb9 0 2024-03-16T10:53:22.289 INFO:tasks.workunit.client.0.smithi017.stdout:6/596: creat d0/d21/fb7 x:0 0 0 2024-03-16T10:53:22.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/575: mknod d8/df/d46/d63/d94/d9d/cba 0 2024-03-16T10:53:22.293 INFO:tasks.workunit.client.0.smithi017.stdout:6/597: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fb8 x:0 0 0 2024-03-16T10:53:22.295 INFO:tasks.workunit.client.0.smithi017.stdout:9/576: symlink d8/df/d46/d63/d94/d9d/lbb 0 2024-03-16T10:53:22.308 INFO:tasks.workunit.client.0.smithi017.stdout:6/598: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c [0,4194304] 0 2024-03-16T10:53:22.310 INFO:tasks.workunit.client.0.smithi017.stdout:9/577: dwrite d8/df/f11 [0,4194304] 0 2024-03-16T10:53:22.310 INFO:tasks.workunit.client.0.smithi017.stdout:9/578: dread - d8/df/d5b/d70/f85 zero size 2024-03-16T10:53:22.312 INFO:tasks.workunit.client.0.smithi017.stdout:9/579: write d8/df/d5b/d32/f39 [429253,83192] 0 2024-03-16T10:53:22.319 INFO:tasks.workunit.client.0.smithi017.stdout:6/599: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/d41 to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9 0 2024-03-16T10:53:22.322 INFO:tasks.workunit.client.0.smithi017.stdout:9/580: rename d8/df/d46/d63/d88/faa to d8/df/d46/d63/fbc 0 2024-03-16T10:53:22.322 INFO:tasks.workunit.client.0.smithi017.stdout:9/581: dread - d8/df/d5b/f8d zero size 2024-03-16T10:53:22.323 INFO:tasks.workunit.client.0.smithi017.stdout:6/600: creat d0/d21/d39/d44/fba x:0 0 0 2024-03-16T10:53:22.324 INFO:tasks.workunit.client.0.smithi017.stdout:9/582: dread d8/df/d5b/f6f [0,4194304] 0 2024-03-16T10:53:22.324 INFO:tasks.workunit.client.0.smithi017.stdout:9/583: write d8/f59 [1436019,33900] 0 2024-03-16T10:53:22.326 INFO:tasks.workunit.client.0.smithi017.stdout:6/601: mkdir d0/d21/d39/d44/d9a/da7/d45/dbb 0 2024-03-16T10:53:22.326 INFO:tasks.workunit.client.0.smithi017.stdout:6/602: readlink d0/d21/lb4 0 2024-03-16T10:53:22.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/584: getdents d8/df/d46 0 2024-03-16T10:53:22.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/603: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 [0,4194304] 0 2024-03-16T10:53:22.337 INFO:tasks.workunit.client.0.smithi017.stdout:6/604: symlink d0/d21/d39/d44/d9a/da7/d38/lbc 0 2024-03-16T10:53:22.345 INFO:tasks.workunit.client.0.smithi017.stdout:9/585: dwrite d8/df/d5b/d32/d45/f61 [0,4194304] 0 2024-03-16T10:53:22.346 INFO:tasks.workunit.client.0.smithi017.stdout:6/605: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/f9d [0,4194304] 0 2024-03-16T10:53:22.349 INFO:tasks.workunit.client.0.smithi017.stdout:7/616: sync 2024-03-16T10:53:22.349 INFO:tasks.workunit.client.0.smithi017.stdout:8/734: sync 2024-03-16T10:53:22.349 INFO:tasks.workunit.client.0.smithi017.stdout:8/735: chown d6/d16/d6c/dd4/l3d 122732559 1 2024-03-16T10:53:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/586: dread d8/f2a [4194304,4194304] 0 2024-03-16T10:53:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:6/606: dread d0/d21/d39/d44/d9a/da7/d45/d4d/f25 [0,4194304] 0 2024-03-16T10:53:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/587: fdatasync d8/df/d5b/f5d 0 2024-03-16T10:53:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/617: truncate d7/d5a/fb8 364405 0 2024-03-16T10:53:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/588: write d8/df/d5b/f8c [944071,21012] 0 2024-03-16T10:53:22.355 INFO:tasks.workunit.client.0.smithi017.stdout:8/736: rename d6/d16/db3/dcb/c58 to d6/d5f/d6e/ceb 0 2024-03-16T10:53:22.357 INFO:tasks.workunit.client.0.smithi017.stdout:6/607: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/cbd 0 2024-03-16T10:53:22.362 INFO:tasks.workunit.client.0.smithi017.stdout:9/589: rmdir d8/df/d46/d9f 0 2024-03-16T10:53:22.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/737: rename d6/d16/f49 to d6/fec 0 2024-03-16T10:53:22.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/738: dread - d6/d5f/d6e/fd7 zero size 2024-03-16T10:53:22.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/739: readlink d6/d14/d6b/lae 0 2024-03-16T10:53:22.370 INFO:tasks.workunit.client.0.smithi017.stdout:8/740: mknod d6/d5c/d96/ced 0 2024-03-16T10:53:22.372 INFO:tasks.workunit.client.0.smithi017.stdout:8/741: rmdir d6/d16/db3/dcb 39 2024-03-16T10:53:22.372 INFO:tasks.workunit.client.0.smithi017.stdout:8/742: stat d6/d14/d6b/fe6 0 2024-03-16T10:53:22.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/590: dwrite d8/f24 [0,4194304] 0 2024-03-16T10:53:22.378 INFO:tasks.workunit.client.0.smithi017.stdout:9/591: creat d8/df/fbd x:0 0 0 2024-03-16T10:53:22.383 INFO:tasks.workunit.client.0.smithi017.stdout:8/743: dwrite d6/d16/d6c/dd4/d92/fc8 [0,4194304] 0 2024-03-16T10:53:22.388 INFO:tasks.workunit.client.0.smithi017.stdout:7/618: rename d7/db/dc/d50/d59/d34/d53/ccb to d7/db/d32/d78/da5/ccd 0 2024-03-16T10:53:22.390 INFO:tasks.workunit.client.0.smithi017.stdout:9/592: rename d8/df/d5b/f8d to d8/df/d5b/daf/db7/fbe 0 2024-03-16T10:53:22.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/619: write d7/db/d12/f8e [1120600,35116] 0 2024-03-16T10:53:22.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/620: write d7/d8a/fb7 [430302,82165] 0 2024-03-16T10:53:22.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/621: write d7/db/dc/d50/d59/d34/f5e [3713803,102357] 0 2024-03-16T10:53:22.391 INFO:tasks.workunit.client.0.smithi017.stdout:7/622: creat d7/db/d32/dc5/fce x:0 0 0 2024-03-16T10:53:22.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/623: rename d7/db/d32/d78/fc1 to d7/db/d32/d78/fcf 0 2024-03-16T10:53:22.401 INFO:tasks.workunit.client.0.smithi017.stdout:7/624: dread d7/d8a/f29 [0,4194304] 0 2024-03-16T10:53:22.413 INFO:tasks.workunit.client.0.smithi017.stdout:7/625: dwrite d7/db/d81/f97 [0,4194304] 0 2024-03-16T10:53:22.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/626: creat d7/db/d32/fd0 x:0 0 0 2024-03-16T10:53:22.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/627: readlink d7/db/d12/l4f 0 2024-03-16T10:53:22.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/628: creat d7/db/d32/d78/da5/fd1 x:0 0 0 2024-03-16T10:53:22.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/629: rename d7/db/d12/d1c/f2e to d7/db/dc/d50/d59/d34/d95/da3/fd2 0 2024-03-16T10:53:22.438 INFO:tasks.workunit.client.0.smithi017.stdout:7/630: rename d7/db/d12/d1c/f3c to d7/db/d81/fd3 0 2024-03-16T10:53:22.441 INFO:tasks.workunit.client.0.smithi017.stdout:7/631: unlink d7/db/dc/d50/d59/l7f 0 2024-03-16T10:53:22.443 INFO:tasks.workunit.client.0.smithi017.stdout:7/632: creat d7/db/dc/d60/fd4 x:0 0 0 2024-03-16T10:53:22.443 INFO:tasks.workunit.client.0.smithi017.stdout:7/633: write d7/db/dc/d50/d59/d34/d95/fa2 [4827467,35841] 0 2024-03-16T10:53:22.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/634: dwrite d7/db/d81/f91 [0,4194304] 0 2024-03-16T10:53:22.458 INFO:tasks.workunit.client.0.smithi017.stdout:7/635: mknod d7/db/dc/d50/cd5 0 2024-03-16T10:53:22.458 INFO:tasks.workunit.client.0.smithi017.stdout:7/636: stat d7/db/dc/dae 0 2024-03-16T10:53:22.459 INFO:tasks.workunit.client.0.smithi017.stdout:7/637: write d7/d5a/fb8 [275886,126437] 0 2024-03-16T10:53:22.476 INFO:tasks.workunit.client.0.smithi017.stdout:7/638: dwrite d7/db/dc/d50/d59/d34/d95/fa2 [0,4194304] 0 2024-03-16T10:53:22.477 INFO:tasks.workunit.client.0.smithi017.stdout:7/639: readlink d7/db/d81/l9b 0 2024-03-16T10:53:22.479 INFO:tasks.workunit.client.0.smithi017.stdout:7/640: creat d7/db/dc/d50/da8/dca/fd6 x:0 0 0 2024-03-16T10:53:22.479 INFO:tasks.workunit.client.0.smithi017.stdout:7/641: readlink d7/db/d12/lbd 0 2024-03-16T10:53:22.481 INFO:tasks.workunit.client.0.smithi017.stdout:7/642: mknod d7/db/dc/d50/d59/d34/d95/da3/cd7 0 2024-03-16T10:53:22.491 INFO:tasks.workunit.client.0.smithi017.stdout:7/643: dwrite d7/db/d32/d78/da5/fd1 [0,4194304] 0 2024-03-16T10:53:22.494 INFO:tasks.workunit.client.0.smithi017.stdout:7/644: stat d7/db/d12/d1c/l71 0 2024-03-16T10:53:22.497 INFO:tasks.workunit.client.0.smithi017.stdout:7/645: read d7/db/dc/d50/d59/f55 [861129,33423] 0 2024-03-16T10:53:22.500 INFO:tasks.workunit.client.0.smithi017.stdout:7/646: creat d7/db/dc/d50/da8/dca/fd8 x:0 0 0 2024-03-16T10:53:22.501 INFO:tasks.workunit.client.0.smithi017.stdout:7/647: symlink d7/ld9 0 2024-03-16T10:53:22.502 INFO:tasks.workunit.client.0.smithi017.stdout:7/648: chown d7/db/dc/d50/d73/fb6 1386 1 2024-03-16T10:53:22.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/649: link d7/db/d12/f3f d7/db/dc/d60/fda 0 2024-03-16T10:53:22.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/650: write d7/db/dc/d50/da8/dca/fd8 [943622,71937] 0 2024-03-16T10:53:22.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/651: fsync d7/d8a/f39 0 2024-03-16T10:53:22.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/652: fsync d7/db/dc/d50/d59/d34/d95/fa2 0 2024-03-16T10:53:22.509 INFO:tasks.workunit.client.0.smithi017.stdout:7/653: dread d7/d8a/f39 [0,4194304] 0 2024-03-16T10:53:22.510 INFO:tasks.workunit.client.0.smithi017.stdout:7/654: readlink d7/d5a/l82 0 2024-03-16T10:53:22.510 INFO:tasks.workunit.client.0.smithi017.stdout:7/655: chown d7/db/dc/d50/d59/d34/d53/c65 1253 1 2024-03-16T10:53:22.512 INFO:tasks.workunit.client.0.smithi017.stdout:7/656: rmdir d7/db/dc/d50/d59/d34/d53 39 2024-03-16T10:53:22.512 INFO:tasks.workunit.client.0.smithi017.stdout:7/657: chown d7/db/dc/d50/d59/d34/f43 171599 1 2024-03-16T10:53:22.513 INFO:tasks.workunit.client.0.smithi017.stdout:7/658: mkdir d7/db/dc/dae/ddb 0 2024-03-16T10:53:22.514 INFO:tasks.workunit.client.0.smithi017.stdout:7/659: readlink d7/d8a/l22 0 2024-03-16T10:53:22.515 INFO:tasks.workunit.client.0.smithi017.stdout:7/660: link d7/d8a/d66/ca6 d7/db/d32/cdc 0 2024-03-16T10:53:22.527 INFO:tasks.workunit.client.0.smithi017.stdout:7/661: dwrite d7/d8a/fb7 [0,4194304] 0 2024-03-16T10:53:22.527 INFO:tasks.workunit.client.0.smithi017.stdout:7/662: stat d7/db/dc/d60/f6a 0 2024-03-16T10:53:22.530 INFO:tasks.workunit.client.0.smithi017.stdout:7/663: creat d7/db/dc/dae/fdd x:0 0 0 2024-03-16T10:53:22.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/664: dread d7/db/dc/f83 [0,4194304] 0 2024-03-16T10:53:22.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/665: dread d7/db/f14 [4194304,4194304] 0 2024-03-16T10:53:22.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/666: dwrite d7/db/dc/d60/fd4 [0,4194304] 0 2024-03-16T10:53:22.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/667: fdatasync d7/db/f93 0 2024-03-16T10:53:22.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/668: write d7/db/dc/d50/f7c [4711098,57230] 0 2024-03-16T10:53:22.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/669: write d7/db/f18 [2282986,128382] 0 2024-03-16T10:53:22.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/670: creat d7/db/dc/d50/d59/d34/d95/fde x:0 0 0 2024-03-16T10:53:22.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/671: fsync d7/d8a/d66/dad/fb5 0 2024-03-16T10:53:22.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:22 smithi174 ceph-mon[36202]: pgmap v427: 97 pgs: 97 active+clean; 1013 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 159 MiB/s wr, 1.43k op/s 2024-03-16T10:53:22.569 INFO:tasks.workunit.client.0.smithi017.stdout:7/672: dread d7/d8a/d66/dad/fb5 [0,4194304] 0 2024-03-16T10:53:22.569 INFO:tasks.workunit.client.0.smithi017.stdout:7/673: write d7/f7a [1045729,54835] 0 2024-03-16T10:53:22.570 INFO:tasks.workunit.client.0.smithi017.stdout:7/674: rmdir d7/db/dc/d60 39 2024-03-16T10:53:22.575 INFO:tasks.workunit.client.0.smithi017.stdout:7/675: write d7/db/dc/d50/d59/d34/f43 [1532967,89142] 0 2024-03-16T10:53:22.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:22 smithi017 ceph-mon[32078]: pgmap v427: 97 pgs: 97 active+clean; 1013 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 159 MiB/s wr, 1.43k op/s 2024-03-16T10:53:22.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/676: dwrite d7/db/d12/d1c/d4e/dbc/fcc [0,4194304] 0 2024-03-16T10:53:22.595 INFO:tasks.workunit.client.0.smithi017.stdout:7/677: rename d7/d5a to d7/db/d12/ddf 0 2024-03-16T10:53:22.597 INFO:tasks.workunit.client.0.smithi017.stdout:7/678: symlink d7/db/d12/le0 0 2024-03-16T10:53:22.599 INFO:tasks.workunit.client.0.smithi017.stdout:7/679: symlink d7/db/dc/d50/d59/d34/d53/le1 0 2024-03-16T10:53:22.599 INFO:tasks.workunit.client.0.smithi017.stdout:7/680: chown d7/d8a/fb7 3 1 2024-03-16T10:53:22.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/681: dwrite d7/d8a/f29 [4194304,4194304] 0 2024-03-16T10:53:22.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/682: dread - d7/db/dc/d50/da8/dca/fd6 zero size 2024-03-16T10:53:22.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/683: dread - d7/d8a/fb0 zero size 2024-03-16T10:53:22.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/684: chown d7/db/dc/dae/fdd 140 1 2024-03-16T10:53:22.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/685: read d7/db/f9d [37064,6077] 0 2024-03-16T10:53:22.617 INFO:tasks.workunit.client.0.smithi017.stdout:7/686: creat d7/db/dc/dae/fe2 x:0 0 0 2024-03-16T10:53:22.617 INFO:tasks.workunit.client.0.smithi017.stdout:7/687: chown d7/d8a/fb7 216391523 1 2024-03-16T10:53:22.629 INFO:tasks.workunit.client.0.smithi017.stdout:7/688: dwrite d7/db/dc/d60/fd4 [0,4194304] 0 2024-03-16T10:53:22.629 INFO:tasks.workunit.client.0.smithi017.stdout:7/689: stat d7/db/d12/d1c/l71 0 2024-03-16T10:53:22.629 INFO:tasks.workunit.client.0.smithi017.stdout:7/690: truncate d7/db/dc/dae/fdd 271090 0 2024-03-16T10:53:22.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:22 smithi111 ceph-mon[36315]: pgmap v427: 97 pgs: 97 active+clean; 1013 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 159 MiB/s wr, 1.43k op/s 2024-03-16T10:53:24.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:24 smithi174 ceph-mon[36202]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 211 MiB/s wr, 1.84k op/s 2024-03-16T10:53:24.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:24 smithi017 ceph-mon[32078]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 211 MiB/s wr, 1.84k op/s 2024-03-16T10:53:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:24 smithi111 ceph-mon[36315]: pgmap v428: 97 pgs: 97 active+clean; 1.3 GiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 211 MiB/s wr, 1.84k op/s 2024-03-16T10:53:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:25 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:53:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:25 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:53:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:25 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:53:25.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:25 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:53:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:25 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:53:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:25 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:53:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:25 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:53:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:25 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:53:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:25 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:53:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:25 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:53:25.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:25 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:53:25.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:25 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:53:25.756 INFO:tasks.workunit.client.0.smithi017.stdout:8/744: sync 2024-03-16T10:53:25.756 INFO:tasks.workunit.client.0.smithi017.stdout:2/568: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:5/816: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:9/593: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:3/609: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:0/799: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:9/594: readlink d8/df/l2f 0 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:5/817: truncate d0/d1/d2/d2c/d38/f61 1291153 0 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:5/818: stat d0/d1/d30/c75 0 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:6/608: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:1/853: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:4/798: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:9/595: write d8/df/d5b/d72/d9e/fa7 [501361,82702] 0 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:7/691: sync 2024-03-16T10:53:25.757 INFO:tasks.workunit.client.0.smithi017.stdout:9/596: write d8/df/d5b/f6f [1944123,64587] 0 2024-03-16T10:53:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/569: mkdir d4/d6/db/d24/d39/d7d/db3 0 2024-03-16T10:53:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:5/819: dread d0/d1/d2/d2c/d36/d41/f8e [0,4194304] 0 2024-03-16T10:53:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/610: dread d8/d1b/d2e/f3e [0,4194304] 0 2024-03-16T10:53:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:5/820: stat d0/d1/d30/dde/d57 0 2024-03-16T10:53:25.760 INFO:tasks.workunit.client.0.smithi017.stdout:0/800: dread d2/d4/d6d/f75 [0,4194304] 0 2024-03-16T10:53:25.760 INFO:tasks.workunit.client.0.smithi017.stdout:0/801: fdatasync d2/d4/d6d/d84/dc1/dd2/d24/d29/f98 0 2024-03-16T10:53:25.761 INFO:tasks.workunit.client.0.smithi017.stdout:8/745: link d6/d5c/f8f d6/d5c/d96/d98/fee 0 2024-03-16T10:53:25.761 INFO:tasks.workunit.client.0.smithi017.stdout:8/746: chown d6/d16/d6c 1543653 1 2024-03-16T10:53:25.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/609: mknod d0/d15/d1f/d7d/cbe 0 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/611: dwrite d8/f52 [4194304,4194304] 0 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/612: stat d8/d1b/d2e/d8d/lb3 0 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/613: chown d8/da/fa9 22538497 1 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/614: fdatasync d8/d1b/d65/f9b 0 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/615: readlink d8/d1b/d2e/laa 0 2024-03-16T10:53:25.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/616: read - d8/d1b/d1c/d62/d69/f96 zero size 2024-03-16T10:53:25.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/570: dwrite d4/dd/d38/f6e [0,4194304] 0 2024-03-16T10:53:25.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/799: rename d15/d1d/f5d to d15/d1d/d21/d26/d66/d8c/dab/dc7/f111 0 2024-03-16T10:53:25.778 INFO:tasks.workunit.client.0.smithi017.stdout:0/802: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d3a/fc7 [0,4194304] 0 2024-03-16T10:53:25.778 INFO:tasks.workunit.client.0.smithi017.stdout:0/803: read - d2/d4/d6d/dde/f10a zero size 2024-03-16T10:53:25.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/692: rmdir d7/db/d32/d78/da5 39 2024-03-16T10:53:25.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/693: readlink d7/db/dc/l1e 0 2024-03-16T10:53:25.785 INFO:tasks.workunit.client.0.smithi017.stdout:0/804: unlink d2/d4/d90/d86/ce2 0 2024-03-16T10:53:25.785 INFO:tasks.workunit.client.0.smithi017.stdout:0/805: dread - d2/d4/d6d/dde/f10a zero size 2024-03-16T10:53:25.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/747: link d6/d16/d6c/dd4/f53 d6/d16/db3/dcb/fef 0 2024-03-16T10:53:25.786 INFO:tasks.workunit.client.0.smithi017.stdout:8/748: dread d6/d5f/d6e/f89 [0,4194304] 0 2024-03-16T10:53:25.786 INFO:tasks.workunit.client.0.smithi017.stdout:0/806: write d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [203654,111004] 0 2024-03-16T10:53:25.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/617: symlink d8/da/da7/lb4 0 2024-03-16T10:53:25.789 INFO:tasks.workunit.client.0.smithi017.stdout:4/800: dwrite d15/d1d/d21/d3c/de9/d43/f9e [0,4194304] 0 2024-03-16T10:53:25.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/571: readlink d4/dd/df/l35 0 2024-03-16T10:53:25.792 INFO:tasks.workunit.client.0.smithi017.stdout:3/618: dread d8/d8c/f95 [0,4194304] 0 2024-03-16T10:53:25.792 INFO:tasks.workunit.client.0.smithi017.stdout:3/619: write d8/d1b/d2e/d60/f74 [2479622,24258] 0 2024-03-16T10:53:25.792 INFO:tasks.workunit.client.0.smithi017.stdout:3/620: chown d8/da/db/f50 11329031 1 2024-03-16T10:53:25.793 INFO:tasks.workunit.client.0.smithi017.stdout:9/597: rename d8/df/d5b/d5e to d8/dbf 0 2024-03-16T10:53:25.796 INFO:tasks.workunit.client.0.smithi017.stdout:8/749: symlink d6/d5f/da4/lf0 0 2024-03-16T10:53:25.797 INFO:tasks.workunit.client.0.smithi017.stdout:0/807: dread d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/f9c [0,4194304] 0 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/801: creat d15/d1d/d21/d3c/de9/d43/dd1/f112 x:0 0 0 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/802: fdatasync d15/d1d/d21/d3c/de9/d40/d51/d64/da8/fc9 0 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/803: chown d15/d1d/d21/d3c/de9/d40/d51/d64/d76/l7a 2423 1 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/804: chown d15/c45 1040914 1 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/805: stat d15/d1d/f36 0 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/806: stat d15/d1d/f36 0 2024-03-16T10:53:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/807: fsync d15/d1d/d27/f3b 0 2024-03-16T10:53:25.800 INFO:tasks.workunit.client.0.smithi017.stdout:0/808: creat d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f119 x:0 0 0 2024-03-16T10:53:25.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/854: creat d1/d3/dd/d31/d66/f11e x:0 0 0 2024-03-16T10:53:25.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/855: write d1/d3/dd/f77 [1346043,50552] 0 2024-03-16T10:53:25.801 INFO:tasks.workunit.client.0.smithi017.stdout:0/809: mknod d2/d4/d61/ddd/c11a 0 2024-03-16T10:53:25.801 INFO:tasks.workunit.client.0.smithi017.stdout:5/821: rename d0/d1/d30/dde/d42/d46 to d0/d1/d2/d111 0 2024-03-16T10:53:25.802 INFO:tasks.workunit.client.0.smithi017.stdout:7/694: dwrite d7/db/dc/d50/d59/d34/f47 [0,4194304] 0 2024-03-16T10:53:25.802 INFO:tasks.workunit.client.0.smithi017.stdout:3/621: dwrite d8/da/f93 [0,4194304] 0 2024-03-16T10:53:25.802 INFO:tasks.workunit.client.0.smithi017.stdout:3/622: chown d8/d1b/d1c/f92 0 1 2024-03-16T10:53:25.803 INFO:tasks.workunit.client.0.smithi017.stdout:7/695: write d7/db/dc/d50/da8/dca/fd6 [540254,125890] 0 2024-03-16T10:53:25.803 INFO:tasks.workunit.client.0.smithi017.stdout:9/598: creat d8/dbf/d68/d7f/fc0 x:0 0 0 2024-03-16T10:53:25.804 INFO:tasks.workunit.client.0.smithi017.stdout:0/810: rename d2/d4/d6d/d84/c97 to d2/d4/d6d/d84/de9/c11b 0 2024-03-16T10:53:25.805 INFO:tasks.workunit.client.0.smithi017.stdout:8/750: chown d6/d5f/d6e/f75 91967 1 2024-03-16T10:53:25.805 INFO:tasks.workunit.client.0.smithi017.stdout:8/751: stat d6/d5c/d96/ca1 0 2024-03-16T10:53:25.809 INFO:tasks.workunit.client.0.smithi017.stdout:4/808: link d15/d1d/d21/d3c/de9/d40/c60 d15/d1d/d27/db6/dc6/c113 0 2024-03-16T10:53:25.809 INFO:tasks.workunit.client.0.smithi017.stdout:4/809: write d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fe1 [520689,84349] 0 2024-03-16T10:53:25.817 INFO:tasks.workunit.client.0.smithi017.stdout:9/599: dwrite d8/f79 [0,4194304] 0 2024-03-16T10:53:25.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/572: link d4/d6/db/c84 d4/d6/d30/d3f/cb4 0 2024-03-16T10:53:25.817 INFO:tasks.workunit.client.0.smithi017.stdout:9/600: dread - d8/dbf/d68/f7a zero size 2024-03-16T10:53:25.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/573: stat d4/dd/d1e/f89 0 2024-03-16T10:53:25.817 INFO:tasks.workunit.client.0.smithi017.stdout:2/574: write d4/dd/df/f5f [2044112,88864] 0 2024-03-16T10:53:25.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/856: symlink d1/d3/dd/l11f 0 2024-03-16T10:53:25.820 INFO:tasks.workunit.client.0.smithi017.stdout:5/822: creat d0/d1/d76/f112 x:0 0 0 2024-03-16T10:53:25.822 INFO:tasks.workunit.client.0.smithi017.stdout:3/623: rmdir d8/d8c 39 2024-03-16T10:53:25.825 INFO:tasks.workunit.client.0.smithi017.stdout:8/752: unlink d6/d5f/f33 0 2024-03-16T10:53:25.825 INFO:tasks.workunit.client.0.smithi017.stdout:8/753: chown d6 918949 1 2024-03-16T10:53:25.833 INFO:tasks.workunit.client.0.smithi017.stdout:4/810: creat d15/d1d/d27/f114 x:0 0 0 2024-03-16T10:53:25.833 INFO:tasks.workunit.client.0.smithi017.stdout:4/811: chown d15/d1d/d21/d3c/de9/d43/dc2/c105 45823 1 2024-03-16T10:53:25.836 INFO:tasks.workunit.client.0.smithi017.stdout:9/601: rename d8/df/d46/d63/fbc to d8/df/d5b/daf/fc1 0 2024-03-16T10:53:25.836 INFO:tasks.workunit.client.0.smithi017.stdout:9/602: readlink d8/df/d5b/d32/d45/l84 0 2024-03-16T10:53:25.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/823: symlink d0/d1/d1f/d29/d88/d91/dda/l113 0 2024-03-16T10:53:25.840 INFO:tasks.workunit.client.0.smithi017.stdout:3/624: symlink d8/d1b/d1c/lb5 0 2024-03-16T10:53:25.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/625: dread d8/d1b/d1c/d62/fa8 [0,4194304] 0 2024-03-16T10:53:25.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/812: unlink d15/d1d/daf/fdd 0 2024-03-16T10:53:25.843 INFO:tasks.workunit.client.0.smithi017.stdout:5/824: dread d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:25.845 INFO:tasks.workunit.client.0.smithi017.stdout:2/575: read d4/d6/db/d66/d2e/f59 [2100195,20787] 0 2024-03-16T10:53:25.846 INFO:tasks.workunit.client.0.smithi017.stdout:8/754: rename d6/d39/fb5 to d6/d16/db3/dcb/ff1 0 2024-03-16T10:53:25.847 INFO:tasks.workunit.client.0.smithi017.stdout:9/603: symlink d8/lc2 0 2024-03-16T10:53:25.851 INFO:tasks.workunit.client.0.smithi017.stdout:5/825: creat d0/d1/d76/f114 x:0 0 0 2024-03-16T10:53:25.851 INFO:tasks.workunit.client.0.smithi017.stdout:5/826: fdatasync d0/d1/d1f/d97/fca 0 2024-03-16T10:53:25.854 INFO:tasks.workunit.client.0.smithi017.stdout:3/626: rename d8/d3f/f98 to d8/d1d/dab/fb6 0 2024-03-16T10:53:25.856 INFO:tasks.workunit.client.0.smithi017.stdout:2/576: rmdir d4/dd 39 2024-03-16T10:53:25.858 INFO:tasks.workunit.client.0.smithi017.stdout:9/604: truncate d8/df/d46/d63/f7e 3726806 0 2024-03-16T10:53:25.858 INFO:tasks.workunit.client.0.smithi017.stdout:9/605: write d8/f59 [4627841,130812] 0 2024-03-16T10:53:25.860 INFO:tasks.workunit.client.0.smithi017.stdout:5/827: creat d0/d1/f115 x:0 0 0 2024-03-16T10:53:25.860 INFO:tasks.workunit.client.0.smithi017.stdout:5/828: write d0/d1/d2/d2c/d36/d51/fc4 [2346665,11054] 0 2024-03-16T10:53:25.860 INFO:tasks.workunit.client.0.smithi017.stdout:5/829: write d0/d1/d2/d8c/fc0 [716417,42316] 0 2024-03-16T10:53:25.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/755: dwrite d6/d5f/f9b [0,4194304] 0 2024-03-16T10:53:25.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/813: rename d15/d1d/d27/f108 to d15/d1d/d21/d3c/de9/d40/d51/f115 0 2024-03-16T10:53:25.871 INFO:tasks.workunit.client.0.smithi017.stdout:5/830: mkdir d0/d1/d1f/d97/d116 0 2024-03-16T10:53:25.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/627: mknod d8/d1b/d2e/d57/cb7 0 2024-03-16T10:53:25.873 INFO:tasks.workunit.client.0.smithi017.stdout:9/606: dwrite d8/df/d5b/f42 [0,4194304] 0 2024-03-16T10:53:25.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/577: rmdir d4/dd 39 2024-03-16T10:53:25.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/578: write d4/d6/db/d66/d2e/fa9 [111368,26276] 0 2024-03-16T10:53:25.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/579: chown d4/dd/d38 1141 1 2024-03-16T10:53:25.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/580: truncate d4/dd/df/f77 322869 0 2024-03-16T10:53:25.876 INFO:tasks.workunit.client.0.smithi017.stdout:8/756: mknod d6/d39/da9/cf2 0 2024-03-16T10:53:25.876 INFO:tasks.workunit.client.0.smithi017.stdout:8/757: fsync d6/d14/d8c/f80 0 2024-03-16T10:53:25.876 INFO:tasks.workunit.client.0.smithi017.stdout:8/758: readlink d6/d5c/lcf 0 2024-03-16T10:53:25.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/696: link d7/db/d12/d1c/d30/f9e d7/db/dc/d50/d59/d34/dbb/fe3 0 2024-03-16T10:53:25.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/831: write d0/d1/d1f/f50 [2593849,15292] 0 2024-03-16T10:53:25.880 INFO:tasks.workunit.client.0.smithi017.stdout:3/628: rmdir d8/d1b/d2e/d60 39 2024-03-16T10:53:25.881 INFO:tasks.workunit.client.0.smithi017.stdout:1/857: link d1/d3/dd/d72/d8f/dbe/f108 d1/d3/dd/d9f/d111/f120 0 2024-03-16T10:53:25.881 INFO:tasks.workunit.client.0.smithi017.stdout:3/629: stat d8/d1b/d2e/d57/f89 0 2024-03-16T10:53:25.883 INFO:tasks.workunit.client.0.smithi017.stdout:1/858: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/f121 x:0 0 0 2024-03-16T10:53:25.883 INFO:tasks.workunit.client.0.smithi017.stdout:2/581: dread d4/d6/db/d66/d2e/f8b [0,4194304] 0 2024-03-16T10:53:25.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/582: getdents d4/d6/db/d24/d39/d7d/db3 0 2024-03-16T10:53:25.884 INFO:tasks.workunit.client.0.smithi017.stdout:9/607: link d8/df/d5b/cab d8/dbf/d68/d98/cc3 0 2024-03-16T10:53:25.885 INFO:tasks.workunit.client.0.smithi017.stdout:7/697: getdents d7/d8a/d66 0 2024-03-16T10:53:25.885 INFO:tasks.workunit.client.0.smithi017.stdout:7/698: chown d7/db/d12/d1c/d4e/l5d 42797 1 2024-03-16T10:53:25.886 INFO:tasks.workunit.client.0.smithi017.stdout:2/583: truncate d4/dd/d1e/f36 461055 0 2024-03-16T10:53:25.888 INFO:tasks.workunit.client.0.smithi017.stdout:4/814: symlink d15/d1d/d21/db1/db5/l116 0 2024-03-16T10:53:25.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/584: creat d4/d6/db/d66/fb5 x:0 0 0 2024-03-16T10:53:25.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/585: fdatasync d4/d6/db/f7a 0 2024-03-16T10:53:25.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/586: dread - d4/d6/d81/fa2 zero size 2024-03-16T10:53:25.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/587: dread - d4/dd/d1e/d4a/fa8 zero size 2024-03-16T10:53:25.892 INFO:tasks.workunit.client.0.smithi017.stdout:4/815: mkdir d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/d117 0 2024-03-16T10:53:25.892 INFO:tasks.workunit.client.0.smithi017.stdout:1/859: dwrite d1/d3/dd/d9f/fad [0,4194304] 0 2024-03-16T10:53:25.892 INFO:tasks.workunit.client.0.smithi017.stdout:4/816: write d15/d1d/d27/f3b [1200800,103463] 0 2024-03-16T10:53:25.892 INFO:tasks.workunit.client.0.smithi017.stdout:4/817: dread - d15/d1d/d21/d3c/de9/d43/f8d zero size 2024-03-16T10:53:25.896 INFO:tasks.workunit.client.0.smithi017.stdout:5/832: rename d0/d1/d2/dc/d68/lbc to d0/d1/d30/dde/d57/l117 0 2024-03-16T10:53:25.897 INFO:tasks.workunit.client.0.smithi017.stdout:5/833: truncate d0/d1/d2/d2c/d36/d41/f8e 978966 0 2024-03-16T10:53:25.898 INFO:tasks.workunit.client.0.smithi017.stdout:3/630: unlink d8/l5f 0 2024-03-16T10:53:25.899 INFO:tasks.workunit.client.0.smithi017.stdout:9/608: creat d8/df/d5b/daf/db7/fc4 x:0 0 0 2024-03-16T10:53:25.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/699: creat d7/db/d32/d78/da5/fe4 x:0 0 0 2024-03-16T10:53:25.902 INFO:tasks.workunit.client.0.smithi017.stdout:4/818: symlink d15/d1d/d21/d26/l118 0 2024-03-16T10:53:25.903 INFO:tasks.workunit.client.0.smithi017.stdout:7/700: creat d7/db/dc/d50/d59/d34/fe5 x:0 0 0 2024-03-16T10:53:25.903 INFO:tasks.workunit.client.0.smithi017.stdout:5/834: truncate d0/d5d/f90 86360 0 2024-03-16T10:53:25.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/631: rename d8/da/db/f19 to d8/d1b/d1c/d62/d69/fb8 0 2024-03-16T10:53:25.907 INFO:tasks.workunit.client.0.smithi017.stdout:4/819: symlink d15/d1d/d21/d3c/de9/d40/l119 0 2024-03-16T10:53:25.908 INFO:tasks.workunit.client.0.smithi017.stdout:7/701: creat d7/d8a/d66/fe6 x:0 0 0 2024-03-16T10:53:25.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/820: creat d15/d1d/d21/d26/dfe/f11a x:0 0 0 2024-03-16T10:53:25.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/609: dwrite d8/df/d5b/d32/f73 [0,4194304] 0 2024-03-16T10:53:25.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/610: fsync d8/df/d5b/f6f 0 2024-03-16T10:53:25.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/611: write d8/df/d5b/daf/db7/fc4 [561073,122305] 0 2024-03-16T10:53:25.918 INFO:tasks.workunit.client.0.smithi017.stdout:9/612: write d8/f30 [2275744,81201] 0 2024-03-16T10:53:25.921 INFO:tasks.workunit.client.0.smithi017.stdout:7/702: mknod d7/db/d12/d96/ce7 0 2024-03-16T10:53:25.923 INFO:tasks.workunit.client.0.smithi017.stdout:4/821: symlink d15/d1d/daf/l11b 0 2024-03-16T10:53:25.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/632: dwrite d8/d1b/d1c/f26 [0,4194304] 0 2024-03-16T10:53:25.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/633: truncate d8/d1b/d2e/d8d/f82 823685 0 2024-03-16T10:53:25.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/613: creat d8/df/d46/d63/d94/d9d/fc5 x:0 0 0 2024-03-16T10:53:25.932 INFO:tasks.workunit.client.0.smithi017.stdout:7/703: creat d7/db/d81/fe8 x:0 0 0 2024-03-16T10:53:25.935 INFO:tasks.workunit.client.0.smithi017.stdout:7/704: mkdir d7/de9 0 2024-03-16T10:53:25.935 INFO:tasks.workunit.client.0.smithi017.stdout:3/634: write d8/d3f/d3d/f5b [2454869,129852] 0 2024-03-16T10:53:25.935 INFO:tasks.workunit.client.0.smithi017.stdout:7/705: rename d7/db/d12 to d7/db/d12/d1c/d4e/dbc/dea 22 2024-03-16T10:53:25.939 INFO:tasks.workunit.client.0.smithi017.stdout:3/635: creat d8/d1b/d65/da6/fb9 x:0 0 0 2024-03-16T10:53:25.941 INFO:tasks.workunit.client.0.smithi017.stdout:4/822: dwrite d15/d1d/d21/d26/f33 [0,4194304] 0 2024-03-16T10:53:25.942 INFO:tasks.workunit.client.0.smithi017.stdout:9/614: dread d8/df/f4f [0,4194304] 0 2024-03-16T10:53:25.942 INFO:tasks.workunit.client.0.smithi017.stdout:9/615: fdatasync d8/df/d46/d63/f6b 0 2024-03-16T10:53:25.942 INFO:tasks.workunit.client.0.smithi017.stdout:3/636: creat d8/d1b/d2e/fba x:0 0 0 2024-03-16T10:53:25.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/823: truncate d15/d1d/d21/d3c/de9/d43/f9e 2904362 0 2024-03-16T10:53:25.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/824: fdatasync d15/d1d/d21/d3c/de9/d40/d51/f71 0 2024-03-16T10:53:25.946 INFO:tasks.workunit.client.0.smithi017.stdout:2/588: dwrite d4/d6/d30/f7c [0,4194304] 0 2024-03-16T10:53:25.946 INFO:tasks.workunit.client.0.smithi017.stdout:9/616: truncate d8/df/d5b/f8c 225134 0 2024-03-16T10:53:25.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/637: creat d8/d1b/d2e/fbb x:0 0 0 2024-03-16T10:53:25.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/638: chown d8/d1b/d2e/fae 286636496 1 2024-03-16T10:53:25.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/639: write d8/d1b/d1c/f41 [2413134,119051] 0 2024-03-16T10:53:25.951 INFO:tasks.workunit.client.0.smithi017.stdout:4/825: unlink d15/d1d/d27/f6b 0 2024-03-16T10:53:25.952 INFO:tasks.workunit.client.0.smithi017.stdout:7/706: dwrite d7/db/dc/d50/d73/fba [0,4194304] 0 2024-03-16T10:53:25.952 INFO:tasks.workunit.client.0.smithi017.stdout:7/707: chown d7/db/d32/l4d 833876 1 2024-03-16T10:53:25.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/640: symlink d8/d3f/d3d/lbc 0 2024-03-16T10:53:25.959 INFO:tasks.workunit.client.0.smithi017.stdout:2/589: mkdir d4/d6/db/d24/db6 0 2024-03-16T10:53:25.960 INFO:tasks.workunit.client.0.smithi017.stdout:2/590: creat d4/d6/db/d66/daf/fb7 x:0 0 0 2024-03-16T10:53:25.960 INFO:tasks.workunit.client.0.smithi017.stdout:2/591: fsync d4/d6/db/d66/fb5 0 2024-03-16T10:53:25.963 INFO:tasks.workunit.client.0.smithi017.stdout:7/708: getdents d7/db/d32/d78 0 2024-03-16T10:53:25.963 INFO:tasks.workunit.client.0.smithi017.stdout:7/709: chown d7/db/dc/d50/f87 0 1 2024-03-16T10:53:25.963 INFO:tasks.workunit.client.0.smithi017.stdout:7/710: chown d7/db/d32/f54 3092863 1 2024-03-16T10:53:25.963 INFO:tasks.workunit.client.0.smithi017.stdout:4/826: dwrite d15/d1d/d21/d3c/de9/d96/fc8 [0,4194304] 0 2024-03-16T10:53:25.965 INFO:tasks.workunit.client.0.smithi017.stdout:3/641: symlink d8/da/db/lbd 0 2024-03-16T10:53:25.965 INFO:tasks.workunit.client.0.smithi017.stdout:3/642: chown d8/d1b/d1c 283439 1 2024-03-16T10:53:25.967 INFO:tasks.workunit.client.0.smithi017.stdout:7/711: creat d7/db/dc/d50/feb x:0 0 0 2024-03-16T10:53:25.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/827: truncate d15/d1d/d21/d3c/f97 3040101 0 2024-03-16T10:53:25.974 INFO:tasks.workunit.client.0.smithi017.stdout:7/712: readlink d7/db/d12/ddf/l90 0 2024-03-16T10:53:25.975 INFO:tasks.workunit.client.0.smithi017.stdout:4/828: mknod d15/d1d/d21/d26/d66/d8c/c11c 0 2024-03-16T10:53:25.976 INFO:tasks.workunit.client.0.smithi017.stdout:3/643: rmdir d8/d3f 39 2024-03-16T10:53:25.977 INFO:tasks.workunit.client.0.smithi017.stdout:2/592: dwrite d4/dd/d1e/f89 [0,4194304] 0 2024-03-16T10:53:25.981 INFO:tasks.workunit.client.0.smithi017.stdout:7/713: creat d7/db/d12/d1c/fec x:0 0 0 2024-03-16T10:53:25.983 INFO:tasks.workunit.client.0.smithi017.stdout:3/644: creat d8/d1b/d1c/d62/fbe x:0 0 0 2024-03-16T10:53:25.988 INFO:tasks.workunit.client.0.smithi017.stdout:3/645: creat d8/fbf x:0 0 0 2024-03-16T10:53:25.990 INFO:tasks.workunit.client.0.smithi017.stdout:7/714: rename d7/db/dc/l1e to d7/db/dc/d50/d59/led 0 2024-03-16T10:53:25.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/593: dwrite d4/d6/db/d24/d39/fa5 [0,4194304] 0 2024-03-16T10:53:25.999 INFO:tasks.workunit.client.0.smithi017.stdout:7/715: dwrite d7/db/dc/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:26.005 INFO:tasks.workunit.client.0.smithi017.stdout:3/646: rename d8/d1b/d2e/d8d/d87/la0 to d8/d1b/d2e/d57/lc0 0 2024-03-16T10:53:26.007 INFO:tasks.workunit.client.0.smithi017.stdout:3/647: creat d8/d1b/d65/da6/fc1 x:0 0 0 2024-03-16T10:53:26.008 INFO:tasks.workunit.client.0.smithi017.stdout:7/716: dwrite d7/db/d32/dc5/fce [0,4194304] 0 2024-03-16T10:53:26.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/717: fdatasync d7/f7a 0 2024-03-16T10:53:26.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/718: chown d7/d8a/f64 489 1 2024-03-16T10:53:26.014 INFO:tasks.workunit.client.0.smithi017.stdout:3/648: dread d8/da/f93 [0,4194304] 0 2024-03-16T10:53:26.016 INFO:tasks.workunit.client.0.smithi017.stdout:3/649: creat d8/d1b/d65/da6/fc2 x:0 0 0 2024-03-16T10:53:26.021 INFO:tasks.workunit.client.0.smithi017.stdout:6/610: sync 2024-03-16T10:53:26.024 INFO:tasks.workunit.client.0.smithi017.stdout:6/611: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f27 1818505 0 2024-03-16T10:53:26.024 INFO:tasks.workunit.client.0.smithi017.stdout:6/612: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fa9 0 1 2024-03-16T10:53:26.024 INFO:tasks.workunit.client.0.smithi017.stdout:6/613: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d86/dad 0 2024-03-16T10:53:26.026 INFO:tasks.workunit.client.0.smithi017.stdout:2/594: rename d4/d6/db/l6b to d4/d6/db/d66/daf/lb8 0 2024-03-16T10:53:26.026 INFO:tasks.workunit.client.0.smithi017.stdout:2/595: write d4/d6/db/d24/d39/f76 [111267,22535] 0 2024-03-16T10:53:26.026 INFO:tasks.workunit.client.0.smithi017.stdout:6/614: creat d0/d21/d39/d44/d9a/da7/d96/fbf x:0 0 0 2024-03-16T10:53:26.026 INFO:tasks.workunit.client.0.smithi017.stdout:6/615: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/faf zero size 2024-03-16T10:53:26.027 INFO:tasks.workunit.client.0.smithi017.stdout:6/616: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fb8 zero size 2024-03-16T10:53:26.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/617: mknod d0/cc0 0 2024-03-16T10:53:26.028 INFO:tasks.workunit.client.0.smithi017.stdout:7/719: dwrite d7/db/dc/d50/d59/d34/d95/fa2 [0,4194304] 0 2024-03-16T10:53:26.028 INFO:tasks.workunit.client.0.smithi017.stdout:7/720: dread - d7/db/dc/d50/d59/d34/fe5 zero size 2024-03-16T10:53:26.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/721: mkdir d7/db/dc/d50/d59/d34/d53/dee 0 2024-03-16T10:53:26.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/722: symlink d7/db/dc/d50/d59/d34/d95/lef 0 2024-03-16T10:53:26.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/723: fsync d7/db/f14 0 2024-03-16T10:53:26.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/724: chown d7/db/d32/l75 208085 1 2024-03-16T10:53:26.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/725: chown d7/c3b 8454229 1 2024-03-16T10:53:26.034 INFO:tasks.workunit.client.0.smithi017.stdout:6/618: getdents d0 0 2024-03-16T10:53:26.034 INFO:tasks.workunit.client.0.smithi017.stdout:3/650: dwrite d8/d1b/d1c/d62/d69/f78 [4194304,4194304] 0 2024-03-16T10:53:26.034 INFO:tasks.workunit.client.0.smithi017.stdout:3/651: read - d8/d1d/dab/fb6 zero size 2024-03-16T10:53:26.037 INFO:tasks.workunit.client.0.smithi017.stdout:3/652: creat d8/d1b/d2e/d8d/fc3 x:0 0 0 2024-03-16T10:53:26.037 INFO:tasks.workunit.client.0.smithi017.stdout:3/653: write d8/d1b/d65/f9b [4302573,72094] 0 2024-03-16T10:53:26.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/726: unlink d7/db/dc/d50/d59/d34/f44 0 2024-03-16T10:53:26.041 INFO:tasks.workunit.client.0.smithi017.stdout:3/654: dread d8/d1b/d2e/fae [0,4194304] 0 2024-03-16T10:53:26.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/727: symlink d7/db/d12/d96/lf0 0 2024-03-16T10:53:26.042 INFO:tasks.workunit.client.0.smithi017.stdout:3/655: mkdir d8/d1d/dab/dc4 0 2024-03-16T10:53:26.043 INFO:tasks.workunit.client.0.smithi017.stdout:7/728: symlink d7/lf1 0 2024-03-16T10:53:26.043 INFO:tasks.workunit.client.0.smithi017.stdout:7/729: write d7/d8a/f39 [4609702,40782] 0 2024-03-16T10:53:26.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/730: mknod d7/db/dc/d50/d73/cf2 0 2024-03-16T10:53:26.052 INFO:tasks.workunit.client.0.smithi017.stdout:7/731: write d7/db/d81/f91 [2905015,4496] 0 2024-03-16T10:53:26.052 INFO:tasks.workunit.client.0.smithi017.stdout:7/732: fdatasync d7/db/d32/f54 0 2024-03-16T10:53:26.052 INFO:tasks.workunit.client.0.smithi017.stdout:7/733: write d7/db/d81/f91 [1286723,47762] 0 2024-03-16T10:53:26.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/596: rename d4/d6/d81/d8f/f99 to d4/d6/db/d66/d93/d63/fb9 0 2024-03-16T10:53:26.057 INFO:tasks.workunit.client.0.smithi017.stdout:2/597: mkdir d4/d6/d30/d3f/dba 0 2024-03-16T10:53:26.059 INFO:tasks.workunit.client.0.smithi017.stdout:2/598: creat d4/d6/db/d66/d2e/fbb x:0 0 0 2024-03-16T10:53:26.060 INFO:tasks.workunit.client.0.smithi017.stdout:3/656: dwrite d8/d3f/f3b [4194304,4194304] 0 2024-03-16T10:53:26.061 INFO:tasks.workunit.client.0.smithi017.stdout:7/734: dread d7/db/dc/d50/d73/fb6 [0,4194304] 0 2024-03-16T10:53:26.062 INFO:tasks.workunit.client.0.smithi017.stdout:3/657: symlink d8/d1b/d2e/d60/d63/lc5 0 2024-03-16T10:53:26.062 INFO:tasks.workunit.client.0.smithi017.stdout:3/658: write d8/da/f66 [4805504,24303] 0 2024-03-16T10:53:26.062 INFO:tasks.workunit.client.0.smithi017.stdout:7/735: write d7/db/dc/d50/d59/f61 [886730,46143] 0 2024-03-16T10:53:26.062 INFO:tasks.workunit.client.0.smithi017.stdout:7/736: chown d7/d8a 663706 1 2024-03-16T10:53:26.065 INFO:tasks.workunit.client.0.smithi017.stdout:3/659: creat d8/d3f/fc6 x:0 0 0 2024-03-16T10:53:26.065 INFO:tasks.workunit.client.0.smithi017.stdout:3/660: stat d8/d1b/d2e/f3e 0 2024-03-16T10:53:26.066 INFO:tasks.workunit.client.0.smithi017.stdout:3/661: creat d8/d1b/d2e/d8d/fc7 x:0 0 0 2024-03-16T10:53:26.066 INFO:tasks.workunit.client.0.smithi017.stdout:3/662: fsync d8/d1b/d2e/d8d/f7b 0 2024-03-16T10:53:26.066 INFO:tasks.workunit.client.0.smithi017.stdout:7/737: dread d7/db/dc/d50/d59/f61 [0,4194304] 0 2024-03-16T10:53:26.068 INFO:tasks.workunit.client.0.smithi017.stdout:3/663: creat d8/d1b/d2e/d8d/fc8 x:0 0 0 2024-03-16T10:53:26.073 INFO:tasks.workunit.client.0.smithi017.stdout:7/738: dread d7/db/dc/d50/f7c [0,4194304] 0 2024-03-16T10:53:26.075 INFO:tasks.workunit.client.0.smithi017.stdout:3/664: dread d8/d1b/d2e/d8d/f7b [0,4194304] 0 2024-03-16T10:53:26.076 INFO:tasks.workunit.client.0.smithi017.stdout:3/665: dread - d8/d3f/fc6 zero size 2024-03-16T10:53:26.080 INFO:tasks.workunit.client.0.smithi017.stdout:3/666: getdents d8/d1b/d2e/d57 0 2024-03-16T10:53:26.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/599: rename d4/d6/db/d66/d2e/f59 to d4/dd/d1e/d3e/fbc 0 2024-03-16T10:53:26.083 INFO:tasks.workunit.client.0.smithi017.stdout:7/739: rename d7 to d7/d8a/d66/dad/df3 22 2024-03-16T10:53:26.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/600: fsync d4/dd/d1e/f36 0 2024-03-16T10:53:26.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/740: truncate d7/d8a/fb2 4123154 0 2024-03-16T10:53:26.085 INFO:tasks.workunit.client.0.smithi017.stdout:2/601: rmdir d4/d6/db/d24/d39/d7d/db3 0 2024-03-16T10:53:26.092 INFO:tasks.workunit.client.0.smithi017.stdout:3/667: dwrite d8/d1b/d1c/f88 [0,4194304] 0 2024-03-16T10:53:26.098 INFO:tasks.workunit.client.0.smithi017.stdout:3/668: link d8/d1b/d1c/d62/f7d d8/d8c/fc9 0 2024-03-16T10:53:26.100 INFO:tasks.workunit.client.0.smithi017.stdout:7/741: dwrite d7/db/dc/d50/d59/f7e [0,4194304] 0 2024-03-16T10:53:26.103 INFO:tasks.workunit.client.0.smithi017.stdout:7/742: dread d7/db/f52 [0,4194304] 0 2024-03-16T10:53:26.105 INFO:tasks.workunit.client.0.smithi017.stdout:7/743: mkdir d7/db/dc/d50/d59/d34/d95/df4 0 2024-03-16T10:53:26.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/744: write d7/db/dc/f10 [3921891,93709] 0 2024-03-16T10:53:26.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/745: write d7/db/d12/d1c/d30/fb9 [394856,23753] 0 2024-03-16T10:53:26.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/746: write d7/db/d81/fd3 [8794110,30835] 0 2024-03-16T10:53:26.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/747: dread - d7/db/d32/d78/fcf zero size 2024-03-16T10:53:26.112 INFO:tasks.workunit.client.0.smithi017.stdout:7/748: chown d7/db/dc/d50/d59/c76 15 1 2024-03-16T10:53:26.112 INFO:tasks.workunit.client.0.smithi017.stdout:3/669: dwrite d8/d1d/f46 [0,4194304] 0 2024-03-16T10:53:26.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/749: rename d7/d8a/fb0 to d7/db/dc/d50/da8/ff5 0 2024-03-16T10:53:26.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/750: readlink d7/db/d12/le0 0 2024-03-16T10:53:26.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/670: dread d8/d1b/d1c/d62/f7d [0,4194304] 0 2024-03-16T10:53:26.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/671: symlink d8/d1b/d65/lca 0 2024-03-16T10:53:26.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/672: read d8/d1b/f8a [90358,125297] 0 2024-03-16T10:53:26.126 INFO:tasks.workunit.client.0.smithi017.stdout:3/673: symlink d8/d3f/d3d/lcb 0 2024-03-16T10:53:26.127 INFO:tasks.workunit.client.0.smithi017.stdout:3/674: dread - d8/d1b/d1c/d62/d69/f83 zero size 2024-03-16T10:53:26.127 INFO:tasks.workunit.client.0.smithi017.stdout:3/675: write d8/d1b/d2e/d57/f89 [641173,123598] 0 2024-03-16T10:53:26.128 INFO:tasks.workunit.client.0.smithi017.stdout:0/811: sync 2024-03-16T10:53:26.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/751: dwrite d7/db/d12/ddf/f86 [0,4194304] 0 2024-03-16T10:53:26.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/752: stat d7/db/dc/d50/d59/d34/d95/fde 0 2024-03-16T10:53:26.136 INFO:tasks.workunit.client.0.smithi017.stdout:7/753: dread d7/d8a/d66/dad/fb5 [0,4194304] 0 2024-03-16T10:53:26.136 INFO:tasks.workunit.client.0.smithi017.stdout:7/754: write d7/db/dc/d50/d59/d34/fe5 [684513,79991] 0 2024-03-16T10:53:26.137 INFO:tasks.workunit.client.0.smithi017.stdout:7/755: creat d7/db/dc/d60/ff6 x:0 0 0 2024-03-16T10:53:26.139 INFO:tasks.workunit.client.0.smithi017.stdout:7/756: symlink d7/db/dc/d50/da8/dca/lf7 0 2024-03-16T10:53:26.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/812: rename d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/f9c to d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f11c 0 2024-03-16T10:53:26.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/813: chown d2/d4/d6d/d84/dc1/dd2/d24/d72/d101 445136590 1 2024-03-16T10:53:26.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/814: chown d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/leb 1340562102 1 2024-03-16T10:53:26.140 INFO:tasks.workunit.client.0.smithi017.stdout:0/815: read - d2/d4/d6d/d84/dc1/fc6 zero size 2024-03-16T10:53:26.140 INFO:tasks.workunit.client.0.smithi017.stdout:7/757: mkdir d7/db/dc/d50/df8 0 2024-03-16T10:53:26.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/758: mkdir d7/de9/df9 0 2024-03-16T10:53:26.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/759: write d7/db/dc/d50/d59/d34/fb1 [814168,27032] 0 2024-03-16T10:53:26.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/816: mkdir d2/d4/d6d/d84/d11d 0 2024-03-16T10:53:26.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/760: mkdir d7/db/dc/d50/d59/d34/d95/da3/dfa 0 2024-03-16T10:53:26.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/761: mkdir d7/db/dc/dae/ddb/dfb 0 2024-03-16T10:53:26.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/762: truncate d7/d8a/f64 4519328 0 2024-03-16T10:53:26.144 INFO:tasks.workunit.client.0.smithi017.stdout:0/817: symlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d88/l11e 0 2024-03-16T10:53:26.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/763: creat d7/db/d12/d1c/d4e/ffc x:0 0 0 2024-03-16T10:53:26.146 INFO:tasks.workunit.client.0.smithi017.stdout:7/764: mknod d7/db/dc/d50/d59/d34/d53/cfd 0 2024-03-16T10:53:26.151 INFO:tasks.workunit.client.0.smithi017.stdout:0/818: write d2/d4/d61/f78 [3070713,106024] 0 2024-03-16T10:53:26.152 INFO:tasks.workunit.client.0.smithi017.stdout:7/765: read d7/db/d12/ddf/f86 [3293400,36654] 0 2024-03-16T10:53:26.153 INFO:tasks.workunit.client.0.smithi017.stdout:0/819: mkdir d2/d4/d6d/d84/dc1/d11f 0 2024-03-16T10:53:26.154 INFO:tasks.workunit.client.0.smithi017.stdout:7/766: write d7/db/d12/d1c/d30/fa7 [28986,108352] 0 2024-03-16T10:53:26.156 INFO:tasks.workunit.client.0.smithi017.stdout:7/767: mkdir d7/d8a/d66/dfe 0 2024-03-16T10:53:26.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/820: rename d2/d4/d6d/d84/dc1/dd2/de/d1e/f9f to d2/d4/d6d/d84/dc1/dd2/d24/d3a/f120 0 2024-03-16T10:53:26.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/821: chown d2/f8c 15643530 1 2024-03-16T10:53:26.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/822: read - d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f110 zero size 2024-03-16T10:53:26.160 INFO:tasks.workunit.client.0.smithi017.stdout:7/768: dread d7/db/f28 [0,4194304] 0 2024-03-16T10:53:26.162 INFO:tasks.workunit.client.0.smithi017.stdout:7/769: creat d7/db/dc/d50/d59/daf/fff x:0 0 0 2024-03-16T10:53:26.164 INFO:tasks.workunit.client.0.smithi017.stdout:7/770: getdents d7/db 0 2024-03-16T10:53:26.170 INFO:tasks.workunit.client.0.smithi017.stdout:0/823: dwrite d2/d4/d6d/ff5 [0,4194304] 0 2024-03-16T10:53:26.170 INFO:tasks.workunit.client.0.smithi017.stdout:0/824: read - d2/d4/d6d/d84/dc1/dd2/d24/ff0 zero size 2024-03-16T10:53:26.170 INFO:tasks.workunit.client.0.smithi017.stdout:0/825: dread - d2/d4/d6d/d84/dc1/dd2/d24/ff0 zero size 2024-03-16T10:53:26.170 INFO:tasks.workunit.client.0.smithi017.stdout:0/826: truncate d2/d4/d6d/fda 454998 0 2024-03-16T10:53:26.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/827: mknod d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/c121 0 2024-03-16T10:53:26.177 INFO:tasks.workunit.client.0.smithi017.stdout:7/771: dwrite d7/db/d12/d1c/f36 [4194304,4194304] 0 2024-03-16T10:53:26.189 INFO:tasks.workunit.client.0.smithi017.stdout:0/828: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d29/f40 [0,4194304] 0 2024-03-16T10:53:26.189 INFO:tasks.workunit.client.0.smithi017.stdout:0/829: chown d2/d4/d6d/d84/dc1/dd2 7913 1 2024-03-16T10:53:26.192 INFO:tasks.workunit.client.0.smithi017.stdout:7/772: dwrite d7/db/d12/d1c/d4e/dbc/fc8 [0,4194304] 0 2024-03-16T10:53:26.192 INFO:tasks.workunit.client.0.smithi017.stdout:7/773: write d7/db/d12/d1c/d30/fa7 [1764042,105319] 0 2024-03-16T10:53:26.192 INFO:tasks.workunit.client.0.smithi017.stdout:7/774: readlink d7/l4a 0 2024-03-16T10:53:26.195 INFO:tasks.workunit.client.0.smithi017.stdout:7/775: symlink d7/db/dc/d60/l100 0 2024-03-16T10:53:26.196 INFO:tasks.workunit.client.0.smithi017.stdout:7/776: chown d7/db/dc/d50/d59/d34/d53/cfd 5581252 1 2024-03-16T10:53:26.207 INFO:tasks.workunit.client.0.smithi017.stdout:0/830: dwrite d2/d4/d90/d86/db7/fc4 [0,4194304] 0 2024-03-16T10:53:26.208 INFO:tasks.workunit.client.0.smithi017.stdout:0/831: chown d2/d4/c7d 1 1 2024-03-16T10:53:26.209 INFO:tasks.workunit.client.0.smithi017.stdout:7/777: dwrite d7/d8a/d66/dad/fb5 [4194304,4194304] 0 2024-03-16T10:53:26.210 INFO:tasks.workunit.client.0.smithi017.stdout:0/832: creat d2/d4/d90/d86/f122 x:0 0 0 2024-03-16T10:53:26.211 INFO:tasks.workunit.client.0.smithi017.stdout:7/778: mkdir d7/db/dc/d50/df8/d101 0 2024-03-16T10:53:26.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/833: rename d2/d4/d6d/d84/dc1/dd2/d24/d29/c70 to d2/d4/d6d/d84/dc1/dd2/de/d1e/c123 0 2024-03-16T10:53:26.219 INFO:tasks.workunit.client.0.smithi017.stdout:7/779: rename d7/db/dc/d50/d59/daf/fff to d7/de9/df9/f102 0 2024-03-16T10:53:26.221 INFO:tasks.workunit.client.0.smithi017.stdout:7/780: rename d7/d9f to d7/db/d12/d1c/d30/d103 0 2024-03-16T10:53:26.235 INFO:tasks.workunit.client.0.smithi017.stdout:0/834: rename d2/d4/ce5 to d2/d4/d6d/d84/dc1/dd2/d24/d3a/c124 0 2024-03-16T10:53:26.237 INFO:tasks.workunit.client.0.smithi017.stdout:0/835: creat d2/d4/d6d/d84/dc1/f125 x:0 0 0 2024-03-16T10:53:26.237 INFO:tasks.workunit.client.0.smithi017.stdout:0/836: symlink d2/d4/d6d/dde/l126 0 2024-03-16T10:53:26.239 INFO:tasks.workunit.client.0.smithi017.stdout:0/837: symlink d2/d4/d6d/d84/de9/l127 0 2024-03-16T10:53:26.240 INFO:tasks.workunit.client.0.smithi017.stdout:0/838: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/f128 x:0 0 0 2024-03-16T10:53:26.241 INFO:tasks.workunit.client.0.smithi017.stdout:0/839: creat d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/f129 x:0 0 0 2024-03-16T10:53:26.254 INFO:tasks.workunit.client.0.smithi017.stdout:0/840: link d2/d4/d90/d86/db7/dc0/ced d2/d4/d6d/d115/d117/c12a 0 2024-03-16T10:53:26.256 INFO:tasks.workunit.client.0.smithi017.stdout:0/841: creat d2/d4/d6d/d84/dc1/dd2/de/d1e/f12b x:0 0 0 2024-03-16T10:53:26.257 INFO:tasks.workunit.client.0.smithi017.stdout:0/842: rmdir d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/d108 0 2024-03-16T10:53:26.257 INFO:tasks.workunit.client.0.smithi017.stdout:0/843: write d2/d4/d90/d86/f122 [576929,124009] 0 2024-03-16T10:53:26.259 INFO:tasks.workunit.client.0.smithi017.stdout:0/844: truncate d2/d4/d6d/d84/dc1/dd2/de/d1e/f36 2822570 0 2024-03-16T10:53:26.259 INFO:tasks.workunit.client.0.smithi017.stdout:0/845: chown d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f119 4672 1 2024-03-16T10:53:26.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/846: dwrite d2/d4/d6d/d84/de9/ffa [0,4194304] 0 2024-03-16T10:53:26.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/847: truncate d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f110 345573 0 2024-03-16T10:53:26.275 INFO:tasks.workunit.client.0.smithi017.stdout:0/848: mkdir d2/d4/d12c 0 2024-03-16T10:53:26.278 INFO:tasks.workunit.client.0.smithi017.stdout:0/849: unlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/lbf 0 2024-03-16T10:53:26.290 INFO:tasks.workunit.client.0.smithi017.stdout:0/850: dwrite d2/d4/d6d/d84/dc1/dd2/d24/f113 [0,4194304] 0 2024-03-16T10:53:26.292 INFO:tasks.workunit.client.0.smithi017.stdout:0/851: creat d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f12d x:0 0 0 2024-03-16T10:53:26.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/852: mknod d2/d4/d90/d10b/c12e 0 2024-03-16T10:53:26.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/853: chown d2/d4/d6d/d84/dc1/dd2/d24/d72 47 1 2024-03-16T10:53:26.295 INFO:tasks.workunit.client.0.smithi017.stdout:0/854: mkdir d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/df4/d12f 0 2024-03-16T10:53:26.295 INFO:tasks.workunit.client.0.smithi017.stdout:0/855: chown d2/d4/d6d/dde/f10a 78581 1 2024-03-16T10:53:26.296 INFO:tasks.workunit.client.0.smithi017.stdout:0/856: symlink d2/d4/d6d/d84/dc1/dd2/l130 0 2024-03-16T10:53:26.296 INFO:tasks.workunit.client.0.smithi017.stdout:0/857: read - d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe4 zero size 2024-03-16T10:53:26.296 INFO:tasks.workunit.client.0.smithi017.stdout:0/858: fsync f0 0 2024-03-16T10:53:26.297 INFO:tasks.workunit.client.0.smithi017.stdout:0/859: symlink d2/d4/d6d/d84/d11d/l131 0 2024-03-16T10:53:26.316 INFO:tasks.workunit.client.0.smithi017.stdout:1/860: sync 2024-03-16T10:53:26.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/759: sync 2024-03-16T10:53:26.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/760: stat d6/d16/db3/cc4 0 2024-03-16T10:53:26.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/761: stat d6/d14/d6b/fe6 0 2024-03-16T10:53:26.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/762: stat d6/d39/da9/dcc 0 2024-03-16T10:53:26.324 INFO:tasks.workunit.client.0.smithi017.stdout:1/861: dread d1/d3/dd/d31/d35/f75 [0,4194304] 0 2024-03-16T10:53:26.328 INFO:tasks.workunit.client.0.smithi017.stdout:8/763: dwrite d6/d5f/d6e/d34/f52 [0,4194304] 0 2024-03-16T10:53:26.328 INFO:tasks.workunit.client.0.smithi017.stdout:8/764: chown d6/d5c/c74 21729239 1 2024-03-16T10:53:26.331 INFO:tasks.workunit.client.0.smithi017.stdout:8/765: creat d6/d5f/d6e/d34/db4/ff3 x:0 0 0 2024-03-16T10:53:26.332 INFO:tasks.workunit.client.0.smithi017.stdout:8/766: dread d6/d14/d6b/f6f [0,4194304] 0 2024-03-16T10:53:26.333 INFO:tasks.workunit.client.0.smithi017.stdout:8/767: write d6/d16/fc7 [163792,74351] 0 2024-03-16T10:53:26.349 INFO:tasks.workunit.client.0.smithi017.stdout:8/768: dwrite d6/d16/db3/dcb/f46 [0,4194304] 0 2024-03-16T10:53:26.350 INFO:tasks.workunit.client.0.smithi017.stdout:8/769: fdatasync d6/d14/d8c/f80 0 2024-03-16T10:53:26.350 INFO:tasks.workunit.client.0.smithi017.stdout:8/770: mknod d6/d16/db3/cf4 0 2024-03-16T10:53:26.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/771: dwrite d6/d5f/d6e/d34/f3f [0,4194304] 0 2024-03-16T10:53:26.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/772: creat d6/d4a/ff5 x:0 0 0 2024-03-16T10:53:26.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/773: chown d6/d5c/d96/fa2 1264788 1 2024-03-16T10:53:26.366 INFO:tasks.workunit.client.0.smithi017.stdout:5/835: sync 2024-03-16T10:53:26.367 INFO:tasks.workunit.client.0.smithi017.stdout:0/860: rename d2/d4/d6d/d84/d11d/l131 to d2/d4/d61/de0/l132 0 2024-03-16T10:53:26.367 INFO:tasks.workunit.client.0.smithi017.stdout:5/836: write d0/d1/d1f/f50 [2093280,106349] 0 2024-03-16T10:53:26.369 INFO:tasks.workunit.client.0.smithi017.stdout:8/774: mknod d6/d39/da9/dcc/cf6 0 2024-03-16T10:53:26.371 INFO:tasks.workunit.client.0.smithi017.stdout:8/775: write d6/fba [442114,20141] 0 2024-03-16T10:53:26.385 INFO:tasks.workunit.client.0.smithi017.stdout:8/776: dwrite d6/f4e [0,4194304] 0 2024-03-16T10:53:26.389 INFO:tasks.workunit.client.0.smithi017.stdout:0/861: dwrite d2/d4/d90/d86/f5a [0,4194304] 0 2024-03-16T10:53:26.389 INFO:tasks.workunit.client.0.smithi017.stdout:5/837: dwrite d0/d1/d2/dc/d68/fb1 [0,4194304] 0 2024-03-16T10:53:26.390 INFO:tasks.workunit.client.0.smithi017.stdout:0/862: dread d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f118 [0,4194304] 0 2024-03-16T10:53:26.393 INFO:tasks.workunit.client.0.smithi017.stdout:8/777: symlink d6/d39/da9/dcc/lf7 0 2024-03-16T10:53:26.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/838: creat d0/d1/d2/d2c/d36/d51/f118 x:0 0 0 2024-03-16T10:53:26.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/839: chown d0/ded/l9d 5099907 1 2024-03-16T10:53:26.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/840: fdatasync d0/d1/d2/d2c/d38/f47 0 2024-03-16T10:53:26.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/841: readlink d0/d1/d2/dc/l1b 0 2024-03-16T10:53:26.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/842: dwrite d0/d1/d30/dde/d42/fe0 [4194304,4194304] 0 2024-03-16T10:53:26.410 INFO:tasks.workunit.client.0.smithi017.stdout:0/863: rename d2/d4/d61/f78 to d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f133 0 2024-03-16T10:53:26.410 INFO:tasks.workunit.client.0.smithi017.stdout:5/843: dread d0/d1/d2/d2c/d36/d41/f62 [0,4194304] 0 2024-03-16T10:53:26.412 INFO:tasks.workunit.client.0.smithi017.stdout:5/844: creat d0/d1/d1f/d97/d116/f119 x:0 0 0 2024-03-16T10:53:26.423 INFO:tasks.workunit.client.0.smithi017.stdout:5/845: dwrite d0/d1/d2/d8c/fc0 [0,4194304] 0 2024-03-16T10:53:26.424 INFO:tasks.workunit.client.0.smithi017.stdout:5/846: write d0/d1/d2/d2c/d36/d41/f8e [523728,19943] 0 2024-03-16T10:53:26.424 INFO:tasks.workunit.client.0.smithi017.stdout:5/847: readlink d0/d1/d2/dc/d2f/l40 0 2024-03-16T10:53:26.433 INFO:tasks.workunit.client.0.smithi017.stdout:5/848: write d0/d1/d2/d2c/d38/fae [7803272,64815] 0 2024-03-16T10:53:26.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/849: rename d0/d1/d2/dc/d2f to d0/d1/d2/d2c/d11a 0 2024-03-16T10:53:26.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/850: unlink d0/d1/d2/d2c/d36/db4/lc9 0 2024-03-16T10:53:26.439 INFO:tasks.workunit.client.0.smithi017.stdout:5/851: getdents d0 0 2024-03-16T10:53:26.441 INFO:tasks.workunit.client.0.smithi017.stdout:5/852: creat d0/d1/d2/d2c/d11a/f11b x:0 0 0 2024-03-16T10:53:26.444 INFO:tasks.workunit.client.0.smithi017.stdout:5/853: rename d0/d1/d30/dde/cc3 to d0/d1/d30/c11c 0 2024-03-16T10:53:26.445 INFO:tasks.workunit.client.0.smithi017.stdout:5/854: symlink d0/d1/d2/d24/l11d 0 2024-03-16T10:53:26.447 INFO:tasks.workunit.client.0.smithi017.stdout:5/855: creat d0/d1/d2/d2c/f11e x:0 0 0 2024-03-16T10:53:26.447 INFO:tasks.workunit.client.0.smithi017.stdout:5/856: stat d0/d1/d2/d2c/d36/l52 0 2024-03-16T10:53:26.448 INFO:tasks.workunit.client.0.smithi017.stdout:5/857: creat d0/d1/d2/f11f x:0 0 0 2024-03-16T10:53:26.450 INFO:tasks.workunit.client.0.smithi017.stdout:5/858: creat d0/d1/d2/d8c/f120 x:0 0 0 2024-03-16T10:53:26.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/859: creat d0/d1/d2/dc/d68/f121 x:0 0 0 2024-03-16T10:53:26.454 INFO:tasks.workunit.client.0.smithi017.stdout:5/860: link d0/d1/d2/d2c/l9e d0/d1/d1f/d97/de6/l122 0 2024-03-16T10:53:26.455 INFO:tasks.workunit.client.0.smithi017.stdout:5/861: truncate d0/d1/f16 2007507 0 2024-03-16T10:53:26.456 INFO:tasks.workunit.client.0.smithi017.stdout:5/862: rmdir d0/d1/d2/d2c 39 2024-03-16T10:53:26.470 INFO:tasks.workunit.client.0.smithi017.stdout:5/863: dwrite d0/d1/d2/d2c/d38/f47 [0,4194304] 0 2024-03-16T10:53:26.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/864: creat d0/ded/f123 x:0 0 0 2024-03-16T10:53:26.480 INFO:tasks.workunit.client.0.smithi017.stdout:5/865: dwrite d0/d1/d1f/d29/d88/d91/dda/f105 [0,4194304] 0 2024-03-16T10:53:26.493 INFO:tasks.workunit.client.0.smithi017.stdout:5/866: dwrite d0/d1/d76/f114 [0,4194304] 0 2024-03-16T10:53:26.493 INFO:tasks.workunit.client.0.smithi017.stdout:5/867: truncate d0/d1/d1f/d29/d88/d91/fa7 1418168 0 2024-03-16T10:53:26.496 INFO:tasks.workunit.client.0.smithi017.stdout:5/868: unlink d0/d1/d2/d2c/d11a/fe1 0 2024-03-16T10:53:26.496 INFO:tasks.workunit.client.0.smithi017.stdout:5/869: chown d0/d1/d76/f96 101865 1 2024-03-16T10:53:26.498 INFO:tasks.workunit.client.0.smithi017.stdout:5/870: dread d0/d1/d2/dc/d68/fe4 [0,4194304] 0 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:4/829: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:9/617: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:7/781: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:2/602: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:9/618: truncate d8/df/d5b/fb2 212050 0 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:6/619: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/676: sync 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:6/620: chown d0/d15 92 1 2024-03-16T10:53:26.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/677: dread d8/d1b/f8a [0,4194304] 0 2024-03-16T10:53:26.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/830: creat d15/d1d/d21/d3c/de9/d96/f11d x:0 0 0 2024-03-16T10:53:26.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/603: unlink d4/dd/d1e/d3e/f4d 0 2024-03-16T10:53:26.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/604: getdents d4/d6/d30/d3f/dba 0 2024-03-16T10:53:26.505 INFO:tasks.workunit.client.0.smithi017.stdout:9/619: symlink d8/df/d5b/d70/lc6 0 2024-03-16T10:53:26.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/621: mknod d0/d21/d39/d44/d9a/cc1 0 2024-03-16T10:53:26.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/622: chown d0/d21/d39/d44/d9a/da7/d45/d4d/l94 5995553 1 2024-03-16T10:53:26.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/623: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fa9 0 2024-03-16T10:53:26.509 INFO:tasks.workunit.client.0.smithi017.stdout:2/605: mkdir d4/d6/d30/d3f/dba/dbd 0 2024-03-16T10:53:26.510 INFO:tasks.workunit.client.0.smithi017.stdout:9/620: symlink d8/df/d5b/d70/d89/lc7 0 2024-03-16T10:53:26.511 INFO:tasks.workunit.client.0.smithi017.stdout:6/624: mkdir d0/d21/d39/d44/dc2 0 2024-03-16T10:53:26.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/831: write d15/d1d/d21/d3c/de9/d43/f9e [1246343,4950] 0 2024-03-16T10:53:26.513 INFO:tasks.workunit.client.0.smithi017.stdout:7/782: mkdir d7/db/dc/d50/d59/d104 0 2024-03-16T10:53:26.515 INFO:tasks.workunit.client.0.smithi017.stdout:6/625: getdents d0/d3e 0 2024-03-16T10:53:26.517 INFO:tasks.workunit.client.0.smithi017.stdout:3/678: dwrite d8/d1d/dab/fb6 [0,4194304] 0 2024-03-16T10:53:26.520 INFO:tasks.workunit.client.0.smithi017.stdout:7/783: mknod d7/db/d12/d1c/d30/c105 0 2024-03-16T10:53:26.528 INFO:tasks.workunit.client.0.smithi017.stdout:5/871: link d0/d1/d1f/d29/dd5/ff8 d0/d1/f124 0 2024-03-16T10:53:26.530 INFO:tasks.workunit.client.0.smithi017.stdout:5/872: unlink d0/d1/fb3 0 2024-03-16T10:53:26.531 INFO:tasks.workunit.client.0.smithi017.stdout:9/621: dwrite d8/df/f11 [0,4194304] 0 2024-03-16T10:53:26.534 INFO:tasks.workunit.client.0.smithi017.stdout:4/832: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/d76/fad [0,4194304] 0 2024-03-16T10:53:26.534 INFO:tasks.workunit.client.0.smithi017.stdout:5/873: mkdir d0/d125 0 2024-03-16T10:53:26.534 INFO:tasks.workunit.client.0.smithi017.stdout:5/874: dread - d0/d5d/d9f/fe5 zero size 2024-03-16T10:53:26.535 INFO:tasks.workunit.client.0.smithi017.stdout:7/784: dwrite d7/db/d12/d1c/d4e/ffc [0,4194304] 0 2024-03-16T10:53:26.535 INFO:tasks.workunit.client.0.smithi017.stdout:7/785: chown d7/db/d81/l9b 1 1 2024-03-16T10:53:26.535 INFO:tasks.workunit.client.0.smithi017.stdout:4/833: creat d15/d1d/d21/d3c/de9/d40/d51/d64/da8/f11e x:0 0 0 2024-03-16T10:53:26.536 INFO:tasks.workunit.client.0.smithi017.stdout:5/875: mkdir d0/d1/d2/d111/d126 0 2024-03-16T10:53:26.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/786: dread d7/f7a [0,4194304] 0 2024-03-16T10:53:26.538 INFO:tasks.workunit.client.0.smithi017.stdout:5/876: link d0/d1/c1a d0/d1/d2/d2c/c127 0 2024-03-16T10:53:26.538 INFO:tasks.workunit.client.0.smithi017.stdout:5/877: stat d0/d1/d2/dc/d68/fb1 0 2024-03-16T10:53:26.538 INFO:tasks.workunit.client.0.smithi017.stdout:5/878: write d0/d1/d2/d2c/d38/f3b [1571139,85103] 0 2024-03-16T10:53:26.539 INFO:tasks.workunit.client.0.smithi017.stdout:5/879: mkdir d0/d1/d2/dec/d128 0 2024-03-16T10:53:26.541 INFO:tasks.workunit.client.0.smithi017.stdout:5/880: creat d0/d1/d2/d2c/f129 x:0 0 0 2024-03-16T10:53:26.550 INFO:tasks.workunit.client.0.smithi017.stdout:5/881: creat d0/d1/d1f/d29/d88/d91/f12a x:0 0 0 2024-03-16T10:53:26.553 INFO:tasks.workunit.client.0.smithi017.stdout:5/882: creat d0/ded/daf/f12b x:0 0 0 2024-03-16T10:53:26.556 INFO:tasks.workunit.client.0.smithi017.stdout:2/606: rename d4/d6/db/d66/l6c to d4/dd/lbe 0 2024-03-16T10:53:26.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/607: mknod d4/dd/d1e/d3e/d51/cbf 0 2024-03-16T10:53:26.559 INFO:tasks.workunit.client.0.smithi017.stdout:3/679: rename d8/da/da7/lb4 to d8/d1d/db2/lcc 0 2024-03-16T10:53:26.562 INFO:tasks.workunit.client.0.smithi017.stdout:4/834: rename d15/d1d/d21/d3c/de9/d40/l62 to d15/d1d/d21/d26/d66/l11f 0 2024-03-16T10:53:26.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:26 smithi174 ceph-mon[36202]: scrub summary: idle 2024-03-16T10:53:26.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:26 smithi174 ceph-mon[36202]: pgmap v429: 97 pgs: 97 active+clean; 1.4 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 193 MiB/s wr, 1.71k op/s 2024-03-16T10:53:26.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/680: truncate d8/f4e 452440 0 2024-03-16T10:53:26.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/681: chown d8/d1b/d2e/d60/d63/lc5 1942 1 2024-03-16T10:53:26.564 INFO:tasks.workunit.client.0.smithi017.stdout:2/608: dread d4/d6/db/d66/d2e/f31 [0,4194304] 0 2024-03-16T10:53:26.564 INFO:tasks.workunit.client.0.smithi017.stdout:2/609: readlink d4/d6/db/d66/l90 0 2024-03-16T10:53:26.564 INFO:tasks.workunit.client.0.smithi017.stdout:4/835: symlink d15/d1d/d21/d3c/de9/d40/d51/d64/d106/l120 0 2024-03-16T10:53:26.565 INFO:tasks.workunit.client.0.smithi017.stdout:2/610: link d4/d6/d30/d3f/f69 d4/dd/fc0 0 2024-03-16T10:53:26.574 INFO:tasks.workunit.client.0.smithi017.stdout:2/611: read d4/dd/df/f80 [3260048,57280] 0 2024-03-16T10:53:26.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/612: write d4/d6/db/d24/d39/d7d/f83 [874397,103558] 0 2024-03-16T10:53:26.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/613: read d4/d6/f16 [986529,86505] 0 2024-03-16T10:53:26.576 INFO:tasks.workunit.client.0.smithi017.stdout:2/614: mknod d4/d6/db/d66/d2e/cc1 0 2024-03-16T10:53:26.578 INFO:tasks.workunit.client.0.smithi017.stdout:2/615: creat d4/d6/fc2 x:0 0 0 2024-03-16T10:53:26.579 INFO:tasks.workunit.client.0.smithi017.stdout:3/682: link d8/d1b/d2e/d57/c77 d8/d1b/ccd 0 2024-03-16T10:53:26.579 INFO:tasks.workunit.client.0.smithi017.stdout:3/683: fdatasync d8/d1b/f27 0 2024-03-16T10:53:26.581 INFO:tasks.workunit.client.0.smithi017.stdout:3/684: creat d8/da/da7/fce x:0 0 0 2024-03-16T10:53:26.586 INFO:tasks.workunit.client.0.smithi017.stdout:7/787: rename d7/db/dc/d50/feb to d7/db/dc/d50/d59/d34/dbb/f106 0 2024-03-16T10:53:26.586 INFO:tasks.workunit.client.0.smithi017.stdout:7/788: write d7/db/dc/d50/da8/ff5 [988097,118861] 0 2024-03-16T10:53:26.588 INFO:tasks.workunit.client.0.smithi017.stdout:5/883: rename d0/d1/l1e to d0/d1/d2/d2c/d36/db4/de2/l12c 0 2024-03-16T10:53:26.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:26 smithi017 ceph-mon[32078]: scrub summary: idle 2024-03-16T10:53:26.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:26 smithi017 ceph-mon[32078]: pgmap v429: 97 pgs: 97 active+clean; 1.4 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 193 MiB/s wr, 1.71k op/s 2024-03-16T10:53:26.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/789: creat d7/db/d12/f107 x:0 0 0 2024-03-16T10:53:26.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/790: truncate d7/db/d32/d78/fcf 110922 0 2024-03-16T10:53:26.592 INFO:tasks.workunit.client.0.smithi017.stdout:3/685: write d8/d1b/d1c/f26 [2459973,21056] 0 2024-03-16T10:53:26.592 INFO:tasks.workunit.client.0.smithi017.stdout:3/686: stat d8/d1b/d2e/l40 0 2024-03-16T10:53:26.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/836: rename d15/d1d/daf/fe3 to d15/d1d/d21/d3c/de9/d43/dde/f121 0 2024-03-16T10:53:26.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/837: dread - d15/d1d/d50/f74 zero size 2024-03-16T10:53:26.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/862: sync 2024-03-16T10:53:26.596 INFO:tasks.workunit.client.0.smithi017.stdout:5/884: unlink d0/d1/d76/f96 0 2024-03-16T10:53:26.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/863: chown d1/d24/d79/dd2/d100 80 1 2024-03-16T10:53:26.599 INFO:tasks.workunit.client.0.smithi017.stdout:4/838: truncate d15/d1d/d21/d3c/de9/d40/d51/d64/da8/feb 98157 0 2024-03-16T10:53:26.600 INFO:tasks.workunit.client.0.smithi017.stdout:1/864: mknod d1/d3/dd/d31/d35/def/c122 0 2024-03-16T10:53:26.602 INFO:tasks.workunit.client.0.smithi017.stdout:1/865: truncate d1/d3/dd/d31/d66/dd3/fec 1114651 0 2024-03-16T10:53:26.603 INFO:tasks.workunit.client.0.smithi017.stdout:3/687: dwrite d8/d1b/d1c/f99 [0,4194304] 0 2024-03-16T10:53:26.603 INFO:tasks.workunit.client.0.smithi017.stdout:3/688: write d8/d3f/f3b [1698840,41088] 0 2024-03-16T10:53:26.607 INFO:tasks.workunit.client.0.smithi017.stdout:1/866: creat d1/d3/dd/ddc/f123 x:0 0 0 2024-03-16T10:53:26.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/791: dwrite d7/d8a/d66/dad/fb5 [4194304,4194304] 0 2024-03-16T10:53:26.613 INFO:tasks.workunit.client.0.smithi017.stdout:5/885: dwrite d0/d1/d107/fcf [4194304,4194304] 0 2024-03-16T10:53:26.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/839: dread d15/d1d/d21/d3c/de9/f32 [0,4194304] 0 2024-03-16T10:53:26.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/840: dread - d15/d1d/d21/d3c/de9/d40/d51/d64/da8/f11e zero size 2024-03-16T10:53:26.613 INFO:tasks.workunit.client.0.smithi017.stdout:5/886: write d0/d1/d2/dc/d68/f121 [1044905,36476] 0 2024-03-16T10:53:26.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/689: dwrite d8/d3f/fc6 [0,4194304] 0 2024-03-16T10:53:26.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/690: read d8/da/db/f15 [5297810,2066] 0 2024-03-16T10:53:26.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/691: dread - d8/d1b/d65/da6/fc1 zero size 2024-03-16T10:53:26.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/692: read d8/d3f/f3b [3761362,79625] 0 2024-03-16T10:53:26.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/693: fdatasync d8/d1b/d1c/f55 0 2024-03-16T10:53:26.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/694: dread - d8/fb0 zero size 2024-03-16T10:53:26.619 INFO:tasks.workunit.client.0.smithi017.stdout:5/887: creat d0/d1/d2/d2c/d36/db4/dea/f12d x:0 0 0 2024-03-16T10:53:26.625 INFO:tasks.workunit.client.0.smithi017.stdout:3/695: read d8/f7a [2960030,31019] 0 2024-03-16T10:53:26.625 INFO:tasks.workunit.client.0.smithi017.stdout:3/696: fsync d8/d1b/d2e/d60/f74 0 2024-03-16T10:53:26.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/792: dwrite d7/db/d12/d1c/f36 [0,4194304] 0 2024-03-16T10:53:26.632 INFO:tasks.workunit.client.0.smithi017.stdout:7/793: mknod d7/db/dc/d50/d59/d34/dbb/c108 0 2024-03-16T10:53:26.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/841: dwrite d15/d1d/d21/d3c/de9/d96/ffc [4194304,4194304] 0 2024-03-16T10:53:26.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/842: getdents d15/d1d/d21/d3c/de9/d43 0 2024-03-16T10:53:26.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/794: creat d7/db/dc/d50/d59/d34/d53/f109 x:0 0 0 2024-03-16T10:53:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/795: creat d7/d8a/d66/f10a x:0 0 0 2024-03-16T10:53:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/796: chown d7/db/dc/d50/da8/ff5 602590 1 2024-03-16T10:53:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/797: getdents d7/db 0 2024-03-16T10:53:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/798: dread - d7/db/dc/d60/ff6 zero size 2024-03-16T10:53:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/799: fdatasync d7/db/dc/d50/d59/d34/f43 0 2024-03-16T10:53:26.641 INFO:tasks.workunit.client.0.smithi017.stdout:2/616: rename d4/d6/db/d24/d39/d7d to d4/dd/d38/dc3 0 2024-03-16T10:53:26.646 INFO:tasks.workunit.client.0.smithi017.stdout:5/888: rename d0/d1/d1f/d97/d116/f119 to d0/d1/d30/dde/d42/db6/f12e 0 2024-03-16T10:53:26.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/697: dwrite d8/d1d/f4b [0,4194304] 0 2024-03-16T10:53:26.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/698: chown d8/d1b/d2e/l38 9009 1 2024-03-16T10:53:26.652 INFO:tasks.workunit.client.0.smithi017.stdout:7/800: dread d7/db/dc/d50/d59/f7e [0,4194304] 0 2024-03-16T10:53:26.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/843: dwrite d15/d1d/d21/d3c/de9/d96/f11d [0,4194304] 0 2024-03-16T10:53:26.655 INFO:tasks.workunit.client.0.smithi017.stdout:5/889: dread d0/d1/d1f/f50 [0,4194304] 0 2024-03-16T10:53:26.656 INFO:tasks.workunit.client.0.smithi017.stdout:3/699: dread d8/d1b/d1c/f99 [0,4194304] 0 2024-03-16T10:53:26.656 INFO:tasks.workunit.client.0.smithi017.stdout:4/844: rmdir d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f 39 2024-03-16T10:53:26.658 INFO:tasks.workunit.client.0.smithi017.stdout:4/845: dread d15/d1d/d27/f3b [0,4194304] 0 2024-03-16T10:53:26.659 INFO:tasks.workunit.client.0.smithi017.stdout:4/846: fsync d15/d1d/d21/d3c/de9/d40/d51/d64/fd6 0 2024-03-16T10:53:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:26 smithi111 ceph-mon[36315]: scrub summary: idle 2024-03-16T10:53:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:26 smithi111 ceph-mon[36315]: pgmap v429: 97 pgs: 97 active+clean; 1.4 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 150 MiB/s rd, 193 MiB/s wr, 1.71k op/s 2024-03-16T10:53:26.662 INFO:tasks.workunit.client.0.smithi017.stdout:4/847: write d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fcb [955935,94514] 0 2024-03-16T10:53:26.662 INFO:tasks.workunit.client.0.smithi017.stdout:4/848: write d15/d1d/d21/d3c/f87 [635769,109324] 0 2024-03-16T10:53:26.663 INFO:tasks.workunit.client.0.smithi017.stdout:5/890: dread d0/d1/d30/dde/d42/d4c/f4e [0,4194304] 0 2024-03-16T10:53:26.664 INFO:tasks.workunit.client.0.smithi017.stdout:2/617: rename d4/dd/d1e/f36 to d4/d97/d9f/fc4 0 2024-03-16T10:53:26.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/801: dwrite d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:26.667 INFO:tasks.workunit.client.0.smithi017.stdout:5/891: dread d0/ded/daf/fd7 [0,4194304] 0 2024-03-16T10:53:26.669 INFO:tasks.workunit.client.0.smithi017.stdout:7/802: creat d7/db/dc/d50/df8/d101/f10b x:0 0 0 2024-03-16T10:53:26.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/892: dread d0/d1/d2/d2c/d36/d41/f62 [0,4194304] 0 2024-03-16T10:53:26.671 INFO:tasks.workunit.client.0.smithi017.stdout:7/803: truncate d7/db/dc/d50/d59/d34/f5e 5770457 0 2024-03-16T10:53:26.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/893: rmdir d0/d1/d30/dde/d42/db6 39 2024-03-16T10:53:26.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/894: fdatasync d0/d1/d2/d2c/f11e 0 2024-03-16T10:53:26.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/895: fdatasync d0/d1/d2/d2c/d36/d51/fc7 0 2024-03-16T10:53:26.672 INFO:tasks.workunit.client.0.smithi017.stdout:2/618: read d4/f25 [6823290,54943] 0 2024-03-16T10:53:26.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/849: read d15/f59 [3552061,50588] 0 2024-03-16T10:53:26.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/850: fdatasync d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fe1 0 2024-03-16T10:53:26.673 INFO:tasks.workunit.client.0.smithi017.stdout:7/804: mknod d7/db/dc/d50/d59/d34/d95/c10c 0 2024-03-16T10:53:26.673 INFO:tasks.workunit.client.0.smithi017.stdout:7/805: fdatasync d7/db/dc/dae/fdd 0 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:0/864: sync 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/778: sync 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:0/865: chown d2/d4/d6d/d84/dc1/dd2/d24/d29/c93 1 1 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/779: truncate d6/d14/d6b/fb6 1985416 0 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/780: rename d6/d5f to d6/d5f/df8 22 2024-03-16T10:53:26.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/781: dread - d6/d5f/d6e/fc6 zero size 2024-03-16T10:53:26.675 INFO:tasks.workunit.client.0.smithi017.stdout:4/851: mkdir d15/d1d/d21/d3c/de9/d43/dd1/d122 0 2024-03-16T10:53:26.676 INFO:tasks.workunit.client.0.smithi017.stdout:7/806: creat d7/db/dc/f10d x:0 0 0 2024-03-16T10:53:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/807: write d7/d8a/d66/f10a [624466,45960] 0 2024-03-16T10:53:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/700: dwrite d8/d1b/d2e/d57/f6a [0,4194304] 0 2024-03-16T10:53:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/701: write d8/d1d/d9a/fac [224586,84233] 0 2024-03-16T10:53:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/702: dread - d8/fb0 zero size 2024-03-16T10:53:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/703: dread - d8/d1b/d2e/d60/f84 zero size 2024-03-16T10:53:26.679 INFO:tasks.workunit.client.0.smithi017.stdout:8/782: unlink d6/d5f/d6e/cb0 0 2024-03-16T10:53:26.683 INFO:tasks.workunit.client.0.smithi017.stdout:4/852: creat d15/d1d/d21/d3c/de9/d43/dc2/df1/f123 x:0 0 0 2024-03-16T10:53:26.685 INFO:tasks.workunit.client.0.smithi017.stdout:3/704: link d8/d1d/l28 d8/d1b/d1c/lcf 0 2024-03-16T10:53:26.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/866: dwrite d2/d4/d6d/d84/fa0 [0,4194304] 0 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:7/808: dread d7/db/d32/d78/da5/fd1 [0,4194304] 0 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/853: rmdir d15/d1d/d21/d10b 0 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/854: dread - d15/d1d/d21/d3c/de9/d43/dde/f121 zero size 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/855: read - d15/d1d/d21/d26/d66/d8c/dab/fff zero size 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:3/705: symlink d8/d1b/d1c/d62/d69/ld0 0 2024-03-16T10:53:26.694 INFO:tasks.workunit.client.0.smithi017.stdout:3/706: truncate d8/d1b/d2e/d60/f84 347898 0 2024-03-16T10:53:26.697 INFO:tasks.workunit.client.0.smithi017.stdout:4/856: link d15/d1d/fa2 d15/d1d/d21/d3c/de9/d40/f124 0 2024-03-16T10:53:26.697 INFO:tasks.workunit.client.0.smithi017.stdout:4/857: truncate d15/d1d/d21/d3c/de9/d96/fa5 1336083 0 2024-03-16T10:53:26.698 INFO:tasks.workunit.client.0.smithi017.stdout:7/809: rmdir d7/db/d12/d1c/d30 39 2024-03-16T10:53:26.698 INFO:tasks.workunit.client.0.smithi017.stdout:7/810: read - d7/db/d32/d78/da5/fe4 zero size 2024-03-16T10:53:26.699 INFO:tasks.workunit.client.0.smithi017.stdout:7/811: readlink d7/db/dc/d50/d59/d34/d95/lef 0 2024-03-16T10:53:26.703 INFO:tasks.workunit.client.0.smithi017.stdout:0/867: write d2/d4/d6d/d84/fa0 [2626638,71475] 0 2024-03-16T10:53:26.704 INFO:tasks.workunit.client.0.smithi017.stdout:3/707: write d8/da/fa4 [4131157,48431] 0 2024-03-16T10:53:26.705 INFO:tasks.workunit.client.0.smithi017.stdout:2/619: dwrite d4/d6/d30/f58 [0,4194304] 0 2024-03-16T10:53:26.705 INFO:tasks.workunit.client.0.smithi017.stdout:7/812: link d7/db/d32/l75 d7/db/d12/d1c/d30/l10e 0 2024-03-16T10:53:26.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/868: creat d2/d4/f134 x:0 0 0 2024-03-16T10:53:26.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/869: write d2/d4/d90/dc2/f10e [683315,14933] 0 2024-03-16T10:53:26.706 INFO:tasks.workunit.client.0.smithi017.stdout:8/783: dwrite d6/d16/db3/dcb/f46 [0,4194304] 0 2024-03-16T10:53:26.709 INFO:tasks.workunit.client.0.smithi017.stdout:3/708: mknod d8/d1d/dab/dc4/cd1 0 2024-03-16T10:53:26.709 INFO:tasks.workunit.client.0.smithi017.stdout:3/709: write d8/da/da7/fce [729873,89380] 0 2024-03-16T10:53:26.709 INFO:tasks.workunit.client.0.smithi017.stdout:3/710: fsync d8/d1b/d2e/d8d/fc7 0 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/620: truncate d4/d6/f20 792487 0 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/621: stat d4/d6/d81/d8f/cab 0 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/622: dread - d4/d6/db/d66/d93/fae zero size 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:4/858: dwrite d15/d1d/d21/d26/d66/d8c/dab/dc7/f111 [0,4194304] 0 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:4/859: write d15/d1d/f25 [1815142,103119] 0 2024-03-16T10:53:26.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/623: dread - d4/d6/db/d66/d2e/fbb zero size 2024-03-16T10:53:26.715 INFO:tasks.workunit.client.0.smithi017.stdout:8/784: rename d6/d39/fbd to d6/d16/db3/ff9 0 2024-03-16T10:53:26.715 INFO:tasks.workunit.client.0.smithi017.stdout:8/785: write d6/d14/d8c/fad [903562,79605] 0 2024-03-16T10:53:26.717 INFO:tasks.workunit.client.0.smithi017.stdout:2/624: rename d4/d6/db/d66/d93/c82 to d4/d6/db/d24/d39/cc5 0 2024-03-16T10:53:26.718 INFO:tasks.workunit.client.0.smithi017.stdout:2/625: symlink d4/dd/d1e/d4a/lc6 0 2024-03-16T10:53:26.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/626: creat d4/d6/db/d66/d93/d63/db0/fc7 x:0 0 0 2024-03-16T10:53:26.721 INFO:tasks.workunit.client.0.smithi017.stdout:4/860: creat d15/d1d/d21/d26/d66/f125 x:0 0 0 2024-03-16T10:53:26.722 INFO:tasks.workunit.client.0.smithi017.stdout:8/786: rmdir d6/d4a 39 2024-03-16T10:53:26.722 INFO:tasks.workunit.client.0.smithi017.stdout:7/813: dwrite d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:26.723 INFO:tasks.workunit.client.0.smithi017.stdout:0/870: dwrite d2/d4/d6d/d84/dc1/dd2/f9 [0,4194304] 0 2024-03-16T10:53:26.728 INFO:tasks.workunit.client.0.smithi017.stdout:8/787: getdents d6/d5c 0 2024-03-16T10:53:26.729 INFO:tasks.workunit.client.0.smithi017.stdout:4/861: write d15/d1d/f91 [3338683,11037] 0 2024-03-16T10:53:26.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/711: rmdir d8/d1b/d1c/daf 39 2024-03-16T10:53:26.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/712: write d8/d1b/d2e/d60/f84 [55309,41485] 0 2024-03-16T10:53:26.732 INFO:tasks.workunit.client.0.smithi017.stdout:8/788: creat d6/d14/d72/ffa x:0 0 0 2024-03-16T10:53:26.733 INFO:tasks.workunit.client.0.smithi017.stdout:0/871: mkdir d2/d4/d61/d135 0 2024-03-16T10:53:26.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/713: mknod d8/d1d/db2/cd2 0 2024-03-16T10:53:26.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/714: fdatasync d8/d1b/d1c/f2f 0 2024-03-16T10:53:26.747 INFO:tasks.workunit.client.0.smithi017.stdout:8/789: truncate d6/d5f/d6e/d34/fab 1867801 0 2024-03-16T10:53:26.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/715: rmdir d8/da/da7 39 2024-03-16T10:53:26.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/716: truncate d8/d1b/d2e/d8d/fc8 312849 0 2024-03-16T10:53:26.752 INFO:tasks.workunit.client.0.smithi017.stdout:0/872: mkdir d2/d4/d61/d136 0 2024-03-16T10:53:26.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/627: rmdir d4/d6/db/d66 39 2024-03-16T10:53:26.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/628: truncate d4/d6/db/d66/d93/f64 4212549 0 2024-03-16T10:53:26.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/629: mknod d4/d6/db/d66/d93/d63/db0/cc8 0 2024-03-16T10:53:26.759 INFO:tasks.workunit.client.0.smithi017.stdout:3/717: mkdir d8/d3f/dd3 0 2024-03-16T10:53:26.759 INFO:tasks.workunit.client.0.smithi017.stdout:3/718: stat d8/d1b/d1c/l49 0 2024-03-16T10:53:26.765 INFO:tasks.workunit.client.0.smithi017.stdout:3/719: creat d8/d3f/dd3/fd4 x:0 0 0 2024-03-16T10:53:26.768 INFO:tasks.workunit.client.0.smithi017.stdout:0/873: dwrite d2/d4/d90/d86/f91 [0,4194304] 0 2024-03-16T10:53:26.768 INFO:tasks.workunit.client.0.smithi017.stdout:0/874: write d2/d4/d90/ffc [154239,101838] 0 2024-03-16T10:53:26.768 INFO:tasks.workunit.client.0.smithi017.stdout:0/875: read - d2/d4/d6d/d84/dc1/dd2/de/d1e/db4/f10c zero size 2024-03-16T10:53:26.768 INFO:tasks.workunit.client.0.smithi017.stdout:2/630: dwrite d4/d6/db/d24/d39/f42 [0,4194304] 0 2024-03-16T10:53:26.769 INFO:tasks.workunit.client.0.smithi017.stdout:0/876: readlink d2/d4/d6d/d84/dc1/dd2/d24/d3a/l58 0 2024-03-16T10:53:26.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/631: getdents d4/d6 0 2024-03-16T10:53:26.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/632: write d4/f56 [1010952,2625] 0 2024-03-16T10:53:26.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/633: chown d4/dd/d1e/d3e/d51/cbf 11 1 2024-03-16T10:53:26.774 INFO:tasks.workunit.client.0.smithi017.stdout:0/877: read d2/d4/d90/d86/f33 [833549,71154] 0 2024-03-16T10:53:26.774 INFO:tasks.workunit.client.0.smithi017.stdout:3/720: dread d8/d1b/d1c/f54 [0,4194304] 0 2024-03-16T10:53:26.778 INFO:tasks.workunit.client.0.smithi017.stdout:7/814: rename d7/db/d12/d1c/fec to d7/db/dc/d50/d59/d34/d95/da3/f10f 0 2024-03-16T10:53:26.780 INFO:tasks.workunit.client.0.smithi017.stdout:7/815: creat d7/db/dc/d50/d59/d34/d95/da3/dfa/f110 x:0 0 0 2024-03-16T10:53:26.781 INFO:tasks.workunit.client.0.smithi017.stdout:4/862: rename d15/d1d/d21/d26/d66/d8c/dab/fff to d15/d1d/d21/d3c/de9/d40/d51/d64/da8/f126 0 2024-03-16T10:53:26.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/816: creat d7/db/dc/d50/d59/d34/d53/f111 x:0 0 0 2024-03-16T10:53:26.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/817: write d7/db/dc/d50/d59/d34/fe5 [883156,95674] 0 2024-03-16T10:53:26.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/818: dread - d7/db/dc/d50/df8/d101/f10b zero size 2024-03-16T10:53:26.783 INFO:tasks.workunit.client.0.smithi017.stdout:4/863: unlink d15/cf0 0 2024-03-16T10:53:26.783 INFO:tasks.workunit.client.0.smithi017.stdout:4/864: stat d15/d1d/d21/d3c/de9/d43 0 2024-03-16T10:53:26.783 INFO:tasks.workunit.client.0.smithi017.stdout:4/865: chown d15/d1d/d21/d3c/de9/d40/d51/d64/d63/fc1 35399207 1 2024-03-16T10:53:26.784 INFO:tasks.workunit.client.0.smithi017.stdout:4/866: mkdir d15/d1d/d21/d3c/de9/d127 0 2024-03-16T10:53:26.786 INFO:tasks.workunit.client.0.smithi017.stdout:4/867: unlink d15/d1d/d21/d26/l118 0 2024-03-16T10:53:26.788 INFO:tasks.workunit.client.0.smithi017.stdout:4/868: symlink d15/d1d/d21/d3c/de9/l128 0 2024-03-16T10:53:26.790 INFO:tasks.workunit.client.0.smithi017.stdout:7/819: dread d7/d8a/fb7 [0,4194304] 0 2024-03-16T10:53:26.791 INFO:tasks.workunit.client.0.smithi017.stdout:3/721: dwrite d8/fb0 [0,4194304] 0 2024-03-16T10:53:26.794 INFO:tasks.workunit.client.0.smithi017.stdout:3/722: symlink d8/da/db/ld5 0 2024-03-16T10:53:26.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/723: rename d8/d1d/dab/dc4/cd1 to d8/d1d/dab/dc4/cd6 0 2024-03-16T10:53:26.806 INFO:tasks.workunit.client.0.smithi017.stdout:2/634: rename d4/d6/d30/c9b to d4/d6/db/d24/d39/cc9 0 2024-03-16T10:53:26.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/878: rename d2/d4/d6d/d84/dc1/dd2/de/l13 to d2/d4/d6d/d84/dc1/d11f/l137 0 2024-03-16T10:53:26.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/879: write d2/d4/d90/fca [152037,118425] 0 2024-03-16T10:53:26.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/880: write d2/d4/d6d/d84/de9/fef [954878,7876] 0 2024-03-16T10:53:26.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/881: write d2/d4/d90/d86/f122 [909392,60987] 0 2024-03-16T10:53:26.814 INFO:tasks.workunit.client.0.smithi017.stdout:4/869: rename d15/d1d/d21/d3c/de9/d43/dc2/df1/ff5 to d15/d1d/d21/d26/d66/d8c/dab/dc7/f129 0 2024-03-16T10:53:26.814 INFO:tasks.workunit.client.0.smithi017.stdout:4/870: write d15/d1d/d21/d3c/de9/d40/d51/d64/d63/fac [1578445,26736] 0 2024-03-16T10:53:26.814 INFO:tasks.workunit.client.0.smithi017.stdout:4/871: chown d15/l5a 20828266 1 2024-03-16T10:53:26.816 INFO:tasks.workunit.client.0.smithi017.stdout:4/872: creat d15/d1d/d21/db1/db5/f12a x:0 0 0 2024-03-16T10:53:26.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/882: dwrite f0 [4194304,4194304] 0 2024-03-16T10:53:26.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/883: mknod d2/d4/d6d/d84/dc1/dd2/d24/d3a/c138 0 2024-03-16T10:53:26.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/873: dwrite d15/d1d/d21/d3c/de9/d40/faa [0,4194304] 0 2024-03-16T10:53:26.826 INFO:tasks.workunit.client.0.smithi017.stdout:0/884: write d2/d4/d6d/d84/dc1/dd2/de/d1e/db4/f10c [702573,38974] 0 2024-03-16T10:53:26.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/874: unlink d15/d1d/d21/d3c/de9/d43/dd1/f112 0 2024-03-16T10:53:26.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/875: stat d15/d1d/d21/d3c/de9/f3a 0 2024-03-16T10:53:26.832 INFO:tasks.workunit.client.0.smithi017.stdout:4/876: creat d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/f12b x:0 0 0 2024-03-16T10:53:26.834 INFO:tasks.workunit.client.0.smithi017.stdout:7/820: rename d7/db/dc/d50/d59/d34/d53/lc2 to d7/db/d32/dc5/l112 0 2024-03-16T10:53:26.835 INFO:tasks.workunit.client.0.smithi017.stdout:7/821: dread d7/db/f9d [0,4194304] 0 2024-03-16T10:53:26.836 INFO:tasks.workunit.client.0.smithi017.stdout:4/877: creat d15/f12c x:0 0 0 2024-03-16T10:53:26.841 INFO:tasks.workunit.client.0.smithi017.stdout:0/885: dwrite d2/d4/d90/d86/db7/dc0/f77 [0,4194304] 0 2024-03-16T10:53:26.841 INFO:tasks.workunit.client.0.smithi017.stdout:9/622: sync 2024-03-16T10:53:26.841 INFO:tasks.workunit.client.0.smithi017.stdout:1/867: sync 2024-03-16T10:53:26.841 INFO:tasks.workunit.client.0.smithi017.stdout:6/626: sync 2024-03-16T10:53:26.842 INFO:tasks.workunit.client.0.smithi017.stdout:5/896: sync 2024-03-16T10:53:26.844 INFO:tasks.workunit.client.0.smithi017.stdout:0/886: creat d2/d4/d61/d135/f139 x:0 0 0 2024-03-16T10:53:26.845 INFO:tasks.workunit.client.0.smithi017.stdout:9/623: creat d8/df/d5b/d70/d89/fc8 x:0 0 0 2024-03-16T10:53:26.846 INFO:tasks.workunit.client.0.smithi017.stdout:1/868: mknod d1/d3/dd/d9f/d111/c124 0 2024-03-16T10:53:26.846 INFO:tasks.workunit.client.0.smithi017.stdout:1/869: fdatasync d1/d3/dd/d31/d66/dd3/fec 0 2024-03-16T10:53:26.847 INFO:tasks.workunit.client.0.smithi017.stdout:4/878: dread d15/d1d/fa2 [0,4194304] 0 2024-03-16T10:53:26.847 INFO:tasks.workunit.client.0.smithi017.stdout:4/879: fsync d15/d1d/d21/d26/d66/d8c/dab/dc7/f129 0 2024-03-16T10:53:26.847 INFO:tasks.workunit.client.0.smithi017.stdout:5/897: mknod d0/d1/d2/d111/d126/c12f 0 2024-03-16T10:53:26.849 INFO:tasks.workunit.client.0.smithi017.stdout:5/898: mknod d0/ded/dab/c130 0 2024-03-16T10:53:26.850 INFO:tasks.workunit.client.0.smithi017.stdout:4/880: creat d15/d1d/d85/f12d x:0 0 0 2024-03-16T10:53:26.850 INFO:tasks.workunit.client.0.smithi017.stdout:4/881: chown d15/d1d/f25 1 1 2024-03-16T10:53:26.854 INFO:tasks.workunit.client.0.smithi017.stdout:6/627: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f8f [0,4194304] 0 2024-03-16T10:53:26.854 INFO:tasks.workunit.client.0.smithi017.stdout:7/822: dwrite d7/de9/df9/f102 [0,4194304] 0 2024-03-16T10:53:26.855 INFO:tasks.workunit.client.0.smithi017.stdout:5/899: creat d0/d1/d30/dde/d42/db6/f131 x:0 0 0 2024-03-16T10:53:26.855 INFO:tasks.workunit.client.0.smithi017.stdout:5/900: chown d0/c15 920643734 1 2024-03-16T10:53:26.859 INFO:tasks.workunit.client.0.smithi017.stdout:4/882: link d15/c45 d15/d1d/d21/d3c/de9/d43/dd1/d122/c12e 0 2024-03-16T10:53:26.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/887: dread d2/d4/d6d/d84/dc1/dd2/de/d19/f56 [0,4194304] 0 2024-03-16T10:53:26.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/883: read d15/d1d/d21/d3c/de9/d40/d51/d64/da8/feb [20292,36527] 0 2024-03-16T10:53:26.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/884: write d15/d1d/d21/f4c [2076283,28884] 0 2024-03-16T10:53:26.860 INFO:tasks.workunit.client.0.smithi017.stdout:4/885: fsync d15/d1d/f3d 0 2024-03-16T10:53:26.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/888: readlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d88/l8b 0 2024-03-16T10:53:26.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/889: write d2/d4/d6d/d84/dc1/dd2/de/d19/f4c [1554949,59700] 0 2024-03-16T10:53:26.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/890: creat d2/d4/d6d/d84/de9/f13a x:0 0 0 2024-03-16T10:53:26.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/891: write d2/d4/d90/d86/fb8 [1776272,40252] 0 2024-03-16T10:53:26.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/892: dread d2/d4/d6d/d84/dc1/dd2/f73 [0,4194304] 0 2024-03-16T10:53:26.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/893: rmdir d2/d4/d6d/d84/dc1/dd2/de/d1e/d99 39 2024-03-16T10:53:26.865 INFO:tasks.workunit.client.0.smithi017.stdout:0/894: symlink d2/d4/d6d/d84/l13b 0 2024-03-16T10:53:26.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/895: mknod d2/d4/d6d/d84/d11d/c13c 0 2024-03-16T10:53:26.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/896: fsync d2/d4/d6d/d84/dc1/dd2/d24/f113 0 2024-03-16T10:53:26.869 INFO:tasks.workunit.client.0.smithi017.stdout:7/823: symlink d7/db/dc/d50/d59/daf/l113 0 2024-03-16T10:53:26.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/824: symlink d7/db/dc/d50/d59/d34/d95/df4/l114 0 2024-03-16T10:53:26.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/825: fsync d7/db/d32/d78/fbf 0 2024-03-16T10:53:26.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/826: fsync d7/db/dc/d50/d59/d34/d95/fa2 0 2024-03-16T10:53:26.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/827: readlink d7/db/l7b 0 2024-03-16T10:53:26.871 INFO:tasks.workunit.client.0.smithi017.stdout:5/901: mkdir d0/d1/d2/dec/d128/d132 0 2024-03-16T10:53:26.877 INFO:tasks.workunit.client.0.smithi017.stdout:7/828: symlink d7/db/dc/l115 0 2024-03-16T10:53:26.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/902: symlink d0/d1/d2/dec/l133 0 2024-03-16T10:53:26.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/903: write d0/d1/d2/d2c/d36/d51/fc4 [3629510,35732] 0 2024-03-16T10:53:26.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/904: fsync d0/ded/daf/f12b 0 2024-03-16T10:53:26.880 INFO:tasks.workunit.client.0.smithi017.stdout:4/886: rmdir d15/d1d/d21/d3c 39 2024-03-16T10:53:26.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/829: mknod d7/db/dc/d50/d73/c116 0 2024-03-16T10:53:26.883 INFO:tasks.workunit.client.0.smithi017.stdout:0/897: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d29/f40 [0,4194304] 0 2024-03-16T10:53:26.883 INFO:tasks.workunit.client.0.smithi017.stdout:0/898: fdatasync d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/fdb 0 2024-03-16T10:53:26.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/628: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f79 [4401891,35541] 0 2024-03-16T10:53:26.884 INFO:tasks.workunit.client.0.smithi017.stdout:5/905: mknod d0/d1/d1f/d29/d88/d91/c134 0 2024-03-16T10:53:26.886 INFO:tasks.workunit.client.0.smithi017.stdout:3/724: rename d8/d1b/d1c to d8/d1d/dab/dc4/dd7 0 2024-03-16T10:53:26.888 INFO:tasks.workunit.client.0.smithi017.stdout:7/830: symlink d7/de9/df9/l117 0 2024-03-16T10:53:26.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/887: dread d15/d1d/d21/f5e [0,4194304] 0 2024-03-16T10:53:26.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/888: fdatasync d15/d1d/d85/f109 0 2024-03-16T10:53:26.890 INFO:tasks.workunit.client.0.smithi017.stdout:6/629: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fc3 x:0 0 0 2024-03-16T10:53:26.891 INFO:tasks.workunit.client.0.smithi017.stdout:5/906: mknod d0/d1/d2/dc/d68/c135 0 2024-03-16T10:53:26.894 INFO:tasks.workunit.client.0.smithi017.stdout:4/889: creat d15/d1d/d21/d3c/de9/d43/dc2/df1/f12f x:0 0 0 2024-03-16T10:53:26.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/630: mknod d0/d21/d39/d44/dc2/cc4 0 2024-03-16T10:53:26.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/631: chown d0/f8e 402361454 1 2024-03-16T10:53:26.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/632: write d0/d15/d1f/f60 [1694096,100561] 0 2024-03-16T10:53:26.896 INFO:tasks.workunit.client.0.smithi017.stdout:6/633: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 x:0 0 0 2024-03-16T10:53:26.897 INFO:tasks.workunit.client.0.smithi017.stdout:6/634: write d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fc3 [499826,41823] 0 2024-03-16T10:53:26.897 INFO:tasks.workunit.client.0.smithi017.stdout:5/907: mkdir d0/d1/d2/d2c/d36/d136 0 2024-03-16T10:53:26.898 INFO:tasks.workunit.client.0.smithi017.stdout:7/831: dread d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:26.898 INFO:tasks.workunit.client.0.smithi017.stdout:4/890: truncate d15/d1d/d21/d26/d66/fc0 1136480 0 2024-03-16T10:53:26.898 INFO:tasks.workunit.client.0.smithi017.stdout:4/891: write d15/d1d/d21/d3c/de9/d40/fd0 [1901384,12651] 0 2024-03-16T10:53:26.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/899: dwrite d2/d4/d90/fca [0,4194304] 0 2024-03-16T10:53:26.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/900: read d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [443040,54558] 0 2024-03-16T10:53:26.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/901: write d2/d4/d90/d86/f122 [1328946,84199] 0 2024-03-16T10:53:26.900 INFO:tasks.workunit.client.0.smithi017.stdout:6/635: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d86/cc6 0 2024-03-16T10:53:26.900 INFO:tasks.workunit.client.0.smithi017.stdout:6/636: getdents d0/d3e 0 2024-03-16T10:53:26.902 INFO:tasks.workunit.client.0.smithi017.stdout:3/725: dwrite d8/d3f/fc6 [0,4194304] 0 2024-03-16T10:53:26.902 INFO:tasks.workunit.client.0.smithi017.stdout:5/908: mknod d0/d1/d2/d2c/d38/c137 0 2024-03-16T10:53:26.903 INFO:tasks.workunit.client.0.smithi017.stdout:7/832: getdents d7/db/dc/d50/df8 0 2024-03-16T10:53:26.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/892: link d15/f17 d15/d1d/d21/f130 0 2024-03-16T10:53:26.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/893: dread - d15/d1d/d21/d26/fa1 zero size 2024-03-16T10:53:26.906 INFO:tasks.workunit.client.0.smithi017.stdout:6/637: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/lc7 0 2024-03-16T10:53:26.911 INFO:tasks.workunit.client.0.smithi017.stdout:3/726: creat d8/d1d/d9a/fd8 x:0 0 0 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:3/727: chown d8/d1b/d2e/fbb 940586 1 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:3/728: truncate d8/d1d/dab/dc4/dd7/f54 5123465 0 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:3/729: write d8/d1d/dab/dc4/dd7/d62/fa8 [1655217,84377] 0 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:3/730: chown d8/d1d/d9a/fd8 11 1 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:3/731: getdents d8/d1b/d2e/d60 0 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/902: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [0,4194304] 0 2024-03-16T10:53:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/638: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f19 [0,4194304] 0 2024-03-16T10:53:26.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/909: mknod d0/d1/d2/c138 0 2024-03-16T10:53:26.928 INFO:tasks.workunit.client.0.smithi017.stdout:4/894: mknod d15/d1d/d21/d3c/de9/d40/d51/d64/d76/c131 0 2024-03-16T10:53:26.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/903: dwrite d2/d4/d6d/d84/dc1/dd2/de/d19/f56 [0,4194304] 0 2024-03-16T10:53:26.929 INFO:tasks.workunit.client.0.smithi017.stdout:5/910: dwrite d0/ded/d6a/f7f [0,4194304] 0 2024-03-16T10:53:26.929 INFO:tasks.workunit.client.0.smithi017.stdout:5/911: fsync d0/d1/d2/dc/d68/f121 0 2024-03-16T10:53:26.931 INFO:tasks.workunit.client.0.smithi017.stdout:3/732: unlink d8/d1b/d2e/l38 0 2024-03-16T10:53:26.931 INFO:tasks.workunit.client.0.smithi017.stdout:3/733: chown d8/d1b/d65/da6 3840976 1 2024-03-16T10:53:26.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/639: truncate d0/d15/f55 3709810 0 2024-03-16T10:53:26.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/640: readlink d0/d21/lb4 0 2024-03-16T10:53:26.936 INFO:tasks.workunit.client.0.smithi017.stdout:7/833: read d7/db/d81/fd3 [2513118,87940] 0 2024-03-16T10:53:26.937 INFO:tasks.workunit.client.0.smithi017.stdout:0/904: write d2/d4/d61/de0/f112 [3852719,97386] 0 2024-03-16T10:53:26.940 INFO:tasks.workunit.client.0.smithi017.stdout:4/895: creat d15/d1d/d27/f132 x:0 0 0 2024-03-16T10:53:26.941 INFO:tasks.workunit.client.0.smithi017.stdout:4/896: chown d15/d1d/d50/l80 244453134 1 2024-03-16T10:53:26.942 INFO:tasks.workunit.client.0.smithi017.stdout:5/912: creat d0/ded/dab/f139 x:0 0 0 2024-03-16T10:53:26.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/913: write d0/d1/d30/dde/d57/f74 [1135224,82674] 0 2024-03-16T10:53:26.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/914: write d0/d1/d30/dde/d42/db6/f12e [327559,54337] 0 2024-03-16T10:53:26.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/915: chown d0/d1/d2/d2c/d36/d51/fc4 7704574 1 2024-03-16T10:53:26.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/641: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fc8 x:0 0 0 2024-03-16T10:53:26.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/642: chown d0/d21/d39 118 1 2024-03-16T10:53:26.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/643: readlink d0/d21/d39/d44/d9a/da7/l58 0 2024-03-16T10:53:26.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/644: chown d0/d21/d39/d44/d9a/da7/d96/fbf 5862 1 2024-03-16T10:53:26.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/834: symlink d7/db/d12/d1c/d4e/l118 0 2024-03-16T10:53:26.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/835: readlink d7/db/d12/d1c/d4e/l118 0 2024-03-16T10:53:26.947 INFO:tasks.workunit.client.0.smithi017.stdout:4/897: mkdir d15/d1d/d21/d3c/de9/d43/dc2/df1/d133 0 2024-03-16T10:53:26.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/916: mknod d0/ded/d6a/c13a 0 2024-03-16T10:53:26.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/734: dwrite d8/d1d/dab/dc4/dd7/f54 [0,4194304] 0 2024-03-16T10:53:26.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/735: truncate d8/d3f/dd3/fd4 916339 0 2024-03-16T10:53:26.950 INFO:tasks.workunit.client.0.smithi017.stdout:5/917: creat d0/d1/d2/d24/f13b x:0 0 0 2024-03-16T10:53:26.951 INFO:tasks.workunit.client.0.smithi017.stdout:4/898: getdents d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f 0 2024-03-16T10:53:26.953 INFO:tasks.workunit.client.0.smithi017.stdout:3/736: truncate d8/da/db/f50 2896255 0 2024-03-16T10:53:26.953 INFO:tasks.workunit.client.0.smithi017.stdout:5/918: dread d0/d1/d2/dc/f49 [0,4194304] 0 2024-03-16T10:53:26.954 INFO:tasks.workunit.client.0.smithi017.stdout:4/899: mkdir d15/d1d/d27/d134 0 2024-03-16T10:53:26.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/737: mkdir d8/d1b/d2e/d60/d63/dd9 0 2024-03-16T10:53:26.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/738: write d8/d1d/d9a/fd8 [84833,78656] 0 2024-03-16T10:53:26.959 INFO:tasks.workunit.client.0.smithi017.stdout:3/739: creat d8/d1d/db2/fda x:0 0 0 2024-03-16T10:53:26.959 INFO:tasks.workunit.client.0.smithi017.stdout:3/740: truncate d8/d1d/dab/dc4/dd7/f5d 4462331 0 2024-03-16T10:53:26.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/741: creat d8/d1d/fdb x:0 0 0 2024-03-16T10:53:26.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/742: fsync d8/d1b/d65/da6/fb9 0 2024-03-16T10:53:26.962 INFO:tasks.workunit.client.0.smithi017.stdout:7/836: dwrite d7/db/d32/f54 [0,4194304] 0 2024-03-16T10:53:26.964 INFO:tasks.workunit.client.0.smithi017.stdout:7/837: creat d7/db/d12/f119 x:0 0 0 2024-03-16T10:53:26.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/645: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f56 [0,4194304] 0 2024-03-16T10:53:26.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/646: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 zero size 2024-03-16T10:53:26.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/900: dwrite d15/d1d/d50/fb9 [0,4194304] 0 2024-03-16T10:53:26.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/901: chown d15/d1d/d21/d3c/de9/d43/dc2/cea 133904256 1 2024-03-16T10:53:26.975 INFO:tasks.workunit.client.0.smithi017.stdout:4/902: symlink d15/d1d/d21/d3c/de9/d43/dc2/l135 0 2024-03-16T10:53:26.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/903: dread d15/d1d/d27/f78 [0,4194304] 0 2024-03-16T10:53:26.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/904: stat d15/d1d/d21/d3c/de9/d40/d51/d64/d63/dca/fd3 0 2024-03-16T10:53:26.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/905: mknod d15/d1d/d50/c136 0 2024-03-16T10:53:26.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/906: mkdir d15/d1d/d21/d3c/de9/d40/d137 0 2024-03-16T10:53:26.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/907: dread - d15/d1d/d21/d3c/de9/d43/f8d zero size 2024-03-16T10:53:26.980 INFO:tasks.workunit.client.0.smithi017.stdout:3/743: dwrite d8/d1d/dab/dc4/dd7/f2f [0,4194304] 0 2024-03-16T10:53:26.981 INFO:tasks.workunit.client.0.smithi017.stdout:4/908: creat d15/d1d/d21/d3c/de9/f138 x:0 0 0 2024-03-16T10:53:26.981 INFO:tasks.workunit.client.0.smithi017.stdout:4/909: write d15/d1d/d21/d3c/de9/d43/dc2/df1/f12f [178397,116716] 0 2024-03-16T10:53:26.985 INFO:tasks.workunit.client.0.smithi017.stdout:3/744: getdents d8/d1d/dab 0 2024-03-16T10:53:26.986 INFO:tasks.workunit.client.0.smithi017.stdout:6/647: dwrite d0/f40 [4194304,4194304] 0 2024-03-16T10:53:26.999 INFO:tasks.workunit.client.0.smithi017.stdout:3/745: dwrite d8/d1d/dab/dc4/dd7/f2f [0,4194304] 0 2024-03-16T10:53:27.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/648: mkdir d0/d15/d1f/d7d/d87/dc9 0 2024-03-16T10:53:27.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/649: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/fb3 zero size 2024-03-16T10:53:27.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/650: dread - d0/d15/d1f/d7d/f7f zero size 2024-03-16T10:53:27.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/651: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/c8b 4039 1 2024-03-16T10:53:27.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/652: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/faf zero size 2024-03-16T10:53:27.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/653: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 [714511,10664] 0 2024-03-16T10:53:27.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/654: chown d0/d21/d39/d44/d9a/da7/d45/l68 96 1 2024-03-16T10:53:27.008 INFO:tasks.workunit.client.0.smithi017.stdout:6/655: link d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f89 d0/d21/fca 0 2024-03-16T10:53:27.009 INFO:tasks.workunit.client.0.smithi017.stdout:6/656: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0 0 2024-03-16T10:53:27.010 INFO:tasks.workunit.client.0.smithi017.stdout:3/746: write d8/d1d/f4b [2703951,105322] 0 2024-03-16T10:53:27.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/870: rename d1/d24/d79/dd2/d100/d94/fb5 to d1/d3/dd/d72/d8f/dbe/f125 0 2024-03-16T10:53:27.013 INFO:tasks.workunit.client.0.smithi017.stdout:8/790: sync 2024-03-16T10:53:27.013 INFO:tasks.workunit.client.0.smithi017.stdout:2/635: sync 2024-03-16T10:53:27.013 INFO:tasks.workunit.client.0.smithi017.stdout:8/791: fdatasync d6/d14/f51 0 2024-03-16T10:53:27.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/792: fdatasync d6/d14/d8c/f9c 0 2024-03-16T10:53:27.014 INFO:tasks.workunit.client.0.smithi017.stdout:2/636: fsync d4/d6/db/d66/f94 0 2024-03-16T10:53:27.014 INFO:tasks.workunit.client.0.smithi017.stdout:2/637: fsync d4/d6/db/d66/d93/d63/db0/fc7 0 2024-03-16T10:53:27.017 INFO:tasks.workunit.client.0.smithi017.stdout:8/793: unlink d6/d16/d6c/dd4/ce1 0 2024-03-16T10:53:27.018 INFO:tasks.workunit.client.0.smithi017.stdout:8/794: stat d6/d5c/f71 0 2024-03-16T10:53:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/624: sync 2024-03-16T10:53:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/625: fdatasync d8/df/f1a 0 2024-03-16T10:53:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/626: fsync d8/dbf/d91/f99 0 2024-03-16T10:53:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/627: chown d8/l76 980639 1 2024-03-16T10:53:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/628: truncate d8/df/d5b/d32/f34 1893098 0 2024-03-16T10:53:27.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/871: dwrite d1/fda [0,4194304] 0 2024-03-16T10:53:27.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/872: dread - d1/d24/d79/dd2/f11b zero size 2024-03-16T10:53:27.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/873: truncate d1/d3/dd/d31/d35/f3e 5038854 0 2024-03-16T10:53:27.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/657: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fae [0,4194304] 0 2024-03-16T10:53:27.022 INFO:tasks.workunit.client.0.smithi017.stdout:8/795: creat d6/d5f/da4/dd8/ffb x:0 0 0 2024-03-16T10:53:27.023 INFO:tasks.workunit.client.0.smithi017.stdout:8/796: chown d6/d16/db3/ce5 965562819 1 2024-03-16T10:53:27.028 INFO:tasks.workunit.client.0.smithi017.stdout:1/874: mknod d1/d3/dd/d31/d35/def/c126 0 2024-03-16T10:53:27.029 INFO:tasks.workunit.client.0.smithi017.stdout:6/658: read d0/d21/d39/d44/f70 [3871362,15981] 0 2024-03-16T10:53:27.029 INFO:tasks.workunit.client.0.smithi017.stdout:8/797: creat d6/d5f/da4/ffc x:0 0 0 2024-03-16T10:53:27.031 INFO:tasks.workunit.client.0.smithi017.stdout:6/659: symlink d0/d21/d39/d44/d9a/da7/lcb 0 2024-03-16T10:53:27.032 INFO:tasks.workunit.client.0.smithi017.stdout:6/660: readlink d0/d21/d39/d44/d9a/da7/d38/lbc 0 2024-03-16T10:53:27.033 INFO:tasks.workunit.client.0.smithi017.stdout:6/661: mknod d0/d21/ccc 0 2024-03-16T10:53:27.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/875: write d1/d3/dd/f10f [1627246,65217] 0 2024-03-16T10:53:27.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/876: dread - d1/d3/dd/d31/d66/f118 zero size 2024-03-16T10:53:27.036 INFO:tasks.workunit.client.0.smithi017.stdout:6/662: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/lcd 0 2024-03-16T10:53:27.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/877: fsync d1/d3/f8a 0 2024-03-16T10:53:27.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/905: rename d2/d4/d61/de0/l132 to d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/df4/l13d 0 2024-03-16T10:53:27.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/906: read d2/d4/d6d/d84/dc1/dd2/f64 [38665,54188] 0 2024-03-16T10:53:27.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/907: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f110 [492377,34223] 0 2024-03-16T10:53:27.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/908: chown d2/d4/d6d/d84/dc1/dd2/d24/d29/db3 1598017172 1 2024-03-16T10:53:27.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/798: dwrite d6/d5f/d6e/f59 [0,4194304] 0 2024-03-16T10:53:27.039 INFO:tasks.workunit.client.0.smithi017.stdout:6/663: link d0/d21/fb7 d0/d21/d39/d44/d9a/da7/d96/fce 0 2024-03-16T10:53:27.040 INFO:tasks.workunit.client.0.smithi017.stdout:0/909: mkdir d2/d4/d6d/d84/dc1/dd2/d24/d3a/d13e 0 2024-03-16T10:53:27.041 INFO:tasks.workunit.client.0.smithi017.stdout:5/919: rename d0/ded/f95 to d0/d1/d1f/d29/d99/f13c 0 2024-03-16T10:53:27.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/910: symlink d2/da1/l13f 0 2024-03-16T10:53:27.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/799: creat d6/d5c/d96/ffd x:0 0 0 2024-03-16T10:53:27.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/800: chown d6/d16/db3/dcb/c63 421983924 1 2024-03-16T10:53:27.044 INFO:tasks.workunit.client.0.smithi017.stdout:0/911: creat d2/d4/d6d/d115/d117/f140 x:0 0 0 2024-03-16T10:53:27.045 INFO:tasks.workunit.client.0.smithi017.stdout:5/920: creat d0/ded/d6a/da0/f13d x:0 0 0 2024-03-16T10:53:27.045 INFO:tasks.workunit.client.0.smithi017.stdout:5/921: truncate d0/d1/d2/d2c/d36/d51/f118 889999 0 2024-03-16T10:53:27.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/922: getdents d0/d1/d1f/d29/d88/d91 0 2024-03-16T10:53:27.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/923: write d0/d1/d2/d24/f13b [921696,90701] 0 2024-03-16T10:53:27.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/801: read d6/d39/f30 [1814465,4689] 0 2024-03-16T10:53:27.050 INFO:tasks.workunit.client.0.smithi017.stdout:6/664: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8 0 2024-03-16T10:53:27.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/802: mkdir d6/d14/d72/dfe 0 2024-03-16T10:53:27.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/803: truncate d6/fec 3077758 0 2024-03-16T10:53:27.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/804: write d6/d14/d6b/f8e [4701383,102379] 0 2024-03-16T10:53:27.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/805: write d6/d16/d6c/dd4/d92/fa0 [342643,13444] 0 2024-03-16T10:53:27.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/806: dread d6/fba [0,4194304] 0 2024-03-16T10:53:27.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/807: readlink d6/d5c/d96/d98/lc2 0 2024-03-16T10:53:27.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/808: fsync d6/d5f/f97 0 2024-03-16T10:53:27.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/809: fsync d6/d5f/da4/dd8/ffb 0 2024-03-16T10:53:27.057 INFO:tasks.workunit.client.0.smithi017.stdout:8/810: mkdir d6/dc5/dff 0 2024-03-16T10:53:27.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/665: dread d0/d15/f17 [0,4194304] 0 2024-03-16T10:53:27.059 INFO:tasks.workunit.client.0.smithi017.stdout:8/811: symlink d6/d5c/d96/l100 0 2024-03-16T10:53:27.059 INFO:tasks.workunit.client.0.smithi017.stdout:8/812: write d6/d16/d6c/dd4/d92/fdd [630829,77863] 0 2024-03-16T10:53:27.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/878: dwrite d1/d3/dd/fc4 [0,4194304] 0 2024-03-16T10:53:27.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/879: fdatasync d1/d3/dd/d31/d66/dd7/d67/f6a 0 2024-03-16T10:53:27.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/880: fsync d1/d24/d79/dd2/d100/d97/ff8 0 2024-03-16T10:53:27.062 INFO:tasks.workunit.client.0.smithi017.stdout:8/813: unlink d6/d16/d6c/dd4/l22 0 2024-03-16T10:53:27.069 INFO:tasks.workunit.client.0.smithi017.stdout:0/912: dwrite d2/d4/d6d/d84/dc1/dd2/d24/ff0 [0,4194304] 0 2024-03-16T10:53:27.072 INFO:tasks.workunit.client.0.smithi017.stdout:0/913: mknod d2/d4/d90/c141 0 2024-03-16T10:53:27.073 INFO:tasks.workunit.client.0.smithi017.stdout:1/881: mkdir d1/d24/d79/dd2/d100/d127 0 2024-03-16T10:53:27.074 INFO:tasks.workunit.client.0.smithi017.stdout:5/924: dwrite d0/d1/d2/d2c/d36/d51/fd0 [0,4194304] 0 2024-03-16T10:53:27.075 INFO:tasks.workunit.client.0.smithi017.stdout:8/814: creat d6/d39/f101 x:0 0 0 2024-03-16T10:53:27.075 INFO:tasks.workunit.client.0.smithi017.stdout:8/815: chown d6/d16/db3/dcb/f46 41514793 1 2024-03-16T10:53:27.078 INFO:tasks.workunit.client.0.smithi017.stdout:0/914: dread d2/d4/d6d/d84/dc1/dd2/f9 [0,4194304] 0 2024-03-16T10:53:27.078 INFO:tasks.workunit.client.0.smithi017.stdout:0/915: fsync d2/d4/d90/d86/f91 0 2024-03-16T10:53:27.079 INFO:tasks.workunit.client.0.smithi017.stdout:0/916: chown d2/d4/d90/d86/f91 6 1 2024-03-16T10:53:27.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/838: rename d7/db/d12/lbd to d7/db/dc/d50/d59/d34/dbb/l11a 0 2024-03-16T10:53:27.085 INFO:tasks.workunit.client.0.smithi017.stdout:1/882: dwrite d1/d3/dd/d31/d66/dd7/fed [0,4194304] 0 2024-03-16T10:53:27.085 INFO:tasks.workunit.client.0.smithi017.stdout:5/925: dread d0/d1/d2/d2c/d11a/fa3 [0,4194304] 0 2024-03-16T10:53:27.086 INFO:tasks.workunit.client.0.smithi017.stdout:7/839: mkdir d7/de9/d11b 0 2024-03-16T10:53:27.088 INFO:tasks.workunit.client.0.smithi017.stdout:5/926: creat d0/d5d/d9f/f13e x:0 0 0 2024-03-16T10:53:27.092 INFO:tasks.workunit.client.0.smithi017.stdout:0/917: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d72/fbd [0,4194304] 0 2024-03-16T10:53:27.093 INFO:tasks.workunit.client.0.smithi017.stdout:1/883: mknod d1/d50/d61/c128 0 2024-03-16T10:53:27.095 INFO:tasks.workunit.client.0.smithi017.stdout:0/918: creat d2/d4/d90/d86/db7/dc0/f142 x:0 0 0 2024-03-16T10:53:27.096 INFO:tasks.workunit.client.0.smithi017.stdout:7/840: dwrite d7/db/f9d [0,4194304] 0 2024-03-16T10:53:27.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/841: mkdir d7/db/dc/d60/d11c 0 2024-03-16T10:53:27.101 INFO:tasks.workunit.client.0.smithi017.stdout:7/842: symlink d7/db/dc/d50/da8/dca/l11d 0 2024-03-16T10:53:27.101 INFO:tasks.workunit.client.0.smithi017.stdout:7/843: chown d7/db/d12/f4c 2030 1 2024-03-16T10:53:27.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/844: write d7/db/dc/d60/fda [756480,50416] 0 2024-03-16T10:53:27.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/845: chown d7/db/d12/d1c/d30/c84 26803 1 2024-03-16T10:53:27.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/846: dread d7/f7a [0,4194304] 0 2024-03-16T10:53:27.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/847: mkdir d7/db/dc/d50/d73/d11e 0 2024-03-16T10:53:27.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/848: write d7/db/d12/d1c/d30/fb9 [1202565,72946] 0 2024-03-16T10:53:27.108 INFO:tasks.workunit.client.0.smithi017.stdout:7/849: creat d7/db/dc/d50/d73/d11e/f11f x:0 0 0 2024-03-16T10:53:27.109 INFO:tasks.workunit.client.0.smithi017.stdout:0/919: dread d2/d4/d61/f6f [0,4194304] 0 2024-03-16T10:53:27.113 INFO:tasks.workunit.client.0.smithi017.stdout:3/747: rename d8/d1b/d2e/d57/c6b to d8/d1b/d2e/d60/cdc 0 2024-03-16T10:53:27.113 INFO:tasks.workunit.client.0.smithi017.stdout:0/920: creat d2/d4/d6d/d84/dc1/f143 x:0 0 0 2024-03-16T10:53:27.115 INFO:tasks.workunit.client.0.smithi017.stdout:9/629: rename d8/df/d5b/d72/c90 to d8/df/d5b/d70/cc9 0 2024-03-16T10:53:27.115 INFO:tasks.workunit.client.0.smithi017.stdout:1/884: dwrite d1/d50/d8d/fc5 [4194304,4194304] 0 2024-03-16T10:53:27.115 INFO:tasks.workunit.client.0.smithi017.stdout:9/630: read d8/df/d5b/d32/f39 [1588065,92799] 0 2024-03-16T10:53:27.115 INFO:tasks.workunit.client.0.smithi017.stdout:9/631: stat d8/dbf/d68/d98 0 2024-03-16T10:53:27.117 INFO:tasks.workunit.client.0.smithi017.stdout:0/921: mknod d2/d4/d6d/d84/dc1/c144 0 2024-03-16T10:53:27.119 INFO:tasks.workunit.client.0.smithi017.stdout:0/922: truncate d2/f9b 1315006 0 2024-03-16T10:53:27.119 INFO:tasks.workunit.client.0.smithi017.stdout:0/923: fdatasync d2/d4/d6d/d84/dc1/dd2/de/f16 0 2024-03-16T10:53:27.119 INFO:tasks.workunit.client.0.smithi017.stdout:0/924: truncate d2/d4/d6d/fe6 4791134 0 2024-03-16T10:53:27.119 INFO:tasks.workunit.client.0.smithi017.stdout:1/885: truncate d1/f78 3912749 0 2024-03-16T10:53:27.121 INFO:tasks.workunit.client.0.smithi017.stdout:1/886: creat d1/d24/d79/dd2/d100/f129 x:0 0 0 2024-03-16T10:53:27.121 INFO:tasks.workunit.client.0.smithi017.stdout:1/887: write d1/d3/dd/d31/d35/fac [722628,100403] 0 2024-03-16T10:53:27.121 INFO:tasks.workunit.client.0.smithi017.stdout:9/632: unlink d8/df/d46/l86 0 2024-03-16T10:53:27.128 INFO:tasks.workunit.client.0.smithi017.stdout:7/850: dwrite d7/db/f28 [0,4194304] 0 2024-03-16T10:53:27.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/633: mknod d8/df/d5b/d32/cca 0 2024-03-16T10:53:27.129 INFO:tasks.workunit.client.0.smithi017.stdout:9/634: readlink d8/df/l4e 0 2024-03-16T10:53:27.133 INFO:tasks.workunit.client.0.smithi017.stdout:3/748: dwrite d8/d3f/d3d/f48 [0,4194304] 0 2024-03-16T10:53:27.137 INFO:tasks.workunit.client.0.smithi017.stdout:5/927: rename d0/d1/d30/l6e to d0/d1/d1f/d29/d88/d91/dda/l13f 0 2024-03-16T10:53:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/635: getdents d8/df/d5b/d32 0 2024-03-16T10:53:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:1/888: rename d1/d24/d79/dd2/d100/d94/cd5 to d1/d24/d79/dd2/d100/c12a 0 2024-03-16T10:53:27.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/925: getdents d2/d4/d90/d86/db7/dc0 0 2024-03-16T10:53:27.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/926: chown d2/d4/d6d/d84/dc1/dd2/d24/d72/f128 504784 1 2024-03-16T10:53:27.143 INFO:tasks.workunit.client.0.smithi017.stdout:0/927: symlink d2/d4/d90/d86/db7/l145 0 2024-03-16T10:53:27.144 INFO:tasks.workunit.client.0.smithi017.stdout:3/749: creat d8/d1b/d2e/fdd x:0 0 0 2024-03-16T10:53:27.144 INFO:tasks.workunit.client.0.smithi017.stdout:3/750: read - d8/fbf zero size 2024-03-16T10:53:27.147 INFO:tasks.workunit.client.0.smithi017.stdout:9/636: rename d8/df/d5b/d72/cb3 to d8/df/d5b/d70/ccb 0 2024-03-16T10:53:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/637: creat d8/df/d46/fcc x:0 0 0 2024-03-16T10:53:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/638: read d8/df/d5b/d32/d45/f77 [965754,109925] 0 2024-03-16T10:53:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/639: write d8/df/d5b/d32/f57 [3954009,79528] 0 2024-03-16T10:53:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:1/889: symlink d1/d24/d79/dd2/d100/l12b 0 2024-03-16T10:53:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:0/928: write d2/d4/d6d/d84/dc1/dd2/f87 [2528096,116142] 0 2024-03-16T10:53:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:9/640: creat d8/df/d66/fcd x:0 0 0 2024-03-16T10:53:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:0/929: write d2/d4/f100 [777899,97699] 0 2024-03-16T10:53:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:9/641: chown d8/dbf/d68/d7f/c8a 3383 1 2024-03-16T10:53:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:1/890: dread d1/d3/dd/ddc/ff3 [0,4194304] 0 2024-03-16T10:53:27.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/930: read d2/d4/d6d/d84/dc1/dd2/d24/d72/d101/f110 [50296,92863] 0 2024-03-16T10:53:27.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/931: getdents d2/d4/d61/d136 0 2024-03-16T10:53:27.154 INFO:tasks.workunit.client.0.smithi017.stdout:5/928: dwrite d0/d1/d30/dde/d42/d4c/ffa [0,4194304] 0 2024-03-16T10:53:27.155 INFO:tasks.workunit.client.0.smithi017.stdout:1/891: dread d1/d3/dd/d72/d8f/dbe/fcc [0,4194304] 0 2024-03-16T10:53:27.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/932: mknod d2/d4/d61/de0/c146 0 2024-03-16T10:53:27.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/933: chown d2/d4/d90/c141 3 1 2024-03-16T10:53:27.156 INFO:tasks.workunit.client.0.smithi017.stdout:9/642: mkdir d8/df/d46/d63/d94/d9d/dce 0 2024-03-16T10:53:27.156 INFO:tasks.workunit.client.0.smithi017.stdout:9/643: chown d8/df/f11 931 1 2024-03-16T10:53:27.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/934: creat d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/f147 x:0 0 0 2024-03-16T10:53:27.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/935: truncate d2/d4/d6d/d84/dc1/dd2/d24/d29/f98 600928 0 2024-03-16T10:53:27.162 INFO:tasks.workunit.client.0.smithi017.stdout:1/892: symlink d1/d3/dd/d31/d110/l12c 0 2024-03-16T10:53:27.162 INFO:tasks.workunit.client.0.smithi017.stdout:1/893: dread - d1/d3/dd/d31/d66/da1/de3/fe7 zero size 2024-03-16T10:53:27.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/936: write d2/d4/d6d/d84/dc1/dd2/d24/d29/f40 [3774210,13902] 0 2024-03-16T10:53:27.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/937: truncate d2/d4/d6d/d84/dc1/dd2/de/d1e/f12b 306063 0 2024-03-16T10:53:27.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/938: truncate d2/d4/d6d/f7f 5332448 0 2024-03-16T10:53:27.167 INFO:tasks.workunit.client.0.smithi017.stdout:1/894: creat d1/d50/d8d/f12d x:0 0 0 2024-03-16T10:53:27.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/929: dwrite d0/d1/d2/ff [0,4194304] 0 2024-03-16T10:53:27.169 INFO:tasks.workunit.client.0.smithi017.stdout:5/930: chown d0/d1/d2/d24 1 1 2024-03-16T10:53:27.169 INFO:tasks.workunit.client.0.smithi017.stdout:1/895: mknod d1/d50/c12e 0 2024-03-16T10:53:27.170 INFO:tasks.workunit.client.0.smithi017.stdout:1/896: truncate d1/d50/d8d/fa0 564635 0 2024-03-16T10:53:27.173 INFO:tasks.workunit.client.0.smithi017.stdout:5/931: unlink d0/d1/d2/d2c/c72 0 2024-03-16T10:53:27.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/932: mknod d0/d5d/c140 0 2024-03-16T10:53:27.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/644: getdents d8/df/d66 0 2024-03-16T10:53:27.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/645: readlink d8/df/d5b/d70/lc6 0 2024-03-16T10:53:27.179 INFO:tasks.workunit.client.0.smithi017.stdout:1/897: dwrite d1/d24/d79/dd2/d100/d97/ff8 [0,4194304] 0 2024-03-16T10:53:27.179 INFO:tasks.workunit.client.0.smithi017.stdout:1/898: truncate d1/d3/dd/d31/d66/f118 76314 0 2024-03-16T10:53:27.179 INFO:tasks.workunit.client.0.smithi017.stdout:9/646: creat d8/dbf/d68/d98/fcf x:0 0 0 2024-03-16T10:53:27.179 INFO:tasks.workunit.client.0.smithi017.stdout:9/647: write d8/df/d46/d63/f7b [1611365,29649] 0 2024-03-16T10:53:27.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/648: creat d8/df/d46/d63/d88/fd0 x:0 0 0 2024-03-16T10:53:27.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/649: chown d8/df/d5b/d70/lc6 15 1 2024-03-16T10:53:27.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/650: read d8/df/d5b/d32/f67 [1294451,32742] 0 2024-03-16T10:53:27.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/651: chown d8/df/c21 0 1 2024-03-16T10:53:27.182 INFO:tasks.workunit.client.0.smithi017.stdout:9/652: write d8/df/d5b/d32/f39 [1204099,31703] 0 2024-03-16T10:53:27.183 INFO:tasks.workunit.client.0.smithi017.stdout:9/653: mkdir d8/df/d66/dd1 0 2024-03-16T10:53:27.185 INFO:tasks.workunit.client.0.smithi017.stdout:7/851: rename d7/db/dc to d7/db/d120 0 2024-03-16T10:53:27.186 INFO:tasks.workunit.client.0.smithi017.stdout:3/751: rmdir d8/d1b/d2e/d57 39 2024-03-16T10:53:27.187 INFO:tasks.workunit.client.0.smithi017.stdout:5/933: dwrite d0/d1/d1f/d29/d88/d91/dda/f100 [0,4194304] 0 2024-03-16T10:53:27.187 INFO:tasks.workunit.client.0.smithi017.stdout:4/910: sync 2024-03-16T10:53:27.190 INFO:tasks.workunit.client.0.smithi017.stdout:9/654: creat d8/df/d5b/d72/fd2 x:0 0 0 2024-03-16T10:53:27.191 INFO:tasks.workunit.client.0.smithi017.stdout:7/852: mknod d7/db/d120/d50/d59/daf/c121 0 2024-03-16T10:53:27.192 INFO:tasks.workunit.client.0.smithi017.stdout:3/752: creat d8/d1b/fde x:0 0 0 2024-03-16T10:53:27.193 INFO:tasks.workunit.client.0.smithi017.stdout:4/911: dread d15/d1d/d21/d26/f4d [0,4194304] 0 2024-03-16T10:53:27.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/934: symlink d0/d1/d30/dde/l141 0 2024-03-16T10:53:27.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/935: write d0/d1/d2/d2c/f129 [161015,18055] 0 2024-03-16T10:53:27.196 INFO:tasks.workunit.client.0.smithi017.stdout:9/655: mknod d8/dbf/d68/d98/cd3 0 2024-03-16T10:53:27.196 INFO:tasks.workunit.client.0.smithi017.stdout:9/656: chown d8/df/d5b/d32/d45/f61 5 1 2024-03-16T10:53:27.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/657: read d8/df/d46/d63/f7b [805875,74552] 0 2024-03-16T10:53:27.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/658: getdents d8/df/d5b/d32/d45 0 2024-03-16T10:53:27.200 INFO:tasks.workunit.client.0.smithi017.stdout:7/853: mknod d7/db/d120/dae/ddb/dfb/c122 0 2024-03-16T10:53:27.200 INFO:tasks.workunit.client.0.smithi017.stdout:7/854: stat d7/de9/df9/f102 0 2024-03-16T10:53:27.201 INFO:tasks.workunit.client.0.smithi017.stdout:1/899: write d1/d3/dd/d31/d66/dd7/dbc/fe1 [1542340,9995] 0 2024-03-16T10:53:27.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/659: symlink d8/d95/ld4 0 2024-03-16T10:53:27.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/660: write d8/df/d5b/d32/d45/f61 [4594481,12750] 0 2024-03-16T10:53:27.206 INFO:tasks.workunit.client.0.smithi017.stdout:4/912: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/da8/fc9 [0,4194304] 0 2024-03-16T10:53:27.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/855: unlink d7/db/d12/ddf/l82 0 2024-03-16T10:53:27.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/900: truncate d1/fae 478388 0 2024-03-16T10:53:27.212 INFO:tasks.workunit.client.0.smithi017.stdout:9/661: creat d8/df/d5b/d72/d9e/fd5 x:0 0 0 2024-03-16T10:53:27.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/913: creat d15/d1d/d21/d3c/de9/d43/dd1/f139 x:0 0 0 2024-03-16T10:53:27.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/914: write d15/d1d/fdb [701057,83834] 0 2024-03-16T10:53:27.216 INFO:tasks.workunit.client.0.smithi017.stdout:1/901: mknod d1/d50/c12f 0 2024-03-16T10:53:27.216 INFO:tasks.workunit.client.0.smithi017.stdout:1/902: fsync d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/fe9 0 2024-03-16T10:53:27.217 INFO:tasks.workunit.client.0.smithi017.stdout:9/662: mknod d8/df/d5b/daf/cd6 0 2024-03-16T10:53:27.217 INFO:tasks.workunit.client.0.smithi017.stdout:9/663: write d8/df/d46/d63/d94/d9d/fc5 [698491,118003] 0 2024-03-16T10:53:27.219 INFO:tasks.workunit.client.0.smithi017.stdout:4/915: truncate d15/d1d/d21/d26/d66/d8c/dab/dc7/f129 64295 0 2024-03-16T10:53:27.220 INFO:tasks.workunit.client.0.smithi017.stdout:7/856: mkdir d7/db/d12/ddf/d123 0 2024-03-16T10:53:27.220 INFO:tasks.workunit.client.0.smithi017.stdout:7/857: readlink d7/db/d120/d60/l100 0 2024-03-16T10:53:27.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/903: creat d1/d3/dd/d72/f130 x:0 0 0 2024-03-16T10:53:27.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/904: truncate d1/d3/dd/d31/d66/dd7/dbc/ddb/ffa 921382 0 2024-03-16T10:53:27.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/905: write d1/f5c [3394808,110901] 0 2024-03-16T10:53:27.225 INFO:tasks.workunit.client.0.smithi017.stdout:9/664: unlink d8/df/d5b/d70/c82 0 2024-03-16T10:53:27.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/916: mkdir d15/d1d/d13a 0 2024-03-16T10:53:27.229 INFO:tasks.workunit.client.0.smithi017.stdout:7/858: creat d7/db/d32/f124 x:0 0 0 2024-03-16T10:53:27.234 INFO:tasks.workunit.client.0.smithi017.stdout:9/665: truncate d8/df/d5b/d32/f73 1481111 0 2024-03-16T10:53:27.234 INFO:tasks.workunit.client.0.smithi017.stdout:9/666: truncate d8/df/d5b/fb2 988791 0 2024-03-16T10:53:27.236 INFO:tasks.workunit.client.0.smithi017.stdout:7/859: creat d7/db/d12/ddf/d123/f125 x:0 0 0 2024-03-16T10:53:27.236 INFO:tasks.workunit.client.0.smithi017.stdout:7/860: fsync d7/db/d32/f54 0 2024-03-16T10:53:27.238 INFO:tasks.workunit.client.0.smithi017.stdout:4/917: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/ffb [0,4194304] 0 2024-03-16T10:53:27.238 INFO:tasks.workunit.client.0.smithi017.stdout:4/918: write d15/d1d/d21/d3c/f104 [238969,90828] 0 2024-03-16T10:53:27.240 INFO:tasks.workunit.client.0.smithi017.stdout:1/906: write d1/d3/dd/d31/d66/da1/fd8 [1086268,41791] 0 2024-03-16T10:53:27.241 INFO:tasks.workunit.client.0.smithi017.stdout:1/907: chown d1/d24/d79/dd2/d100 6463347 1 2024-03-16T10:53:27.241 INFO:tasks.workunit.client.0.smithi017.stdout:1/908: readlink d1/d3/dd/lf7 0 2024-03-16T10:53:27.242 INFO:tasks.workunit.client.0.smithi017.stdout:1/909: creat d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/f131 x:0 0 0 2024-03-16T10:53:27.242 INFO:tasks.workunit.client.0.smithi017.stdout:1/910: rename d1/d24/d79 to d1/d24/d79/d7a/d132 22 2024-03-16T10:53:27.242 INFO:tasks.workunit.client.0.smithi017.stdout:1/911: dread - d1/d3/dd/fe6 zero size 2024-03-16T10:53:27.244 INFO:tasks.workunit.client.0.smithi017.stdout:9/667: dwrite d8/f79 [4194304,4194304] 0 2024-03-16T10:53:27.245 INFO:tasks.workunit.client.0.smithi017.stdout:4/919: creat d15/d1d/d50/f13b x:0 0 0 2024-03-16T10:53:27.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/668: truncate d8/df/d5b/d32/f34 1288129 0 2024-03-16T10:53:27.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/669: fdatasync d8/df/d5b/d72/d9e/fa7 0 2024-03-16T10:53:27.251 INFO:tasks.workunit.client.0.smithi017.stdout:1/912: rmdir d1/d3/dd/d72/d8f 39 2024-03-16T10:53:27.253 INFO:tasks.workunit.client.0.smithi017.stdout:4/920: creat d15/d1d/d13a/f13c x:0 0 0 2024-03-16T10:53:27.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/670: creat d8/df/d46/d63/d94/dad/fd7 x:0 0 0 2024-03-16T10:53:27.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/671: chown d8/df/d46/c64 4 1 2024-03-16T10:53:27.258 INFO:tasks.workunit.client.0.smithi017.stdout:4/921: creat d15/d1d/d21/d26/d66/d8c/dab/df2/f13d x:0 0 0 2024-03-16T10:53:27.258 INFO:tasks.workunit.client.0.smithi017.stdout:7/861: write d7/d8a/f64 [5126736,52348] 0 2024-03-16T10:53:27.260 INFO:tasks.workunit.client.0.smithi017.stdout:4/922: mknod d15/d1d/d21/d26/d66/d8c/dab/df2/c13e 0 2024-03-16T10:53:27.263 INFO:tasks.workunit.client.0.smithi017.stdout:7/862: symlink d7/db/d120/dae/ddb/l126 0 2024-03-16T10:53:27.265 INFO:tasks.workunit.client.0.smithi017.stdout:4/923: creat d15/d1d/d21/d3c/de9/d40/d51/d64/f13f x:0 0 0 2024-03-16T10:53:27.267 INFO:tasks.workunit.client.0.smithi017.stdout:9/672: creat d8/df/d5b/d32/d45/fd8 x:0 0 0 2024-03-16T10:53:27.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/924: mknod d15/d1d/d21/d3c/de9/d40/d51/d64/c140 0 2024-03-16T10:53:27.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/925: write d15/d1d/d21/d3c/f87 [1788745,56504] 0 2024-03-16T10:53:27.279 INFO:tasks.workunit.client.0.smithi017.stdout:9/673: mkdir d8/df/d46/d63/d88/dd9 0 2024-03-16T10:53:27.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/926: creat d15/d1d/d21/d26/d66/d8c/dab/dc7/f141 x:0 0 0 2024-03-16T10:53:27.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/927: write d15/d1d/d21/d26/d66/f84 [905869,35470] 0 2024-03-16T10:53:27.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/928: chown d15/d1d/d85/f12d 30164 1 2024-03-16T10:53:27.288 INFO:tasks.workunit.client.0.smithi017.stdout:9/674: creat d8/df/d46/d63/d94/d9d/dce/fda x:0 0 0 2024-03-16T10:53:27.290 INFO:tasks.workunit.client.0.smithi017.stdout:9/675: mknod d8/df/d5b/d72/cdb 0 2024-03-16T10:53:27.293 INFO:tasks.workunit.client.0.smithi017.stdout:9/676: mkdir d8/df/d46/d63/d88/ddc 0 2024-03-16T10:53:27.293 INFO:tasks.workunit.client.0.smithi017.stdout:9/677: readlink d8/df/d5b/d70/d89/la0 0 2024-03-16T10:53:27.296 INFO:tasks.workunit.client.0.smithi017.stdout:4/929: dread d15/d1d/d21/d3c/de9/d40/f44 [0,4194304] 0 2024-03-16T10:53:27.296 INFO:tasks.workunit.client.0.smithi017.stdout:9/678: creat d8/df/d46/d63/d88/ddc/fdd x:0 0 0 2024-03-16T10:53:27.297 INFO:tasks.workunit.client.0.smithi017.stdout:4/930: symlink d15/d1d/daf/l142 0 2024-03-16T10:53:27.297 INFO:tasks.workunit.client.0.smithi017.stdout:4/931: chown d15/d1d/d85/fa6 6539 1 2024-03-16T10:53:27.298 INFO:tasks.workunit.client.0.smithi017.stdout:1/913: link d1/d3/dd/d72/c90 d1/d24/d79/dd2/d100/d93/c133 0 2024-03-16T10:53:27.298 INFO:tasks.workunit.client.0.smithi017.stdout:9/679: mkdir d8/d95/dde 0 2024-03-16T10:53:27.300 INFO:tasks.workunit.client.0.smithi017.stdout:4/932: symlink d15/d1d/d27/l143 0 2024-03-16T10:53:27.301 INFO:tasks.workunit.client.0.smithi017.stdout:1/914: truncate d1/f5c 701366 0 2024-03-16T10:53:27.302 INFO:tasks.workunit.client.0.smithi017.stdout:1/915: chown d1/d3/dd/d9f 0 1 2024-03-16T10:53:27.304 INFO:tasks.workunit.client.0.smithi017.stdout:9/680: creat d8/dbf/d68/d7f/fdf x:0 0 0 2024-03-16T10:53:27.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/681: write d8/df/d5b/f42 [2976347,115336] 0 2024-03-16T10:53:27.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/682: dread - d8/df/fbd zero size 2024-03-16T10:53:27.313 INFO:tasks.workunit.client.0.smithi017.stdout:1/916: mknod d1/d50/d61/c134 0 2024-03-16T10:53:27.317 INFO:tasks.workunit.client.0.smithi017.stdout:9/683: symlink d8/df/d46/le0 0 2024-03-16T10:53:27.319 INFO:tasks.workunit.client.0.smithi017.stdout:9/684: creat d8/df/d5b/d70/fe1 x:0 0 0 2024-03-16T10:53:27.320 INFO:tasks.workunit.client.0.smithi017.stdout:9/685: unlink d8/dbf/d68/d98/fcf 0 2024-03-16T10:53:27.322 INFO:tasks.workunit.client.0.smithi017.stdout:7/863: rename d7/db/d120/d50/d59/d34/d95/da3/dfa to d7/db/d120/d50/da8/d127 0 2024-03-16T10:53:27.326 INFO:tasks.workunit.client.0.smithi017.stdout:2/638: sync 2024-03-16T10:53:27.326 INFO:tasks.workunit.client.0.smithi017.stdout:6/666: sync 2024-03-16T10:53:27.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/816: sync 2024-03-16T10:53:27.326 INFO:tasks.workunit.client.0.smithi017.stdout:6/667: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/fb6 1813549 1 2024-03-16T10:53:27.327 INFO:tasks.workunit.client.0.smithi017.stdout:2/639: mkdir d4/dca 0 2024-03-16T10:53:27.328 INFO:tasks.workunit.client.0.smithi017.stdout:8/817: symlink d6/dc5/l102 0 2024-03-16T10:53:27.329 INFO:tasks.workunit.client.0.smithi017.stdout:8/818: fsync d6/d5f/d6e/fd7 0 2024-03-16T10:53:27.330 INFO:tasks.workunit.client.0.smithi017.stdout:2/640: rmdir d4/d6/d81 39 2024-03-16T10:53:27.331 INFO:tasks.workunit.client.0.smithi017.stdout:6/668: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f27 [387777,59538] 0 2024-03-16T10:53:27.331 INFO:tasks.workunit.client.0.smithi017.stdout:2/641: dread d4/d6/db/d24/d39/f76 [0,4194304] 0 2024-03-16T10:53:27.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/669: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84 0 2024-03-16T10:53:27.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/670: write d0/d21/d39/d44/d9a/da7/d45/d4d/f83 [84632,42985] 0 2024-03-16T10:53:27.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/671: getdents d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69 0 2024-03-16T10:53:27.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/672: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/faa zero size 2024-03-16T10:53:27.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/686: dwrite d8/df/d5b/f42 [0,4194304] 0 2024-03-16T10:53:27.336 INFO:tasks.workunit.client.0.smithi017.stdout:6/673: write d0/d21/fca [275601,17111] 0 2024-03-16T10:53:27.336 INFO:tasks.workunit.client.0.smithi017.stdout:6/674: write d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fb8 [460633,21250] 0 2024-03-16T10:53:27.337 INFO:tasks.workunit.client.0.smithi017.stdout:8/819: write d6/f68 [2633712,88507] 0 2024-03-16T10:53:27.337 INFO:tasks.workunit.client.0.smithi017.stdout:9/687: mknod d8/df/d5b/d32/ce2 0 2024-03-16T10:53:27.339 INFO:tasks.workunit.client.0.smithi017.stdout:6/675: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d86/dad/fcf x:0 0 0 2024-03-16T10:53:27.342 INFO:tasks.workunit.client.0.smithi017.stdout:9/688: creat d8/d95/dde/fe3 x:0 0 0 2024-03-16T10:53:27.342 INFO:tasks.workunit.client.0.smithi017.stdout:9/689: read - d8/df/d46/d63/d94/d9d/fac zero size 2024-03-16T10:53:27.343 INFO:tasks.workunit.client.0.smithi017.stdout:9/690: creat d8/df/d46/fe4 x:0 0 0 2024-03-16T10:53:27.344 INFO:tasks.workunit.client.0.smithi017.stdout:8/820: write d6/d14/d8c/f9c [856161,23398] 0 2024-03-16T10:53:27.344 INFO:tasks.workunit.client.0.smithi017.stdout:8/821: getdents d6/d39/da9/ddb 0 2024-03-16T10:53:27.344 INFO:tasks.workunit.client.0.smithi017.stdout:9/691: mknod d8/df/d5b/daf/ce5 0 2024-03-16T10:53:27.344 INFO:tasks.workunit.client.0.smithi017.stdout:9/692: chown d8/df/d5b/d32/d45/f77 1027906 1 2024-03-16T10:53:27.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/822: link d6/d16/db3/ce5 d6/d16/db3/c103 0 2024-03-16T10:53:27.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/823: write d6/d16/db3/ff9 [1685295,71240] 0 2024-03-16T10:53:27.348 INFO:tasks.workunit.client.0.smithi017.stdout:9/693: mkdir d8/df/d5b/daf/db7/de6 0 2024-03-16T10:53:27.348 INFO:tasks.workunit.client.0.smithi017.stdout:6/676: write d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/f9d [2533761,95765] 0 2024-03-16T10:53:27.351 INFO:tasks.workunit.client.0.smithi017.stdout:2/642: dwrite d4/f52 [0,4194304] 0 2024-03-16T10:53:27.351 INFO:tasks.workunit.client.0.smithi017.stdout:2/643: getdents d4/dd/d1e/da7 0 2024-03-16T10:53:27.352 INFO:tasks.workunit.client.0.smithi017.stdout:8/824: creat d6/d5f/d6e/f104 x:0 0 0 2024-03-16T10:53:27.354 INFO:tasks.workunit.client.0.smithi017.stdout:6/677: rmdir d0/d3e 39 2024-03-16T10:53:27.357 INFO:tasks.workunit.client.0.smithi017.stdout:2/644: getdents d4/d97 0 2024-03-16T10:53:27.365 INFO:tasks.workunit.client.0.smithi017.stdout:4/933: rename d15/d1d/d21/d3c/de9/d43/dde to d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/d117/d144 0 2024-03-16T10:53:27.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/694: dwrite d8/d95/dde/fe3 [0,4194304] 0 2024-03-16T10:53:27.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/695: fsync d8/d95/dde/fe3 0 2024-03-16T10:53:27.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/696: stat d8/df/d46/fe4 0 2024-03-16T10:53:27.367 INFO:tasks.workunit.client.0.smithi017.stdout:7/864: rename d7/db/d120/d60/d11c to d7/d128 0 2024-03-16T10:53:27.369 INFO:tasks.workunit.client.0.smithi017.stdout:4/934: creat d15/d1d/d21/d3c/de9/d96/f145 x:0 0 0 2024-03-16T10:53:27.371 INFO:tasks.workunit.client.0.smithi017.stdout:2/645: dread d4/dd/d1e/f89 [0,4194304] 0 2024-03-16T10:53:27.374 INFO:tasks.workunit.client.0.smithi017.stdout:6/678: rename d0/d21/l7a to d0/d21/d39/d44/d9a/da7/d38/ld0 0 2024-03-16T10:53:27.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/865: creat d7/db/d12/ddf/f129 x:0 0 0 2024-03-16T10:53:27.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/866: write d7/db/d12/f4c [5141720,17470] 0 2024-03-16T10:53:27.378 INFO:tasks.workunit.client.0.smithi017.stdout:2/646: creat d4/d6/db/fcb x:0 0 0 2024-03-16T10:53:27.380 INFO:tasks.workunit.client.0.smithi017.stdout:8/825: dwrite d6/d16/db3/dcb/f46 [0,4194304] 0 2024-03-16T10:53:27.381 INFO:tasks.workunit.client.0.smithi017.stdout:9/697: rename d8/f2a to d8/df/d46/d63/db4/fe7 0 2024-03-16T10:53:27.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/867: truncate d7/db/d120/d60/fda 3658351 0 2024-03-16T10:53:27.386 INFO:tasks.workunit.client.0.smithi017.stdout:4/935: dwrite d15/d1d/d21/d3c/f97 [0,4194304] 0 2024-03-16T10:53:27.388 INFO:tasks.workunit.client.0.smithi017.stdout:7/868: creat d7/db/d120/d50/d59/d34/dbb/f12a x:0 0 0 2024-03-16T10:53:27.388 INFO:tasks.workunit.client.0.smithi017.stdout:7/869: write d7/db/d120/dae/fdd [483649,125757] 0 2024-03-16T10:53:27.389 INFO:tasks.workunit.client.0.smithi017.stdout:9/698: rename d8/df/d5b/f3b to d8/df/d66/fe8 0 2024-03-16T10:53:27.392 INFO:tasks.workunit.client.0.smithi017.stdout:7/870: creat d7/db/d120/d50/df8/f12b x:0 0 0 2024-03-16T10:53:27.392 INFO:tasks.workunit.client.0.smithi017.stdout:7/871: stat d7/c3b 0 2024-03-16T10:53:27.394 INFO:tasks.workunit.client.0.smithi017.stdout:2/647: dread d4/d6/f26 [0,4194304] 0 2024-03-16T10:53:27.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/699: dread d8/df/d5b/f5d [0,4194304] 0 2024-03-16T10:53:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:6/679: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fc3 [0,4194304] 0 2024-03-16T10:53:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:8/826: dwrite d6/d5c/d96/ffd [0,4194304] 0 2024-03-16T10:53:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:9/700: rmdir d8/df/d66 39 2024-03-16T10:53:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:9/701: write d8/dbf/d91/f99 [4440333,88941] 0 2024-03-16T10:53:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:9/702: readlink d8/df/d5b/d32/l41 0 2024-03-16T10:53:27.405 INFO:tasks.workunit.client.0.smithi017.stdout:8/827: rmdir d6/d5f 39 2024-03-16T10:53:27.407 INFO:tasks.workunit.client.0.smithi017.stdout:4/936: dwrite d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/f12b [0,4194304] 0 2024-03-16T10:53:27.408 INFO:tasks.workunit.client.0.smithi017.stdout:9/703: creat d8/df/d46/d63/d88/fe9 x:0 0 0 2024-03-16T10:53:27.408 INFO:tasks.workunit.client.0.smithi017.stdout:9/704: getdents d8/df/d66/dd1 0 2024-03-16T10:53:27.410 INFO:tasks.workunit.client.0.smithi017.stdout:2/648: truncate d4/d6/db/d66/d2e/f3c 130485 0 2024-03-16T10:53:27.412 INFO:tasks.workunit.client.0.smithi017.stdout:6/680: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f19 [0,4194304] 0 2024-03-16T10:53:27.416 INFO:tasks.workunit.client.0.smithi017.stdout:2/649: rmdir d4/dd 39 2024-03-16T10:53:27.416 INFO:tasks.workunit.client.0.smithi017.stdout:4/937: write d15/d1d/f56 [1016229,52417] 0 2024-03-16T10:53:27.416 INFO:tasks.workunit.client.0.smithi017.stdout:4/938: stat d15/d1d/d21/d3c/de9/d40/d51/f107 0 2024-03-16T10:53:27.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/650: unlink d4/d6/db/d66/d2e/fbb 0 2024-03-16T10:53:27.431 INFO:tasks.workunit.client.0.smithi017.stdout:8/828: dwrite d6/d16/d6c/dd4/f53 [0,4194304] 0 2024-03-16T10:53:27.431 INFO:tasks.workunit.client.0.smithi017.stdout:8/829: truncate d6/d5f/d6e/fc6 887237 0 2024-03-16T10:53:27.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/681: dwrite d0/d21/fca [0,4194304] 0 2024-03-16T10:53:27.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/682: stat d0/d21/d39/d44/d9a/da7/d45/d4d/lb2 0 2024-03-16T10:53:27.435 INFO:tasks.workunit.client.0.smithi017.stdout:9/705: dwrite d8/df/d46/d63/f7b [0,4194304] 0 2024-03-16T10:53:27.440 INFO:tasks.workunit.client.0.smithi017.stdout:2/651: dwrite d4/d6/db/d66/d93/f6a [0,4194304] 0 2024-03-16T10:53:27.441 INFO:tasks.workunit.client.0.smithi017.stdout:9/706: rename d8/df/d5b/f3a to d8/dbf/d68/fea 0 2024-03-16T10:53:27.442 INFO:tasks.workunit.client.0.smithi017.stdout:9/707: fsync d8/df/d66/f6e 0 2024-03-16T10:53:27.442 INFO:tasks.workunit.client.0.smithi017.stdout:9/708: chown d8/l26 12 1 2024-03-16T10:53:27.442 INFO:tasks.workunit.client.0.smithi017.stdout:4/939: dwrite d15/d1d/d21/f4c [0,4194304] 0 2024-03-16T10:53:27.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/652: rmdir d4/d6/d30/d3f 39 2024-03-16T10:53:27.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/653: fsync d4/d6/db/d24/d39/f3b 0 2024-03-16T10:53:27.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/709: truncate d8/f24 3435534 0 2024-03-16T10:53:27.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/710: fdatasync d8/f59 0 2024-03-16T10:53:27.450 INFO:tasks.workunit.client.0.smithi017.stdout:4/940: unlink d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fe1 0 2024-03-16T10:53:27.453 INFO:tasks.workunit.client.0.smithi017.stdout:9/711: dread d8/df/d5b/d32/d45/f77 [0,4194304] 0 2024-03-16T10:53:27.455 INFO:tasks.workunit.client.0.smithi017.stdout:8/830: dwrite d6/d39/f101 [0,4194304] 0 2024-03-16T10:53:27.456 INFO:tasks.workunit.client.0.smithi017.stdout:8/831: dread d6/d5f/d6e/fc6 [0,4194304] 0 2024-03-16T10:53:27.458 INFO:tasks.workunit.client.0.smithi017.stdout:9/712: mkdir d8/dbf/d68/d98/deb 0 2024-03-16T10:53:27.458 INFO:tasks.workunit.client.0.smithi017.stdout:6/683: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:27.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/941: dread d15/d1d/d85/fa9 [0,4194304] 0 2024-03-16T10:53:27.459 INFO:tasks.workunit.client.0.smithi017.stdout:2/654: dwrite d4/d97/d9f/fc4 [0,4194304] 0 2024-03-16T10:53:27.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/713: symlink d8/df/d46/d63/d94/d9d/lec 0 2024-03-16T10:53:27.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/714: chown d8/df/f4f 98647363 1 2024-03-16T10:53:27.462 INFO:tasks.workunit.client.0.smithi017.stdout:8/832: write d6/d39/f101 [1691850,129198] 0 2024-03-16T10:53:27.465 INFO:tasks.workunit.client.0.smithi017.stdout:6/684: rename d0/d21/fca to d0/d15/fd1 0 2024-03-16T10:53:27.466 INFO:tasks.workunit.client.0.smithi017.stdout:9/715: creat d8/df/d5b/daf/db7/de6/fed x:0 0 0 2024-03-16T10:53:27.468 INFO:tasks.workunit.client.0.smithi017.stdout:2/655: mkdir d4/d6/db/d66/dcc 0 2024-03-16T10:53:27.468 INFO:tasks.workunit.client.0.smithi017.stdout:2/656: write d4/dd/f1d [2834002,91093] 0 2024-03-16T10:53:27.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/942: rename d15/d1d/d21/d3c/de9/d7c to d15/d1d/d21/d3c/de9/d43/dd1/d122/d146 0 2024-03-16T10:53:27.470 INFO:tasks.workunit.client.0.smithi017.stdout:6/685: mkdir d0/d77/dd2 0 2024-03-16T10:53:27.474 INFO:tasks.workunit.client.0.smithi017.stdout:6/686: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d86/dad to d0/d3e/dd3 0 2024-03-16T10:53:27.474 INFO:tasks.workunit.client.0.smithi017.stdout:6/687: readlink d0/d15/l34 0 2024-03-16T10:53:27.475 INFO:tasks.workunit.client.0.smithi017.stdout:4/943: rmdir d15/d1d/d21/d3c/de9/d40/d51/d64/d76 39 2024-03-16T10:53:27.475 INFO:tasks.workunit.client.0.smithi017.stdout:8/833: dwrite d6/d5f/da4/ffc [0,4194304] 0 2024-03-16T10:53:27.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/944: symlink d15/d1d/d21/d26/d66/d8c/dab/dc7/l147 0 2024-03-16T10:53:27.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/945: write d15/d1d/d21/d3c/de9/d40/f10e [2530468,42734] 0 2024-03-16T10:53:27.477 INFO:tasks.workunit.client.0.smithi017.stdout:8/834: mknod d6/d14/d6b/c105 0 2024-03-16T10:53:27.478 INFO:tasks.workunit.client.0.smithi017.stdout:4/946: mknod d15/d1d/d21/d3c/de9/d40/d51/d64/d106/c148 0 2024-03-16T10:53:27.479 INFO:tasks.workunit.client.0.smithi017.stdout:9/716: dwrite d8/df/d5b/d32/d45/fa1 [0,4194304] 0 2024-03-16T10:53:27.480 INFO:tasks.workunit.client.0.smithi017.stdout:8/835: creat d6/d4a/f106 x:0 0 0 2024-03-16T10:53:27.483 INFO:tasks.workunit.client.0.smithi017.stdout:8/836: creat d6/d5f/d6e/d34/db4/f107 x:0 0 0 2024-03-16T10:53:27.483 INFO:tasks.workunit.client.0.smithi017.stdout:8/837: dread - d6/d14/d8c/fc1 zero size 2024-03-16T10:53:27.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/947: dread d15/d1d/d21/d3c/de9/d40/d51/d64/fd8 [0,4194304] 0 2024-03-16T10:53:27.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/948: chown d15/d1d/d21/d26/d66/f125 2325439 1 2024-03-16T10:53:27.502 INFO:tasks.workunit.client.0.smithi017.stdout:5/936: sync 2024-03-16T10:53:27.502 INFO:tasks.workunit.client.0.smithi017.stdout:0/939: sync 2024-03-16T10:53:27.502 INFO:tasks.workunit.client.0.smithi017.stdout:3/753: sync 2024-03-16T10:53:27.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/754: readlink d8/d1d/db2/lcc 0 2024-03-16T10:53:27.503 INFO:tasks.workunit.client.0.smithi017.stdout:5/937: truncate d0/d1/d2/d8c/f120 579603 0 2024-03-16T10:53:27.504 INFO:tasks.workunit.client.0.smithi017.stdout:3/755: creat d8/fdf x:0 0 0 2024-03-16T10:53:27.504 INFO:tasks.workunit.client.0.smithi017.stdout:0/940: truncate d2/d4/d6d/d84/dc1/dd2/de/fb0 2224449 0 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/717: dwrite d8/df/d46/f55 [0,4194304] 0 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/718: stat d8/df/d46/d63 0 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/719: read - d8/dbf/d68/d7f/fc0 zero size 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/720: dread - d8/df/d5b/d32/d45/f9c zero size 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/721: dread - d8/df/d5b/d72/fd2 zero size 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/722: fdatasync d8/df/d5b/d32/f67 0 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:9/723: read - d8/df/d5b/d70/fe1 zero size 2024-03-16T10:53:27.506 INFO:tasks.workunit.client.0.smithi017.stdout:0/941: creat d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/f148 x:0 0 0 2024-03-16T10:53:27.507 INFO:tasks.workunit.client.0.smithi017.stdout:8/838: dwrite d6/d14/d6b/f8e [0,4194304] 0 2024-03-16T10:53:27.508 INFO:tasks.workunit.client.0.smithi017.stdout:0/942: symlink d2/d4/d61/d136/l149 0 2024-03-16T10:53:27.508 INFO:tasks.workunit.client.0.smithi017.stdout:0/943: write d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/f147 [9455,81935] 0 2024-03-16T10:53:27.508 INFO:tasks.workunit.client.0.smithi017.stdout:0/944: dread - d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f12d zero size 2024-03-16T10:53:27.508 INFO:tasks.workunit.client.0.smithi017.stdout:8/839: truncate d6/d16/db3/ff9 1540932 0 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:5/938: dread d0/ded/d6a/f7e [0,4194304] 0 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:5/939: chown d0/f98 134341859 1 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:5/940: truncate d0/ded/d6a/f7e 4632724 0 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:5/941: write d0/ded/d6a/da0/f13d [181343,69850] 0 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/945: symlink d2/d4/d6d/d84/dc1/dd2/d24/d29/db3/l14a 0 2024-03-16T10:53:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/946: write d2/d4/d6d/dde/f10a [660474,97229] 0 2024-03-16T10:53:27.514 INFO:tasks.workunit.client.0.smithi017.stdout:5/942: mkdir d0/d1/d2/dec/d128/d132/d142 0 2024-03-16T10:53:27.514 INFO:tasks.workunit.client.0.smithi017.stdout:0/947: unlink d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fe4 0 2024-03-16T10:53:27.516 INFO:tasks.workunit.client.0.smithi017.stdout:9/724: read d8/df/d5b/daf/fc1 [1433575,71511] 0 2024-03-16T10:53:27.518 INFO:tasks.workunit.client.0.smithi017.stdout:3/756: dwrite d8/d1b/d65/da6/fc2 [0,4194304] 0 2024-03-16T10:53:27.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/840: dwrite d6/d5c/d96/d98/fee [4194304,4194304] 0 2024-03-16T10:53:27.521 INFO:tasks.workunit.client.0.smithi017.stdout:8/841: mknod d6/dc5/c108 0 2024-03-16T10:53:27.522 INFO:tasks.workunit.client.0.smithi017.stdout:5/943: dread d0/d1/d1f/f7b [0,4194304] 0 2024-03-16T10:53:27.524 INFO:tasks.workunit.client.0.smithi017.stdout:8/842: rename d6/d16/db3/dcb/c63 to d6/d16/d6c/c109 0 2024-03-16T10:53:27.525 INFO:tasks.workunit.client.0.smithi017.stdout:5/944: mknod d0/d1/d1f/d97/de6/c143 0 2024-03-16T10:53:27.526 INFO:tasks.workunit.client.0.smithi017.stdout:8/843: stat d6/d14/d6b/ce4 0 2024-03-16T10:53:27.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/844: mkdir d6/d16/d6c/dd4/d10a 0 2024-03-16T10:53:27.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/845: truncate d6/d16/db3/dcb/ff1 578880 0 2024-03-16T10:53:27.529 INFO:tasks.workunit.client.0.smithi017.stdout:5/945: write d0/d1/f16 [1587450,60289] 0 2024-03-16T10:53:27.529 INFO:tasks.workunit.client.0.smithi017.stdout:3/757: dread d8/d3f/d3d/f48 [0,4194304] 0 2024-03-16T10:53:27.530 INFO:tasks.workunit.client.0.smithi017.stdout:8/846: link d6/d16/d6c/l82 d6/d5f/da4/l10b 0 2024-03-16T10:53:27.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/758: write d8/da/db/f15 [8735900,24227] 0 2024-03-16T10:53:27.530 INFO:tasks.workunit.client.0.smithi017.stdout:0/948: dwrite d2/d4/d6d/ff5 [0,4194304] 0 2024-03-16T10:53:27.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/759: creat d8/d8c/fe0 x:0 0 0 2024-03-16T10:53:27.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/760: chown d8/da/fa4 15023 1 2024-03-16T10:53:27.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/761: fdatasync d8/d1b/d2e/d57/f89 0 2024-03-16T10:53:27.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/762: write d8/d1b/d2e/d8d/fc7 [854420,27616] 0 2024-03-16T10:53:27.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/763: fdatasync d8/f4e 0 2024-03-16T10:53:27.537 INFO:tasks.workunit.client.0.smithi017.stdout:8/847: dread d6/d16/f70 [0,4194304] 0 2024-03-16T10:53:27.543 INFO:tasks.workunit.client.0.smithi017.stdout:0/949: write d2/d4/f51 [1099050,55252] 0 2024-03-16T10:53:27.549 INFO:tasks.workunit.client.0.smithi017.stdout:3/764: dwrite d8/d1d/dab/dc4/dd7/d62/d69/f80 [0,4194304] 0 2024-03-16T10:53:27.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/725: dwrite d8/df/d5b/d32/f34 [0,4194304] 0 2024-03-16T10:53:27.556 INFO:tasks.workunit.client.0.smithi017.stdout:8/848: dwrite d6/d5c/d96/d98/fe7 [0,4194304] 0 2024-03-16T10:53:27.558 INFO:tasks.workunit.client.0.smithi017.stdout:9/726: creat d8/df/d46/d63/d94/d9d/fee x:0 0 0 2024-03-16T10:53:27.558 INFO:tasks.workunit.client.0.smithi017.stdout:9/727: write d8/df/d5b/f6f [663132,6916] 0 2024-03-16T10:53:27.558 INFO:tasks.workunit.client.0.smithi017.stdout:9/728: readlink d8/lc2 0 2024-03-16T10:53:27.560 INFO:tasks.workunit.client.0.smithi017.stdout:8/849: symlink d6/d14/d72/l10c 0 2024-03-16T10:53:27.562 INFO:tasks.workunit.client.0.smithi017.stdout:3/765: dread d8/d8c/fc9 [0,4194304] 0 2024-03-16T10:53:27.562 INFO:tasks.workunit.client.0.smithi017.stdout:5/946: rename d0/d1/d2/d8c/db9 to d0/d1/d2/d2c/d11a/d144 0 2024-03-16T10:53:27.563 INFO:tasks.workunit.client.0.smithi017.stdout:0/950: dwrite d2/d4/d6d/d84/dc1/dd2/de/d1e/f12b [0,4194304] 0 2024-03-16T10:53:27.566 INFO:tasks.workunit.client.0.smithi017.stdout:5/947: mkdir d0/d1/d30/dde/d57/d145 0 2024-03-16T10:53:27.566 INFO:tasks.workunit.client.0.smithi017.stdout:0/951: creat d2/d4/d6d/d84/dc1/dd2/d24/d3a/f14b x:0 0 0 2024-03-16T10:53:27.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/850: write d6/d5c/f8f [6535559,94233] 0 2024-03-16T10:53:27.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/729: dread d8/dbf/d68/fea [0,4194304] 0 2024-03-16T10:53:27.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/730: readlink d8/df/d66/l74 0 2024-03-16T10:53:27.568 INFO:tasks.workunit.client.0.smithi017.stdout:3/766: rmdir d8/d1d/dab 39 2024-03-16T10:53:27.569 INFO:tasks.workunit.client.0.smithi017.stdout:5/948: mkdir d0/d1/d1f/d29/d88/d146 0 2024-03-16T10:53:27.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/767: mknod d8/d1d/dab/dc4/dd7/d62/d69/d8b/ce1 0 2024-03-16T10:53:27.571 INFO:tasks.workunit.client.0.smithi017.stdout:5/949: creat d0/d1/f147 x:0 0 0 2024-03-16T10:53:27.573 INFO:tasks.workunit.client.0.smithi017.stdout:5/950: unlink d0/d1/c1a 0 2024-03-16T10:53:27.576 INFO:tasks.workunit.client.0.smithi017.stdout:5/951: link d0/f87 d0/d1/d2/d2c/d36/db4/dea/f148 0 2024-03-16T10:53:27.577 INFO:tasks.workunit.client.0.smithi017.stdout:5/952: readlink d0/d1/d2/d8c/lb7 0 2024-03-16T10:53:27.580 INFO:tasks.workunit.client.0.smithi017.stdout:9/731: dread d8/df/f1a [8388608,4194304] 0 2024-03-16T10:53:27.583 INFO:tasks.workunit.client.0.smithi017.stdout:8/851: dread d6/d16/d6c/dd4/d92/fc8 [0,4194304] 0 2024-03-16T10:53:27.583 INFO:tasks.workunit.client.0.smithi017.stdout:0/952: dwrite d2/d4/d90/d86/db7/dc0/dd5/f102 [0,4194304] 0 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/953: mkdir d0/d1/d2/d2c/d36/d149 0 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/954: write d0/d1/d76/f112 [762512,40418] 0 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:5/955: chown d0/d1/d2/d2c/d11a/d144 834651 1 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:0/953: truncate d2/d4/d6d/d84/dc1/dd2/d24/ff0 3647934 0 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:0/954: fsync d2/d4/d90/d86/f5a 0 2024-03-16T10:53:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:0/955: chown d2/d4/d6d/d84/dc1/dd2/d24/d3a/c138 483951057 1 2024-03-16T10:53:27.586 INFO:tasks.workunit.client.0.smithi017.stdout:9/732: creat d8/dbf/d68/d7f/fef x:0 0 0 2024-03-16T10:53:27.586 INFO:tasks.workunit.client.0.smithi017.stdout:9/733: chown d8/df/d66/c87 77875 1 2024-03-16T10:53:27.587 INFO:tasks.workunit.client.0.smithi017.stdout:0/956: mknod d2/d4/d6d/d115/c14c 0 2024-03-16T10:53:27.594 INFO:tasks.workunit.client.0.smithi017.stdout:5/956: mkdir d0/d1/d2/d2c/d36/d136/d14a 0 2024-03-16T10:53:27.596 INFO:tasks.workunit.client.0.smithi017.stdout:9/734: symlink d8/df/d46/d63/d94/lf0 0 2024-03-16T10:53:27.596 INFO:tasks.workunit.client.0.smithi017.stdout:0/957: dread d2/d4/d6d/d84/dc1/dd2/de/d19/f56 [0,4194304] 0 2024-03-16T10:53:27.598 INFO:tasks.workunit.client.0.smithi017.stdout:5/957: rename d0/d1/d30/dde/d42/db6 to d0/d1/d1f/d29/d88/d91/dda/d14b 0 2024-03-16T10:53:27.601 INFO:tasks.workunit.client.0.smithi017.stdout:9/735: creat d8/df/d66/dd1/ff1 x:0 0 0 2024-03-16T10:53:27.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/736: write d8/df/d5b/daf/db7/fc4 [474403,20092] 0 2024-03-16T10:53:27.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/737: readlink d8/df/d5b/d72/la6 0 2024-03-16T10:53:27.604 INFO:tasks.workunit.client.0.smithi017.stdout:5/958: creat d0/ded/f14c x:0 0 0 2024-03-16T10:53:27.611 INFO:tasks.workunit.client.0.smithi017.stdout:5/959: creat d0/d1/d2/d2c/d36/db4/de2/f14d x:0 0 0 2024-03-16T10:53:27.612 INFO:tasks.workunit.client.0.smithi017.stdout:0/958: creat d2/d4/d90/d86/db7/dc0/f14d x:0 0 0 2024-03-16T10:53:27.612 INFO:tasks.workunit.client.0.smithi017.stdout:9/738: dwrite d8/df/d5b/d32/f50 [4194304,4194304] 0 2024-03-16T10:53:27.613 INFO:tasks.workunit.client.0.smithi017.stdout:5/960: creat d0/d1/d1f/d29/dd5/f14e x:0 0 0 2024-03-16T10:53:27.614 INFO:tasks.workunit.client.0.smithi017.stdout:0/959: rmdir d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1 39 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/917: sync 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/872: sync 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/918: read - d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/ffd zero size 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/919: chown d1/d3/dd/d72/f74 230 1 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/920: stat d1/d50/faa 0 2024-03-16T10:53:27.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/921: truncate d1/d24/d79/dd2/d100/f10d 572376 0 2024-03-16T10:53:27.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/739: write d8/dbf/d68/fea [2572951,117680] 0 2024-03-16T10:53:27.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/740: stat d8/l26 0 2024-03-16T10:53:27.620 INFO:tasks.workunit.client.0.smithi017.stdout:9/741: truncate d8/dbf/d91/f99 4124159 0 2024-03-16T10:53:27.622 INFO:tasks.workunit.client.0.smithi017.stdout:0/960: read d2/d4/d6d/d84/dc1/dd2/f9 [2103293,61657] 0 2024-03-16T10:53:27.622 INFO:tasks.workunit.client.0.smithi017.stdout:9/742: creat d8/df/d5b/d32/ff2 x:0 0 0 2024-03-16T10:53:27.624 INFO:tasks.workunit.client.0.smithi017.stdout:0/961: creat d2/d4/d6d/d84/dc1/dd2/de/d1e/db4/f14e x:0 0 0 2024-03-16T10:53:27.625 INFO:tasks.workunit.client.0.smithi017.stdout:9/743: unlink d8/f30 0 2024-03-16T10:53:27.625 INFO:tasks.workunit.client.0.smithi017.stdout:9/744: read - d8/df/d5b/d32/d45/f9c zero size 2024-03-16T10:53:27.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/961: dwrite d0/d1/d1f/d29/d99/f13c [0,4194304] 0 2024-03-16T10:53:27.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/962: chown d0/d1/f124 607 1 2024-03-16T10:53:27.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/963: dread - d0/d1/d1f/d29/dd5/f14e zero size 2024-03-16T10:53:27.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/964: stat d0/ded/d6a/da0/ccb 0 2024-03-16T10:53:27.627 INFO:tasks.workunit.client.0.smithi017.stdout:7/873: dread d7/d8a/f39 [0,4194304] 0 2024-03-16T10:53:27.627 INFO:tasks.workunit.client.0.smithi017.stdout:9/745: symlink d8/dbf/d68/d7f/lf3 0 2024-03-16T10:53:27.627 INFO:tasks.workunit.client.0.smithi017.stdout:0/962: dread d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f133 [0,4194304] 0 2024-03-16T10:53:27.629 INFO:tasks.workunit.client.0.smithi017.stdout:5/965: mkdir d0/d1/d1f/d97/d14f 0 2024-03-16T10:53:27.629 INFO:tasks.workunit.client.0.smithi017.stdout:5/966: write d0/d1/d1f/d29/d88/d91/fba [485473,125960] 0 2024-03-16T10:53:27.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/874: rmdir d7/db/d12/ddf/d123 39 2024-03-16T10:53:27.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/875: write d7/d8a/f39 [2403591,103605] 0 2024-03-16T10:53:27.632 INFO:tasks.workunit.client.0.smithi017.stdout:9/746: mknod d8/df/d46/d63/d94/cf4 0 2024-03-16T10:53:27.634 INFO:tasks.workunit.client.0.smithi017.stdout:5/967: unlink d0/d1/d2/d24/f13b 0 2024-03-16T10:53:27.635 INFO:tasks.workunit.client.0.smithi017.stdout:1/922: dwrite d1/d24/d79/dd2/f11b [0,4194304] 0 2024-03-16T10:53:27.636 INFO:tasks.workunit.client.0.smithi017.stdout:9/747: creat d8/df/d5b/d72/d9e/ff5 x:0 0 0 2024-03-16T10:53:27.639 INFO:tasks.workunit.client.0.smithi017.stdout:9/748: symlink d8/df/d5b/daf/db7/de6/lf6 0 2024-03-16T10:53:27.641 INFO:tasks.workunit.client.0.smithi017.stdout:0/963: dwrite d2/d4/d6d/d84/dc1/dd2/d24/d29/fe3 [0,4194304] 0 2024-03-16T10:53:27.643 INFO:tasks.workunit.client.0.smithi017.stdout:5/968: rename d0/d1/d2/d2c/fbd to d0/d1/d1f/d97/f150 0 2024-03-16T10:53:27.644 INFO:tasks.workunit.client.0.smithi017.stdout:0/964: truncate d2/d4/d6d/d84/dc1/dd2/d24/d72/d7b/f96 1747963 0 2024-03-16T10:53:27.645 INFO:tasks.workunit.client.0.smithi017.stdout:0/965: unlink d2/d4/d6d/d84/dc1/dd2/c68 0 2024-03-16T10:53:27.646 INFO:tasks.workunit.client.0.smithi017.stdout:1/923: dread d1/d3/dd/d72/f74 [0,4194304] 0 2024-03-16T10:53:27.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/876: dwrite d7/db/d32/d78/da5/fe4 [0,4194304] 0 2024-03-16T10:53:27.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/877: write d7/db/d12/ddf/d123/f125 [285105,111926] 0 2024-03-16T10:53:27.648 INFO:tasks.workunit.client.0.smithi017.stdout:1/924: mknod d1/d24/d79/dd2/d100/d97/c135 0 2024-03-16T10:53:27.648 INFO:tasks.workunit.client.0.smithi017.stdout:0/966: mkdir d2/d4/d12c/d14f 0 2024-03-16T10:53:27.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/969: symlink d0/d1/d1f/d97/d116/l151 0 2024-03-16T10:53:27.649 INFO:tasks.workunit.client.0.smithi017.stdout:5/970: write d0/d1/d1f/d29/d88/d91/f12a [32563,73394] 0 2024-03-16T10:53:27.649 INFO:tasks.workunit.client.0.smithi017.stdout:1/925: mknod d1/d24/d79/dd2/d100/d93/c136 0 2024-03-16T10:53:27.649 INFO:tasks.workunit.client.0.smithi017.stdout:1/926: readlink d1/d24/d79/dd2/d100/d97/lc3 0 2024-03-16T10:53:27.659 INFO:tasks.workunit.client.0.smithi017.stdout:7/878: read d7/db/d81/f97 [1083527,123805] 0 2024-03-16T10:53:27.660 INFO:tasks.workunit.client.0.smithi017.stdout:9/749: dwrite d8/dbf/d68/d7f/fc0 [0,4194304] 0 2024-03-16T10:53:27.661 INFO:tasks.workunit.client.0.smithi017.stdout:7/879: creat d7/db/d120/d50/d59/d34/d95/f12c x:0 0 0 2024-03-16T10:53:27.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/880: creat d7/db/d120/d50/d59/d34/d53/f12d x:0 0 0 2024-03-16T10:53:27.666 INFO:tasks.workunit.client.0.smithi017.stdout:7/881: creat d7/db/d120/d50/d59/d34/d53/dee/f12e x:0 0 0 2024-03-16T10:53:27.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/967: unlink d2/d4/d6d/f7f 0 2024-03-16T10:53:27.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/968: write d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/f129 [484121,81112] 0 2024-03-16T10:53:27.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/971: getdents d0/d1/d1f/d97 0 2024-03-16T10:53:27.669 INFO:tasks.workunit.client.0.smithi017.stdout:5/972: chown d0/d1/d2/dc/f49 52 1 2024-03-16T10:53:27.670 INFO:tasks.workunit.client.0.smithi017.stdout:9/750: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:27.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/969: rmdir d2/d4/d6d/d84/dc1/dd2/d24/d72/d88 39 2024-03-16T10:53:27.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/970: write d2/d4/d6d/d84/dc1/dd2/d24/d29/fc5 [335887,75274] 0 2024-03-16T10:53:27.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/971: write d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/fba [2061549,125029] 0 2024-03-16T10:53:27.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/972: creat d2/d4/d6d/d84/dc1/dd2/de/d1e/f150 x:0 0 0 2024-03-16T10:53:27.680 INFO:tasks.workunit.client.0.smithi017.stdout:0/973: creat d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/dd1/f151 x:0 0 0 2024-03-16T10:53:27.681 INFO:tasks.workunit.client.0.smithi017.stdout:5/973: dread d0/d1/d107/f66 [0,4194304] 0 2024-03-16T10:53:27.681 INFO:tasks.workunit.client.0.smithi017.stdout:7/882: unlink d7/db/d12/d1c/d30/c85 0 2024-03-16T10:53:27.682 INFO:tasks.workunit.client.0.smithi017.stdout:5/974: creat d0/d1/d2/d111/f152 x:0 0 0 2024-03-16T10:53:27.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/751: read d8/df/d5b/d32/f50 [3467808,104087] 0 2024-03-16T10:53:27.684 INFO:tasks.workunit.client.0.smithi017.stdout:7/883: creat d7/db/d120/d50/df8/f12f x:0 0 0 2024-03-16T10:53:27.685 INFO:tasks.workunit.client.0.smithi017.stdout:0/974: dread d2/d4/d6d/d84/dc1/dd2/f63 [0,4194304] 0 2024-03-16T10:53:27.685 INFO:tasks.workunit.client.0.smithi017.stdout:0/975: chown d2/d4/d6d/d84/dc1/dd2/l130 14 1 2024-03-16T10:53:27.686 INFO:tasks.workunit.client.0.smithi017.stdout:5/975: link d0/d1/d30/dde/d42/d4c/f4e d0/d1/d1f/d29/d88/f153 0 2024-03-16T10:53:27.686 INFO:tasks.workunit.client.0.smithi017.stdout:5/976: fsync d0/ded/f8d 0 2024-03-16T10:53:27.687 INFO:tasks.workunit.client.0.smithi017.stdout:0/976: symlink d2/d4/d6d/d84/dc1/dd2/l152 0 2024-03-16T10:53:27.687 INFO:tasks.workunit.client.0.smithi017.stdout:0/977: chown d2/d4/d90/dc2 211699622 1 2024-03-16T10:53:27.687 INFO:tasks.workunit.client.0.smithi017.stdout:9/752: symlink d8/df/d5b/d32/lf7 0 2024-03-16T10:53:27.691 INFO:tasks.workunit.client.0.smithi017.stdout:5/977: creat d0/d1/d1f/d29/d99/f154 x:0 0 0 2024-03-16T10:53:27.693 INFO:tasks.workunit.client.0.smithi017.stdout:5/978: creat d0/d1/d2/dec/d128/d132/d142/f155 x:0 0 0 2024-03-16T10:53:27.693 INFO:tasks.workunit.client.0.smithi017.stdout:5/979: chown d0/d1/d1f/d29/d88/d91/dda/fff 15161268 1 2024-03-16T10:53:27.695 INFO:tasks.workunit.client.0.smithi017.stdout:5/980: dread d0/d1/d2/d2c/d36/d51/f118 [0,4194304] 0 2024-03-16T10:53:27.707 INFO:tasks.workunit.client.0.smithi017.stdout:1/927: rename d1/d3/dd/d31/d35/c5b to d1/d3/dd/d31/d66/dd3/c137 0 2024-03-16T10:53:27.709 INFO:tasks.workunit.client.0.smithi017.stdout:5/981: dread d0/d1/d1f/d97/fca [0,4194304] 0 2024-03-16T10:53:27.709 INFO:tasks.workunit.client.0.smithi017.stdout:5/982: chown d0/d1/d107 59 1 2024-03-16T10:53:27.711 INFO:tasks.workunit.client.0.smithi017.stdout:7/884: rename d7/db/d120/d50/d59/f8f to d7/db/d32/d78/da5/f130 0 2024-03-16T10:53:27.711 INFO:tasks.workunit.client.0.smithi017.stdout:2/657: sync 2024-03-16T10:53:27.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/768: sync 2024-03-16T10:53:27.712 INFO:tasks.workunit.client.0.smithi017.stdout:4/949: sync 2024-03-16T10:53:27.712 INFO:tasks.workunit.client.0.smithi017.stdout:6/688: sync 2024-03-16T10:53:27.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/753: dwrite d8/df/d66/dd1/ff1 [0,4194304] 0 2024-03-16T10:53:27.714 INFO:tasks.workunit.client.0.smithi017.stdout:5/983: rename d0/d1/d2/dec/d128 to d0/d1/d2/d2c/d36/d149/d156 0 2024-03-16T10:53:27.715 INFO:tasks.workunit.client.0.smithi017.stdout:0/978: dwrite d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/f119 [0,4194304] 0 2024-03-16T10:53:27.715 INFO:tasks.workunit.client.0.smithi017.stdout:0/979: truncate d2/d4/d6d/d84/dc1/dd2/de/f16 4722526 0 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:7/885: link d7/db/d12/d1c/l71 d7/db/d120/d50/d73/d11e/l131 0 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:4/950: rmdir d15/d1d/d21/d3c/de9/d40/d51/d64/d76 39 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/928: dread d1/d50/d8d/fc5 [4194304,4194304] 0 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/769: symlink d8/d1b/d2e/d60/le2 0 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/770: fsync d8/d1b/d2e/fba 0 2024-03-16T10:53:27.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/771: chown d8/d1b/c22 39 1 2024-03-16T10:53:27.721 INFO:tasks.workunit.client.0.smithi017.stdout:0/980: truncate d2/d4/d6d/d84/dc1/dd2/f87 628189 0 2024-03-16T10:53:27.721 INFO:tasks.workunit.client.0.smithi017.stdout:6/689: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fa9 to d0/d21/d39/d44/d95/fd4 0 2024-03-16T10:53:27.721 INFO:tasks.workunit.client.0.smithi017.stdout:6/690: truncate d0/d15/d1f/f60 2720492 0 2024-03-16T10:53:27.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/658: dwrite d4/dd/d1e/d4a/fa8 [0,4194304] 0 2024-03-16T10:53:27.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/659: chown d4/d6/db/d66/d93/fae 0 1 2024-03-16T10:53:27.728 INFO:tasks.workunit.client.0.smithi017.stdout:7/886: symlink d7/l132 0 2024-03-16T10:53:27.728 INFO:tasks.workunit.client.0.smithi017.stdout:7/887: truncate d7/d8a/f29 9412780 0 2024-03-16T10:53:27.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/772: truncate d8/f17 322716 0 2024-03-16T10:53:27.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/951: read d15/d1d/d21/d3c/de9/d96/f11d [1788052,63038] 0 2024-03-16T10:53:27.730 INFO:tasks.workunit.client.0.smithi017.stdout:1/929: dwrite d1/d3/dd/d31/d66/de0/f103 [4194304,4194304] 0 2024-03-16T10:53:27.730 INFO:tasks.workunit.client.0.smithi017.stdout:1/930: fsync d1/d3/dd/d31/d35/f75 0 2024-03-16T10:53:27.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/691: dread d0/d15/f55 [0,4194304] 0 2024-03-16T10:53:27.731 INFO:tasks.workunit.client.0.smithi017.stdout:9/754: link d8/l3e d8/d95/lf8 0 2024-03-16T10:53:27.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/660: rmdir d4/d6/db/d66/daf 39 2024-03-16T10:53:27.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/984: truncate d0/d1/d2/d2c/d38/f61 1132542 0 2024-03-16T10:53:27.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/773: truncate d8/d3f/fc6 3949117 0 2024-03-16T10:53:27.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/774: chown d8/d1d/dab/dc4/dd7/d62/d69 1998504 1 2024-03-16T10:53:27.735 INFO:tasks.workunit.client.0.smithi017.stdout:7/888: rmdir d7/db/d32/dc5 39 2024-03-16T10:53:27.735 INFO:tasks.workunit.client.0.smithi017.stdout:7/889: fsync d7/db/d12/d1c/f36 0 2024-03-16T10:53:27.737 INFO:tasks.workunit.client.0.smithi017.stdout:5/985: write d0/d1/d1f/d97/fca [3011090,80324] 0 2024-03-16T10:53:27.737 INFO:tasks.workunit.client.0.smithi017.stdout:5/986: write d0/d1/d2/d2c/d36/d51/fc7 [357301,85603] 0 2024-03-16T10:53:27.739 INFO:tasks.workunit.client.0.smithi017.stdout:2/661: creat d4/d6/fcd x:0 0 0 2024-03-16T10:53:27.742 INFO:tasks.workunit.client.0.smithi017.stdout:8/852: sync 2024-03-16T10:53:27.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/952: dread d15/d1d/d21/d3c/de9/d96/fa5 [0,4194304] 0 2024-03-16T10:53:27.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/662: mkdir d4/dce 0 2024-03-16T10:53:27.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/663: fdatasync d4/f5e 0 2024-03-16T10:53:27.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/664: readlink d4/dd/d38/dc3/lb1 0 2024-03-16T10:53:27.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/931: dwrite d1/d3/d88/f102 [0,4194304] 0 2024-03-16T10:53:27.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/932: readlink d1/d3/dd/l10 0 2024-03-16T10:53:27.755 INFO:tasks.workunit.client.0.smithi017.stdout:3/775: dwrite d8/d1d/dab/dc4/dd7/d62/d69/f83 [0,4194304] 0 2024-03-16T10:53:27.755 INFO:tasks.workunit.client.0.smithi017.stdout:3/776: chown d8/d1d/c24 4853 1 2024-03-16T10:53:27.757 INFO:tasks.workunit.client.0.smithi017.stdout:2/665: dread d4/f56 [0,4194304] 0 2024-03-16T10:53:27.757 INFO:tasks.workunit.client.0.smithi017.stdout:6/692: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:27.758 INFO:tasks.workunit.client.0.smithi017.stdout:6/693: read d0/d21/d39/d44/d9a/da7/d45/d4d/f83 [20030,79714] 0 2024-03-16T10:53:27.758 INFO:tasks.workunit.client.0.smithi017.stdout:6/694: dread - d0/d21/d39/d44/fba zero size 2024-03-16T10:53:27.759 INFO:tasks.workunit.client.0.smithi017.stdout:8/853: unlink d6/d16/ca5 0 2024-03-16T10:53:27.760 INFO:tasks.workunit.client.0.smithi017.stdout:4/953: link d15/d1d/f81 d15/d1d/d21/d3c/de9/d40/d137/f149 0 2024-03-16T10:53:27.763 INFO:tasks.workunit.client.0.smithi017.stdout:1/933: read d1/fda [2048872,128740] 0 2024-03-16T10:53:27.764 INFO:tasks.workunit.client.0.smithi017.stdout:1/934: dread - d1/d24/d79/fb6 zero size 2024-03-16T10:53:27.765 INFO:tasks.workunit.client.0.smithi017.stdout:0/981: unlink d2/d4/d6d/d84/dc1/dd2/de/f16 0 2024-03-16T10:53:27.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/890: dwrite d7/db/d32/d78/da5/f130 [0,4194304] 0 2024-03-16T10:53:27.768 INFO:tasks.workunit.client.0.smithi017.stdout:0/982: getdents d2/d4/d61/d135 0 2024-03-16T10:53:27.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/695: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f4b 3204373 0 2024-03-16T10:53:27.770 INFO:tasks.workunit.client.0.smithi017.stdout:0/983: mknod d2/d4/d6d/d84/dc1/dd2/de/d19/d2e/c153 0 2024-03-16T10:53:27.770 INFO:tasks.workunit.client.0.smithi017.stdout:7/891: rename d7/db/d120/d50/d59/d34/d53/le1 to d7/db/d120/d50/d59/d34/dbb/l133 0 2024-03-16T10:53:27.771 INFO:tasks.workunit.client.0.smithi017.stdout:0/984: read d2/d4/d6d/d84/dc1/dd2/d24/d29/f6a [2133948,129309] 0 2024-03-16T10:53:27.773 INFO:tasks.workunit.client.0.smithi017.stdout:8/854: mkdir d6/d5c/d10d 0 2024-03-16T10:53:27.775 INFO:tasks.workunit.client.0.smithi017.stdout:0/985: unlink f0 0 2024-03-16T10:53:27.777 INFO:tasks.workunit.client.0.smithi017.stdout:4/954: truncate d15/f9b 458253 0 2024-03-16T10:53:27.777 INFO:tasks.workunit.client.0.smithi017.stdout:4/955: fdatasync d15/d1d/d21/f72 0 2024-03-16T10:53:27.777 INFO:tasks.workunit.client.0.smithi017.stdout:4/956: write d15/d1d/d21/d26/d66/d8c/dab/dc7/f141 [194745,27617] 0 2024-03-16T10:53:27.777 INFO:tasks.workunit.client.0.smithi017.stdout:4/957: truncate d15/d1d/d21/d26/d66/d8c/dab/df2/f13d 980480 0 2024-03-16T10:53:27.777 INFO:tasks.workunit.client.0.smithi017.stdout:0/986: rmdir d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9 39 2024-03-16T10:53:27.778 INFO:tasks.workunit.client.0.smithi017.stdout:6/696: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 [0,4194304] 0 2024-03-16T10:53:27.779 INFO:tasks.workunit.client.0.smithi017.stdout:0/987: symlink d2/d4/d6d/d84/dc1/dd2/l154 0 2024-03-16T10:53:27.779 INFO:tasks.workunit.client.0.smithi017.stdout:3/777: stat d8/d1b/d2e/d57/f6a 0 2024-03-16T10:53:27.780 INFO:tasks.workunit.client.0.smithi017.stdout:3/778: write d8/d1d/dab/dc4/dd7/d62/fbe [948201,16938] 0 2024-03-16T10:53:27.782 INFO:tasks.workunit.client.0.smithi017.stdout:0/988: creat d2/d4/d6d/d84/dc1/dd2/de/d19/f155 x:0 0 0 2024-03-16T10:53:27.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/892: link d7/db/f93 d7/db/d120/d50/d73/d11e/f134 0 2024-03-16T10:53:27.783 INFO:tasks.workunit.client.0.smithi017.stdout:0/989: symlink d2/d4/d6d/dde/l156 0 2024-03-16T10:53:27.785 INFO:tasks.workunit.client.0.smithi017.stdout:4/958: unlink d15/d1d/d21/d3c/de9/d43/dd1/d122/d146/c95 0 2024-03-16T10:53:27.786 INFO:tasks.workunit.client.0.smithi017.stdout:6/697: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/fb6 [3115041,101575] 0 2024-03-16T10:53:27.786 INFO:tasks.workunit.client.0.smithi017.stdout:3/779: creat d8/d1b/d2e/d8d/d87/fe3 x:0 0 0 2024-03-16T10:53:27.789 INFO:tasks.workunit.client.0.smithi017.stdout:6/698: rmdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e 39 2024-03-16T10:53:27.791 INFO:tasks.workunit.client.0.smithi017.stdout:6/699: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dd5 0 2024-03-16T10:53:27.792 INFO:tasks.workunit.client.0.smithi017.stdout:6/700: truncate d0/d21/f36 442067 0 2024-03-16T10:53:27.808 INFO:tasks.workunit.client.0.smithi017.stdout:4/959: dwrite d15/d1d/d21/d3c/de9/d96/f11d [0,4194304] 0 2024-03-16T10:53:27.808 INFO:tasks.workunit.client.0.smithi017.stdout:4/960: write d15/d1d/d21/d3c/de9/d40/d51/d64/da8/f126 [82805,53433] 0 2024-03-16T10:53:27.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/780: dwrite d8/d1b/d2e/d8d/fc3 [0,4194304] 0 2024-03-16T10:53:27.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/961: rename d15/d1d/d21/d3c/de9/d43/f9e to d15/d1d/d21/d26/d66/f14a 0 2024-03-16T10:53:27.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/962: chown d15/d1d/d21/d3c/de9/d40/d51/f115 2734418 1 2024-03-16T10:53:27.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/781: creat d8/d8c/fe4 x:0 0 0 2024-03-16T10:53:27.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/782: stat d8/d1b/d2e/d60/d63/dd9 0 2024-03-16T10:53:27.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/783: stat d8/f4e 0 2024-03-16T10:53:27.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/784: chown d8/f17 26 1 2024-03-16T10:53:27.816 INFO:tasks.workunit.client.0.smithi017.stdout:4/963: creat d15/d1d/d27/db6/f14b x:0 0 0 2024-03-16T10:53:27.816 INFO:tasks.workunit.client.0.smithi017.stdout:4/964: write d15/d1d/d27/f55 [264626,116605] 0 2024-03-16T10:53:27.817 INFO:tasks.workunit.client.0.smithi017.stdout:3/785: creat d8/d1d/dab/dc4/dd7/d62/d69/fe5 x:0 0 0 2024-03-16T10:53:27.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/701: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 [0,4194304] 0 2024-03-16T10:53:27.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/702: chown d0/d3e/c48 4003125 1 2024-03-16T10:53:27.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/703: fsync d0/d15/d1f/f32 0 2024-03-16T10:53:27.822 INFO:tasks.workunit.client.0.smithi017.stdout:4/965: mkdir d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/d14c 0 2024-03-16T10:53:27.827 INFO:tasks.workunit.client.0.smithi017.stdout:6/704: symlink d0/d21/d39/d44/d9a/ld6 0 2024-03-16T10:53:27.828 INFO:tasks.workunit.client.0.smithi017.stdout:2/666: dwrite d4/d6/db/d24/d39/f42 [0,4194304] 0 2024-03-16T10:53:27.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/705: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f79 [0,4194304] 0 2024-03-16T10:53:27.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/706: chown d0/d15/l34 31 1 2024-03-16T10:53:27.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/707: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fb8 0 2024-03-16T10:53:27.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/708: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f89 0 2024-03-16T10:53:27.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/709: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/f9b zero size 2024-03-16T10:53:27.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/786: dwrite d8/d1d/dab/dc4/dd7/d62/d69/f96 [0,4194304] 0 2024-03-16T10:53:27.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/787: dread - d8/fbf zero size 2024-03-16T10:53:27.836 INFO:tasks.workunit.client.0.smithi017.stdout:6/710: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c 506925 0 2024-03-16T10:53:27.839 INFO:tasks.workunit.client.0.smithi017.stdout:7/893: dwrite d7/db/d120/d50/d59/f55 [0,4194304] 0 2024-03-16T10:53:27.840 INFO:tasks.workunit.client.0.smithi017.stdout:7/894: chown d7/db/d81/fac 11 1 2024-03-16T10:53:27.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/990: dwrite d2/d4/d6d/fe6 [0,4194304] 0 2024-03-16T10:53:27.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/991: truncate d2/d4/d6d/d84/dc1/dd2/de/d1e/d99/f129 1300789 0 2024-03-16T10:53:27.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/992: chown d2/d4/d6d/d84/de9/fef 42925 1 2024-03-16T10:53:27.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/993: chown d2/da1/f92 121931 1 2024-03-16T10:53:27.841 INFO:tasks.workunit.client.0.smithi017.stdout:3/788: creat d8/d3f/dd3/fe6 x:0 0 0 2024-03-16T10:53:27.843 INFO:tasks.workunit.client.0.smithi017.stdout:7/895: rename d7/d8a/cc0 to d7/db/d12/ddf/d123/c135 0 2024-03-16T10:53:27.844 INFO:tasks.workunit.client.0.smithi017.stdout:0/994: creat d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/f157 x:0 0 0 2024-03-16T10:53:27.846 INFO:tasks.workunit.client.0.smithi017.stdout:7/896: link d7/db/d32/d78/da5/fe4 d7/de9/df9/f136 0 2024-03-16T10:53:27.848 INFO:tasks.workunit.client.0.smithi017.stdout:9/755: dwrite d8/df/d5b/f43 [0,4194304] 0 2024-03-16T10:53:27.848 INFO:tasks.workunit.client.0.smithi017.stdout:9/756: truncate d8/df/d46/f55 4730435 0 2024-03-16T10:53:27.850 INFO:tasks.workunit.client.0.smithi017.stdout:6/711: read d0/f6a [1473563,46398] 0 2024-03-16T10:53:27.850 INFO:tasks.workunit.client.0.smithi017.stdout:9/757: creat d8/df/d5b/d32/d45/d8b/ff9 x:0 0 0 2024-03-16T10:53:27.850 INFO:tasks.workunit.client.0.smithi017.stdout:2/667: dwrite d4/f2c [0,4194304] 0 2024-03-16T10:53:27.850 INFO:tasks.workunit.client.0.smithi017.stdout:9/758: write d8/df/d5b/d32/f57 [2009133,57455] 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:2/668: fsync d4/f6d 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:9/759: write d8/f59 [2851666,58866] 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:9/760: fdatasync d8/df/d46/d63/db4/fe7 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:7/897: creat d7/db/d12/d1c/d4e/f137 x:0 0 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:7/898: fdatasync d7/db/d120/d50/f87 0 2024-03-16T10:53:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:2/669: creat d4/dd/d1e/da7/fcf x:0 0 0 2024-03-16T10:53:27.853 INFO:tasks.workunit.client.0.smithi017.stdout:2/670: creat d4/dd/d1e/d4a/fd0 x:0 0 0 2024-03-16T10:53:27.856 INFO:tasks.workunit.client.0.smithi017.stdout:3/789: dwrite d8/d8c/fe4 [0,4194304] 0 2024-03-16T10:53:27.856 INFO:tasks.workunit.client.0.smithi017.stdout:6/712: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 [0,4194304] 0 2024-03-16T10:53:27.860 INFO:tasks.workunit.client.0.smithi017.stdout:9/761: dread d8/df/d46/d63/f7b [0,4194304] 0 2024-03-16T10:53:27.860 INFO:tasks.workunit.client.0.smithi017.stdout:9/762: dread - d8/df/d5b/d32/d45/fd8 zero size 2024-03-16T10:53:27.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/995: dwrite d2/d4/d90/d86/db7/dc0/f14d [0,4194304] 0 2024-03-16T10:53:27.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/671: dwrite d4/d6/d30/f7c [0,4194304] 0 2024-03-16T10:53:27.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/672: write d4/d6/db/d66/d2e/f3d [1276127,31653] 0 2024-03-16T10:53:27.873 INFO:tasks.workunit.client.0.smithi017.stdout:3/790: creat d8/d1d/fe7 x:0 0 0 2024-03-16T10:53:27.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/713: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fc8 [0,4194304] 0 2024-03-16T10:53:27.877 INFO:tasks.workunit.client.0.smithi017.stdout:9/763: rename d8/df/d5b/d32/ca5 to d8/df/d5b/d32/cfa 0 2024-03-16T10:53:27.879 INFO:tasks.workunit.client.0.smithi017.stdout:2/673: dwrite d4/dd/d1e/d4a/fa8 [0,4194304] 0 2024-03-16T10:53:27.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/714: write d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f19 [1193191,37445] 0 2024-03-16T10:53:27.884 INFO:tasks.workunit.client.0.smithi017.stdout:6/715: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f82 [69978,18225] 0 2024-03-16T10:53:27.884 INFO:tasks.workunit.client.0.smithi017.stdout:6/716: fdatasync d0/d15/f3d 0 2024-03-16T10:53:27.884 INFO:tasks.workunit.client.0.smithi017.stdout:6/717: fsync d0/d15/d1f/f60 0 2024-03-16T10:53:27.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/791: creat d8/d1d/dab/dc4/dd7/d62/d69/fe8 x:0 0 0 2024-03-16T10:53:27.893 INFO:tasks.workunit.client.0.smithi017.stdout:9/764: creat d8/df/d5b/d72/d9e/ffb x:0 0 0 2024-03-16T10:53:27.893 INFO:tasks.workunit.client.0.smithi017.stdout:9/765: read - d8/dbf/d68/f7a zero size 2024-03-16T10:53:27.895 INFO:tasks.workunit.client.0.smithi017.stdout:2/674: dwrite d4/dd/d1e/d3e/f45 [0,4194304] 0 2024-03-16T10:53:27.898 INFO:tasks.workunit.client.0.smithi017.stdout:6/718: link d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/lcd d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/ld7 0 2024-03-16T10:53:27.899 INFO:tasks.workunit.client.0.smithi017.stdout:3/792: creat d8/d1b/d2e/d8d/fe9 x:0 0 0 2024-03-16T10:53:27.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/719: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8 0 2024-03-16T10:53:27.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/793: mknod d8/d1d/dab/dc4/dd7/d62/d69/d8b/cea 0 2024-03-16T10:53:27.908 INFO:tasks.workunit.client.0.smithi017.stdout:9/766: dread d8/f24 [0,4194304] 0 2024-03-16T10:53:27.908 INFO:tasks.workunit.client.0.smithi017.stdout:9/767: chown d8/df/c12 223740213 1 2024-03-16T10:53:27.914 INFO:tasks.workunit.client.0.smithi017.stdout:6/720: read d0/d21/d39/d44/d9a/da7/f7b [2439096,39892] 0 2024-03-16T10:53:27.926 INFO:tasks.workunit.client.0.smithi017.stdout:9/768: creat d8/dbf/d68/d98/ffc x:0 0 0 2024-03-16T10:53:27.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/721: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:27.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/722: readlink d0/d3e/l80 0 2024-03-16T10:53:27.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/723: dread - d0/d21/d39/d44/d9a/da7/d38/f63 zero size 2024-03-16T10:53:27.932 INFO:tasks.workunit.client.0.smithi017.stdout:9/769: write d8/f79 [7934605,57191] 0 2024-03-16T10:53:27.932 INFO:tasks.workunit.client.0.smithi017.stdout:9/770: stat d8/df/d5b/daf/fc1 0 2024-03-16T10:53:27.936 INFO:tasks.workunit.client.0.smithi017.stdout:7/899: rename d7/db/d120/d50/da8/dca/l11d to d7/db/d120/dae/ddb/l138 0 2024-03-16T10:53:27.937 INFO:tasks.workunit.client.0.smithi017.stdout:7/900: creat d7/db/d120/dae/ddb/f139 x:0 0 0 2024-03-16T10:53:27.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/996: rename d2/d4/d6d/d84/dc1/dd2/d24/d72/d8e/df9/ld7 to d2/d4/d6d/d84/dc1/dd2/de/d1e/l158 0 2024-03-16T10:53:27.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/997: read - d2/d4/d6d/d84/dc1/f143 zero size 2024-03-16T10:53:27.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/998: fsync d2/d4/d6d/d84/dc1/dd2/d24/f113 0 2024-03-16T10:53:27.941 INFO:tasks.workunit.client.0.smithi017.stdout:0/999: symlink d2/d4/d90/dc2/l159 0 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/724: rename d0/d21/d39/d44/d9a/da7/d38/c81 to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/da6/cd9 0 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/725: read d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f27 [39115,61417] 0 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/726: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/fa0 zero size 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/727: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 488833 0 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/987: sync 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:2/675: link d4/d6/db/c84 d4/dd/d1e/d3e/d51/cd1 0 2024-03-16T10:53:27.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/988: dread - d0/d1/d2/d2c/d36/db4/dea/f12d zero size 2024-03-16T10:53:27.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/901: dread d7/db/d120/f17 [4194304,4194304] 0 2024-03-16T10:53:27.944 INFO:tasks.workunit.client.0.smithi017.stdout:9/771: dwrite d8/df/d46/d63/d94/d9d/fc5 [0,4194304] 0 2024-03-16T10:53:27.944 INFO:tasks.workunit.client.0.smithi017.stdout:9/772: chown d8/df/d5b/daf/ce5 19199 1 2024-03-16T10:53:27.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/728: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/cda 0 2024-03-16T10:53:27.945 INFO:tasks.workunit.client.0.smithi017.stdout:2/676: rename d4/dd/f1d to d4/d6/d30/d3f/dba/dbd/fd2 0 2024-03-16T10:53:27.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/989: creat d0/d1/d1f/d97/f157 x:0 0 0 2024-03-16T10:53:27.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/990: truncate d0/d5d/d9f/f13e 462257 0 2024-03-16T10:53:27.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/991: dread - d0/d1/d1f/d29/d88/d91/fc1 zero size 2024-03-16T10:53:27.953 INFO:tasks.workunit.client.0.smithi017.stdout:7/902: mkdir d7/db/d120/d13a 0 2024-03-16T10:53:27.955 INFO:tasks.workunit.client.0.smithi017.stdout:9/773: symlink d8/df/d5b/daf/db7/lfd 0 2024-03-16T10:53:27.957 INFO:tasks.workunit.client.0.smithi017.stdout:6/729: symlink d0/d3e/ldb 0 2024-03-16T10:53:27.957 INFO:tasks.workunit.client.0.smithi017.stdout:6/730: dread - d0/d21/fb7 zero size 2024-03-16T10:53:27.958 INFO:tasks.workunit.client.0.smithi017.stdout:2/677: dwrite d4/dd/d38/f6e [0,4194304] 0 2024-03-16T10:53:27.960 INFO:tasks.workunit.client.0.smithi017.stdout:5/992: rename d0/d1/d30/dde/d42/lf3 to d0/ded/d6a/l158 0 2024-03-16T10:53:27.961 INFO:tasks.workunit.client.0.smithi017.stdout:5/993: stat d0/d1/d1f/d29/dd5/ff8 0 2024-03-16T10:53:27.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/774: mkdir d8/dbf/d68/d98/deb/dfe 0 2024-03-16T10:53:27.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/775: stat d8/df/d5b/d70/d89/lc7 0 2024-03-16T10:53:27.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/776: write d8/df/d66/f6e [2865510,13278] 0 2024-03-16T10:53:27.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/731: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/cdc 0 2024-03-16T10:53:27.965 INFO:tasks.workunit.client.0.smithi017.stdout:5/994: symlink d0/d1/d1f/d29/d88/d91/dda/l159 0 2024-03-16T10:53:27.967 INFO:tasks.workunit.client.0.smithi017.stdout:9/777: unlink d8/df/d66/fe8 0 2024-03-16T10:53:27.968 INFO:tasks.workunit.client.0.smithi017.stdout:6/732: mknod d0/d21/d39/d44/d9a/da7/d45/cdd 0 2024-03-16T10:53:27.970 INFO:tasks.workunit.client.0.smithi017.stdout:9/778: mknod d8/df/d5b/d70/cff 0 2024-03-16T10:53:27.973 INFO:tasks.workunit.client.0.smithi017.stdout:6/733: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dde 0 2024-03-16T10:53:27.974 INFO:tasks.workunit.client.0.smithi017.stdout:6/734: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/ldf 0 2024-03-16T10:53:27.974 INFO:tasks.workunit.client.0.smithi017.stdout:9/779: read d8/df/d46/f5a [2621731,81194] 0 2024-03-16T10:53:27.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/735: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8/le0 0 2024-03-16T10:53:27.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/736: creat d0/d21/d39/d44/d9a/da7/d38/fe1 x:0 0 0 2024-03-16T10:53:27.979 INFO:tasks.workunit.client.0.smithi017.stdout:6/737: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f19 [0,4194304] 0 2024-03-16T10:53:27.981 INFO:tasks.workunit.client.0.smithi017.stdout:6/738: link d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fe2 0 2024-03-16T10:53:27.981 INFO:tasks.workunit.client.0.smithi017.stdout:6/739: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/c51 0 2024-03-16T10:53:27.981 INFO:tasks.workunit.client.0.smithi017.stdout:6/740: readlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/ldf 0 2024-03-16T10:53:27.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/741: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fe3 x:0 0 0 2024-03-16T10:53:27.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/742: dread - d0/d21/d39/d44/d9a/da7/d38/fe1 zero size 2024-03-16T10:53:27.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/743: truncate d0/d21/d39/d44/fba 978804 0 2024-03-16T10:53:27.985 INFO:tasks.workunit.client.0.smithi017.stdout:6/744: unlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/c8b 0 2024-03-16T10:53:27.990 INFO:tasks.workunit.client.0.smithi017.stdout:6/745: dread d0/d21/d39/d44/f70 [0,4194304] 0 2024-03-16T10:53:27.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/746: dread d0/d21/d39/d44/d9a/da7/d38/f71 [0,4194304] 0 2024-03-16T10:53:27.993 INFO:tasks.workunit.client.0.smithi017.stdout:6/747: creat d0/d21/d39/d44/d9a/da7/fe4 x:0 0 0 2024-03-16T10:53:27.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/748: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/de5 0 2024-03-16T10:53:28.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/903: rename d7/db/d120/d50/d59/d34/dbb/l11a to d7/db/d32/d78/l13b 0 2024-03-16T10:53:28.003 INFO:tasks.workunit.client.0.smithi017.stdout:9/780: link d8/f24 d8/df/d5b/d32/d45/f100 0 2024-03-16T10:53:28.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/904: rename d7/db/d120/d50/d59/d34/d95/df4/l114 to d7/db/d120/d50/d59/d34/d95/df4/l13c 0 2024-03-16T10:53:28.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/905: mkdir d7/db/d81/d13d 0 2024-03-16T10:53:28.010 INFO:tasks.workunit.client.0.smithi017.stdout:7/906: truncate d7/db/d12/d1c/d4e/dbc/fcc 3149083 0 2024-03-16T10:53:28.010 INFO:tasks.workunit.client.0.smithi017.stdout:7/907: readlink d7/db/d12/l4f 0 2024-03-16T10:53:28.010 INFO:tasks.workunit.client.0.smithi017.stdout:7/908: readlink d7/db/d120/d50/d59/d34/l35 0 2024-03-16T10:53:28.017 INFO:tasks.workunit.client.0.smithi017.stdout:9/781: dwrite d8/df/f11 [8388608,4194304] 0 2024-03-16T10:53:28.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/782: dread d8/df/d5b/d32/d45/f83 [0,4194304] 0 2024-03-16T10:53:28.025 INFO:tasks.workunit.client.0.smithi017.stdout:9/783: creat d8/df/d46/d63/f101 x:0 0 0 2024-03-16T10:53:28.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/909: dwrite d7/db/d120/d50/d59/d34/f5e [0,4194304] 0 2024-03-16T10:53:28.030 INFO:tasks.workunit.client.0.smithi017.stdout:9/784: dread d8/f1c [0,4194304] 0 2024-03-16T10:53:28.031 INFO:tasks.workunit.client.0.smithi017.stdout:7/910: unlink d7/db/d32/cdc 0 2024-03-16T10:53:28.032 INFO:tasks.workunit.client.0.smithi017.stdout:9/785: rename d8/df/d46/d63/db4 to d8/df/d46/d63/d102 0 2024-03-16T10:53:28.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/911: truncate d7/db/d12/d1c/d4e/dbc/fcc 3080652 0 2024-03-16T10:53:28.045 INFO:tasks.workunit.client.0.smithi017.stdout:2/678: rename d4/dd/f14 to d4/d6/db/d66/d93/d63/fd3 0 2024-03-16T10:53:28.048 INFO:tasks.workunit.client.0.smithi017.stdout:6/749: rename d0/d21/d39/d44/f70 to d0/d3e/fe6 0 2024-03-16T10:53:28.048 INFO:tasks.workunit.client.0.smithi017.stdout:6/750: fdatasync d0/d21/d39/d44/d9a/da7/d96/fb1 0 2024-03-16T10:53:28.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/912: dread d7/db/d12/d1c/f41 [0,4194304] 0 2024-03-16T10:53:28.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/913: write d7/db/d120/d50/d59/d34/fa1 [983235,117787] 0 2024-03-16T10:53:28.053 INFO:tasks.workunit.client.0.smithi017.stdout:6/751: link d0/d21/d39/d44/d9a/da7/d38/f71 d0/d15/d1f/d7d/d87/fe7 0 2024-03-16T10:53:28.065 INFO:tasks.workunit.client.0.smithi017.stdout:7/914: dwrite d7/db/d120/d50/da8/dca/fd6 [0,4194304] 0 2024-03-16T10:53:28.067 INFO:tasks.workunit.client.0.smithi017.stdout:7/915: creat d7/db/d12/d1c/f13e x:0 0 0 2024-03-16T10:53:28.068 INFO:tasks.workunit.client.0.smithi017.stdout:7/916: link d7/db/d120/d50/d73/d11e/l131 d7/db/d32/d78/l13f 0 2024-03-16T10:53:28.069 INFO:tasks.workunit.client.0.smithi017.stdout:7/917: symlink d7/db/d120/d50/d59/daf/l140 0 2024-03-16T10:53:28.071 INFO:tasks.workunit.client.0.smithi017.stdout:7/918: mkdir d7/db/d120/d50/d59/daf/d141 0 2024-03-16T10:53:28.072 INFO:tasks.workunit.client.0.smithi017.stdout:7/919: write d7/db/d12/ddf/f74 [654987,106614] 0 2024-03-16T10:53:28.078 INFO:tasks.workunit.client.0.smithi017.stdout:9/786: rename d8/df/d5b/d32/d45/c65 to d8/dbf/c103 0 2024-03-16T10:53:28.082 INFO:tasks.workunit.client.0.smithi017.stdout:2/679: rename d4/dd/d1e/d4a/l9d to d4/d6/db/d66/ld4 0 2024-03-16T10:53:28.084 INFO:tasks.workunit.client.0.smithi017.stdout:2/680: symlink d4/d6/d30/ld5 0 2024-03-16T10:53:28.084 INFO:tasks.workunit.client.0.smithi017.stdout:2/681: fdatasync d4/f25 0 2024-03-16T10:53:28.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/682: symlink d4/d6/d30/d3f/ld6 0 2024-03-16T10:53:28.089 INFO:tasks.workunit.client.0.smithi017.stdout:9/787: write d8/df/d5b/d32/f34 [26549,65614] 0 2024-03-16T10:53:28.090 INFO:tasks.workunit.client.0.smithi017.stdout:6/752: rename d0/d21/d39/d44/d9a/da7/c64 to d0/d21/d39/d44/ce8 0 2024-03-16T10:53:28.093 INFO:tasks.workunit.client.0.smithi017.stdout:2/683: getdents d4/dd/d1e 0 2024-03-16T10:53:28.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/788: creat d8/df/d5b/f104 x:0 0 0 2024-03-16T10:53:28.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/789: readlink d8/df/d5b/d32/d45/l97 0 2024-03-16T10:53:28.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/790: chown d8/df/d46/d63/d88/ddc/fdd 1975288 1 2024-03-16T10:53:28.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/791: getdents d8/dbf 0 2024-03-16T10:53:28.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/684: write d4/dd/d1e/d4a/fa8 [352438,76057] 0 2024-03-16T10:53:28.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/920: rename d7/db/f4b to d7/db/d120/d50/d59/f142 0 2024-03-16T10:53:28.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/921: fdatasync d7/db/d12/f3f 0 2024-03-16T10:53:28.103 INFO:tasks.workunit.client.0.smithi017.stdout:9/792: truncate d8/df/d5b/d32/f50 8092836 0 2024-03-16T10:53:28.103 INFO:tasks.workunit.client.0.smithi017.stdout:6/753: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f4b [0,4194304] 0 2024-03-16T10:53:28.103 INFO:tasks.workunit.client.0.smithi017.stdout:6/754: write d0/f40 [874215,129297] 0 2024-03-16T10:53:28.104 INFO:tasks.workunit.client.0.smithi017.stdout:2/685: symlink d4/d6/ld7 0 2024-03-16T10:53:28.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/922: rename d7/db/d12/d96/lf0 to d7/db/d120/dae/ddb/l143 0 2024-03-16T10:53:28.109 INFO:tasks.workunit.client.0.smithi017.stdout:9/793: creat d8/df/d46/d63/d102/f105 x:0 0 0 2024-03-16T10:53:28.111 INFO:tasks.workunit.client.0.smithi017.stdout:6/755: mkdir d0/d21/de9 0 2024-03-16T10:53:28.112 INFO:tasks.workunit.client.0.smithi017.stdout:2/686: rename d4/dd/df/l8c to d4/ld8 0 2024-03-16T10:53:28.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/923: creat d7/db/d81/d13d/f144 x:0 0 0 2024-03-16T10:53:28.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/924: dread - d7/db/d120/f10d zero size 2024-03-16T10:53:28.115 INFO:tasks.workunit.client.0.smithi017.stdout:7/925: symlink d7/db/d120/d50/d59/d34/d95/da3/l145 0 2024-03-16T10:53:28.117 INFO:tasks.workunit.client.0.smithi017.stdout:9/794: link d8/f38 d8/dbf/d91/f106 0 2024-03-16T10:53:28.117 INFO:tasks.workunit.client.0.smithi017.stdout:9/795: chown d8/df 10 1 2024-03-16T10:53:28.122 INFO:tasks.workunit.client.0.smithi017.stdout:7/926: mknod d7/db/d12/d1c/d4e/c146 0 2024-03-16T10:53:28.122 INFO:tasks.workunit.client.0.smithi017.stdout:6/756: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:28.123 INFO:tasks.workunit.client.0.smithi017.stdout:9/796: rmdir d8/df/d5b/d70/d89 39 2024-03-16T10:53:28.123 INFO:tasks.workunit.client.0.smithi017.stdout:9/797: readlink d8/df/d5b/d32/la9 0 2024-03-16T10:53:28.129 INFO:tasks.workunit.client.0.smithi017.stdout:7/927: creat d7/db/d12/ddf/f147 x:0 0 0 2024-03-16T10:53:28.129 INFO:tasks.workunit.client.0.smithi017.stdout:7/928: chown d7/db/d120/d50/d59/daf/fc3 40 1 2024-03-16T10:53:28.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/757: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8/cea 0 2024-03-16T10:53:28.132 INFO:tasks.workunit.client.0.smithi017.stdout:9/798: write d8/f38 [3948181,55190] 0 2024-03-16T10:53:28.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/758: unlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f8f 0 2024-03-16T10:53:28.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/759: chown d0/d15/d1f/d7d/f7f 15869 1 2024-03-16T10:53:28.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/760: write d0/d21/d39/d44/d9a/da7/d96/fbf [714041,43218] 0 2024-03-16T10:53:28.135 INFO:tasks.workunit.client.0.smithi017.stdout:7/929: dread d7/db/d120/d60/fda [0,4194304] 0 2024-03-16T10:53:28.135 INFO:tasks.workunit.client.0.smithi017.stdout:9/799: creat d8/d95/dde/f107 x:0 0 0 2024-03-16T10:53:28.135 INFO:tasks.workunit.client.0.smithi017.stdout:6/761: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fb8 [0,4194304] 0 2024-03-16T10:53:28.136 INFO:tasks.workunit.client.0.smithi017.stdout:9/800: creat d8/f108 x:0 0 0 2024-03-16T10:53:28.136 INFO:tasks.workunit.client.0.smithi017.stdout:9/801: chown d8/df/d46/d63/d94/d9d/dce/fda 185080451 1 2024-03-16T10:53:28.138 INFO:tasks.workunit.client.0.smithi017.stdout:6/762: creat d0/d15/d1f/d7d/d87/feb x:0 0 0 2024-03-16T10:53:28.139 INFO:tasks.workunit.client.0.smithi017.stdout:9/802: creat d8/dbf/d68/f109 x:0 0 0 2024-03-16T10:53:28.139 INFO:tasks.workunit.client.0.smithi017.stdout:7/930: write d7/d8a/fb7 [2817838,85610] 0 2024-03-16T10:53:28.141 INFO:tasks.workunit.client.0.smithi017.stdout:9/803: mknod d8/df/d46/d63/d102/c10a 0 2024-03-16T10:53:28.141 INFO:tasks.workunit.client.0.smithi017.stdout:9/804: truncate d8/df/d5b/d72/fd2 868781 0 2024-03-16T10:53:28.141 INFO:tasks.workunit.client.0.smithi017.stdout:9/805: chown d8/df/d46/d63/d88/fe9 8148942 1 2024-03-16T10:53:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/931: mkdir d7/db/d12/ddf/d123/d148 0 2024-03-16T10:53:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/932: write d7/db/d120/d50/da8/d127/f110 [64742,72475] 0 2024-03-16T10:53:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/933: chown d7/db/d120/d60/f6a 33 1 2024-03-16T10:53:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/934: chown d7/db/d120/l115 1 1 2024-03-16T10:53:28.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/935: rmdir d7/db/d12/d96 39 2024-03-16T10:53:28.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/936: dread - d7/db/d12/d1c/f13e zero size 2024-03-16T10:53:28.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/937: fdatasync d7/db/d120/d50/d73/d11e/f11f 0 2024-03-16T10:53:28.145 INFO:tasks.workunit.client.0.smithi017.stdout:7/938: creat d7/db/d120/d50/d59/d34/d95/df4/f149 x:0 0 0 2024-03-16T10:53:28.146 INFO:tasks.workunit.client.0.smithi017.stdout:7/939: dread d7/db/d120/d50/d59/daf/fc3 [0,4194304] 0 2024-03-16T10:53:28.146 INFO:tasks.workunit.client.0.smithi017.stdout:7/940: write d7/d8a/d66/f10a [1444162,15898] 0 2024-03-16T10:53:28.148 INFO:tasks.workunit.client.0.smithi017.stdout:9/806: dread d8/f38 [0,4194304] 0 2024-03-16T10:53:28.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/807: creat d8/df/d66/dd1/f10b x:0 0 0 2024-03-16T10:53:28.156 INFO:tasks.workunit.client.0.smithi017.stdout:7/941: dread d7/db/f14 [0,4194304] 0 2024-03-16T10:53:28.157 INFO:tasks.workunit.client.0.smithi017.stdout:7/942: dread - d7/db/d120/d50/d59/d34/d95/f12c zero size 2024-03-16T10:53:28.159 INFO:tasks.workunit.client.0.smithi017.stdout:7/943: link d7/db/d120/f17 d7/db/d12/d1c/d4e/dbc/f14a 0 2024-03-16T10:53:28.163 INFO:tasks.workunit.client.0.smithi017.stdout:9/808: dwrite d8/df/d46/d63/d94/d9d/fac [0,4194304] 0 2024-03-16T10:53:28.163 INFO:tasks.workunit.client.0.smithi017.stdout:9/809: write d8/df/d5b/daf/db7/de6/fed [412966,51322] 0 2024-03-16T10:53:28.167 INFO:tasks.workunit.client.0.smithi017.stdout:6/763: link d0/d21/d39/d44/d9a/da7/d45/d4d/f25 d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/fec 0 2024-03-16T10:53:28.168 INFO:tasks.workunit.client.0.smithi017.stdout:2/687: rename d4/dd/d1e/d3e/d51 to d4/dd/df/dd9 0 2024-03-16T10:53:28.169 INFO:tasks.workunit.client.0.smithi017.stdout:2/688: truncate d4/d6/db/d24/f5b 800820 0 2024-03-16T10:53:28.171 INFO:tasks.workunit.client.0.smithi017.stdout:9/810: symlink d8/df/d66/l10c 0 2024-03-16T10:53:28.173 INFO:tasks.workunit.client.0.smithi017.stdout:9/811: read d8/df/d46/d63/d102/fe7 [8838000,44679] 0 2024-03-16T10:53:28.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/764: creat d0/d15/d1f/d7d/d87/dc9/fed x:0 0 0 2024-03-16T10:53:28.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/765: chown d0/d21/d39/d44/d9a/da7/lb 48 1 2024-03-16T10:53:28.178 INFO:tasks.workunit.client.0.smithi017.stdout:6/766: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dd5 to d0/d3e/dee 0 2024-03-16T10:53:28.180 INFO:tasks.workunit.client.0.smithi017.stdout:7/944: dwrite d7/db/d120/d50/d59/d34/d53/f9c [4194304,4194304] 0 2024-03-16T10:53:28.182 INFO:tasks.workunit.client.0.smithi017.stdout:2/689: dwrite d4/d6/db/d24/d39/f76 [0,4194304] 0 2024-03-16T10:53:28.184 INFO:tasks.workunit.client.0.smithi017.stdout:7/945: symlink d7/de9/df9/l14b 0 2024-03-16T10:53:28.187 INFO:tasks.workunit.client.0.smithi017.stdout:2/690: mkdir d4/d6/db/d66/d2e/dda 0 2024-03-16T10:53:28.187 INFO:tasks.workunit.client.0.smithi017.stdout:2/691: chown d4/d6/db/d66/d2e/f3c 50531867 1 2024-03-16T10:53:28.188 INFO:tasks.workunit.client.0.smithi017.stdout:2/692: fsync d4/dd/d1e/d4a/fd0 0 2024-03-16T10:53:28.188 INFO:tasks.workunit.client.0.smithi017.stdout:7/946: rename d7/db/d120/d50/d73/fba to d7/db/d120/dae/ddb/dfb/f14c 0 2024-03-16T10:53:28.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/767: dwrite d0/d21/d39/f5a [0,4194304] 0 2024-03-16T10:53:28.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/768: write d0/d21/d39/d44/fba [1104193,97704] 0 2024-03-16T10:53:28.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/769: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/da6 0 2024-03-16T10:53:28.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/812: write d8/df/d5b/d32/d45/f100 [393845,123282] 0 2024-03-16T10:53:28.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/770: read d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 [3217992,54046] 0 2024-03-16T10:53:28.202 INFO:tasks.workunit.client.0.smithi017.stdout:6/771: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 2277133 0 2024-03-16T10:53:28.203 INFO:tasks.workunit.client.0.smithi017.stdout:6/772: stat d0/d3e/fe6 0 2024-03-16T10:53:28.212 INFO:tasks.workunit.client.0.smithi017.stdout:2/693: rename d4/dd/d1e/cad to d4/d97/d9f/cdb 0 2024-03-16T10:53:28.212 INFO:tasks.workunit.client.0.smithi017.stdout:2/694: truncate d4/d6/d30/fb2 779087 0 2024-03-16T10:53:28.215 INFO:tasks.workunit.client.0.smithi017.stdout:7/947: rename d7/db/d120/l23 to d7/db/d120/d50/df8/d101/l14d 0 2024-03-16T10:53:28.217 INFO:tasks.workunit.client.0.smithi017.stdout:9/813: dwrite d8/df/d5b/f5d [0,4194304] 0 2024-03-16T10:53:28.217 INFO:tasks.workunit.client.0.smithi017.stdout:9/814: write d8/df/d5b/d72/d9e/ffb [988035,2026] 0 2024-03-16T10:53:28.226 INFO:tasks.workunit.client.0.smithi017.stdout:6/773: dwrite d0/d21/d39/d44/d9a/da7/fab [0,4194304] 0 2024-03-16T10:53:28.227 INFO:tasks.workunit.client.0.smithi017.stdout:6/774: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/cef 0 2024-03-16T10:53:28.229 INFO:tasks.workunit.client.0.smithi017.stdout:7/948: dwrite d7/d8a/d66/f10a [0,4194304] 0 2024-03-16T10:53:28.229 INFO:tasks.workunit.client.0.smithi017.stdout:7/949: read - d7/db/d81/fe8 zero size 2024-03-16T10:53:28.229 INFO:tasks.workunit.client.0.smithi017.stdout:6/775: mknod d0/d21/d39/d44/d9a/da7/d45/dbb/cf0 0 2024-03-16T10:53:28.230 INFO:tasks.workunit.client.0.smithi017.stdout:2/695: dwrite d4/d6/d30/d3f/dba/dbd/fd2 [0,4194304] 0 2024-03-16T10:53:28.232 INFO:tasks.workunit.client.0.smithi017.stdout:7/950: creat d7/db/d120/d50/d59/daf/d141/f14e x:0 0 0 2024-03-16T10:53:28.234 INFO:tasks.workunit.client.0.smithi017.stdout:6/776: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dde/ff1 x:0 0 0 2024-03-16T10:53:28.238 INFO:tasks.workunit.client.0.smithi017.stdout:2/696: read d4/dd/df/dd9/f8a [2931157,38088] 0 2024-03-16T10:53:28.240 INFO:tasks.workunit.client.0.smithi017.stdout:7/951: dread d7/db/d12/d1c/d30/f9e [0,4194304] 0 2024-03-16T10:53:28.241 INFO:tasks.workunit.client.0.smithi017.stdout:7/952: chown d7/db/d120/d50/da8/dca/fd8 0 1 2024-03-16T10:53:28.241 INFO:tasks.workunit.client.0.smithi017.stdout:7/953: chown d7/db/d120/d50/df8/d101/l14d 0 1 2024-03-16T10:53:28.241 INFO:tasks.workunit.client.0.smithi017.stdout:2/697: mknod d4/d6/db/d66/d2e/d78/cdc 0 2024-03-16T10:53:28.246 INFO:tasks.workunit.client.0.smithi017.stdout:7/954: mknod d7/db/d12/d1c/d30/c14f 0 2024-03-16T10:53:28.248 INFO:tasks.workunit.client.0.smithi017.stdout:2/698: rmdir d4/d97/d9f 39 2024-03-16T10:53:28.248 INFO:tasks.workunit.client.0.smithi017.stdout:2/699: fdatasync d4/d6/db/d66/d93/f70 0 2024-03-16T10:53:28.249 INFO:tasks.workunit.client.0.smithi017.stdout:9/815: rename d8/df/d46/d63/d88/ddc to d8/df/d5b/d32/d45/d10d 0 2024-03-16T10:53:28.249 INFO:tasks.workunit.client.0.smithi017.stdout:2/700: truncate d4/d6/db/d24/d39/f42 426477 0 2024-03-16T10:53:28.251 INFO:tasks.workunit.client.0.smithi017.stdout:7/955: symlink d7/db/d32/dc5/l150 0 2024-03-16T10:53:28.251 INFO:tasks.workunit.client.0.smithi017.stdout:7/956: fsync d7/db/d120/d50/d73/d11e/f134 0 2024-03-16T10:53:28.251 INFO:tasks.workunit.client.0.smithi017.stdout:2/701: creat d4/dd/d1e/d3e/fdd x:0 0 0 2024-03-16T10:53:28.256 INFO:tasks.workunit.client.0.smithi017.stdout:7/957: unlink d7/db/d120/d50/da8/dca/fd6 0 2024-03-16T10:53:28.256 INFO:tasks.workunit.client.0.smithi017.stdout:7/958: readlink d7/db/d120/d50/d59/led 0 2024-03-16T10:53:28.261 INFO:tasks.workunit.client.0.smithi017.stdout:9/816: dwrite d8/f1c [0,4194304] 0 2024-03-16T10:53:28.262 INFO:tasks.workunit.client.0.smithi017.stdout:9/817: write d8/df/d5b/d32/d45/f77 [3456018,25406] 0 2024-03-16T10:53:28.262 INFO:tasks.workunit.client.0.smithi017.stdout:2/702: write d4/d6/d30/d3f/f85 [281619,111385] 0 2024-03-16T10:53:28.264 INFO:tasks.workunit.client.0.smithi017.stdout:7/959: mkdir d7/db/d32/d151 0 2024-03-16T10:53:28.266 INFO:tasks.workunit.client.0.smithi017.stdout:2/703: stat d4/dd/df/dd9/cd1 0 2024-03-16T10:53:28.267 INFO:tasks.workunit.client.0.smithi017.stdout:7/960: getdents d7/de9 0 2024-03-16T10:53:28.270 INFO:tasks.workunit.client.0.smithi017.stdout:2/704: mknod d4/d6/d81/d8f/cde 0 2024-03-16T10:53:28.270 INFO:tasks.workunit.client.0.smithi017.stdout:2/705: write d4/f5e [704883,63773] 0 2024-03-16T10:53:28.272 INFO:tasks.workunit.client.0.smithi017.stdout:2/706: creat d4/dd/df/fdf x:0 0 0 2024-03-16T10:53:28.274 INFO:tasks.workunit.client.0.smithi017.stdout:2/707: creat d4/d6/db/d66/daf/fe0 x:0 0 0 2024-03-16T10:53:28.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/818: rmdir d8/df/d5b/d32/d45 39 2024-03-16T10:53:28.288 INFO:tasks.workunit.client.0.smithi017.stdout:9/819: creat d8/df/d5b/d32/d45/f10e x:0 0 0 2024-03-16T10:53:28.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/961: dwrite d7/db/d120/d50/d59/d34/d95/f12c [0,4194304] 0 2024-03-16T10:53:28.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/962: chown d7/db/d120/dae/fdd 15 1 2024-03-16T10:53:28.290 INFO:tasks.workunit.client.0.smithi017.stdout:9/820: symlink d8/df/d46/d63/l10f 0 2024-03-16T10:53:28.292 INFO:tasks.workunit.client.0.smithi017.stdout:9/821: link d8/df/d5b/d72/d9e/ffb d8/dbf/f110 0 2024-03-16T10:53:28.293 INFO:tasks.workunit.client.0.smithi017.stdout:2/708: dwrite d4/dd/df/dd9/f8a [0,4194304] 0 2024-03-16T10:53:28.295 INFO:tasks.workunit.client.0.smithi017.stdout:2/709: creat d4/d6/d30/d3f/fe1 x:0 0 0 2024-03-16T10:53:28.296 INFO:tasks.workunit.client.0.smithi017.stdout:2/710: mknod d4/d6/db/d66/d93/d63/ce2 0 2024-03-16T10:53:28.298 INFO:tasks.workunit.client.0.smithi017.stdout:2/711: dread d4/f6d [0,4194304] 0 2024-03-16T10:53:28.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/712: dread d4/f25 [4194304,4194304] 0 2024-03-16T10:53:28.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/963: dwrite d7/db/d32/d78/fcf [0,4194304] 0 2024-03-16T10:53:28.306 INFO:tasks.workunit.client.0.smithi017.stdout:2/713: read d4/d6/d30/d3f/f54 [1678911,69745] 0 2024-03-16T10:53:28.309 INFO:tasks.workunit.client.0.smithi017.stdout:9/822: dwrite d8/df/d5b/f42 [0,4194304] 0 2024-03-16T10:53:28.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/964: creat d7/db/d120/f152 x:0 0 0 2024-03-16T10:53:28.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/714: creat d4/d6/d30/d3f/dba/dbd/fe3 x:0 0 0 2024-03-16T10:53:28.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/715: stat d4/d97/la6 0 2024-03-16T10:53:28.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/716: stat d4/d6/f26 0 2024-03-16T10:53:28.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/717: fsync d4/dd/f67 0 2024-03-16T10:53:28.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/718: chown d4/d6/db/d24/d39/l60 26 1 2024-03-16T10:53:28.313 INFO:tasks.workunit.client.0.smithi017.stdout:9/823: symlink d8/dbf/d68/l111 0 2024-03-16T10:53:28.317 INFO:tasks.workunit.client.0.smithi017.stdout:9/824: getdents d8/df/d5b 0 2024-03-16T10:53:28.318 INFO:tasks.workunit.client.0.smithi017.stdout:9/825: dread d8/df/d5b/d72/fd2 [0,4194304] 0 2024-03-16T10:53:28.319 INFO:tasks.workunit.client.0.smithi017.stdout:7/965: rename d7/de9/df9/l117 to d7/db/d120/d50/d59/l153 0 2024-03-16T10:53:28.320 INFO:tasks.workunit.client.0.smithi017.stdout:9/826: mkdir d8/df/d5b/daf/db7/de6/d112 0 2024-03-16T10:53:28.321 INFO:tasks.workunit.client.0.smithi017.stdout:9/827: rmdir d8/df/d5b/d70/d89 39 2024-03-16T10:53:28.321 INFO:tasks.workunit.client.0.smithi017.stdout:9/828: write d8/df/d5b/d70/d89/fc8 [348536,60665] 0 2024-03-16T10:53:28.323 INFO:tasks.workunit.client.0.smithi017.stdout:9/829: mknod d8/dbf/d91/c113 0 2024-03-16T10:53:28.323 INFO:tasks.workunit.client.0.smithi017.stdout:2/719: dwrite d4/d6/db/d66/f5d [0,4194304] 0 2024-03-16T10:53:28.324 INFO:tasks.workunit.client.0.smithi017.stdout:9/830: mknod d8/df/d5b/d32/c114 0 2024-03-16T10:53:28.325 INFO:tasks.workunit.client.0.smithi017.stdout:9/831: chown d8/dbf/d68/l78 4 1 2024-03-16T10:53:28.325 INFO:tasks.workunit.client.0.smithi017.stdout:9/832: readlink d8/df/l2e 0 2024-03-16T10:53:28.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/833: creat d8/df/d5b/daf/db7/de6/d112/f115 x:0 0 0 2024-03-16T10:53:28.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/834: chown d8/dbf/d91/c113 0 1 2024-03-16T10:53:28.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/835: truncate d8/df/d5b/d72/d9e/ff5 143514 0 2024-03-16T10:53:28.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/836: chown d8/c80 3053 1 2024-03-16T10:53:28.328 INFO:tasks.workunit.client.0.smithi017.stdout:9/837: mknod d8/df/d66/dd1/c116 0 2024-03-16T10:53:28.329 INFO:tasks.workunit.client.0.smithi017.stdout:2/720: creat d4/dd/d38/dc3/fe4 x:0 0 0 2024-03-16T10:53:28.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/838: symlink d8/df/d5b/daf/db7/de6/l117 0 2024-03-16T10:53:28.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/839: truncate d8/df/d66/dd1/f10b 261719 0 2024-03-16T10:53:28.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/840: readlink d8/df/d5b/d72/la6 0 2024-03-16T10:53:28.330 INFO:tasks.workunit.client.0.smithi017.stdout:2/721: creat d4/d6/db/d66/d2e/d78/fe5 x:0 0 0 2024-03-16T10:53:28.331 INFO:tasks.workunit.client.0.smithi017.stdout:9/841: mkdir d8/df/d66/dd1/d118 0 2024-03-16T10:53:28.333 INFO:tasks.workunit.client.0.smithi017.stdout:9/842: write d8/df/d5b/d32/d45/f61 [4514672,266] 0 2024-03-16T10:53:28.333 INFO:tasks.workunit.client.0.smithi017.stdout:2/722: mkdir d4/dd/d1e/de6 0 2024-03-16T10:53:28.333 INFO:tasks.workunit.client.0.smithi017.stdout:7/966: dwrite d7/db/d120/d50/d59/d34/f47 [4194304,4194304] 0 2024-03-16T10:53:28.334 INFO:tasks.workunit.client.0.smithi017.stdout:7/967: symlink d7/db/d120/dae/ddb/l154 0 2024-03-16T10:53:28.350 INFO:tasks.workunit.client.0.smithi017.stdout:2/723: write d4/d6/db/d66/d2e/f8b [1927197,13944] 0 2024-03-16T10:53:28.351 INFO:tasks.workunit.client.0.smithi017.stdout:9/843: dwrite d8/df/d5b/d32/f34 [0,4194304] 0 2024-03-16T10:53:28.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/844: mkdir d8/df/d5b/d119 0 2024-03-16T10:53:28.356 INFO:tasks.workunit.client.0.smithi017.stdout:2/724: dread d4/d6/db/d66/d93/d63/fd3 [0,4194304] 0 2024-03-16T10:53:28.358 INFO:tasks.workunit.client.0.smithi017.stdout:2/725: creat d4/dd/d38/fe7 x:0 0 0 2024-03-16T10:53:28.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/968: dwrite d7/db/d32/fd0 [0,4194304] 0 2024-03-16T10:53:28.360 INFO:tasks.workunit.client.0.smithi017.stdout:2/726: rename d4/d6/d30/f58 to d4/d6/d30/fe8 0 2024-03-16T10:53:28.362 INFO:tasks.workunit.client.0.smithi017.stdout:7/969: mkdir d7/db/d120/d50/d155 0 2024-03-16T10:53:28.366 INFO:tasks.workunit.client.0.smithi017.stdout:2/727: link d4/dd/d1e/d3e/fbc d4/dd/d1e/fe9 0 2024-03-16T10:53:28.371 INFO:tasks.workunit.client.0.smithi017.stdout:7/970: dread f2 [8388608,4194304] 0 2024-03-16T10:53:28.381 INFO:tasks.workunit.client.0.smithi017.stdout:7/971: dwrite d7/db/d120/d50/d59/d34/f43 [0,4194304] 0 2024-03-16T10:53:28.381 INFO:tasks.workunit.client.0.smithi017.stdout:7/972: write d7/db/d120/d60/fda [2181959,104610] 0 2024-03-16T10:53:28.381 INFO:tasks.workunit.client.0.smithi017.stdout:7/973: fsync d7/db/d12/d1c/f41 0 2024-03-16T10:53:28.382 INFO:tasks.workunit.client.0.smithi017.stdout:2/728: dwrite d4/d6/db/d66/d2e/f8b [0,4194304] 0 2024-03-16T10:53:28.386 INFO:tasks.workunit.client.0.smithi017.stdout:7/974: truncate d7/db/d12/f3f 1598801 0 2024-03-16T10:53:28.388 INFO:tasks.workunit.client.0.smithi017.stdout:7/975: rename d7/db/d12/d1c/f13e to d7/d8a/d66/dfe/f156 0 2024-03-16T10:53:28.391 INFO:tasks.workunit.client.0.smithi017.stdout:7/976: rename d7/db/d120/d60/fd4 to d7/de9/f157 0 2024-03-16T10:53:28.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/977: mkdir d7/db/d120/d50/d73/d158 0 2024-03-16T10:53:28.403 INFO:tasks.workunit.client.0.smithi017.stdout:7/978: dwrite d7/db/d12/f3f [0,4194304] 0 2024-03-16T10:53:28.403 INFO:tasks.workunit.client.0.smithi017.stdout:2/729: write d4/d6/d30/f8d [242989,90413] 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:2/730: creat d4/d6/db/d66/d2e/fea x:0 0 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/979: creat d7/db/d12/ddf/f159 x:0 0 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/980: fsync d7/db/d12/f107 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/981: fdatasync d7/db/d120/d50/d59/d34/f47 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/982: readlink d7/db/d120/d50/d73/d11e/l131 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/983: write d7/db/d120/d50/d59/d34/d53/f109 [318452,80987] 0 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/984: chown d7/d8a/f29 1 1 2024-03-16T10:53:28.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/985: mkdir d7/db/d120/d50/d59/d34/dbb/d15a 0 2024-03-16T10:53:28.406 INFO:tasks.workunit.client.0.smithi017.stdout:7/986: truncate d7/db/d120/d50/d59/d34/d95/f12c 3554792 0 2024-03-16T10:53:28.408 INFO:tasks.workunit.client.0.smithi017.stdout:7/987: rename d7/db/d12/d1c/c70 to d7/de9/c15b 0 2024-03-16T10:53:28.408 INFO:tasks.workunit.client.0.smithi017.stdout:7/988: stat d7/db/d120/d50/d59/c76 0 2024-03-16T10:53:28.410 INFO:tasks.workunit.client.0.smithi017.stdout:7/989: dread d7/db/d120/d50/d59/d34/fa1 [0,4194304] 0 2024-03-16T10:53:28.411 INFO:tasks.workunit.client.0.smithi017.stdout:7/990: creat d7/db/f15c x:0 0 0 2024-03-16T10:53:28.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/991: dread d7/db/d12/d1c/d4e/dbc/fc8 [0,4194304] 0 2024-03-16T10:53:28.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/992: rename d7/db/d32/c56 to d7/db/c15d 0 2024-03-16T10:53:28.419 INFO:tasks.workunit.client.0.smithi017.stdout:7/993: dread d7/db/d120/d50/d59/d34/fa1 [0,4194304] 0 2024-03-16T10:53:28.419 INFO:tasks.workunit.client.0.smithi017.stdout:7/994: truncate d7/d8a/d66/fe6 237374 0 2024-03-16T10:53:28.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/995: dwrite d7/db/d12/ddf/f159 [0,4194304] 0 2024-03-16T10:53:28.436 INFO:tasks.workunit.client.0.smithi017.stdout:7/996: creat d7/db/d12/d96/f15e x:0 0 0 2024-03-16T10:53:28.437 INFO:tasks.workunit.client.0.smithi017.stdout:5/995: sync 2024-03-16T10:53:28.437 INFO:tasks.workunit.client.0.smithi017.stdout:4/966: sync 2024-03-16T10:53:28.437 INFO:tasks.workunit.client.0.smithi017.stdout:8/855: sync 2024-03-16T10:53:28.437 INFO:tasks.workunit.client.0.smithi017.stdout:3/794: sync 2024-03-16T10:53:28.438 INFO:tasks.workunit.client.0.smithi017.stdout:1/935: sync 2024-03-16T10:53:28.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/996: dread - d0/d1/d76/fe9 zero size 2024-03-16T10:53:28.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/997: chown d0/d1/d107/fcf 721 1 2024-03-16T10:53:28.439 INFO:tasks.workunit.client.0.smithi017.stdout:1/936: mkdir d1/d3/dd/d31/d66/da1/de3/d138 0 2024-03-16T10:53:28.439 INFO:tasks.workunit.client.0.smithi017.stdout:8/856: dread d6/d39/fe0 [0,4194304] 0 2024-03-16T10:53:28.440 INFO:tasks.workunit.client.0.smithi017.stdout:3/795: link d8/da/c32 d8/d1b/d2e/d8d/ceb 0 2024-03-16T10:53:28.440 INFO:tasks.workunit.client.0.smithi017.stdout:3/796: fdatasync d8/d1b/d2e/fbb 0 2024-03-16T10:53:28.440 INFO:tasks.workunit.client.0.smithi017.stdout:3/797: fdatasync d8/d1d/dab/dc4/dd7/f5d 0 2024-03-16T10:53:28.440 INFO:tasks.workunit.client.0.smithi017.stdout:8/857: dread d6/d16/db3/dcb/f46 [4194304,4194304] 0 2024-03-16T10:53:28.442 INFO:tasks.workunit.client.0.smithi017.stdout:4/967: symlink d15/d1d/d21/d3c/de9/d43/dd1/d122/d146/l14d 0 2024-03-16T10:53:28.444 INFO:tasks.workunit.client.0.smithi017.stdout:7/997: dread d7/db/f93 [0,4194304] 0 2024-03-16T10:53:28.445 INFO:tasks.workunit.client.0.smithi017.stdout:6/777: sync 2024-03-16T10:53:28.446 INFO:tasks.workunit.client.0.smithi017.stdout:6/778: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/c9f 4 1 2024-03-16T10:53:28.446 INFO:tasks.workunit.client.0.smithi017.stdout:6/779: chown d0/d21/d39/c5c 6 1 2024-03-16T10:53:28.446 INFO:tasks.workunit.client.0.smithi017.stdout:4/968: symlink d15/d1d/d21/db1/db5/l14e 0 2024-03-16T10:53:28.447 INFO:tasks.workunit.client.0.smithi017.stdout:6/780: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f8a [0,4194304] 0 2024-03-16T10:53:28.449 INFO:tasks.workunit.client.0.smithi017.stdout:8/858: symlink d6/d16/l10e 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:1/937: write d1/d3/dd/d31/d66/da1/fd8 [1293569,9782] 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/998: dwrite d0/d1/d30/dde/d42/f4a [0,4194304] 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:1/938: truncate d1/d3/dd/d31/d66/dd7/dbc/ddb/de2/ffd 665375 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/999: stat d0/d1/d2/d2c/d36/d136 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/969: unlink d15/d1d/f91 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/970: fdatasync d15/d1d/d21/d26/d66/d8c/dab/dc7/fe0 0 2024-03-16T10:53:28.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/971: chown d15/d1d/d21/d3c/de9/d40/d137 17054 1 2024-03-16T10:53:28.454 INFO:tasks.workunit.client.0.smithi017.stdout:6/781: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/ff2 x:0 0 0 2024-03-16T10:53:28.454 INFO:tasks.workunit.client.0.smithi017.stdout:6/782: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/fec 0 2024-03-16T10:53:28.454 INFO:tasks.workunit.client.0.smithi017.stdout:6/783: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/f14 0 2024-03-16T10:53:28.456 INFO:tasks.workunit.client.0.smithi017.stdout:3/798: dwrite d8/fdf [0,4194304] 0 2024-03-16T10:53:28.456 INFO:tasks.workunit.client.0.smithi017.stdout:3/799: fdatasync d8/d1b/d2e/d8d/fc7 0 2024-03-16T10:53:28.457 INFO:tasks.workunit.client.0.smithi017.stdout:8/859: rename d6/d14/c5a to d6/d5f/da4/dd8/c10f 0 2024-03-16T10:53:28.459 INFO:tasks.workunit.client.0.smithi017.stdout:7/998: mknod d7/db/d12/ddf/c15f 0 2024-03-16T10:53:28.461 INFO:tasks.workunit.client.0.smithi017.stdout:1/939: symlink d1/d3/dd/d31/d35/def/l139 0 2024-03-16T10:53:28.463 INFO:tasks.workunit.client.0.smithi017.stdout:6/784: creat d0/ff3 x:0 0 0 2024-03-16T10:53:28.467 INFO:tasks.workunit.client.0.smithi017.stdout:4/972: rename d15/d1d/d21/d26/d66/d8c/dab/dc7 to d15/d1d/d21/d3c/de9/d14f 0 2024-03-16T10:53:28.470 INFO:tasks.workunit.client.0.smithi017.stdout:8/860: mkdir d6/d5f/d6e/d34/db4/d110 0 2024-03-16T10:53:28.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/999: mknod d7/db/c160 0 2024-03-16T10:53:28.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/800: dwrite d8/d1d/dab/dc4/dd7/d62/d69/fe8 [0,4194304] 0 2024-03-16T10:53:28.477 INFO:tasks.workunit.client.0.smithi017.stdout:6/785: link d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/c85 d0/d15/d1f/d7d/d87/dc9/cf4 0 2024-03-16T10:53:28.478 INFO:tasks.workunit.client.0.smithi017.stdout:6/786: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/lf5 0 2024-03-16T10:53:28.478 INFO:tasks.workunit.client.0.smithi017.stdout:6/787: write d0/d21/d39/d44/d95/fd4 [1902490,43240] 0 2024-03-16T10:53:28.478 INFO:tasks.workunit.client.0.smithi017.stdout:8/861: mknod d6/d5c/d96/c111 0 2024-03-16T10:53:28.480 INFO:tasks.workunit.client.0.smithi017.stdout:4/973: dwrite d15/d1d/d27/f114 [0,4194304] 0 2024-03-16T10:53:28.485 INFO:tasks.workunit.client.0.smithi017.stdout:6/788: creat d0/d3e/dee/ff6 x:0 0 0 2024-03-16T10:53:28.487 INFO:tasks.workunit.client.0.smithi017.stdout:8/862: mkdir d6/d5f/da4/d112 0 2024-03-16T10:53:28.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/974: rename d15/d1d/d21/d3c/de9/d40/d137 to d15/d1d/d21/d3c/de9/d43/dd1/d150 0 2024-03-16T10:53:28.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/975: write d15/d1d/d21/d3c/de9/d14f/fe0 [464473,118898] 0 2024-03-16T10:53:28.493 INFO:tasks.workunit.client.0.smithi017.stdout:3/801: link d8/fdf d8/d1d/dab/dc4/dd7/d62/fec 0 2024-03-16T10:53:28.493 INFO:tasks.workunit.client.0.smithi017.stdout:3/802: fsync d8/d1b/d2e/d60/f84 0 2024-03-16T10:53:28.494 INFO:tasks.workunit.client.0.smithi017.stdout:6/789: creat d0/d21/d39/d44/d95/ff7 x:0 0 0 2024-03-16T10:53:28.497 INFO:tasks.workunit.client.0.smithi017.stdout:8/863: truncate d6/d5f/d6e/d34/f52 1261200 0 2024-03-16T10:53:28.498 INFO:tasks.workunit.client.0.smithi017.stdout:4/976: creat d15/d1d/d27/d134/f151 x:0 0 0 2024-03-16T10:53:28.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/790: symlink d0/d21/d39/d44/d95/lf8 0 2024-03-16T10:53:28.502 INFO:tasks.workunit.client.0.smithi017.stdout:8/864: creat d6/d14/f113 x:0 0 0 2024-03-16T10:53:28.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/977: mknod d15/d1d/d21/d3c/de9/d43/dd1/c152 0 2024-03-16T10:53:28.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/978: readlink d15/d1d/d21/d26/d66/d8c/lfa 0 2024-03-16T10:53:28.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/979: write d15/d1d/d27/f55 [1347410,97945] 0 2024-03-16T10:53:28.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/865: mkdir d6/d4a/d114 0 2024-03-16T10:53:28.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/866: write d6/d5f/d6e/fc6 [891486,85489] 0 2024-03-16T10:53:28.506 INFO:tasks.workunit.client.0.smithi017.stdout:4/980: fsync d15/d1d/f29 0 2024-03-16T10:53:28.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/791: write d0/d15/fd1 [929275,111917] 0 2024-03-16T10:53:28.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/792: stat d0/d21/d39/d44/d9a/da7/l58 0 2024-03-16T10:53:28.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/793: read - d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/faa zero size 2024-03-16T10:53:28.508 INFO:tasks.workunit.client.0.smithi017.stdout:8/867: symlink d6/d4a/d114/l115 0 2024-03-16T10:53:28.510 INFO:tasks.workunit.client.0.smithi017.stdout:6/794: truncate d0/d21/d39/d44/d9a/da7/f7b 3158423 0 2024-03-16T10:53:28.512 INFO:tasks.workunit.client.0.smithi017.stdout:8/868: symlink d6/d14/d8c/l116 0 2024-03-16T10:53:28.514 INFO:tasks.workunit.client.0.smithi017.stdout:8/869: mkdir d6/d5c/d10d/d117 0 2024-03-16T10:53:28.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/870: creat d6/dc5/dff/f118 x:0 0 0 2024-03-16T10:53:28.522 INFO:tasks.workunit.client.0.smithi017.stdout:8/871: getdents d6/d39 0 2024-03-16T10:53:28.524 INFO:tasks.workunit.client.0.smithi017.stdout:8/872: creat d6/d5f/d6e/f119 x:0 0 0 2024-03-16T10:53:28.524 INFO:tasks.workunit.client.0.smithi017.stdout:8/873: readlink d6/d5c/lc9 0 2024-03-16T10:53:28.526 INFO:tasks.workunit.client.0.smithi017.stdout:8/874: unlink d6/d4a/f106 0 2024-03-16T10:53:28.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/875: mknod d6/d39/da9/c11a 0 2024-03-16T10:53:28.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/876: write d6/d16/d6c/dd4/d92/fdd [707417,29165] 0 2024-03-16T10:53:28.529 INFO:tasks.workunit.client.0.smithi017.stdout:8/877: rename d6/d16/l10e to d6/l11b 0 2024-03-16T10:53:28.531 INFO:tasks.workunit.client.0.smithi017.stdout:8/878: mknod d6/d16/d6c/dd4/d10a/c11c 0 2024-03-16T10:53:28.531 INFO:tasks.workunit.client.0.smithi017.stdout:8/879: truncate d6/f67 2346512 0 2024-03-16T10:53:28.532 INFO:tasks.workunit.client.0.smithi017.stdout:6/795: dwrite d0/f4 [0,4194304] 0 2024-03-16T10:53:28.533 INFO:tasks.workunit.client.0.smithi017.stdout:8/880: mknod d6/d5c/d96/c11d 0 2024-03-16T10:53:28.534 INFO:tasks.workunit.client.0.smithi017.stdout:6/796: creat d0/d3e/dee/ff9 x:0 0 0 2024-03-16T10:53:28.536 INFO:tasks.workunit.client.0.smithi017.stdout:8/881: mkdir d6/d5f/da4/dd8/d11e 0 2024-03-16T10:53:28.537 INFO:tasks.workunit.client.0.smithi017.stdout:6/797: rmdir d0/d3e/dd3 39 2024-03-16T10:53:28.537 INFO:tasks.workunit.client.0.smithi017.stdout:6/798: dread - d0/d15/d1f/d7d/d87/feb zero size 2024-03-16T10:53:28.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/882: creat d6/d5c/d96/d98/f11f x:0 0 0 2024-03-16T10:53:28.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/883: stat d6/d16/d6c/dd4/l2a 0 2024-03-16T10:53:28.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/799: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/fec 0 2024-03-16T10:53:28.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/800: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 0 2024-03-16T10:53:28.542 INFO:tasks.workunit.client.0.smithi017.stdout:6/801: mkdir d0/d21/d39/d44/d95/dfa 0 2024-03-16T10:53:28.544 INFO:tasks.workunit.client.0.smithi017.stdout:6/802: creat d0/d21/d39/d44/d9a/ffb x:0 0 0 2024-03-16T10:53:28.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/803: creat d0/d21/d39/d44/ffc x:0 0 0 2024-03-16T10:53:28.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/804: dread - d0/d3e/dd3/fcf zero size 2024-03-16T10:53:28.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/805: rmdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2c 39 2024-03-16T10:53:28.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/884: dwrite d6/d5c/d96/d98/fee [4194304,4194304] 0 2024-03-16T10:53:28.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/885: dread - d6/d14/f113 zero size 2024-03-16T10:53:28.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/886: dread - d6/d5f/d6e/f119 zero size 2024-03-16T10:53:28.550 INFO:tasks.workunit.client.0.smithi017.stdout:6/806: rename d0/d15/f17 to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/ffd 0 2024-03-16T10:53:28.553 INFO:tasks.workunit.client.0.smithi017.stdout:6/807: link d0/d21/d39/d44/d9a/da7/f13 d0/d3e/dd3/ffe 0 2024-03-16T10:53:28.554 INFO:tasks.workunit.client.0.smithi017.stdout:6/808: symlink d0/d21/d39/d44/d9a/lff 0 2024-03-16T10:53:28.554 INFO:tasks.workunit.client.0.smithi017.stdout:6/809: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/f9b 280719 0 2024-03-16T10:53:28.556 INFO:tasks.workunit.client.0.smithi017.stdout:6/810: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/de5/d100 0 2024-03-16T10:53:28.560 INFO:tasks.workunit.client.0.smithi017.stdout:8/887: dwrite d6/d16/d6c/dd4/d92/fc8 [0,4194304] 0 2024-03-16T10:53:28.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:28 smithi174 ceph-mon[36202]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 196 MiB/s wr, 1.73k op/s 2024-03-16T10:53:28.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:28 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:28.564 INFO:tasks.workunit.client.0.smithi017.stdout:6/811: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f79 2594082 0 2024-03-16T10:53:28.565 INFO:tasks.workunit.client.0.smithi017.stdout:9/845: sync 2024-03-16T10:53:28.566 INFO:tasks.workunit.client.0.smithi017.stdout:6/812: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f101 x:0 0 0 2024-03-16T10:53:28.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/846: creat d8/df/d46/d63/d88/dd9/f11a x:0 0 0 2024-03-16T10:53:28.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/847: chown d8/df/d5b/daf/db7/fc4 50 1 2024-03-16T10:53:28.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/848: readlink d8/df/d66/l74 0 2024-03-16T10:53:28.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/813: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/f102 x:0 0 0 2024-03-16T10:53:28.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/814: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fae 3 1 2024-03-16T10:53:28.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/849: symlink d8/dbf/d68/l11b 0 2024-03-16T10:53:28.574 INFO:tasks.workunit.client.0.smithi017.stdout:9/850: truncate d8/f38 3667669 0 2024-03-16T10:53:28.574 INFO:tasks.workunit.client.0.smithi017.stdout:6/815: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/f27 [0,4194304] 0 2024-03-16T10:53:28.574 INFO:tasks.workunit.client.0.smithi017.stdout:6/816: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/ff2 [222384,105742] 0 2024-03-16T10:53:28.574 INFO:tasks.workunit.client.0.smithi017.stdout:6/817: fdatasync d0/d21/d39/d44/d9a/da7/d96/fbf 0 2024-03-16T10:53:28.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/851: unlink d8/f1c 0 2024-03-16T10:53:28.576 INFO:tasks.workunit.client.0.smithi017.stdout:8/888: dwrite d6/d4a/f78 [0,4194304] 0 2024-03-16T10:53:28.577 INFO:tasks.workunit.client.0.smithi017.stdout:6/818: stat d0/d21/d39/d44/d9a/da7/l12 0 2024-03-16T10:53:28.577 INFO:tasks.workunit.client.0.smithi017.stdout:6/819: truncate d0/d21/d39/d44/d9a/da7/d38/f63 740657 0 2024-03-16T10:53:28.587 INFO:tasks.workunit.client.0.smithi017.stdout:6/820: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/de5/c103 0 2024-03-16T10:53:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:28 smithi017 ceph-mon[32078]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 196 MiB/s wr, 1.73k op/s 2024-03-16T10:53:28.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:28 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:28.597 INFO:tasks.workunit.client.0.smithi017.stdout:8/889: write d6/d14/d6b/fb6 [2091527,82325] 0 2024-03-16T10:53:28.603 INFO:tasks.workunit.client.0.smithi017.stdout:8/890: write d6/d39/fde [435298,130279] 0 2024-03-16T10:53:28.606 INFO:tasks.workunit.client.0.smithi017.stdout:8/891: dread d6/d39/f30 [0,4194304] 0 2024-03-16T10:53:28.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/892: link d6/d4a/f78 d6/d14/f120 0 2024-03-16T10:53:28.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/893: truncate d6/d16/d6c/dd4/f53 3112407 0 2024-03-16T10:53:28.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/894: write d6/d14/d8c/f8b [590085,67239] 0 2024-03-16T10:53:28.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/895: chown d6/d16/db3/dcb/f2b 51217003 1 2024-03-16T10:53:28.611 INFO:tasks.workunit.client.0.smithi017.stdout:8/896: getdents d6 0 2024-03-16T10:53:28.611 INFO:tasks.workunit.client.0.smithi017.stdout:8/897: write d6/d4a/ff5 [963374,34763] 0 2024-03-16T10:53:28.612 INFO:tasks.workunit.client.0.smithi017.stdout:8/898: symlink d6/d39/l121 0 2024-03-16T10:53:28.612 INFO:tasks.workunit.client.0.smithi017.stdout:8/899: stat d6/d5c/d10d 0 2024-03-16T10:53:28.620 INFO:tasks.workunit.client.0.smithi017.stdout:2/731: sync 2024-03-16T10:53:28.620 INFO:tasks.workunit.client.0.smithi017.stdout:1/940: sync 2024-03-16T10:53:28.620 INFO:tasks.workunit.client.0.smithi017.stdout:1/941: getdents d1/d24 0 2024-03-16T10:53:28.630 INFO:tasks.workunit.client.0.smithi017.stdout:2/732: write d4/d6/d30/f7c [3949178,74601] 0 2024-03-16T10:53:28.632 INFO:tasks.workunit.client.0.smithi017.stdout:2/733: write d4/dd/d1e/d3e/fbc [2073411,55767] 0 2024-03-16T10:53:28.634 INFO:tasks.workunit.client.0.smithi017.stdout:2/734: rename d4/dce to d4/dca/deb 0 2024-03-16T10:53:28.636 INFO:tasks.workunit.client.0.smithi017.stdout:1/942: dwrite d1/d50/d8d/f12d [0,4194304] 0 2024-03-16T10:53:28.636 INFO:tasks.workunit.client.0.smithi017.stdout:1/943: chown d1/fae 55543197 1 2024-03-16T10:53:28.640 INFO:tasks.workunit.client.0.smithi017.stdout:1/944: mknod d1/d3/dd/d31/d35/c13a 0 2024-03-16T10:53:28.647 INFO:tasks.workunit.client.0.smithi017.stdout:2/735: dwrite d4/d6/db/d66/f5d [0,4194304] 0 2024-03-16T10:53:28.647 INFO:tasks.workunit.client.0.smithi017.stdout:2/736: dread - d4/d6/db/d66/d2e/d78/fe5 zero size 2024-03-16T10:53:28.647 INFO:tasks.workunit.client.0.smithi017.stdout:2/737: dread - d4/d6/d30/d3f/fe1 zero size 2024-03-16T10:53:28.647 INFO:tasks.workunit.client.0.smithi017.stdout:1/945: write d1/d3/dd/d31/d66/dd3/f6e [3050334,9154] 0 2024-03-16T10:53:28.648 INFO:tasks.workunit.client.0.smithi017.stdout:2/738: rename d4/f52 to d4/d6/d81/fec 0 2024-03-16T10:53:28.649 INFO:tasks.workunit.client.0.smithi017.stdout:2/739: mknod d4/d6/db/d66/d2e/ced 0 2024-03-16T10:53:28.651 INFO:tasks.workunit.client.0.smithi017.stdout:2/740: mkdir d4/d6/db/d66/d93/d63/dee 0 2024-03-16T10:53:28.651 INFO:tasks.workunit.client.0.smithi017.stdout:2/741: fdatasync d4/d6/db/d66/d2e/f31 0 2024-03-16T10:53:28.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/946: write d1/d3/f6d [7100944,23667] 0 2024-03-16T10:53:28.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/947: chown d1/d3/dd/d9f/d111 164754 1 2024-03-16T10:53:28.657 INFO:tasks.workunit.client.0.smithi017.stdout:1/948: link d1/d3/f29 d1/d50/d61/f13b 0 2024-03-16T10:53:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:28 smithi111 ceph-mon[36315]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 MiB/s rd, 196 MiB/s wr, 1.73k op/s 2024-03-16T10:53:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:28 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:28.695 INFO:tasks.workunit.client.0.smithi017.stdout:2/742: rename d4/d6/db/d66/d93/f64 to d4/d6/db/fef 0 2024-03-16T10:53:28.696 INFO:tasks.workunit.client.0.smithi017.stdout:2/743: mknod d4/dd/d1e/d3e/cf0 0 2024-03-16T10:53:28.696 INFO:tasks.workunit.client.0.smithi017.stdout:2/744: stat d4/dd/d38/l4c 0 2024-03-16T10:53:28.698 INFO:tasks.workunit.client.0.smithi017.stdout:2/745: creat d4/dd/d1e/d4a/ff1 x:0 0 0 2024-03-16T10:53:28.700 INFO:tasks.workunit.client.0.smithi017.stdout:2/746: write d4/dd/d38/dc3/f83 [110441,114780] 0 2024-03-16T10:53:28.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/747: creat d4/d6/d30/d3f/ff2 x:0 0 0 2024-03-16T10:53:28.710 INFO:tasks.workunit.client.0.smithi017.stdout:1/949: rename d1/d3/dd/d9f/d111/c124 to d1/d24/d79/c13c 0 2024-03-16T10:53:28.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/950: write d1/d3/dd/d31/d66/dd3/fe4 [4404446,125470] 0 2024-03-16T10:53:28.724 INFO:tasks.workunit.client.0.smithi017.stdout:2/748: rename d4/dd/d38 to d4/dd/d1e/d4a/df3 0 2024-03-16T10:53:28.726 INFO:tasks.workunit.client.0.smithi017.stdout:2/749: creat d4/d6/d30/d3f/dba/ff4 x:0 0 0 2024-03-16T10:53:28.727 INFO:tasks.workunit.client.0.smithi017.stdout:2/750: rmdir d4/d6/db/d66/d2e/d78 39 2024-03-16T10:53:28.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/751: mkdir d4/d6/db/d66/d2e/d78/df5 0 2024-03-16T10:53:28.728 INFO:tasks.workunit.client.0.smithi017.stdout:1/951: write d1/d3/dd/d31/d66/dd7/dbc/fd1 [4059065,47690] 0 2024-03-16T10:53:28.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/752: creat d4/d6/d81/ff6 x:0 0 0 2024-03-16T10:53:28.733 INFO:tasks.workunit.client.0.smithi017.stdout:4/981: sync 2024-03-16T10:53:28.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/803: sync 2024-03-16T10:53:28.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/804: chown d8/d1d/dab/dc4/dd7/l47 38284652 1 2024-03-16T10:53:28.735 INFO:tasks.workunit.client.0.smithi017.stdout:4/982: creat d15/d1d/d21/d3c/de9/d40/d51/d64/d63/f153 x:0 0 0 2024-03-16T10:53:28.737 INFO:tasks.workunit.client.0.smithi017.stdout:3/805: creat d8/d3f/dd3/fed x:0 0 0 2024-03-16T10:53:28.739 INFO:tasks.workunit.client.0.smithi017.stdout:8/900: sync 2024-03-16T10:53:28.739 INFO:tasks.workunit.client.0.smithi017.stdout:9/852: sync 2024-03-16T10:53:28.739 INFO:tasks.workunit.client.0.smithi017.stdout:6/821: sync 2024-03-16T10:53:28.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/952: read d1/d3/dd/f9a [3954981,8047] 0 2024-03-16T10:53:28.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/853: creat d8/df/d46/d63/d94/f11c x:0 0 0 2024-03-16T10:53:28.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/753: dread d4/d6/d30/fe8 [0,4194304] 0 2024-03-16T10:53:28.743 INFO:tasks.workunit.client.0.smithi017.stdout:8/901: creat d6/d16/d6c/dd4/f122 x:0 0 0 2024-03-16T10:53:28.743 INFO:tasks.workunit.client.0.smithi017.stdout:8/902: chown d6 1943 1 2024-03-16T10:53:28.744 INFO:tasks.workunit.client.0.smithi017.stdout:1/953: mknod d1/c13d 0 2024-03-16T10:53:28.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/854: getdents d8/df/d46/d63/d94/d9d 0 2024-03-16T10:53:28.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/855: write d8/df/d46/d63/f7b [1687486,44440] 0 2024-03-16T10:53:28.745 INFO:tasks.workunit.client.0.smithi017.stdout:4/983: dread d15/d1d/d21/d3c/de9/d14f/f111 [0,4194304] 0 2024-03-16T10:53:28.745 INFO:tasks.workunit.client.0.smithi017.stdout:4/984: chown d15/f12c 63966095 1 2024-03-16T10:53:28.747 INFO:tasks.workunit.client.0.smithi017.stdout:8/903: symlink d6/d39/l123 0 2024-03-16T10:53:28.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/985: dread d15/d1d/d21/d3c/de9/d14f/f141 [0,4194304] 0 2024-03-16T10:53:28.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/986: readlink d15/d1d/d21/d26/d66/d8c/dab/lda 0 2024-03-16T10:53:28.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/954: getdents d1/d3/dd/d9f/d111 0 2024-03-16T10:53:28.749 INFO:tasks.workunit.client.0.smithi017.stdout:8/904: creat d6/d14/d72/dfe/f124 x:0 0 0 2024-03-16T10:53:28.749 INFO:tasks.workunit.client.0.smithi017.stdout:8/905: chown d6/d4a/d114/l115 9238511 1 2024-03-16T10:53:28.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/987: symlink d15/d1d/d13a/l154 0 2024-03-16T10:53:28.752 INFO:tasks.workunit.client.0.smithi017.stdout:1/955: truncate d1/f41 4007494 0 2024-03-16T10:53:28.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/906: creat d6/d5c/d96/d98/f125 x:0 0 0 2024-03-16T10:53:28.756 INFO:tasks.workunit.client.0.smithi017.stdout:4/988: creat d15/d1d/d21/d3c/de9/d43/dd1/d150/f155 x:0 0 0 2024-03-16T10:53:28.756 INFO:tasks.workunit.client.0.smithi017.stdout:4/989: fdatasync d15/d1d/d21/d3c/de9/d40/d51/d64/d63/d9f/fcb 0 2024-03-16T10:53:28.759 INFO:tasks.workunit.client.0.smithi017.stdout:9/856: dwrite d8/d95/dde/fe3 [4194304,4194304] 0 2024-03-16T10:53:28.766 INFO:tasks.workunit.client.0.smithi017.stdout:9/857: dread d8/df/d46/d63/d94/d9d/fc5 [0,4194304] 0 2024-03-16T10:53:28.769 INFO:tasks.workunit.client.0.smithi017.stdout:1/956: dread d1/d3/dd/d31/d66/dd7/f73 [0,4194304] 0 2024-03-16T10:53:28.771 INFO:tasks.workunit.client.0.smithi017.stdout:9/858: link d8/df/d66/f6e d8/dbf/d68/f11d 0 2024-03-16T10:53:28.772 INFO:tasks.workunit.client.0.smithi017.stdout:8/907: dwrite d6/d5c/f73 [0,4194304] 0 2024-03-16T10:53:28.772 INFO:tasks.workunit.client.0.smithi017.stdout:8/908: chown d6/d16/d6c/dd4/d92 227 1 2024-03-16T10:53:28.776 INFO:tasks.workunit.client.0.smithi017.stdout:4/990: dwrite d15/d1d/d27/fb2 [0,4194304] 0 2024-03-16T10:53:28.776 INFO:tasks.workunit.client.0.smithi017.stdout:9/859: creat d8/df/d5b/d72/d9e/f11e x:0 0 0 2024-03-16T10:53:28.777 INFO:tasks.workunit.client.0.smithi017.stdout:9/860: dread d8/df/d66/dd1/f10b [0,4194304] 0 2024-03-16T10:53:28.778 INFO:tasks.workunit.client.0.smithi017.stdout:1/957: write d1/d3/dd/d72/f80 [1621358,26580] 0 2024-03-16T10:53:28.779 INFO:tasks.workunit.client.0.smithi017.stdout:4/991: mkdir d15/d1d/d21/d3c/de9/d43/d156 0 2024-03-16T10:53:28.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/861: truncate d8/dbf/d91/f99 2624640 0 2024-03-16T10:53:28.781 INFO:tasks.workunit.client.0.smithi017.stdout:4/992: symlink d15/d1d/d21/d3c/de9/d127/l157 0 2024-03-16T10:53:28.781 INFO:tasks.workunit.client.0.smithi017.stdout:4/993: stat d15/d1d/d21/d3c/de9/d40/d51/d64/d63/f6f 0 2024-03-16T10:53:28.781 INFO:tasks.workunit.client.0.smithi017.stdout:9/862: dread d8/df/d5b/f8c [0,4194304] 0 2024-03-16T10:53:28.781 INFO:tasks.workunit.client.0.smithi017.stdout:8/909: dwrite d6/d14/d72/f95 [4194304,4194304] 0 2024-03-16T10:53:28.782 INFO:tasks.workunit.client.0.smithi017.stdout:8/910: write d6/d5f/d6e/d34/db4/ff3 [744741,8935] 0 2024-03-16T10:53:28.782 INFO:tasks.workunit.client.0.smithi017.stdout:8/911: chown d6/dc5/l102 6228 1 2024-03-16T10:53:28.785 INFO:tasks.workunit.client.0.smithi017.stdout:9/863: dread d8/df/d5b/d32/f39 [0,4194304] 0 2024-03-16T10:53:28.785 INFO:tasks.workunit.client.0.smithi017.stdout:9/864: write d8/df/d66/f6e [8836208,78214] 0 2024-03-16T10:53:28.786 INFO:tasks.workunit.client.0.smithi017.stdout:4/994: unlink d15/f68 0 2024-03-16T10:53:28.786 INFO:tasks.workunit.client.0.smithi017.stdout:4/995: chown d15/d1d/d21/d26/d66/l11f 11517956 1 2024-03-16T10:53:28.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/996: mkdir d15/d1d/d13a/d158 0 2024-03-16T10:53:28.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/997: write d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/d117/d144/ff3 [705497,104269] 0 2024-03-16T10:53:28.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/998: mkdir d15/d1d/d21/d3c/de9/d40/d51/d64/d76/da3/d117/d159 0 2024-03-16T10:53:28.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/806: rename d8/d1b/d2e/d60/d63/f72 to d8/d1b/d2e/d57/fee 0 2024-03-16T10:53:28.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/807: stat d8/d1b/d2e/d60/le2 0 2024-03-16T10:53:28.804 INFO:tasks.workunit.client.0.smithi017.stdout:3/808: creat d8/d3f/fef x:0 0 0 2024-03-16T10:53:28.804 INFO:tasks.workunit.client.0.smithi017.stdout:3/809: write d8/d1b/d2e/d57/fee [4357939,76538] 0 2024-03-16T10:53:28.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/810: mkdir d8/d1d/d9a/df0 0 2024-03-16T10:53:28.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/811: chown d8/d1d/l25 762 1 2024-03-16T10:53:28.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/812: dread d8/d1d/d9a/fd8 [0,4194304] 0 2024-03-16T10:53:28.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/813: dread d8/d1d/dab/dc4/dd7/d62/f7d [0,4194304] 0 2024-03-16T10:53:28.830 INFO:tasks.workunit.client.0.smithi017.stdout:4/999: dwrite d15/d1d/d21/d26/d66/d8c/f92 [0,4194304] 0 2024-03-16T10:53:28.835 INFO:tasks.workunit.client.0.smithi017.stdout:6/822: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/c98 to d0/d15/d1f/c104 0 2024-03-16T10:53:28.837 INFO:tasks.workunit.client.0.smithi017.stdout:9/865: rename d8/df/d5b/d32/cca to d8/df/d5b/daf/c11f 0 2024-03-16T10:53:28.837 INFO:tasks.workunit.client.0.smithi017.stdout:9/866: stat d8/df/d46/d63/d94/d9d/cba 0 2024-03-16T10:53:28.838 INFO:tasks.workunit.client.0.smithi017.stdout:6/823: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/l105 0 2024-03-16T10:53:28.841 INFO:tasks.workunit.client.0.smithi017.stdout:9/867: creat d8/d95/dde/f120 x:0 0 0 2024-03-16T10:53:28.841 INFO:tasks.workunit.client.0.smithi017.stdout:9/868: stat d8/l81 0 2024-03-16T10:53:28.843 INFO:tasks.workunit.client.0.smithi017.stdout:6/824: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fc8 932064 0 2024-03-16T10:53:28.843 INFO:tasks.workunit.client.0.smithi017.stdout:6/825: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 0 2024-03-16T10:53:28.846 INFO:tasks.workunit.client.0.smithi017.stdout:6/826: rename d0/d3e/dee/ff9 to d0/d21/d39/d44/d95/f106 0 2024-03-16T10:53:28.846 INFO:tasks.workunit.client.0.smithi017.stdout:9/869: read d8/df/f4f [3057196,96619] 0 2024-03-16T10:53:28.849 INFO:tasks.workunit.client.0.smithi017.stdout:6/827: rename d0/d21/d39/d44/d9a/cc1 to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/c107 0 2024-03-16T10:53:28.849 INFO:tasks.workunit.client.0.smithi017.stdout:6/828: write d0/ff3 [528845,59506] 0 2024-03-16T10:53:28.851 INFO:tasks.workunit.client.0.smithi017.stdout:1/958: unlink d1/d3/dd/d31/d66/dd7/cc1 0 2024-03-16T10:53:28.853 INFO:tasks.workunit.client.0.smithi017.stdout:1/959: getdents d1/d3/dd/ddc 0 2024-03-16T10:53:28.853 INFO:tasks.workunit.client.0.smithi017.stdout:6/829: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/d108 0 2024-03-16T10:53:28.855 INFO:tasks.workunit.client.0.smithi017.stdout:1/960: symlink d1/d3/de/l13e 0 2024-03-16T10:53:28.855 INFO:tasks.workunit.client.0.smithi017.stdout:1/961: chown d1/d3/dd/d31/d66/c68 59820 1 2024-03-16T10:53:28.855 INFO:tasks.workunit.client.0.smithi017.stdout:9/870: write d8/df/d5b/d32/f3c [250889,85008] 0 2024-03-16T10:53:28.855 INFO:tasks.workunit.client.0.smithi017.stdout:6/830: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/de5/l109 0 2024-03-16T10:53:28.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/962: dread d1/d50/d8d/fa0 [0,4194304] 0 2024-03-16T10:53:28.860 INFO:tasks.workunit.client.0.smithi017.stdout:6/831: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f10a x:0 0 0 2024-03-16T10:53:28.860 INFO:tasks.workunit.client.0.smithi017.stdout:6/832: truncate d0/d3e/dd3/fcf 42113 0 2024-03-16T10:53:28.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/963: symlink d1/l13f 0 2024-03-16T10:53:28.862 INFO:tasks.workunit.client.0.smithi017.stdout:1/964: mknod d1/d24/d79/c140 0 2024-03-16T10:53:28.873 INFO:tasks.workunit.client.0.smithi017.stdout:6/833: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fae [0,4194304] 0 2024-03-16T10:53:28.875 INFO:tasks.workunit.client.0.smithi017.stdout:6/834: mkdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dde/d10b 0 2024-03-16T10:53:28.875 INFO:tasks.workunit.client.0.smithi017.stdout:1/965: dread d1/d3/dd/d72/d8f/dbe/f125 [0,4194304] 0 2024-03-16T10:53:28.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/835: fsync d0/d15/f1c 0 2024-03-16T10:53:28.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/836: write d0/d3e/f57 [1247395,125388] 0 2024-03-16T10:53:28.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/871: dwrite d8/df/d66/dd1/f10b [0,4194304] 0 2024-03-16T10:53:28.882 INFO:tasks.workunit.client.0.smithi017.stdout:6/837: dread d0/f74 [0,4194304] 0 2024-03-16T10:53:28.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/838: fsync d0/f40 0 2024-03-16T10:53:28.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/839: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/lf5 1 1 2024-03-16T10:53:28.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/840: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9 285408894 1 2024-03-16T10:53:28.886 INFO:tasks.workunit.client.0.smithi017.stdout:9/872: write d8/dbf/d68/f11d [4595870,69772] 0 2024-03-16T10:53:28.886 INFO:tasks.workunit.client.0.smithi017.stdout:9/873: dread - d8/dbf/d68/f109 zero size 2024-03-16T10:53:28.887 INFO:tasks.workunit.client.0.smithi017.stdout:9/874: mkdir d8/dbf/d91/d121 0 2024-03-16T10:53:28.889 INFO:tasks.workunit.client.0.smithi017.stdout:9/875: mkdir d8/df/d66/dd1/d122 0 2024-03-16T10:53:28.893 INFO:tasks.workunit.client.0.smithi017.stdout:9/876: creat d8/df/d5b/d70/d89/f123 x:0 0 0 2024-03-16T10:53:28.894 INFO:tasks.workunit.client.0.smithi017.stdout:9/877: mkdir d8/dbf/d68/d98/deb/d124 0 2024-03-16T10:53:28.899 INFO:tasks.workunit.client.0.smithi017.stdout:6/841: dwrite d0/ff3 [0,4194304] 0 2024-03-16T10:53:28.907 INFO:tasks.workunit.client.0.smithi017.stdout:9/878: dwrite d8/df/d5b/daf/db7/de6/d112/f115 [0,4194304] 0 2024-03-16T10:53:28.907 INFO:tasks.workunit.client.0.smithi017.stdout:9/879: chown d8/df/c7d 38404 1 2024-03-16T10:53:28.908 INFO:tasks.workunit.client.0.smithi017.stdout:6/842: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f56 [0,4194304] 0 2024-03-16T10:53:28.910 INFO:tasks.workunit.client.0.smithi017.stdout:9/880: creat d8/dbf/d68/d7f/f125 x:0 0 0 2024-03-16T10:53:28.910 INFO:tasks.workunit.client.0.smithi017.stdout:9/881: write d8/df/d5b/daf/db7/fc4 [1074491,88060] 0 2024-03-16T10:53:28.910 INFO:tasks.workunit.client.0.smithi017.stdout:9/882: dread - d8/df/d46/d63/d94/f11c zero size 2024-03-16T10:53:28.910 INFO:tasks.workunit.client.0.smithi017.stdout:9/883: write d8/df/d5b/d72/d9e/ff5 [4726,116015] 0 2024-03-16T10:53:28.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/843: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/f10c x:0 0 0 2024-03-16T10:53:28.913 INFO:tasks.workunit.client.0.smithi017.stdout:6/844: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/l10d 0 2024-03-16T10:53:28.916 INFO:tasks.workunit.client.0.smithi017.stdout:1/966: rename d1/d3/dd/f55 to d1/d24/d79/dd2/f141 0 2024-03-16T10:53:28.916 INFO:tasks.workunit.client.0.smithi017.stdout:1/967: chown d1/d3/dd/d31/d66/dd3/cfb 26 1 2024-03-16T10:53:28.916 INFO:tasks.workunit.client.0.smithi017.stdout:1/968: stat d1/d3/dd/d31/d66/dd7/d67/f6a 0 2024-03-16T10:53:28.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/845: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/fc8 to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/f10e 0 2024-03-16T10:53:28.921 INFO:tasks.workunit.client.0.smithi017.stdout:6/846: mkdir d0/d21/d39/d44/d95/dfa/d10f 0 2024-03-16T10:53:28.921 INFO:tasks.workunit.client.0.smithi017.stdout:6/847: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/faa [124257,70146] 0 2024-03-16T10:53:28.924 INFO:tasks.workunit.client.0.smithi017.stdout:1/969: dread d1/d3/dd/d9f/d111/f120 [0,4194304] 0 2024-03-16T10:53:28.925 INFO:tasks.workunit.client.0.smithi017.stdout:1/970: creat d1/d3/dd/d31/d66/da1/de3/d138/f142 x:0 0 0 2024-03-16T10:53:28.926 INFO:tasks.workunit.client.0.smithi017.stdout:1/971: creat d1/d3/dd/f143 x:0 0 0 2024-03-16T10:53:28.927 INFO:tasks.workunit.client.0.smithi017.stdout:9/884: dwrite d8/dbf/d68/d98/ffc [0,4194304] 0 2024-03-16T10:53:28.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/848: read d0/d21/d39/f5a [3122250,110115] 0 2024-03-16T10:53:28.936 INFO:tasks.workunit.client.0.smithi017.stdout:9/885: unlink d8/df/d46/f58 0 2024-03-16T10:53:28.936 INFO:tasks.workunit.client.0.smithi017.stdout:9/886: chown d8/dbf/d68/d98/lb5 1 1 2024-03-16T10:53:28.940 INFO:tasks.workunit.client.0.smithi017.stdout:9/887: unlink d8/d95/dde/f107 0 2024-03-16T10:53:28.940 INFO:tasks.workunit.client.0.smithi017.stdout:9/888: readlink d8/df/d5b/d70/lc6 0 2024-03-16T10:53:28.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/849: dwrite d0/d21/d39/d44/d9a/ffb [0,4194304] 0 2024-03-16T10:53:28.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/850: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78 3 1 2024-03-16T10:53:28.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/851: readlink d0/d15/d1f/lb5 0 2024-03-16T10:53:28.945 INFO:tasks.workunit.client.0.smithi017.stdout:6/852: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/f110 x:0 0 0 2024-03-16T10:53:28.953 INFO:tasks.workunit.client.0.smithi017.stdout:1/972: rename d1/d3/dd/d72/d8f/dbe/f108 to d1/d24/d79/f144 0 2024-03-16T10:53:28.953 INFO:tasks.workunit.client.0.smithi017.stdout:6/853: read d0/d15/f1c [1343445,6468] 0 2024-03-16T10:53:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/912: sync 2024-03-16T10:53:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:3/814: sync 2024-03-16T10:53:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:2/754: sync 2024-03-16T10:53:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:3/815: read d8/da/db/f2a [3856278,122292] 0 2024-03-16T10:53:28.954 INFO:tasks.workunit.client.0.smithi017.stdout:3/816: truncate d8/d1b/d65/da6/fb9 623605 0 2024-03-16T10:53:28.955 INFO:tasks.workunit.client.0.smithi017.stdout:9/889: rename d8/df/d5b/d32/ce2 to d8/dbf/d68/d98/c126 0 2024-03-16T10:53:28.955 INFO:tasks.workunit.client.0.smithi017.stdout:9/890: truncate d8/d95/dde/f120 17448 0 2024-03-16T10:53:28.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/854: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/ffd [4194304,4194304] 0 2024-03-16T10:53:28.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/855: chown d0/d3e/c48 64273115 1 2024-03-16T10:53:28.959 INFO:tasks.workunit.client.0.smithi017.stdout:2/755: symlink d4/d6/d30/lf7 0 2024-03-16T10:53:28.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/817: unlink d8/da/db/f2a 0 2024-03-16T10:53:28.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/818: chown d8/d3f/d3d/f5b 3779 1 2024-03-16T10:53:28.961 INFO:tasks.workunit.client.0.smithi017.stdout:6/856: symlink d0/d21/d39/d44/d9a/da7/l111 0 2024-03-16T10:53:28.963 INFO:tasks.workunit.client.0.smithi017.stdout:2/756: creat d4/d97/ff8 x:0 0 0 2024-03-16T10:53:28.965 INFO:tasks.workunit.client.0.smithi017.stdout:2/757: creat d4/d6/db/d66/d2e/d78/ff9 x:0 0 0 2024-03-16T10:53:28.965 INFO:tasks.workunit.client.0.smithi017.stdout:2/758: dread - d4/d6/db/d66/d2e/fea zero size 2024-03-16T10:53:28.966 INFO:tasks.workunit.client.0.smithi017.stdout:3/819: symlink d8/da/lf1 0 2024-03-16T10:53:28.970 INFO:tasks.workunit.client.0.smithi017.stdout:6/857: unlink d0/d3e/dd3/fcf 0 2024-03-16T10:53:28.970 INFO:tasks.workunit.client.0.smithi017.stdout:6/858: read - d0/d3e/dee/ff6 zero size 2024-03-16T10:53:28.971 INFO:tasks.workunit.client.0.smithi017.stdout:1/973: getdents d1/d3/dd/d31/d66 0 2024-03-16T10:53:28.972 INFO:tasks.workunit.client.0.smithi017.stdout:3/820: mknod d8/d1d/dab/dc4/dd7/d62/d69/d8b/cf2 0 2024-03-16T10:53:28.973 INFO:tasks.workunit.client.0.smithi017.stdout:6/859: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/l112 0 2024-03-16T10:53:28.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/860: truncate d0/f6a 1981396 0 2024-03-16T10:53:28.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/861: truncate d0/d21/d39/d44/d95/fd4 4505809 0 2024-03-16T10:53:28.978 INFO:tasks.workunit.client.0.smithi017.stdout:6/862: rmdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e 39 2024-03-16T10:53:28.979 INFO:tasks.workunit.client.0.smithi017.stdout:8/913: dwrite d6/f68 [0,4194304] 0 2024-03-16T10:53:28.980 INFO:tasks.workunit.client.0.smithi017.stdout:6/863: creat d0/d15/d1f/d7d/d87/f113 x:0 0 0 2024-03-16T10:53:28.981 INFO:tasks.workunit.client.0.smithi017.stdout:6/864: dread - d0/d3e/dee/ff6 zero size 2024-03-16T10:53:28.981 INFO:tasks.workunit.client.0.smithi017.stdout:1/974: dread d1/d3/dd/d31/d66/dd7/f39 [4194304,4194304] 0 2024-03-16T10:53:28.981 INFO:tasks.workunit.client.0.smithi017.stdout:9/891: dwrite d8/f38 [0,4194304] 0 2024-03-16T10:53:28.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/914: getdents d6/d14/d72 0 2024-03-16T10:53:28.982 INFO:tasks.workunit.client.0.smithi017.stdout:9/892: mknod d8/df/d5b/d32/d45/d8b/c127 0 2024-03-16T10:53:28.982 INFO:tasks.workunit.client.0.smithi017.stdout:3/821: dwrite d8/da/db/f15 [8388608,4194304] 0 2024-03-16T10:53:28.982 INFO:tasks.workunit.client.0.smithi017.stdout:3/822: truncate d8/d1b/d2e/d57/f89 1183334 0 2024-03-16T10:53:28.983 INFO:tasks.workunit.client.0.smithi017.stdout:3/823: chown d8/d1b/d2e/laa 174 1 2024-03-16T10:53:28.986 INFO:tasks.workunit.client.0.smithi017.stdout:6/865: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c [0,4194304] 0 2024-03-16T10:53:28.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/915: creat d6/d5f/da4/dd8/d11e/f126 x:0 0 0 2024-03-16T10:53:28.989 INFO:tasks.workunit.client.0.smithi017.stdout:9/893: rename d8/df/fbd to d8/dbf/d68/d7f/f128 0 2024-03-16T10:53:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:1/975: rmdir d1/d3/dd/d31/d35 39 2024-03-16T10:53:28.992 INFO:tasks.workunit.client.0.smithi017.stdout:8/916: write d6/d5f/f9b [48976,54682] 0 2024-03-16T10:53:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/866: mkdir d0/d21/d114 0 2024-03-16T10:53:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/867: readlink d0/d3e/ldb 0 2024-03-16T10:53:28.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/868: dread - d0/d15/d1f/d7d/d87/feb zero size 2024-03-16T10:53:28.996 INFO:tasks.workunit.client.0.smithi017.stdout:1/976: truncate d1/d3/dd/d31/d35/f3e 118152 0 2024-03-16T10:53:28.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/977: creat d1/d3/dd/d31/d66/da1/de3/d138/f145 x:0 0 0 2024-03-16T10:53:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:2/759: link d4/dd/d1e/d4a/df3/fe7 d4/dd/d1e/ffa 0 2024-03-16T10:53:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:3/824: dwrite d8/d1b/d2e/d8d/fc8 [0,4194304] 0 2024-03-16T10:53:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:3/825: readlink d8/da/db/lbd 0 2024-03-16T10:53:29.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/978: creat d1/d50/f146 x:0 0 0 2024-03-16T10:53:29.001 INFO:tasks.workunit.client.0.smithi017.stdout:3/826: dread d8/d1d/d9a/fac [0,4194304] 0 2024-03-16T10:53:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:3/827: creat d8/d1d/dab/dc4/dd7/d62/d69/d8b/ff3 x:0 0 0 2024-03-16T10:53:29.007 INFO:tasks.workunit.client.0.smithi017.stdout:3/828: readlink l4 0 2024-03-16T10:53:29.011 INFO:tasks.workunit.client.0.smithi017.stdout:6/869: dwrite d0/d21/fb7 [0,4194304] 0 2024-03-16T10:53:29.011 INFO:tasks.workunit.client.0.smithi017.stdout:2/760: truncate d4/d6/db/d66/d2e/f3c 376962 0 2024-03-16T10:53:29.011 INFO:tasks.workunit.client.0.smithi017.stdout:2/761: dread - d4/dd/d1e/d4a/df3/dc3/fe4 zero size 2024-03-16T10:53:29.011 INFO:tasks.workunit.client.0.smithi017.stdout:3/829: write d8/d1b/d2e/d57/f6a [4292399,6010] 0 2024-03-16T10:53:29.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/979: dwrite d1/d3/dd/d9f/f30 [0,4194304] 0 2024-03-16T10:53:29.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/980: stat d1/d24/d79/fca 0 2024-03-16T10:53:29.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/981: chown d1/d24/d79/dd2/d100/f10d 6898674 1 2024-03-16T10:53:29.015 INFO:tasks.workunit.client.0.smithi017.stdout:6/870: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f115 x:0 0 0 2024-03-16T10:53:29.015 INFO:tasks.workunit.client.0.smithi017.stdout:6/871: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/faf 774535 0 2024-03-16T10:53:29.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/982: mkdir d1/d24/d79/d147 0 2024-03-16T10:53:29.018 INFO:tasks.workunit.client.0.smithi017.stdout:2/762: read d4/d6/db/fef [644142,20434] 0 2024-03-16T10:53:29.018 INFO:tasks.workunit.client.0.smithi017.stdout:2/763: chown d4/dd/d1e/ffa 106 1 2024-03-16T10:53:29.019 INFO:tasks.workunit.client.0.smithi017.stdout:2/764: readlink d4/d6/db/d66/d2e/l46 0 2024-03-16T10:53:29.019 INFO:tasks.workunit.client.0.smithi017.stdout:2/765: chown d4/d6/fa 1804 1 2024-03-16T10:53:29.019 INFO:tasks.workunit.client.0.smithi017.stdout:2/766: dread - d4/dd/df/fdf zero size 2024-03-16T10:53:29.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/872: dread d0/d15/d1f/d7d/d87/f90 [0,4194304] 0 2024-03-16T10:53:29.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/873: chown d0/d21/d39/f5a 252592765 1 2024-03-16T10:53:29.028 INFO:tasks.workunit.client.0.smithi017.stdout:3/830: dwrite d8/d1b/d2e/d8d/fc8 [0,4194304] 0 2024-03-16T10:53:29.035 INFO:tasks.workunit.client.0.smithi017.stdout:3/831: creat d8/da/ff4 x:0 0 0 2024-03-16T10:53:29.038 INFO:tasks.workunit.client.0.smithi017.stdout:3/832: truncate d8/f7a 804555 0 2024-03-16T10:53:29.038 INFO:tasks.workunit.client.0.smithi017.stdout:6/874: write d0/d21/f36 [121732,60710] 0 2024-03-16T10:53:29.040 INFO:tasks.workunit.client.0.smithi017.stdout:3/833: unlink d8/d8c/fe0 0 2024-03-16T10:53:29.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/875: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/f116 x:0 0 0 2024-03-16T10:53:29.046 INFO:tasks.workunit.client.0.smithi017.stdout:3/834: dread d8/d1d/dab/dc4/dd7/f2f [0,4194304] 0 2024-03-16T10:53:29.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/835: dread d8/d1b/d2e/d60/f84 [0,4194304] 0 2024-03-16T10:53:29.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/836: write d8/da/fa4 [3125600,42960] 0 2024-03-16T10:53:29.048 INFO:tasks.workunit.client.0.smithi017.stdout:6/876: write d0/d21/d39/d44/d9a/da7/f18 [659618,81218] 0 2024-03-16T10:53:29.056 INFO:tasks.workunit.client.0.smithi017.stdout:6/877: read d0/f4 [1299935,22414] 0 2024-03-16T10:53:29.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/878: creat d0/d21/d39/d44/d9a/da7/f117 x:0 0 0 2024-03-16T10:53:29.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/983: rename d1/d50/d61/f13b to d1/d3/dd/d31/d66/dd7/dbc/ddb/f148 0 2024-03-16T10:53:29.059 INFO:tasks.workunit.client.0.smithi017.stdout:1/984: truncate d1/d3/dd/d31/d66/da1/de3/fe7 624809 0 2024-03-16T10:53:29.060 INFO:tasks.workunit.client.0.smithi017.stdout:1/985: truncate d1/d3/dd/d9f/fad 3844367 0 2024-03-16T10:53:29.060 INFO:tasks.workunit.client.0.smithi017.stdout:1/986: write d1/d3/dd/d31/d66/da1/de3/f10c [1362571,34846] 0 2024-03-16T10:53:29.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/987: symlink d1/d24/d79/d7a/da9/d113/l149 0 2024-03-16T10:53:29.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/879: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fe2 [0,4194304] 0 2024-03-16T10:53:29.074 INFO:tasks.workunit.client.0.smithi017.stdout:1/988: dwrite d1/d24/d79/dd2/d100/d97/ff8 [0,4194304] 0 2024-03-16T10:53:29.076 INFO:tasks.workunit.client.0.smithi017.stdout:1/989: symlink d1/d3/dd/d9f/d111/l14a 0 2024-03-16T10:53:29.081 INFO:tasks.workunit.client.0.smithi017.stdout:2/767: rename d4/dd/d1e/d3e to d4/d6/db/dfb 0 2024-03-16T10:53:29.082 INFO:tasks.workunit.client.0.smithi017.stdout:2/768: mknod d4/d6/db/d24/d39/cfc 0 2024-03-16T10:53:29.083 INFO:tasks.workunit.client.0.smithi017.stdout:3/837: rename d8/d1d/dab/dc4/dd7/d62/d69/fe8 to d8/d8c/ff5 0 2024-03-16T10:53:29.083 INFO:tasks.workunit.client.0.smithi017.stdout:3/838: chown d8/d1b/f27 22542075 1 2024-03-16T10:53:29.085 INFO:tasks.workunit.client.0.smithi017.stdout:2/769: unlink d4/d6/d30/d3f/ld6 0 2024-03-16T10:53:29.085 INFO:tasks.workunit.client.0.smithi017.stdout:6/880: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/dde/ff1 [0,4194304] 0 2024-03-16T10:53:29.085 INFO:tasks.workunit.client.0.smithi017.stdout:6/881: readlink d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/la5 0 2024-03-16T10:53:29.085 INFO:tasks.workunit.client.0.smithi017.stdout:6/882: chown d0/d15/l34 1 1 2024-03-16T10:53:29.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/770: getdents d4/d6/db/d66/d2e/d78 0 2024-03-16T10:53:29.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/771: stat d4/d6/db/d24/d39/f76 0 2024-03-16T10:53:29.088 INFO:tasks.workunit.client.0.smithi017.stdout:1/990: dwrite d1/f34 [0,4194304] 0 2024-03-16T10:53:29.089 INFO:tasks.workunit.client.0.smithi017.stdout:1/991: mknod d1/d50/d8d/d10a/c14b 0 2024-03-16T10:53:29.092 INFO:tasks.workunit.client.0.smithi017.stdout:6/883: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 [0,4194304] 0 2024-03-16T10:53:29.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/772: dwrite d4/f25 [4194304,4194304] 0 2024-03-16T10:53:29.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/773: dread d4/dd/df/dd9/f88 [0,4194304] 0 2024-03-16T10:53:29.100 INFO:tasks.workunit.client.0.smithi017.stdout:6/884: creat d0/d21/f118 x:0 0 0 2024-03-16T10:53:29.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/774: truncate d4/d6/db/f7a 3064381 0 2024-03-16T10:53:29.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/775: dread - d4/d6/db/d66/fb5 zero size 2024-03-16T10:53:29.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/776: write d4/d6/d81/fa2 [974137,2927] 0 2024-03-16T10:53:29.105 INFO:tasks.workunit.client.0.smithi017.stdout:6/885: unlink d0/d21/f36 0 2024-03-16T10:53:29.105 INFO:tasks.workunit.client.0.smithi017.stdout:6/886: chown d0/d21/d39/d44/d9a/da7/d38/f63 25 1 2024-03-16T10:53:29.109 INFO:tasks.workunit.client.0.smithi017.stdout:6/887: link d0/d21/d39/d44/d9a/da7/l111 d0/d15/d1f/d7d/d87/dc9/l119 0 2024-03-16T10:53:29.111 INFO:tasks.workunit.client.0.smithi017.stdout:2/777: read d4/d6/db/dfb/f45 [55295,99572] 0 2024-03-16T10:53:29.112 INFO:tasks.workunit.client.0.smithi017.stdout:2/778: symlink d4/d6/db/d66/d2e/d78/lfd 0 2024-03-16T10:53:29.118 INFO:tasks.workunit.client.0.smithi017.stdout:6/888: dread d0/f40 [0,4194304] 0 2024-03-16T10:53:29.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/839: rename d8/d1b/d2e/d57/fee to d8/d1b/d2e/d60/ff6 0 2024-03-16T10:53:29.123 INFO:tasks.workunit.client.0.smithi017.stdout:3/840: mkdir d8/d1b/d2e/d60/df7 0 2024-03-16T10:53:29.123 INFO:tasks.workunit.client.0.smithi017.stdout:2/779: dread d4/d6/db/d66/d2e/f8b [0,4194304] 0 2024-03-16T10:53:29.124 INFO:tasks.workunit.client.0.smithi017.stdout:2/780: fsync d4/d6/db/d66/d93/f70 0 2024-03-16T10:53:29.124 INFO:tasks.workunit.client.0.smithi017.stdout:2/781: chown d4/d6/db/d24/d39 173 1 2024-03-16T10:53:29.129 INFO:tasks.workunit.client.0.smithi017.stdout:3/841: link d8/d1b/d65/da6/fb9 d8/d1b/d2e/d60/d63/ff8 0 2024-03-16T10:53:29.130 INFO:tasks.workunit.client.0.smithi017.stdout:2/782: symlink d4/d6/d30/d3f/dba/lfe 0 2024-03-16T10:53:29.130 INFO:tasks.workunit.client.0.smithi017.stdout:2/783: stat d4/d6/db/d24/d39/l60 0 2024-03-16T10:53:29.131 INFO:tasks.workunit.client.0.smithi017.stdout:3/842: symlink d8/d1b/d2e/d57/lf9 0 2024-03-16T10:53:29.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/784: creat d4/d6/db/d66/d93/d63/fff x:0 0 0 2024-03-16T10:53:29.133 INFO:tasks.workunit.client.0.smithi017.stdout:2/785: mkdir d4/d6/db/d66/d93/d100 0 2024-03-16T10:53:29.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/889: dwrite d0/d15/d1f/d7d/d87/fe7 [0,4194304] 0 2024-03-16T10:53:29.134 INFO:tasks.workunit.client.0.smithi017.stdout:2/786: creat d4/dd/d1e/f101 x:0 0 0 2024-03-16T10:53:29.134 INFO:tasks.workunit.client.0.smithi017.stdout:2/787: write d4/d6/db/d66/fb5 [685434,13936] 0 2024-03-16T10:53:29.134 INFO:tasks.workunit.client.0.smithi017.stdout:2/788: fsync d4/d6/d30/f7c 0 2024-03-16T10:53:29.137 INFO:tasks.workunit.client.0.smithi017.stdout:2/789: unlink d4/d6/db/dfb/l4f 0 2024-03-16T10:53:29.137 INFO:tasks.workunit.client.0.smithi017.stdout:2/790: fsync d4/d6/fc2 0 2024-03-16T10:53:29.141 INFO:tasks.workunit.client.0.smithi017.stdout:3/843: write d8/d1d/dab/dc4/dd7/d62/d69/f96 [3940104,108515] 0 2024-03-16T10:53:29.144 INFO:tasks.workunit.client.0.smithi017.stdout:3/844: creat d8/d1b/d2e/d8d/d87/ffa x:0 0 0 2024-03-16T10:53:29.147 INFO:tasks.workunit.client.0.smithi017.stdout:3/845: dread d8/d1b/d2e/d8d/f7b [0,4194304] 0 2024-03-16T10:53:29.147 INFO:tasks.workunit.client.0.smithi017.stdout:3/846: chown d8/d1b/d2e/d60/d63/lc5 60 1 2024-03-16T10:53:29.147 INFO:tasks.workunit.client.0.smithi017.stdout:3/847: fsync d8/d1b/f27 0 2024-03-16T10:53:29.150 INFO:tasks.workunit.client.0.smithi017.stdout:3/848: dread d8/d1d/dab/dc4/dd7/d62/d69/fb8 [4194304,4194304] 0 2024-03-16T10:53:29.150 INFO:tasks.workunit.client.0.smithi017.stdout:6/890: rename d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8/cea to d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/d108/c11a 0 2024-03-16T10:53:29.150 INFO:tasks.workunit.client.0.smithi017.stdout:2/791: dwrite d4/d6/db/d24/d39/f42 [0,4194304] 0 2024-03-16T10:53:29.152 INFO:tasks.workunit.client.0.smithi017.stdout:6/891: rename d0/d21/d39/d44/d9a/da7/d96/fce to d0/d21/d39/d44/d9a/da7/d96/f11b 0 2024-03-16T10:53:29.153 INFO:tasks.workunit.client.0.smithi017.stdout:6/892: getdents d0/d77 0 2024-03-16T10:53:29.162 INFO:tasks.workunit.client.0.smithi017.stdout:3/849: read d8/d3f/f3b [7126040,124395] 0 2024-03-16T10:53:29.163 INFO:tasks.workunit.client.0.smithi017.stdout:3/850: mknod d8/d1d/dab/dc4/dd7/d62/cfb 0 2024-03-16T10:53:29.165 INFO:tasks.workunit.client.0.smithi017.stdout:3/851: dread d8/d1d/d9a/fd8 [0,4194304] 0 2024-03-16T10:53:29.165 INFO:tasks.workunit.client.0.smithi017.stdout:6/893: write d0/d21/d39/d44/d9a/da7/fab [1690599,98805] 0 2024-03-16T10:53:29.165 INFO:tasks.workunit.client.0.smithi017.stdout:3/852: dread - d8/d1d/dab/dc4/dd7/daf/fb1 zero size 2024-03-16T10:53:29.166 INFO:tasks.workunit.client.0.smithi017.stdout:3/853: dread d8/d1b/d2e/f3e [0,4194304] 0 2024-03-16T10:53:29.167 INFO:tasks.workunit.client.0.smithi017.stdout:6/894: rename d0/d15/d1f/d7d/d87/dc9/fed to d0/d21/f11c 0 2024-03-16T10:53:29.167 INFO:tasks.workunit.client.0.smithi017.stdout:6/895: mknod d0/d77/c11d 0 2024-03-16T10:53:29.168 INFO:tasks.workunit.client.0.smithi017.stdout:2/792: dwrite d4/f2c [4194304,4194304] 0 2024-03-16T10:53:29.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/896: creat d0/d15/d1f/d7d/f11e x:0 0 0 2024-03-16T10:53:29.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/897: write d0/d21/d39/d44/f4f [1093516,16234] 0 2024-03-16T10:53:29.171 INFO:tasks.workunit.client.0.smithi017.stdout:2/793: rmdir d4/dd/d1e/de6 0 2024-03-16T10:53:29.178 INFO:tasks.workunit.client.0.smithi017.stdout:6/898: dread d0/d21/d39/d44/d9a/da7/d38/f71 [0,4194304] 0 2024-03-16T10:53:29.181 INFO:tasks.workunit.client.0.smithi017.stdout:6/899: mknod d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/c11f 0 2024-03-16T10:53:29.181 INFO:tasks.workunit.client.0.smithi017.stdout:6/900: write d0/d21/d39/d44/d9a/da7/d96/fb1 [733494,51977] 0 2024-03-16T10:53:29.182 INFO:tasks.workunit.client.0.smithi017.stdout:6/901: rmdir d0/d15 39 2024-03-16T10:53:29.183 INFO:tasks.workunit.client.0.smithi017.stdout:3/854: dwrite d8/d1b/d2e/d60/ff6 [4194304,4194304] 0 2024-03-16T10:53:29.183 INFO:tasks.workunit.client.0.smithi017.stdout:2/794: dwrite d4/d6/db/d66/d93/f6a [4194304,4194304] 0 2024-03-16T10:53:29.184 INFO:tasks.workunit.client.0.smithi017.stdout:3/855: symlink d8/d1b/d2e/d60/d63/lfc 0 2024-03-16T10:53:29.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/902: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:29.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/903: chown d0/d15/d1f/d7d 64 1 2024-03-16T10:53:29.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/904: dread - d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/f110 zero size 2024-03-16T10:53:29.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/905: fdatasync d0/d21/d39/d44/d9a/da7/f117 0 2024-03-16T10:53:29.202 INFO:tasks.workunit.client.0.smithi017.stdout:6/906: mkdir d0/d15/d1f/d7d/d120 0 2024-03-16T10:53:29.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/907: unlink d0/d21/d39/f5a 0 2024-03-16T10:53:29.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/908: fsync d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fe3 0 2024-03-16T10:53:29.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/909: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 0 2024-03-16T10:53:29.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/894: sync 2024-03-16T10:53:29.206 INFO:tasks.workunit.client.0.smithi017.stdout:9/895: truncate d8/df/d5b/d70/f85 997652 0 2024-03-16T10:53:29.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/896: truncate d8/f38 3972725 0 2024-03-16T10:53:29.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/897: chown d8/df/d5b/daf/db7/fbe 132096113 1 2024-03-16T10:53:29.209 INFO:tasks.workunit.client.0.smithi017.stdout:3/856: dwrite d8/d3f/dd3/fd4 [0,4194304] 0 2024-03-16T10:53:29.209 INFO:tasks.workunit.client.0.smithi017.stdout:3/857: write d8/da/f31 [8910361,29695] 0 2024-03-16T10:53:29.214 INFO:tasks.workunit.client.0.smithi017.stdout:6/910: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 [0,4194304] 0 2024-03-16T10:53:29.216 INFO:tasks.workunit.client.0.smithi017.stdout:6/911: creat d0/d21/d39/d44/d9a/da7/d45/d4d/f121 x:0 0 0 2024-03-16T10:53:29.217 INFO:tasks.workunit.client.0.smithi017.stdout:6/912: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8/f122 x:0 0 0 2024-03-16T10:53:29.218 INFO:tasks.workunit.client.0.smithi017.stdout:6/913: mknod d0/d77/dd2/c123 0 2024-03-16T10:53:29.219 INFO:tasks.workunit.client.0.smithi017.stdout:6/914: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/da8/fb6 [5128119,122559] 0 2024-03-16T10:53:29.228 INFO:tasks.workunit.client.0.smithi017.stdout:3/858: dwrite d8/d8c/fe4 [4194304,4194304] 0 2024-03-16T10:53:29.228 INFO:tasks.workunit.client.0.smithi017.stdout:3/859: chown d8/d1b/d2e/d8d/f82 6972229 1 2024-03-16T10:53:29.228 INFO:tasks.workunit.client.0.smithi017.stdout:3/860: chown d8/da/fa9 107703 1 2024-03-16T10:53:29.228 INFO:tasks.workunit.client.0.smithi017.stdout:3/861: chown d8/d1d/f4b 165 1 2024-03-16T10:53:29.230 INFO:tasks.workunit.client.0.smithi017.stdout:3/862: creat d8/ffd x:0 0 0 2024-03-16T10:53:29.231 INFO:tasks.workunit.client.0.smithi017.stdout:9/898: dwrite d8/dbf/d91/f106 [0,4194304] 0 2024-03-16T10:53:29.231 INFO:tasks.workunit.client.0.smithi017.stdout:9/899: chown d8/dbf/d68/d98/cb0 1 1 2024-03-16T10:53:29.233 INFO:tasks.workunit.client.0.smithi017.stdout:9/900: rmdir d8/df/d66/dd1/d118 0 2024-03-16T10:53:29.236 INFO:tasks.workunit.client.0.smithi017.stdout:9/901: rmdir d8 39 2024-03-16T10:53:29.236 INFO:tasks.workunit.client.0.smithi017.stdout:9/902: fdatasync d8/df/d5b/d70/d89/f123 0 2024-03-16T10:53:29.237 INFO:tasks.workunit.client.0.smithi017.stdout:6/915: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/fc3 [0,4194304] 0 2024-03-16T10:53:29.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/903: unlink d8/dbf/d68/l11b 0 2024-03-16T10:53:29.241 INFO:tasks.workunit.client.0.smithi017.stdout:3/863: dread d8/d1b/d2e/d57/f6a [0,4194304] 0 2024-03-16T10:53:29.243 INFO:tasks.workunit.client.0.smithi017.stdout:6/916: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f124 x:0 0 0 2024-03-16T10:53:29.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/904: read - d8/df/d46/d63/d102/f105 zero size 2024-03-16T10:53:29.249 INFO:tasks.workunit.client.0.smithi017.stdout:3/864: rename d8/da/c32 to d8/d1b/d2e/d8d/d87/cfe 0 2024-03-16T10:53:29.253 INFO:tasks.workunit.client.0.smithi017.stdout:3/865: symlink d8/d3f/dd3/lff 0 2024-03-16T10:53:29.253 INFO:tasks.workunit.client.0.smithi017.stdout:3/866: fdatasync d8/d1d/dab/dc4/dd7/f2f 0 2024-03-16T10:53:29.254 INFO:tasks.workunit.client.0.smithi017.stdout:9/905: truncate d8/dbf/d91/f106 2750104 0 2024-03-16T10:53:29.254 INFO:tasks.workunit.client.0.smithi017.stdout:9/906: write d8/df/d5b/d72/fd2 [1354536,129747] 0 2024-03-16T10:53:29.255 INFO:tasks.workunit.client.0.smithi017.stdout:6/917: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/ff2 [0,4194304] 0 2024-03-16T10:53:29.255 INFO:tasks.workunit.client.0.smithi017.stdout:6/918: chown d0/d15/d1f/f60 39170885 1 2024-03-16T10:53:29.256 INFO:tasks.workunit.client.0.smithi017.stdout:3/867: mknod d8/d8c/c100 0 2024-03-16T10:53:29.256 INFO:tasks.workunit.client.0.smithi017.stdout:8/917: sync 2024-03-16T10:53:29.258 INFO:tasks.workunit.client.0.smithi017.stdout:9/907: unlink d8/dbf/d68/l111 0 2024-03-16T10:53:29.258 INFO:tasks.workunit.client.0.smithi017.stdout:1/992: sync 2024-03-16T10:53:29.259 INFO:tasks.workunit.client.0.smithi017.stdout:1/993: mkdir d1/d3/dd/d31/d66/dd7/dbc/d14c 0 2024-03-16T10:53:29.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/919: mkdir d0/d125 0 2024-03-16T10:53:29.263 INFO:tasks.workunit.client.0.smithi017.stdout:3/868: dread d8/d1d/dab/dc4/dd7/f99 [0,4194304] 0 2024-03-16T10:53:29.264 INFO:tasks.workunit.client.0.smithi017.stdout:9/908: symlink d8/dbf/d68/l129 0 2024-03-16T10:53:29.264 INFO:tasks.workunit.client.0.smithi017.stdout:9/909: dread - d8/df/d66/fcd zero size 2024-03-16T10:53:29.265 INFO:tasks.workunit.client.0.smithi017.stdout:8/918: dread d6/d5c/f73 [0,4194304] 0 2024-03-16T10:53:29.266 INFO:tasks.workunit.client.0.smithi017.stdout:1/994: mkdir d1/d3/dd/d31/d35/d14d 0 2024-03-16T10:53:29.266 INFO:tasks.workunit.client.0.smithi017.stdout:6/920: symlink d0/d21/d39/d44/l126 0 2024-03-16T10:53:29.268 INFO:tasks.workunit.client.0.smithi017.stdout:8/919: creat d6/d5f/d6e/d34/db4/f127 x:0 0 0 2024-03-16T10:53:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:6/921: rename d0/d3e/ldb to d0/d21/d39/d44/d9a/da7/d45/l127 0 2024-03-16T10:53:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:6/922: dread - d0/d15/d1f/d7d/f7f zero size 2024-03-16T10:53:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:8/920: getdents d6/d39 0 2024-03-16T10:53:29.273 INFO:tasks.workunit.client.0.smithi017.stdout:8/921: fdatasync d6/fec 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/922: getdents d6/d16/d6c 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/923: write d6/d16/d6c/dd4/f47 [4069546,92617] 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/924: getdents d6/d39 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/925: write d6/d14/d8c/fc1 [654636,117469] 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/926: getdents d6/d16/d6c 0 2024-03-16T10:53:29.274 INFO:tasks.workunit.client.0.smithi017.stdout:3/869: dwrite d8/da/fa9 [0,4194304] 0 2024-03-16T10:53:29.278 INFO:tasks.workunit.client.0.smithi017.stdout:1/995: write d1/d50/d8d/fc5 [7694520,127354] 0 2024-03-16T10:53:29.278 INFO:tasks.workunit.client.0.smithi017.stdout:8/927: creat d6/d14/d72/f128 x:0 0 0 2024-03-16T10:53:29.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/996: dread d1/d3/dd/d72/d8f/dbe/fcc [0,4194304] 0 2024-03-16T10:53:29.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/997: chown d1/d3/dd/d31/d35/c11d 27258910 1 2024-03-16T10:53:29.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/910: dwrite d8/df/d46/d63/d94/d9d/fc5 [0,4194304] 0 2024-03-16T10:53:29.288 INFO:tasks.workunit.client.0.smithi017.stdout:1/998: dread d1/d3/dd/d31/fc8 [0,4194304] 0 2024-03-16T10:53:29.288 INFO:tasks.workunit.client.0.smithi017.stdout:3/870: dread d8/da/db/f23 [0,4194304] 0 2024-03-16T10:53:29.290 INFO:tasks.workunit.client.0.smithi017.stdout:1/999: mknod d1/d24/d79/dd2/d100/c14e 0 2024-03-16T10:53:29.290 INFO:tasks.workunit.client.0.smithi017.stdout:6/923: dwrite d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:29.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/928: dwrite d6/d5f/da4/dd8/d11e/f126 [0,4194304] 0 2024-03-16T10:53:29.295 INFO:tasks.workunit.client.0.smithi017.stdout:9/911: unlink d8/l81 0 2024-03-16T10:53:29.295 INFO:tasks.workunit.client.0.smithi017.stdout:9/912: readlink d8/dbf/d68/l78 0 2024-03-16T10:53:29.298 INFO:tasks.workunit.client.0.smithi017.stdout:3/871: rename d8/da/l6d to d8/d1d/db2/l101 0 2024-03-16T10:53:29.298 INFO:tasks.workunit.client.0.smithi017.stdout:3/872: stat d8/d1b/d2e/l40 0 2024-03-16T10:53:29.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/924: truncate d0/d21/d39/d44/d95/fd4 2190498 0 2024-03-16T10:53:29.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/925: fdatasync d0/d3e/f49 0 2024-03-16T10:53:29.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/926: readlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d78/l5d 0 2024-03-16T10:53:29.303 INFO:tasks.workunit.client.0.smithi017.stdout:2/795: sync 2024-03-16T10:53:29.303 INFO:tasks.workunit.client.0.smithi017.stdout:8/929: dwrite d6/d5f/d6e/f59 [0,4194304] 0 2024-03-16T10:53:29.303 INFO:tasks.workunit.client.0.smithi017.stdout:9/913: symlink d8/dbf/d91/l12a 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/873: dread d8/d1d/dab/dc4/dd7/d62/d69/f80 [0,4194304] 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/874: write d8/d1d/fdb [974720,121506] 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/875: write d8/d1b/d65/f9b [4980073,122400] 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/876: stat d8/ffd 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/877: write d8/da/db/f15 [5030616,46287] 0 2024-03-16T10:53:29.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/878: chown d8/d3f/d3d/f48 0 1 2024-03-16T10:53:29.309 INFO:tasks.workunit.client.0.smithi017.stdout:8/930: mkdir d6/d16/dcd/d129 0 2024-03-16T10:53:29.310 INFO:tasks.workunit.client.0.smithi017.stdout:2/796: write d4/d6/db/f7a [247894,7682] 0 2024-03-16T10:53:29.310 INFO:tasks.workunit.client.0.smithi017.stdout:2/797: write d4/d6/d81/ff6 [703915,104138] 0 2024-03-16T10:53:29.310 INFO:tasks.workunit.client.0.smithi017.stdout:2/798: getdents d4/d6/db/d66/d93/d63 0 2024-03-16T10:53:29.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/914: symlink d8/l12b 0 2024-03-16T10:53:29.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/931: unlink d6/d5f/d6e/d34/fab 0 2024-03-16T10:53:29.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/932: dread - d6/d5f/da4/dd8/ffb zero size 2024-03-16T10:53:29.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/927: write d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/f4c [1507569,91930] 0 2024-03-16T10:53:29.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/928: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/d97/d108/c11a 1331 1 2024-03-16T10:53:29.325 INFO:tasks.workunit.client.0.smithi017.stdout:8/933: dread d6/d16/db3/dcb/f46 [0,4194304] 0 2024-03-16T10:53:29.337 INFO:tasks.workunit.client.0.smithi017.stdout:9/915: mknod d8/df/d5b/d70/d89/c12c 0 2024-03-16T10:53:29.360 INFO:tasks.workunit.client.0.smithi017.stdout:8/934: mkdir d6/d16/db3/dcb/d12a 0 2024-03-16T10:53:29.361 INFO:tasks.workunit.client.0.smithi017.stdout:8/935: write d6/d14/d6b/f6f [784641,63437] 0 2024-03-16T10:53:29.370 INFO:tasks.workunit.client.0.smithi017.stdout:8/936: write d6/d14/f69 [6581701,75690] 0 2024-03-16T10:53:29.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/916: symlink d8/df/d5b/daf/db7/de6/l12d 0 2024-03-16T10:53:29.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/917: write d8/dbf/d68/d7f/f125 [458446,75943] 0 2024-03-16T10:53:29.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/918: dwrite d8/f79 [4194304,4194304] 0 2024-03-16T10:53:29.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/919: write d8/dbf/d68/d7f/fef [614908,24730] 0 2024-03-16T10:53:29.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/920: dread d8/df/d46/d63/d94/d9d/fc5 [0,4194304] 0 2024-03-16T10:53:29.398 INFO:tasks.workunit.client.0.smithi017.stdout:9/921: creat d8/df/f12e x:0 0 0 2024-03-16T10:53:29.414 INFO:tasks.workunit.client.0.smithi017.stdout:6/929: rmdir d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e 39 2024-03-16T10:53:29.419 INFO:tasks.workunit.client.0.smithi017.stdout:6/930: mkdir d0/d21/d39/d44/d9a/da7/d38/d128 0 2024-03-16T10:53:29.445 INFO:tasks.workunit.client.0.smithi017.stdout:3/879: rename d8/da/db/l51 to d8/d1b/d2e/d57/l102 0 2024-03-16T10:53:29.447 INFO:tasks.workunit.client.0.smithi017.stdout:8/937: rename d6/d16/c9e to d6/d39/c12b 0 2024-03-16T10:53:29.447 INFO:tasks.workunit.client.0.smithi017.stdout:8/938: write d6/d5f/d6e/fc6 [953532,1581] 0 2024-03-16T10:53:29.449 INFO:tasks.workunit.client.0.smithi017.stdout:3/880: creat d8/d1d/dab/dc4/dd7/f103 x:0 0 0 2024-03-16T10:53:29.451 INFO:tasks.workunit.client.0.smithi017.stdout:9/922: rename d8/df/d66/l10c to d8/df/d46/d63/d102/l12f 0 2024-03-16T10:53:29.454 INFO:tasks.workunit.client.0.smithi017.stdout:9/923: creat d8/df/d5b/f130 x:0 0 0 2024-03-16T10:53:29.455 INFO:tasks.workunit.client.0.smithi017.stdout:9/924: truncate d8/df/d66/dd1/f10b 218542 0 2024-03-16T10:53:29.457 INFO:tasks.workunit.client.0.smithi017.stdout:3/881: link d8/d1d/l25 d8/d1b/d2e/d60/l104 0 2024-03-16T10:53:29.457 INFO:tasks.workunit.client.0.smithi017.stdout:9/925: mknod d8/df/d5b/daf/c131 0 2024-03-16T10:53:29.458 INFO:tasks.workunit.client.0.smithi017.stdout:9/926: truncate d8/df/d5b/d70/d89/fc8 891181 0 2024-03-16T10:53:29.460 INFO:tasks.workunit.client.0.smithi017.stdout:3/882: symlink d8/d1d/dab/dc4/dd7/d62/d69/d8b/l105 0 2024-03-16T10:53:29.461 INFO:tasks.workunit.client.0.smithi017.stdout:8/939: dwrite d6/d5c/d96/d98/fe7 [0,4194304] 0 2024-03-16T10:53:29.462 INFO:tasks.workunit.client.0.smithi017.stdout:3/883: unlink d8/d1b/f8a 0 2024-03-16T10:53:29.462 INFO:tasks.workunit.client.0.smithi017.stdout:3/884: dread - d8/d1d/fe7 zero size 2024-03-16T10:53:29.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/885: stat d8/d1d/c24 0 2024-03-16T10:53:29.465 INFO:tasks.workunit.client.0.smithi017.stdout:8/940: truncate d6/d5f/d6e/d34/f79 780151 0 2024-03-16T10:53:29.467 INFO:tasks.workunit.client.0.smithi017.stdout:3/886: mkdir d8/d1b/d2e/d60/df7/d106 0 2024-03-16T10:53:29.467 INFO:tasks.workunit.client.0.smithi017.stdout:3/887: chown d8/d1d/dab/dc4/dd7/d62/d69/f96 147850 1 2024-03-16T10:53:29.470 INFO:tasks.workunit.client.0.smithi017.stdout:3/888: creat d8/d1b/d2e/d8d/f107 x:0 0 0 2024-03-16T10:53:29.471 INFO:tasks.workunit.client.0.smithi017.stdout:8/941: rmdir d6/d39/da9 39 2024-03-16T10:53:29.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/889: creat d8/d3f/f108 x:0 0 0 2024-03-16T10:53:29.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/890: stat d8/da/fe 0 2024-03-16T10:53:29.478 INFO:tasks.workunit.client.0.smithi017.stdout:8/942: dread d6/d39/f56 [0,4194304] 0 2024-03-16T10:53:29.481 INFO:tasks.workunit.client.0.smithi017.stdout:3/891: dread d8/d1d/dab/dc4/dd7/d62/d69/f78 [4194304,4194304] 0 2024-03-16T10:53:29.481 INFO:tasks.workunit.client.0.smithi017.stdout:3/892: write d8/d1d/db2/fda [258526,43473] 0 2024-03-16T10:53:29.483 INFO:tasks.workunit.client.0.smithi017.stdout:3/893: creat d8/d1b/d2e/d60/d63/dd9/f109 x:0 0 0 2024-03-16T10:53:29.483 INFO:tasks.workunit.client.0.smithi017.stdout:3/894: fdatasync d8/d1d/dab/dc4/dd7/d62/d69/f78 0 2024-03-16T10:53:29.484 INFO:tasks.workunit.client.0.smithi017.stdout:3/895: rmdir d8/d1b/d2e/d60/df7 39 2024-03-16T10:53:29.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/896: rename d8/d1b/d2e/d60/le2 to d8/d1b/d2e/d60/d63/l10a 0 2024-03-16T10:53:29.488 INFO:tasks.workunit.client.0.smithi017.stdout:3/897: creat d8/d1d/dab/f10b x:0 0 0 2024-03-16T10:53:29.490 INFO:tasks.workunit.client.0.smithi017.stdout:8/943: dwrite d6/d14/d6b/fe6 [0,4194304] 0 2024-03-16T10:53:29.498 INFO:tasks.workunit.client.0.smithi017.stdout:8/944: truncate d6/d14/d6b/f8e 1325208 0 2024-03-16T10:53:29.502 INFO:tasks.workunit.client.0.smithi017.stdout:3/898: dwrite d8/d1d/dab/dc4/dd7/d62/fec [4194304,4194304] 0 2024-03-16T10:53:29.502 INFO:tasks.workunit.client.0.smithi017.stdout:3/899: write d8/f52 [1667513,107351] 0 2024-03-16T10:53:29.505 INFO:tasks.workunit.client.0.smithi017.stdout:3/900: unlink d8/d1d/dab/dc4/dd7/f85 0 2024-03-16T10:53:29.505 INFO:tasks.workunit.client.0.smithi017.stdout:3/901: dread - d8/d1d/dab/dc4/dd7/daf/fb1 zero size 2024-03-16T10:53:29.509 INFO:tasks.workunit.client.0.smithi017.stdout:8/945: dwrite d6/d5f/d6e/f119 [0,4194304] 0 2024-03-16T10:53:29.521 INFO:tasks.workunit.client.0.smithi017.stdout:3/902: dwrite d8/d1b/d2e/fae [0,4194304] 0 2024-03-16T10:53:29.524 INFO:tasks.workunit.client.0.smithi017.stdout:3/903: creat d8/f10c x:0 0 0 2024-03-16T10:53:29.525 INFO:tasks.workunit.client.0.smithi017.stdout:3/904: rmdir d8/d1d 39 2024-03-16T10:53:29.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/905: unlink d8/d1b/d2e/d60/ff6 0 2024-03-16T10:53:29.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/906: truncate d8/d1b/d2e/d8d/f82 222831 0 2024-03-16T10:53:29.534 INFO:tasks.workunit.client.0.smithi017.stdout:3/907: rmdir d8/d1d/d9a 39 2024-03-16T10:53:29.534 INFO:tasks.workunit.client.0.smithi017.stdout:3/908: dread - d8/d3f/fef zero size 2024-03-16T10:53:29.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/909: symlink d8/d1b/d2e/d60/df7/l10d 0 2024-03-16T10:53:29.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/910: fsync d8/d1d/dab/dc4/dd7/f99 0 2024-03-16T10:53:29.536 INFO:tasks.workunit.client.0.smithi017.stdout:3/911: link d8/d1b/d65/f81 d8/d3f/f10e 0 2024-03-16T10:53:29.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/912: chown d8/da/lf1 76 1 2024-03-16T10:53:29.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/913: fdatasync d8/d1b/d2e/d57/f6a 0 2024-03-16T10:53:29.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/914: dwrite d8/ffd [0,4194304] 0 2024-03-16T10:53:29.553 INFO:tasks.workunit.client.0.smithi017.stdout:3/915: mkdir d8/d1b/d2e/d8d/d10f 0 2024-03-16T10:53:29.555 INFO:tasks.workunit.client.0.smithi017.stdout:3/916: creat d8/d1d/db2/f110 x:0 0 0 2024-03-16T10:53:29.555 INFO:tasks.workunit.client.0.smithi017.stdout:3/917: write d8/d1b/d2e/fba [751470,22072] 0 2024-03-16T10:53:29.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/918: mknod d8/d1d/dab/c111 0 2024-03-16T10:53:29.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/919: dwrite d8/d1b/d2e/d8d/fc3 [0,4194304] 0 2024-03-16T10:53:29.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/920: symlink d8/d1b/d2e/d60/d63/dd9/l112 0 2024-03-16T10:53:29.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/921: chown d8/d8c/fc9 87710 1 2024-03-16T10:53:29.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/922: dwrite d8/d1b/d65/da6/fc2 [0,4194304] 0 2024-03-16T10:53:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.586+0000 7f9f08a27640 1 -- 172.21.15.17:0/3342500770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f041033c0 msgr2=0x7f9f04109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.586+0000 7f9f08a27640 1 --2- 172.21.15.17:0/3342500770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f041033c0 0x7f9f04109c50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009ca0 tx=0x7f9efc02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 -- 172.21.15.17:0/3342500770 shutdown_connections 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 --2- 172.21.15.17:0/3342500770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f041033c0 0x7f9f04109c50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 --2- 172.21.15.17:0/3342500770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f04102a00 0x7f9f04102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 --2- 172.21.15.17:0/3342500770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04101810 0x7f9f04101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 -- 172.21.15.17:0/3342500770 >> 172.21.15.17:0/3342500770 conn(0x7f9f040fcda0 msgr2=0x7f9f040ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 -- 172.21.15.17:0/3342500770 shutdown_connections 2024-03-16T10:53:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.587+0000 7f9f08a27640 1 -- 172.21.15.17:0/3342500770 wait complete. 2024-03-16T10:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.588+0000 7f9f08a27640 1 Processor -- start 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.588+0000 7f9f08a27640 1 -- start start 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.588+0000 7f9f08a27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.588+0000 7f9f08a27640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 0x7f9f04197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.588+0000 7f9f08a27640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f041033c0 0x7f9f0419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f08a27640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d490 con 0x7f9f04101810 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f08a27640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d310 con 0x7f9f04102a00 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f08a27640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0410d610 con 0x7f9f041033c0 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56204/0 (socket says 172.21.15.17:56204) 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 -- 172.21.15.17:0/621567381 learned_addr learned my addr 172.21.15.17:0/621567381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 0x7f9f04197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f041033c0 0x7f9f0419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 -- 172.21.15.17:0/621567381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f041033c0 msgr2=0x7f9f0419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f041033c0 0x7f9f0419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 -- 172.21.15.17:0/621567381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 msgr2=0x7f9f04197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 0x7f9f04197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 -- 172.21.15.17:0/621567381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0419f630 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 0x7f9f04197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f0259c640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400e9c0 tx=0x7f9ef400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9ef37fe640 1 -- 172.21.15.17:0/621567381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef400cd80 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0419f920 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9ef37fe640 1 -- 172.21.15.17:0/621567381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef40035f0 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9ef37fe640 1 -- 172.21.15.17:0/621567381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4010690 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.589+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0419fec0 con 0x7f9f04101810 2024-03-16T10:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.592+0000 7f9ef37fe640 1 -- 172.21.15.17:0/621567381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f9ef40037a0 con 0x7f9f04101810 2024-03-16T10:53:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.593+0000 7f9ef37fe640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 0x7f9eec0a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.593+0000 7f9f0b60e740 1 Processor -- start 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.593+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 0x7f9eec0a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.593+0000 7f9ef37fe640 1 -- 172.21.15.17:0/621567381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9ef40ced70 con 0x7f9f04101810 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.593+0000 7f9f0b60e740 1 -- start start 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9340 0x55c9401a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c94010ea40 con 0x55c9401aeea0 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c9400b7920 con 0x55c9401a9d30 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c94010aae0 con 0x55c9401a9340 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 0x7f9eec0a4d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f04198f20 tx=0x7f9ef8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:60316/0 (socket says 172.21.15.17:60316) 2024-03-16T10:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f01d9b640 1 -- 172.21.15.17:0/2008070635 learned_addr learned my addr 172.21.15.17:0/2008070635 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f0259c640 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9340 0x55c9401a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 -- 172.21.15.17:0/2008070635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9340 msgr2=0x55c9401a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9340 0x55c9401a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 -- 172.21.15.17:0/2008070635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 msgr2=0x55c9401ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 -- 172.21.15.17:0/2008070635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9400cf460 con 0x55c9401aeea0 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.594+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b1330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9efc037040 tx=0x7f9efc0323d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e95d2af424a8db server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.595+0000 7f9ef0ff9640 1 -- 172.21.15.17:0/2008070635 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc043070 con 0x55c9401aeea0 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.595+0000 7f9ef0ff9640 1 -- 172.21.15.17:0/2008070635 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9efc02cca0 con 0x55c9401aeea0 2024-03-16T10:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.595+0000 7f9ef0ff9640 1 -- 172.21.15.17:0/2008070635 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc039040 con 0x55c9401aeea0 2024-03-16T10:53:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2008070635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 msgr2=0x55c9401b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b1330 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9efc037040 tx=0x7f9efc0323d0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2008070635 shutdown_connections 2024-03-16T10:53:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b1330 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9d30 0x55c9401ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2008070635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9340 0x55c9401a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2008070635 >> 172.21.15.17:0/2008070635 conn(0x55c9401a48b0 msgr2=0x55c9401a4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2008070635 shutdown_connections 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2008070635 wait complete. 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 -- start start 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.596+0000 7f9f0b60e740 1 Processor -- start 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9d30 0x55c9401b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401aeea0 0x55c9401bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9401b1df0 con 0x55c9401a9d30 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c9400cad70 con 0x55c9401a9340 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c9401b1f70 con 0x55c9401aeea0 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f01d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9d30 0x55c9401b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:60332/0 (socket says 172.21.15.17:60332) 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 -- 172.21.15.17:0/1895678311 learned_addr learned my addr 172.21.15.17:0/1895678311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401aeea0 0x55c9401bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 -- 172.21.15.17:0/1895678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401aeea0 msgr2=0x55c9401bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401aeea0 0x55c9401bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.597+0000 7f9f0259c640 1 -- 172.21.15.17:0/1895678311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9d30 msgr2=0x55c9401b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0259c640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9d30 0x55c9401b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0259c640 1 -- 172.21.15.17:0/1895678311 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c93fe23210 con 0x55c9401a9340 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0b60e740 10 client.0 _ll_register_callbacks cb 0x55c93fe22a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9efc02cca0 con 0x55c9401a9340 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0259c640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c6a0 tx=0x7f9ef409bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1dc60198ee38717 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9ee9ffb640 10 client.26141 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/1895678311 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40a3f50 con 0x55c9401a9340 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/1895678311 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9ef40860c0 con 0x55c9401a9340 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/1895678311 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ef40afb90 con 0x55c9401a9340 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0b60e740 10 client.26141 fetch_fsmap learned FSMap version 35 2024-03-16T10:53:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.598+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55c93feef620 con 0x55c9401a9340 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/1895678311 <== mon.2 v2:172.21.15.111:3300/0 4 ==== fsmap(e 35) ==== 8414+0+0 (secure 0 0 0) 0x7f9ef409ac00 con 0x55c9401a9340 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 10 client.26141 fetch_fsmap finished waiting for FSMap version 35 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 10 client.26141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 20 client.26141 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9401c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 4 client.26141 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c94011bf80 con 0x55c9401bf2a0 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.599+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9401c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9ee9ffb640 10 client.26141 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9401c1760 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9609ae2853dc77 server_cookie=7766b345116de3aa in_seq=0 out_seq=0 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/1895678311 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c94011bf80 con 0x55c9401bf2a0 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9ee9ffb640 10 client.26141 handle_command_reply: tid=0 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9f0b60e740 1 client.26141 shutdown 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 msgr2=0x55c9401b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.600+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c6a0 tx=0x7f9ef409bff0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 shutdown_connections 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9401c1760 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401aeea0 0x55c9401bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9ee9ffb640 0 client.26141 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9d30 0x55c9401b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1895678311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b3590 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 >> 172.21.15.17:0/1895678311 conn(0x55c9401a48b0 msgr2=0x55c9401a3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 shutdown_connections 2024-03-16T10:53:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1895678311 wait complete. 2024-03-16T10:53:29.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/923: dwrite d8/d1d/dab/dc4/dd7/daf/fb1 [0,4194304] 0 2024-03-16T10:53:29.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/924: fsync d8/f52 0 2024-03-16T10:53:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.601+0000 7f9f0b60e740 20 client.26141 trim_cache size 0 max 16384 2024-03-16T10:53:29.606 INFO:tasks.workunit.client.0.smithi017.stdout:3/925: mkdir d8/d1d/dab/dc4/dd7/d62/d69/d8b/d113 0 2024-03-16T10:53:29.606 INFO:tasks.workunit.client.0.smithi017.stdout:3/926: truncate d8/d1d/db2/f110 234602 0 2024-03-16T10:53:29.606 INFO:tasks.workunit.client.0.smithi017.stdout:3/927: rename d8/d1d/dab/dc4/dd7/d62/d69/d8b/ff3 to d8/d3f/d3d/f114 0 2024-03-16T10:53:29.612 INFO:tasks.workunit.client.0.smithi017.stdout:2/799: sync 2024-03-16T10:53:29.612 INFO:tasks.workunit.client.0.smithi017.stdout:6/931: sync 2024-03-16T10:53:29.612 INFO:tasks.workunit.client.0.smithi017.stdout:6/932: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9 0 1 2024-03-16T10:53:29.614 INFO:tasks.workunit.client.0.smithi017.stdout:2/800: creat d4/d6/db/d24/f102 x:0 0 0 2024-03-16T10:53:29.615 INFO:tasks.workunit.client.0.smithi017.stdout:2/801: read d4/d6/fa [8744062,28790] 0 2024-03-16T10:53:29.615 INFO:tasks.workunit.client.0.smithi017.stdout:2/802: stat d4/dd/d1e/f89 0 2024-03-16T10:53:29.615 INFO:tasks.workunit.client.0.smithi017.stdout:2/803: write d4/d6/d30/d3f/f85 [1369116,26037] 0 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.617+0000 7f9f0b60e740 1 Processor -- start 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 -- start start 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c94019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a8ab0 con 0x55c9401aeea0 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041aa7d0 con 0x55c9401a9340 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a9180 con 0x55c9401a9d30 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56230/0 (socket says 172.21.15.17:56230) 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 -- 172.21.15.17:0/1443225297 learned_addr learned my addr 172.21.15.17:0/1443225297 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 -- 172.21.15.17:0/1443225297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 msgr2=0x55c94019fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T10:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c94019fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 -- 172.21.15.17:0/1443225297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 msgr2=0x55c9401b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 -- 172.21.15.17:0/1443225297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9401ae2a0 con 0x55c9401aeea0 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.618+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009ca0 tx=0x7f9efc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dbd1ea35f8791f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.619+0000 7f9eebfff640 1 -- 172.21.15.17:0/1443225297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc04c070 con 0x55c9401aeea0 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.619+0000 7f9eebfff640 1 -- 172.21.15.17:0/1443225297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9efc02ce50 con 0x55c9401aeea0 2024-03-16T10:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.619+0000 7f9eebfff640 1 -- 172.21.15.17:0/1443225297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc039040 con 0x55c9401aeea0 2024-03-16T10:53:29.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/928: dwrite d8/d1b/d2e/d8d/fe9 [0,4194304] 0 2024-03-16T10:53:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1443225297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 msgr2=0x55c9401b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009ca0 tx=0x7f9efc004a40 comp rx=0 tx=0).stop 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1443225297 shutdown_connections 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401aeea0 0x55c9401b31a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c94019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/1443225297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401a9340 0x55c9401b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1443225297 >> 172.21.15.17:0/1443225297 conn(0x55c9401a48b0 msgr2=0x55c9401a4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1443225297 shutdown_connections 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- 172.21.15.17:0/1443225297 wait complete. 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 -- start start 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 Processor -- start 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c9401ba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.620+0000 7f9f0b60e740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041aa040 con 0x55c9401a9340 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a9910 con 0x55c9401aeea0 2024-03-16T10:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0b60e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041a6a20 con 0x55c9401a9d30 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0b60e740 10 client.0 _ll_register_callbacks cb 0x7f9ef4097390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f02d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56234/0 (socket says 172.21.15.17:56234) 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f02d9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:60348/0 (socket says 172.21.15.17:60348) 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 -- 172.21.15.17:0/2112381529 learned_addr learned my addr 172.21.15.17:0/2112381529 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c9401ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 -- 172.21.15.17:0/2112381529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 msgr2=0x55c9401ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c9401ba780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 -- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 msgr2=0x55c9401b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 -- 172.21.15.17:0/2112381529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9401b9100 con 0x55c9401a9340 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f02d9d640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9f0259c640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ef409b740 tx=0x7f9ef40cc7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c26160de04c4b0b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9ee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.621+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40a3f50 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9ef409cce0 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9efc02ce50 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ef409b110 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 10 client.16290 fetch_fsmap learned FSMap version 35 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c940226250 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9efc02ce50 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 35) ==== 8414+0+0 (secure 0 0 0) 0x7f9ef40a0820 con 0x55c9401a9340 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 10 client.16290 fetch_fsmap finished waiting for FSMap version 35 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 20 client.16290 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9402288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 4 client.16290 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9401162d0 con 0x55c9401bf2a0 2024-03-16T10:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.622+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9402288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.623+0000 7f9ee9ffb640 10 client.16290 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:29.623+0000 7f9f01d9b640 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9402288b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75cdd7fe6344675 server_cookie=48d6de2001c7e690 in_seq=0 out_seq=0 2024-03-16T10:53:29.628 INFO:tasks.workunit.client.0.smithi017.stdout:6/933: dwrite d0/d15/d1f/d7d/d87/f90 [0,4194304] 0 2024-03-16T10:53:29.630 INFO:tasks.workunit.client.0.smithi017.stdout:6/934: rmdir d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/dd8 39 2024-03-16T10:53:29.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/929: dwrite d8/d1b/d65/da6/fc1 [0,4194304] 0 2024-03-16T10:53:29.642 INFO:tasks.workunit.client.0.smithi017.stdout:6/935: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/f10a [0,4194304] 0 2024-03-16T10:53:29.642 INFO:tasks.workunit.client.0.smithi017.stdout:6/936: stat d0/d21/d39/d44/f4f 0 2024-03-16T10:53:29.644 INFO:tasks.workunit.client.0.smithi017.stdout:6/937: getdents d0/d21/d39/d44/d9a/da7/d45 0 2024-03-16T10:53:29.660 INFO:tasks.workunit.client.0.smithi017.stdout:6/938: dwrite d0/d21/d39/d44/ffc [0,4194304] 0 2024-03-16T10:53:29.672 INFO:tasks.workunit.client.0.smithi017.stdout:6/939: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/ff2 [0,4194304] 0 2024-03-16T10:53:29.672 INFO:tasks.workunit.client.0.smithi017.stdout:6/940: truncate d0/d21/d39/d44/d9a/da7/fe4 878188 0 2024-03-16T10:53:30.053 INFO:tasks.workunit.client.0.smithi017.stdout:6/941: creat d0/d21/d39/d44/d95/f129 x:0 0 0 2024-03-16T10:53:30.054 INFO:tasks.workunit.client.0.smithi017.stdout:6/942: stat d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/da6/cd9 0 2024-03-16T10:53:30.139 INFO:tasks.workunit.client.0.smithi017.stdout:6/943: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f4b [0,4194304] 0 2024-03-16T10:53:30.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/944: dread d0/d3e/f57 [0,4194304] 0 2024-03-16T10:53:30.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/945: fsync d0/d21/d39/d44/d9a/da7/f18 0 2024-03-16T10:53:30.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/946: link d0/d77/c11d d0/d21/d114/c12a 0 2024-03-16T10:53:30.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/947: chown d0/d21/d39/d44/d9a/da7 1618805 1 2024-03-16T10:53:30.173 INFO:tasks.workunit.client.0.smithi017.stdout:6/948: link d0/d21/d39/d44/d9a/da7/d45/d4d/lb2 d0/d21/d39/d44/d9a/l12b 0 2024-03-16T10:53:30.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/949: mknod d0/d21/d39/d44/d9a/da7/d38/d128/c12c 0 2024-03-16T10:53:30.179 INFO:tasks.workunit.client.0.smithi017.stdout:6/950: read d0/d21/d39/d44/d9a/da7/d38/f71 [1771956,57482] 0 2024-03-16T10:53:30.193 INFO:tasks.workunit.client.0.smithi017.stdout:6/951: dwrite d0/d15/fd1 [0,4194304] 0 2024-03-16T10:53:30.196 INFO:tasks.workunit.client.0.smithi017.stdout:6/952: symlink d0/d15/d1f/d7d/d120/l12d 0 2024-03-16T10:53:30.196 INFO:tasks.workunit.client.0.smithi017.stdout:6/953: fdatasync d0/d15/d1f/d7d/d87/fe7 0 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.195+0000 7f9ee9ffb640 1 -- 172.21.15.17:0/2112381529 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9401162d0 con 0x55c9401bf2a0 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.195+0000 7f9ee9ffb640 10 client.16290 handle_command_reply: tid=0 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.195+0000 7f9f0b60e740 1 client.16290 shutdown 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.195+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 msgr2=0x55c9401ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ef409b740 tx=0x7f9ef40cc7e0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 shutdown_connections 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c9401bf2a0 0x55c9402288b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9ee9ffb640 0 client.16290 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9401aeea0 0x55c9401b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9401a9d30 0x55c9401ba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 --2- 172.21.15.17:0/2112381529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9401a9340 0x55c9401ba240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 >> 172.21.15.17:0/2112381529 conn(0x55c9401a48b0 msgr2=0x55c94019fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 shutdown_connections 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 1 -- 172.21.15.17:0/2112381529 wait complete. 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.196+0000 7f9f0b60e740 20 client.16290 trim_cache size 0 max 16384 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:53:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:53:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:53:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 msgr2=0x7f9eec0a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 0x7f9eec0a4d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f04198f20 tx=0x7f9ef8005f90 comp rx=0 tx=0).stop 2024-03-16T10:53:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 msgr2=0x7f9f04197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400e9c0 tx=0x7f9ef400ee80 comp rx=0 tx=0).stop 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 shutdown_connections 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f9eec0a28a0 0x7f9eec0a4d60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f041033c0 0x7f9f0419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f04102a00 0x7f9f04197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 --2- 172.21.15.17:0/621567381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f04101810 0x7f9f04197a10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 >> 172.21.15.17:0/621567381 conn(0x7f9f040fcda0 msgr2=0x7f9f04105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 shutdown_connections 2024-03-16T10:53:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:30.197+0000 7f9f08a27640 1 -- 172.21.15.17:0/621567381 wait complete. 2024-03-16T10:53:30.203 INFO:tasks.workunit.client.0.smithi017.stdout:6/954: mkdir d0/d77/d12e 0 2024-03-16T10:53:30.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/955: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/f12f x:0 0 0 2024-03-16T10:53:30.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/956: dread - d0/d21/d39/d44/d95/f129 zero size 2024-03-16T10:53:30.206 INFO:tasks.workunit.client.0.smithi017.stdout:6/957: symlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/l130 0 2024-03-16T10:53:30.208 INFO:tasks.workunit.client.0.smithi017.stdout:6/958: unlink d0/d21/d39/d44/d9a/da7/l12 0 2024-03-16T10:53:30.219 INFO:tasks.workunit.client.0.smithi017.stdout:6/959: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f8a [0,4194304] 0 2024-03-16T10:53:30.221 INFO:tasks.workunit.client.0.smithi017.stdout:6/960: creat d0/d21/d39/d44/d95/dfa/d10f/f131 x:0 0 0 2024-03-16T10:53:30.222 INFO:tasks.workunit.client.0.smithi017.stdout:6/961: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/f132 x:0 0 0 2024-03-16T10:53:30.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/962: creat d0/d21/de9/f133 x:0 0 0 2024-03-16T10:53:30.224 INFO:tasks.workunit.client.0.smithi017.stdout:6/963: symlink d0/d21/d39/d44/l134 0 2024-03-16T10:53:30.224 INFO:tasks.workunit.client.0.smithi017.stdout:6/964: readlink d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/db9/l10d 0 2024-03-16T10:53:30.225 INFO:tasks.workunit.client.0.smithi017.stdout:6/965: creat d0/d21/d39/d44/d9a/da7/d38/d128/f135 x:0 0 0 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/946: sync 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/804: sync 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:3/930: sync 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:9/927: sync 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:9/928: write d8/dbf/d68/fea [5217135,16063] 0 2024-03-16T10:53:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/805: write d4/d6/d30/d3f/dba/dbd/fe3 [449298,3460] 0 2024-03-16T10:53:30.233 INFO:tasks.workunit.client.0.smithi017.stdout:3/931: getdents d8/d1b/d2e/d60/d63 0 2024-03-16T10:53:30.233 INFO:tasks.workunit.client.0.smithi017.stdout:6/966: read d0/d3e/f49 [2968460,42469] 0 2024-03-16T10:53:30.234 INFO:tasks.workunit.client.0.smithi017.stdout:9/929: link d8/df/d5b/c3f d8/df/d46/d63/d94/c132 0 2024-03-16T10:53:30.235 INFO:tasks.workunit.client.0.smithi017.stdout:2/806: unlink d4/d6/db/d24/d39/fa5 0 2024-03-16T10:53:30.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/930: link d8/dbf/cb9 d8/df/d46/c133 0 2024-03-16T10:53:30.242 INFO:tasks.workunit.client.0.smithi017.stdout:3/932: write d8/d1d/dab/fb6 [3387543,105770] 0 2024-03-16T10:53:30.243 INFO:tasks.workunit.client.0.smithi017.stdout:2/807: write d4/d6/db/d66/d93/f6a [5003556,8458] 0 2024-03-16T10:53:30.244 INFO:tasks.workunit.client.0.smithi017.stdout:2/808: write d4/d6/db/dfb/fbc [710110,117048] 0 2024-03-16T10:53:30.245 INFO:tasks.workunit.client.0.smithi017.stdout:2/809: truncate d4/d6/db/dfb/f45 3514575 0 2024-03-16T10:53:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:8/947: dwrite d6/d16/db3/dcb/fa7 [4194304,4194304] 0 2024-03-16T10:53:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:8/948: chown d6/d39/da9 0 1 2024-03-16T10:53:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:2/810: truncate d4/f25 2743099 0 2024-03-16T10:53:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:3/933: write d8/d8c/fe4 [2276218,65475] 0 2024-03-16T10:53:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:3/934: fdatasync d8/d3f/f108 0 2024-03-16T10:53:30.251 INFO:tasks.workunit.client.0.smithi017.stdout:2/811: symlink d4/d6/db/d66/d93/d63/l103 0 2024-03-16T10:53:30.251 INFO:tasks.workunit.client.0.smithi017.stdout:2/812: stat d4/d6/db/d66/d2e/l46 0 2024-03-16T10:53:30.252 INFO:tasks.workunit.client.0.smithi017.stdout:9/931: dwrite d8/f38 [0,4194304] 0 2024-03-16T10:53:30.252 INFO:tasks.workunit.client.0.smithi017.stdout:2/813: truncate d4/d6/db/d66/d2e/fa9 341623 0 2024-03-16T10:53:30.260 INFO:tasks.workunit.client.0.smithi017.stdout:3/935: mkdir d8/d1d/dab/dc4/dd7/d115 0 2024-03-16T10:53:30.261 INFO:tasks.workunit.client.0.smithi017.stdout:9/932: mknod d8/df/d5b/daf/db7/de6/d112/c134 0 2024-03-16T10:53:30.263 INFO:tasks.workunit.client.0.smithi017.stdout:8/949: mkdir d6/d5f/d6e/d12c 0 2024-03-16T10:53:30.265 INFO:tasks.workunit.client.0.smithi017.stdout:8/950: write d6/d16/d6c/dd4/d92/fa0 [174340,116414] 0 2024-03-16T10:53:30.265 INFO:tasks.workunit.client.0.smithi017.stdout:2/814: dwrite d4/dd/f4b [0,4194304] 0 2024-03-16T10:53:30.268 INFO:tasks.workunit.client.0.smithi017.stdout:9/933: mkdir d8/df/d5b/d70/d89/d135 0 2024-03-16T10:53:30.269 INFO:tasks.workunit.client.0.smithi017.stdout:2/815: rmdir d4/dd/d1e/d4a/df3/dc3 39 2024-03-16T10:53:30.270 INFO:tasks.workunit.client.0.smithi017.stdout:2/816: mknod d4/d6/db/d66/daf/c104 0 2024-03-16T10:53:30.270 INFO:tasks.workunit.client.0.smithi017.stdout:2/817: chown d4/d6/db/d66/d2e/f3c 253622 1 2024-03-16T10:53:30.270 INFO:tasks.workunit.client.0.smithi017.stdout:8/951: rename d6/d16/d6c/dd4/d92/fdd to d6/d16/d6c/f12d 0 2024-03-16T10:53:30.275 INFO:tasks.workunit.client.0.smithi017.stdout:2/818: rename d4/d6/db/d66/fb5 to d4/dd/d1e/da7/f105 0 2024-03-16T10:53:30.275 INFO:tasks.workunit.client.0.smithi017.stdout:2/819: write d4/d6/db/d24/d39/f76 [5177173,47485] 0 2024-03-16T10:53:30.276 INFO:tasks.workunit.client.0.smithi017.stdout:9/934: mkdir d8/dbf/d68/d98/deb/d124/d136 0 2024-03-16T10:53:30.279 INFO:tasks.workunit.client.0.smithi017.stdout:8/952: rename d6/d16/db3/dcb/f46 to d6/d16/dcd/f12e 0 2024-03-16T10:53:30.279 INFO:tasks.workunit.client.0.smithi017.stdout:8/953: chown d6/d5c/d96/fa2 6697374 1 2024-03-16T10:53:30.281 INFO:tasks.workunit.client.0.smithi017.stdout:3/936: link d8/da/db/l5c d8/d3f/dd3/l116 0 2024-03-16T10:53:30.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/935: unlink d8/df/d5b/d70/d89/f123 0 2024-03-16T10:53:30.284 INFO:tasks.workunit.client.0.smithi017.stdout:3/937: symlink d8/d1d/dab/dc4/l117 0 2024-03-16T10:53:30.286 INFO:tasks.workunit.client.0.smithi017.stdout:3/938: mkdir d8/d1b/d2e/d60/d63/dd9/d118 0 2024-03-16T10:53:30.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/954: dread d6/d5c/d96/d98/fe7 [0,4194304] 0 2024-03-16T10:53:30.289 INFO:tasks.workunit.client.0.smithi017.stdout:8/955: mkdir d6/d14/d12f 0 2024-03-16T10:53:30.290 INFO:tasks.workunit.client.0.smithi017.stdout:2/820: dwrite d4/d6/db/d66/d2e/fa9 [0,4194304] 0 2024-03-16T10:53:30.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/821: dwrite d4/d6/db/d66/d93/f4e [0,4194304] 0 2024-03-16T10:53:30.302 INFO:tasks.workunit.client.0.smithi017.stdout:2/822: read - d4/dd/d1e/ffa zero size 2024-03-16T10:53:30.305 INFO:tasks.workunit.client.0.smithi017.stdout:3/939: dwrite d8/d1d/f4b [0,4194304] 0 2024-03-16T10:53:30.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/823: symlink d4/d6/d81/d8f/l106 0 2024-03-16T10:53:30.306 INFO:tasks.workunit.client.0.smithi017.stdout:3/940: fsync d8/da/f93 0 2024-03-16T10:53:30.315 INFO:tasks.workunit.client.0.smithi017.stdout:2/824: dread d4/d6/db/d24/d39/f76 [0,4194304] 0 2024-03-16T10:53:30.315 INFO:tasks.workunit.client.0.smithi017.stdout:2/825: chown d4/d6/db/d66/d93 7208 1 2024-03-16T10:53:30.316 INFO:tasks.workunit.client.0.smithi017.stdout:2/826: mknod d4/d6/c107 0 2024-03-16T10:53:30.319 INFO:tasks.workunit.client.0.smithi017.stdout:2/827: rename d4/d6/db/d24/f5b to d4/dd/d1e/d4a/df3/f108 0 2024-03-16T10:53:30.320 INFO:tasks.workunit.client.0.smithi017.stdout:3/941: dwrite d8/d1d/dab/dc4/dd7/d62/fec [8388608,4194304] 0 2024-03-16T10:53:30.322 INFO:tasks.workunit.client.0.smithi017.stdout:2/828: mknod d4/dd/d1e/d4a/df3/c109 0 2024-03-16T10:53:30.322 INFO:tasks.workunit.client.0.smithi017.stdout:2/829: stat d4/dd/df/dd9/la4 0 2024-03-16T10:53:30.323 INFO:tasks.workunit.client.0.smithi017.stdout:2/830: creat d4/dca/deb/f10a x:0 0 0 2024-03-16T10:53:30.324 INFO:tasks.workunit.client.0.smithi017.stdout:2/831: creat d4/d6/db/d66/d93/d63/f10b x:0 0 0 2024-03-16T10:53:30.326 INFO:tasks.workunit.client.0.smithi017.stdout:2/832: link d4/dd/df/f19 d4/d97/d9f/f10c 0 2024-03-16T10:53:30.326 INFO:tasks.workunit.client.0.smithi017.stdout:3/942: dread d8/da/fa9 [0,4194304] 0 2024-03-16T10:53:30.327 INFO:tasks.workunit.client.0.smithi017.stdout:2/833: creat d4/d6/db/d66/d2e/f10d x:0 0 0 2024-03-16T10:53:30.327 INFO:tasks.workunit.client.0.smithi017.stdout:2/834: readlink d4/d6/l6f 0 2024-03-16T10:53:30.327 INFO:tasks.workunit.client.0.smithi017.stdout:2/835: write d4/d6/db/fef [3842166,18085] 0 2024-03-16T10:53:30.327 INFO:tasks.workunit.client.0.smithi017.stdout:3/943: creat d8/d3f/d3d/f119 x:0 0 0 2024-03-16T10:53:30.328 INFO:tasks.workunit.client.0.smithi017.stdout:2/836: mkdir d4/d6/db/d66/d2e/d78/df5/d10e 0 2024-03-16T10:53:30.329 INFO:tasks.workunit.client.0.smithi017.stdout:3/944: mkdir d8/d3f/d11a 0 2024-03-16T10:53:30.329 INFO:tasks.workunit.client.0.smithi017.stdout:3/945: write d8/d1d/fdb [2141967,30253] 0 2024-03-16T10:53:30.330 INFO:tasks.workunit.client.0.smithi017.stdout:2/837: dread d4/dd/d1e/da7/f105 [0,4194304] 0 2024-03-16T10:53:30.330 INFO:tasks.workunit.client.0.smithi017.stdout:3/946: creat d8/d1d/f11b x:0 0 0 2024-03-16T10:53:30.331 INFO:tasks.workunit.client.0.smithi017.stdout:2/838: creat d4/dd/f10f x:0 0 0 2024-03-16T10:53:30.332 INFO:tasks.workunit.client.0.smithi017.stdout:3/947: creat d8/d1b/d2e/d60/d63/f11c x:0 0 0 2024-03-16T10:53:30.332 INFO:tasks.workunit.client.0.smithi017.stdout:2/839: rmdir d4/d6/db/d66/d93/d63/dee 0 2024-03-16T10:53:30.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/840: creat d4/d6/db/d66/d93/f110 x:0 0 0 2024-03-16T10:53:30.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/841: write d4/dd/f67 [8997,72717] 0 2024-03-16T10:53:30.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/842: read - d4/dd/f10f zero size 2024-03-16T10:53:30.335 INFO:tasks.workunit.client.0.smithi017.stdout:2/843: rmdir d4/d97/d9f 39 2024-03-16T10:53:30.338 INFO:tasks.workunit.client.0.smithi017.stdout:3/948: dread d8/ffd [0,4194304] 0 2024-03-16T10:53:30.339 INFO:tasks.workunit.client.0.smithi017.stdout:3/949: mknod d8/d1d/d9a/c11d 0 2024-03-16T10:53:30.341 INFO:tasks.workunit.client.0.smithi017.stdout:3/950: mknod d8/d1b/d2e/d57/c11e 0 2024-03-16T10:53:30.347 INFO:tasks.workunit.client.0.smithi017.stdout:3/951: dread d8/da/f93 [0,4194304] 0 2024-03-16T10:53:30.347 INFO:tasks.workunit.client.0.smithi017.stdout:3/952: chown d8/d1b/d2e/d60/d63/la1 1028 1 2024-03-16T10:53:30.347 INFO:tasks.workunit.client.0.smithi017.stdout:3/953: write d8/d1b/d2e/fdd [614062,45212] 0 2024-03-16T10:53:30.347 INFO:tasks.workunit.client.0.smithi017.stdout:3/954: readlink d8/d1b/d65/l9e 0 2024-03-16T10:53:30.348 INFO:tasks.workunit.client.0.smithi017.stdout:3/955: dread d8/d1d/db2/fda [0,4194304] 0 2024-03-16T10:53:30.348 INFO:tasks.workunit.client.0.smithi017.stdout:3/956: stat d8/fc 0 2024-03-16T10:53:30.350 INFO:tasks.workunit.client.0.smithi017.stdout:3/957: rename d8/da/db/ld5 to d8/d1b/d2e/d8d/d10f/l11f 0 2024-03-16T10:53:30.352 INFO:tasks.workunit.client.0.smithi017.stdout:3/958: creat d8/d1d/dab/dc4/dd7/d115/f120 x:0 0 0 2024-03-16T10:53:30.353 INFO:tasks.workunit.client.0.smithi017.stdout:2/844: write d4/d6/d30/fb2 [1033580,94574] 0 2024-03-16T10:53:30.359 INFO:tasks.workunit.client.0.smithi017.stdout:3/959: write d8/d1d/dab/dc4/dd7/f2f [2328465,71325] 0 2024-03-16T10:53:30.359 INFO:tasks.workunit.client.0.smithi017.stdout:3/960: chown d8/d1d/dab/dc4/dd7/d62/cfb 2108 1 2024-03-16T10:53:30.361 INFO:tasks.workunit.client.0.smithi017.stdout:3/961: rmdir d8/d3f 39 2024-03-16T10:53:30.363 INFO:tasks.workunit.client.0.smithi017.stdout:3/962: dread d8/d1d/dab/dc4/dd7/d62/fbe [0,4194304] 0 2024-03-16T10:53:30.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/963: chown d8/da/l2b 253627 1 2024-03-16T10:53:30.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/964: truncate d8/d8c/f95 554206 0 2024-03-16T10:53:30.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/965: fdatasync d8/da/f93 0 2024-03-16T10:53:30.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/966: chown d8 1 1 2024-03-16T10:53:30.365 INFO:tasks.workunit.client.0.smithi017.stdout:3/967: fdatasync d8/d1d/dab/dc4/dd7/d62/fec 0 2024-03-16T10:53:30.365 INFO:tasks.workunit.client.0.smithi017.stdout:2/845: dwrite d4/dd/d1e/d4a/df3/dc3/f83 [0,4194304] 0 2024-03-16T10:53:30.365 INFO:tasks.workunit.client.0.smithi017.stdout:3/968: mknod d8/d1b/d2e/d60/df7/d106/c121 0 2024-03-16T10:53:30.367 INFO:tasks.workunit.client.0.smithi017.stdout:2/846: creat d4/dd/d1e/f111 x:0 0 0 2024-03-16T10:53:30.367 INFO:tasks.workunit.client.0.smithi017.stdout:3/969: rmdir d8/da/db 39 2024-03-16T10:53:30.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/970: symlink d8/d1b/d2e/d60/d63/dd9/d118/l122 0 2024-03-16T10:53:30.369 INFO:tasks.workunit.client.0.smithi017.stdout:3/971: mknod d8/d1b/d2e/d8d/d87/c123 0 2024-03-16T10:53:30.373 INFO:tasks.workunit.client.0.smithi017.stdout:2/847: dread d4/d6/db/d66/d2e/fa9 [0,4194304] 0 2024-03-16T10:53:30.373 INFO:tasks.workunit.client.0.smithi017.stdout:2/848: truncate d4/d97/ff8 42166 0 2024-03-16T10:53:30.374 INFO:tasks.workunit.client.0.smithi017.stdout:2/849: readlink d4/d6/db/d66/ld4 0 2024-03-16T10:53:30.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/850: mknod d4/d6/db/d66/d2e/dda/c112 0 2024-03-16T10:53:30.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/851: readlink d4/ld8 0 2024-03-16T10:53:30.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/852: chown d4/d6/db/d24/d39/cc5 90642 1 2024-03-16T10:53:30.377 INFO:tasks.workunit.client.0.smithi017.stdout:2/853: creat d4/d6/db/d66/d2e/d78/df5/f113 x:0 0 0 2024-03-16T10:53:30.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/972: dwrite d8/d1b/fde [0,4194304] 0 2024-03-16T10:53:30.382 INFO:tasks.workunit.client.0.smithi017.stdout:2/854: read d4/d6/db/d24/d39/f42 [287793,50508] 0 2024-03-16T10:53:30.383 INFO:tasks.workunit.client.0.smithi017.stdout:2/855: mkdir d4/d6/db/d66/d93/d63/db0/d114 0 2024-03-16T10:53:30.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/856: rename d4 to d4/d6/d30/d3f/dba/d115 22 2024-03-16T10:53:30.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/857: read d4/d97/ff8 [29859,59908] 0 2024-03-16T10:53:30.384 INFO:tasks.workunit.client.0.smithi017.stdout:3/973: creat d8/da/da7/f124 x:0 0 0 2024-03-16T10:53:30.386 INFO:tasks.workunit.client.0.smithi017.stdout:3/974: creat d8/d1b/d2e/d60/d63/f125 x:0 0 0 2024-03-16T10:53:30.389 INFO:tasks.workunit.client.0.smithi017.stdout:3/975: symlink d8/d1b/d2e/d60/d63/dd9/d118/l126 0 2024-03-16T10:53:30.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/976: write d8/d3f/dd3/fe6 [924359,44865] 0 2024-03-16T10:53:30.392 INFO:tasks.workunit.client.0.smithi017.stdout:3/977: mknod d8/d3f/dd3/c127 0 2024-03-16T10:53:30.393 INFO:tasks.workunit.client.0.smithi017.stdout:3/978: rmdir d8/d3f 39 2024-03-16T10:53:30.408 INFO:tasks.workunit.client.0.smithi017.stdout:2/858: rename d4/f2c to d4/dd/df/dd9/f116 0 2024-03-16T10:53:30.408 INFO:tasks.workunit.client.0.smithi017.stdout:2/859: fdatasync d4/d6/d30/f7c 0 2024-03-16T10:53:30.410 INFO:tasks.workunit.client.0.smithi017.stdout:2/860: dread d4/dd/d1e/d4a/df3/fac [0,4194304] 0 2024-03-16T10:53:30.410 INFO:tasks.workunit.client.0.smithi017.stdout:3/979: dwrite d8/d1d/dab/dc4/dd7/f2f [0,4194304] 0 2024-03-16T10:53:30.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/980: truncate d8/d1d/dab/dc4/dd7/f54 3321191 0 2024-03-16T10:53:30.412 INFO:tasks.workunit.client.0.smithi017.stdout:2/861: creat d4/dd/df/dd9/f117 x:0 0 0 2024-03-16T10:53:30.412 INFO:tasks.workunit.client.0.smithi017.stdout:3/981: fsync d8/d3f/fef 0 2024-03-16T10:53:30.413 INFO:tasks.workunit.client.0.smithi017.stdout:2/862: creat d4/d6/db/d66/d2e/d78/df5/f118 x:0 0 0 2024-03-16T10:53:30.423 INFO:tasks.workunit.client.0.smithi017.stdout:3/982: read d8/da/f66 [274670,8900] 0 2024-03-16T10:53:30.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/983: rmdir d8/da/da7 39 2024-03-16T10:53:30.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/984: write d8/da/db/f23 [4618652,68835] 0 2024-03-16T10:53:30.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/985: chown d8/d1d/f4b 10154 1 2024-03-16T10:53:30.432 INFO:tasks.workunit.client.0.smithi017.stdout:3/986: dread d8/d1d/dab/dc4/dd7/d62/fec [4194304,4194304] 0 2024-03-16T10:53:30.433 INFO:tasks.workunit.client.0.smithi017.stdout:3/987: write d8/d3f/dd3/fed [6061,78237] 0 2024-03-16T10:53:30.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/988: creat d8/d1d/d9a/f128 x:0 0 0 2024-03-16T10:53:30.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/989: readlink d8/d1b/d2e/d57/lc0 0 2024-03-16T10:53:30.436 INFO:tasks.workunit.client.0.smithi017.stdout:3/990: mkdir d8/da/db/d129 0 2024-03-16T10:53:30.448 INFO:tasks.workunit.client.0.smithi017.stdout:3/991: dwrite d8/fdf [8388608,4194304] 0 2024-03-16T10:53:30.456 INFO:tasks.workunit.client.0.smithi017.stdout:3/992: dwrite d8/d1d/dab/dc4/dd7/f99 [0,4194304] 0 2024-03-16T10:53:30.459 INFO:tasks.workunit.client.0.smithi017.stdout:3/993: fsync d8/d1d/d9a/f128 0 2024-03-16T10:53:30.472 INFO:tasks.workunit.client.0.smithi017.stdout:3/994: dwrite d8/d1d/dab/dc4/dd7/d62/d69/f83 [4194304,4194304] 0 2024-03-16T10:53:30.475 INFO:tasks.workunit.client.0.smithi017.stdout:3/995: unlink d8/d1b/d2e/fdd 0 2024-03-16T10:53:30.491 INFO:tasks.workunit.client.0.smithi017.stdout:3/996: rename d8/d1b to d8/d8c/d12a 0 2024-03-16T10:53:30.492 INFO:tasks.workunit.client.0.smithi017.stdout:3/997: mknod d8/d1d/dab/dc4/dd7/d115/c12b 0 2024-03-16T10:53:30.493 INFO:tasks.workunit.client.0.smithi017.stdout:3/998: rmdir d8/da/da7 39 2024-03-16T10:53:30.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/999: creat d8/f12c x:0 0 0 2024-03-16T10:53:30.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:30 smithi174 ceph-mon[36202]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 151 MiB/s wr, 1.48k op/s 2024-03-16T10:53:30.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:30 smithi017 ceph-mon[32078]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 151 MiB/s wr, 1.48k op/s 2024-03-16T10:53:30.638 INFO:tasks.workunit.client.0.smithi017.stdout:6/967: sync 2024-03-16T10:53:30.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/936: sync 2024-03-16T10:53:30.638 INFO:tasks.workunit.client.0.smithi017.stdout:6/968: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fe3 344747 0 2024-03-16T10:53:30.639 INFO:tasks.workunit.client.0.smithi017.stdout:6/969: creat d0/d21/f136 x:0 0 0 2024-03-16T10:53:30.648 INFO:tasks.workunit.client.0.smithi017.stdout:9/937: dread d8/dbf/d68/f11d [0,4194304] 0 2024-03-16T10:53:30.649 INFO:tasks.workunit.client.0.smithi017.stdout:9/938: mkdir d8/df/d46/d63/d94/d9d/dce/d137 0 2024-03-16T10:53:30.650 INFO:tasks.workunit.client.0.smithi017.stdout:9/939: symlink d8/df/d46/d63/d94/dad/l138 0 2024-03-16T10:53:30.653 INFO:tasks.workunit.client.0.smithi017.stdout:9/940: dread d8/f4d [0,4194304] 0 2024-03-16T10:53:30.661 INFO:tasks.workunit.client.0.smithi017.stdout:6/970: dwrite d0/d21/d39/d44/d9a/da7/d96/f11b [0,4194304] 0 2024-03-16T10:53:30.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:30 smithi111 ceph-mon[36315]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 151 MiB/s wr, 1.48k op/s 2024-03-16T10:53:30.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/971: creat d0/d21/d39/d44/d9a/f137 x:0 0 0 2024-03-16T10:53:30.663 INFO:tasks.workunit.client.0.smithi017.stdout:9/941: dread d8/df/d46/d63/d102/fe7 [0,4194304] 0 2024-03-16T10:53:30.664 INFO:tasks.workunit.client.0.smithi017.stdout:9/942: chown d8/df/d46/le0 387105 1 2024-03-16T10:53:30.665 INFO:tasks.workunit.client.0.smithi017.stdout:6/972: truncate d0/d15/d1f/f60 1284739 0 2024-03-16T10:53:30.669 INFO:tasks.workunit.client.0.smithi017.stdout:6/973: dread d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/f10e [0,4194304] 0 2024-03-16T10:53:30.672 INFO:tasks.workunit.client.0.smithi017.stdout:6/974: rename d0/d21/d39/d44/d9a/da7/d45/d4d/l94 to d0/d21/d39/d44/d95/dfa/d10f/l138 0 2024-03-16T10:53:30.674 INFO:tasks.workunit.client.0.smithi017.stdout:6/975: creat d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/f139 x:0 0 0 2024-03-16T10:53:30.677 INFO:tasks.workunit.client.0.smithi017.stdout:6/976: mknod d0/d15/c13a 0 2024-03-16T10:53:30.678 INFO:tasks.workunit.client.0.smithi017.stdout:9/943: dwrite d8/df/d5b/d32/ff2 [0,4194304] 0 2024-03-16T10:53:30.679 INFO:tasks.workunit.client.0.smithi017.stdout:6/977: creat d0/f13b x:0 0 0 2024-03-16T10:53:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/978: mknod d0/d15/d1f/d7d/d120/c13c 0 2024-03-16T10:53:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/944: dread d8/df/d5b/d32/d45/f77 [0,4194304] 0 2024-03-16T10:53:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/945: creat d8/df/d5b/d32/d45/d8b/f139 x:0 0 0 2024-03-16T10:53:30.686 INFO:tasks.workunit.client.0.smithi017.stdout:9/946: link d8/df/d46/d63/d94/d9d/lbb d8/df/d46/d63/d88/l13a 0 2024-03-16T10:53:30.687 INFO:tasks.workunit.client.0.smithi017.stdout:9/947: symlink d8/df/d46/d63/d94/l13b 0 2024-03-16T10:53:30.688 INFO:tasks.workunit.client.0.smithi017.stdout:9/948: symlink d8/dbf/d68/l13c 0 2024-03-16T10:53:30.690 INFO:tasks.workunit.client.0.smithi017.stdout:9/949: dread d8/df/d46/d63/d102/fe7 [4194304,4194304] 0 2024-03-16T10:53:30.691 INFO:tasks.workunit.client.0.smithi017.stdout:9/950: rename d8/dbf/d68/d98/cb0 to d8/c13d 0 2024-03-16T10:53:30.763 INFO:tasks.workunit.client.0.smithi017.stdout:8/956: sync 2024-03-16T10:53:30.763 INFO:tasks.workunit.client.0.smithi017.stdout:2/863: sync 2024-03-16T10:53:30.763 INFO:tasks.workunit.client.0.smithi017.stdout:8/957: write d6/d39/fe0 [938956,31195] 0 2024-03-16T10:53:30.771 INFO:tasks.workunit.client.0.smithi017.stdout:2/864: read d4/d6/db/d66/d2e/f3c [40780,81845] 0 2024-03-16T10:53:30.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/865: creat d4/d6/d30/d3f/dba/dbd/f119 x:0 0 0 2024-03-16T10:53:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:2/866: mkdir d4/d6/db/d66/d93/d63/d11a 0 2024-03-16T10:53:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:2/867: readlink d4/dd/d1e/l47 0 2024-03-16T10:53:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:8/958: dwrite d6/d5f/d6e/d34/db4/ff3 [0,4194304] 0 2024-03-16T10:53:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:8/959: fsync d6/d14/d6b/f8e 0 2024-03-16T10:53:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:8/960: read - d6/d5f/da4/dd8/ffb zero size 2024-03-16T10:53:30.794 INFO:tasks.workunit.client.0.smithi017.stdout:2/868: dwrite d4/dd/df/f1b [0,4194304] 0 2024-03-16T10:53:30.794 INFO:tasks.workunit.client.0.smithi017.stdout:8/961: dwrite d6/f68 [4194304,4194304] 0 2024-03-16T10:53:30.795 INFO:tasks.workunit.client.0.smithi017.stdout:2/869: write d4/d6/d81/ff6 [667305,117254] 0 2024-03-16T10:53:30.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/870: creat d4/d6/db/d66/d93/f11b x:0 0 0 2024-03-16T10:53:30.798 INFO:tasks.workunit.client.0.smithi017.stdout:8/962: rename d6/d16/d6c/dd4/d92/l93 to d6/d5c/l130 0 2024-03-16T10:53:30.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/871: creat d4/d6/db/d66/d2e/d78/df5/f11c x:0 0 0 2024-03-16T10:53:30.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/872: fdatasync d4/d6/f16 0 2024-03-16T10:53:30.801 INFO:tasks.workunit.client.0.smithi017.stdout:8/963: unlink d6/d5f/d6e/lf 0 2024-03-16T10:53:30.801 INFO:tasks.workunit.client.0.smithi017.stdout:2/873: dread d4/dd/f18 [4194304,4194304] 0 2024-03-16T10:53:30.801 INFO:tasks.workunit.client.0.smithi017.stdout:2/874: truncate d4/d6/db/d66/f5d 4161980 0 2024-03-16T10:53:30.803 INFO:tasks.workunit.client.0.smithi017.stdout:9/951: sync 2024-03-16T10:53:30.803 INFO:tasks.workunit.client.0.smithi017.stdout:6/979: sync 2024-03-16T10:53:30.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/875: symlink d4/dca/l11d 0 2024-03-16T10:53:30.804 INFO:tasks.workunit.client.0.smithi017.stdout:9/952: truncate d8/df/d46/d63/d94/d9d/fac 3940338 0 2024-03-16T10:53:30.804 INFO:tasks.workunit.client.0.smithi017.stdout:2/876: creat d4/d6/db/d66/d93/d100/f11e x:0 0 0 2024-03-16T10:53:30.805 INFO:tasks.workunit.client.0.smithi017.stdout:9/953: mknod d8/d95/c13e 0 2024-03-16T10:53:30.807 INFO:tasks.workunit.client.0.smithi017.stdout:9/954: creat d8/d95/f13f x:0 0 0 2024-03-16T10:53:30.809 INFO:tasks.workunit.client.0.smithi017.stdout:9/955: read d8/df/d5b/f8c [223010,3066] 0 2024-03-16T10:53:30.809 INFO:tasks.workunit.client.0.smithi017.stdout:9/956: chown d8/dbf/d91/f106 57139813 1 2024-03-16T10:53:30.809 INFO:tasks.workunit.client.0.smithi017.stdout:9/957: chown d8/df/l4e 71626 1 2024-03-16T10:53:30.809 INFO:tasks.workunit.client.0.smithi017.stdout:2/877: mkdir d4/dd/df/d11f 0 2024-03-16T10:53:30.812 INFO:tasks.workunit.client.0.smithi017.stdout:2/878: mknod d4/dca/deb/c120 0 2024-03-16T10:53:30.812 INFO:tasks.workunit.client.0.smithi017.stdout:2/879: stat d4/f25 0 2024-03-16T10:53:30.812 INFO:tasks.workunit.client.0.smithi017.stdout:2/880: chown d4/d6/db/d66/ld4 61187309 1 2024-03-16T10:53:30.814 INFO:tasks.workunit.client.0.smithi017.stdout:2/881: mknod d4/d6/db/d24/db6/c121 0 2024-03-16T10:53:30.815 INFO:tasks.workunit.client.0.smithi017.stdout:2/882: rename d4/d6/fa to d4/d6/d30/f122 0 2024-03-16T10:53:30.818 INFO:tasks.workunit.client.0.smithi017.stdout:2/883: symlink d4/d6/db/d66/d2e/dda/l123 0 2024-03-16T10:53:30.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/884: unlink d4/dd/df/l35 0 2024-03-16T10:53:30.821 INFO:tasks.workunit.client.0.smithi017.stdout:2/885: symlink d4/d6/d81/l124 0 2024-03-16T10:53:30.821 INFO:tasks.workunit.client.0.smithi017.stdout:2/886: fsync d4/d6/f21 0 2024-03-16T10:53:30.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/887: mknod d4/d6/db/d24/c125 0 2024-03-16T10:53:30.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/888: chown d4/dd/d1e/d4a/l61 41 1 2024-03-16T10:53:30.825 INFO:tasks.workunit.client.0.smithi017.stdout:2/889: symlink d4/dd/d1e/d4a/df3/l126 0 2024-03-16T10:53:30.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/980: dwrite d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/fe3 [0,4194304] 0 2024-03-16T10:53:30.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/981: fdatasync d0/d15/d1f/d7d/f7f 0 2024-03-16T10:53:30.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/982: readlink d0/d21/d39/d44/l126 0 2024-03-16T10:53:30.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/983: write d0/f13b [75250,94459] 0 2024-03-16T10:53:30.833 INFO:tasks.workunit.client.0.smithi017.stdout:8/964: dwrite d6/d5f/da4/dd8/ffb [0,4194304] 0 2024-03-16T10:53:30.834 INFO:tasks.workunit.client.0.smithi017.stdout:6/984: getdents d0/d21/d39/d44/d9a/da7/d38 0 2024-03-16T10:53:30.838 INFO:tasks.workunit.client.0.smithi017.stdout:8/965: getdents d6/d16/d6c 0 2024-03-16T10:53:30.838 INFO:tasks.workunit.client.0.smithi017.stdout:8/966: stat d6/d16/d6c/dd4/f53 0 2024-03-16T10:53:30.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/967: unlink d6/d5f/d6e/d34/f52 0 2024-03-16T10:53:30.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/968: write d6/d16/d6c/f12d [1449274,118333] 0 2024-03-16T10:53:30.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/969: chown d6/d5f/d6e 228204959 1 2024-03-16T10:53:30.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/970: getdents d6/d5f/d6e/d34/db4/d110 0 2024-03-16T10:53:30.849 INFO:tasks.workunit.client.0.smithi017.stdout:8/971: dwrite d6/d5f/d6e/f89 [0,4194304] 0 2024-03-16T10:53:30.852 INFO:tasks.workunit.client.0.smithi017.stdout:8/972: mknod d6/d16/d6c/dd4/d10a/c131 0 2024-03-16T10:53:30.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/973: dread d6/d5f/d6e/f17 [0,4194304] 0 2024-03-16T10:53:30.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/974: readlink d6/d5c/lcf 0 2024-03-16T10:53:30.872 INFO:tasks.workunit.client.0.smithi017.stdout:8/975: dwrite d6/d5f/d6e/d34/f79 [0,4194304] 0 2024-03-16T10:53:30.872 INFO:tasks.workunit.client.0.smithi017.stdout:8/976: fsync d6/d16/db3/dcb/fa7 0 2024-03-16T10:53:30.875 INFO:tasks.workunit.client.0.smithi017.stdout:8/977: mkdir d6/d5f/da4/d132 0 2024-03-16T10:53:30.876 INFO:tasks.workunit.client.0.smithi017.stdout:8/978: mknod d6/d16/db3/dcb/d12a/c133 0 2024-03-16T10:53:30.878 INFO:tasks.workunit.client.0.smithi017.stdout:8/979: dread d6/d16/fc7 [0,4194304] 0 2024-03-16T10:53:30.880 INFO:tasks.workunit.client.0.smithi017.stdout:8/980: unlink d6/d39/fc3 0 2024-03-16T10:53:30.881 INFO:tasks.workunit.client.0.smithi017.stdout:8/981: stat d6/d5f/d6e/lb8 0 2024-03-16T10:53:30.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/982: symlink d6/d4a/l134 0 2024-03-16T10:53:30.884 INFO:tasks.workunit.client.0.smithi017.stdout:8/983: mknod d6/d5c/d10d/d117/c135 0 2024-03-16T10:53:30.884 INFO:tasks.workunit.client.0.smithi017.stdout:8/984: read d6/d5c/f71 [266030,7277] 0 2024-03-16T10:53:30.884 INFO:tasks.workunit.client.0.smithi017.stdout:8/985: fdatasync d6/d5f/da4/ffc 0 2024-03-16T10:53:30.884 INFO:tasks.workunit.client.0.smithi017.stdout:8/986: stat d6/d5c/d10d/d117 0 2024-03-16T10:53:30.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/987: mknod d6/d5f/d6e/d34/db4/c136 0 2024-03-16T10:53:30.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/988: readlink d6/d16/d6c/l7c 0 2024-03-16T10:53:30.887 INFO:tasks.workunit.client.0.smithi017.stdout:8/989: mknod d6/d39/c137 0 2024-03-16T10:53:30.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/990: creat d6/d5c/d10d/d117/f138 x:0 0 0 2024-03-16T10:53:30.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/991: rmdir d6/d16/d6c/dd4/d92 39 2024-03-16T10:53:30.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/992: dwrite d6/d39/f101 [0,4194304] 0 2024-03-16T10:53:30.989 INFO:tasks.workunit.client.0.smithi017.stdout:9/958: sync 2024-03-16T10:53:30.991 INFO:tasks.workunit.client.0.smithi017.stdout:9/959: mkdir d8/df/d5b/daf/db7/de6/d112/d140 0 2024-03-16T10:53:30.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/960: creat d8/dbf/d68/d98/f141 x:0 0 0 2024-03-16T10:53:30.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/961: chown d8/l27 10288 1 2024-03-16T10:53:30.993 INFO:tasks.workunit.client.0.smithi017.stdout:9/962: creat d8/df/d46/d63/d94/dad/f142 x:0 0 0 2024-03-16T10:53:30.994 INFO:tasks.workunit.client.0.smithi017.stdout:9/963: chown d8/df/d46/ca3 34 1 2024-03-16T10:53:30.994 INFO:tasks.workunit.client.0.smithi017.stdout:9/964: stat d8/df/d46/d63/d94/d9d/cba 0 2024-03-16T10:53:30.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/965: dread d8/df/d66/dd1/f10b [0,4194304] 0 2024-03-16T10:53:30.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/966: read d8/df/d5b/d32/f50 [6972800,71148] 0 2024-03-16T10:53:30.997 INFO:tasks.workunit.client.0.smithi017.stdout:9/967: creat d8/dbf/d68/d98/deb/d124/d136/f143 x:0 0 0 2024-03-16T10:53:30.997 INFO:tasks.workunit.client.0.smithi017.stdout:9/968: dread - d8/dbf/d68/d98/f141 zero size 2024-03-16T10:53:30.997 INFO:tasks.workunit.client.0.smithi017.stdout:9/969: stat d8/df/d46/d63/d102/c10a 0 2024-03-16T10:53:30.999 INFO:tasks.workunit.client.0.smithi017.stdout:9/970: creat d8/dbf/d68/d98/deb/d124/d136/f144 x:0 0 0 2024-03-16T10:53:31.004 INFO:tasks.workunit.client.0.smithi017.stdout:9/971: read d8/dbf/d91/f99 [2187765,99205] 0 2024-03-16T10:53:31.006 INFO:tasks.workunit.client.0.smithi017.stdout:9/972: creat d8/dbf/d68/d7f/f145 x:0 0 0 2024-03-16T10:53:31.006 INFO:tasks.workunit.client.0.smithi017.stdout:9/973: readlink d8/df/d5b/d70/d89/lc7 0 2024-03-16T10:53:31.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/974: dwrite d8/df/d5b/f104 [0,4194304] 0 2024-03-16T10:53:31.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/975: write d8/df/f11 [4055390,91173] 0 2024-03-16T10:53:31.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/976: dwrite d8/df/d5b/d32/d45/f61 [0,4194304] 0 2024-03-16T10:53:31.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/977: fsync d8/df/d46/d63/d94/f11c 0 2024-03-16T10:53:31.039 INFO:tasks.workunit.client.0.smithi017.stdout:9/978: mkdir d8/df/d5b/daf/db7/de6/d112/d146 0 2024-03-16T10:53:31.040 INFO:tasks.workunit.client.0.smithi017.stdout:9/979: write d8/df/d46/d63/d88/fd0 [806413,24612] 0 2024-03-16T10:53:31.040 INFO:tasks.workunit.client.0.smithi017.stdout:9/980: stat d8/dbf/d68/d7f/lf3 0 2024-03-16T10:53:31.041 INFO:tasks.workunit.client.0.smithi017.stdout:9/981: symlink d8/d95/l147 0 2024-03-16T10:53:31.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/982: dwrite d8/df/d46/f5a [0,4194304] 0 2024-03-16T10:53:31.059 INFO:tasks.workunit.client.0.smithi017.stdout:9/983: dread - d8/df/d5b/d72/d9e/fd5 zero size 2024-03-16T10:53:31.063 INFO:tasks.workunit.client.0.smithi017.stdout:9/984: link d8/dbf/d68/d7f/l8e d8/df/d66/dd1/l148 0 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/890: sync 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:8/993: sync 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:6/985: sync 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/891: chown d4/d6/d30/d3f/f85 150 1 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:6/986: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 778 1 2024-03-16T10:53:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:8/994: write d6/f4e [1227335,46078] 0 2024-03-16T10:53:31.069 INFO:tasks.workunit.client.0.smithi017.stdout:6/987: mknod d0/d15/d1f/d7d/d87/dc9/c13d 0 2024-03-16T10:53:31.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/988: read d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/d84/f10e [150637,22058] 0 2024-03-16T10:53:31.073 INFO:tasks.workunit.client.0.smithi017.stdout:6/989: dread d0/f13b [0,4194304] 0 2024-03-16T10:53:31.073 INFO:tasks.workunit.client.0.smithi017.stdout:6/990: chown d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/db0/fc5 0 1 2024-03-16T10:53:31.073 INFO:tasks.workunit.client.0.smithi017.stdout:6/991: fdatasync d0/d21/d39/d44/d9a/da7/d45/d4d/d2c/ff2 0 2024-03-16T10:53:31.073 INFO:tasks.workunit.client.0.smithi017.stdout:9/985: dwrite d8/df/d5b/d32/d45/f10e [0,4194304] 0 2024-03-16T10:53:31.074 INFO:tasks.workunit.client.0.smithi017.stdout:6/992: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/d69/d7e/f93 2489922 0 2024-03-16T10:53:31.074 INFO:tasks.workunit.client.0.smithi017.stdout:6/993: fsync d0/d3e/dee/ff6 0 2024-03-16T10:53:31.076 INFO:tasks.workunit.client.0.smithi017.stdout:9/986: rmdir d8/dbf/d91/d121 0 2024-03-16T10:53:31.076 INFO:tasks.workunit.client.0.smithi017.stdout:9/987: chown d8/df/d46/le0 563180 1 2024-03-16T10:53:31.076 INFO:tasks.workunit.client.0.smithi017.stdout:9/988: truncate d8/df/d5b/daf/db7/fc4 1934115 0 2024-03-16T10:53:31.077 INFO:tasks.workunit.client.0.smithi017.stdout:9/989: symlink d8/dbf/l149 0 2024-03-16T10:53:31.079 INFO:tasks.workunit.client.0.smithi017.stdout:9/990: mkdir d8/df/d46/d63/d14a 0 2024-03-16T10:53:31.081 INFO:tasks.workunit.client.0.smithi017.stdout:9/991: link d8/df/d5b/daf/c11f d8/df/d5b/d72/c14b 0 2024-03-16T10:53:31.082 INFO:tasks.workunit.client.0.smithi017.stdout:8/995: dwrite d6/d14/d72/f95 [0,4194304] 0 2024-03-16T10:53:31.082 INFO:tasks.workunit.client.0.smithi017.stdout:6/994: dread d0/f3c [0,4194304] 0 2024-03-16T10:53:31.082 INFO:tasks.workunit.client.0.smithi017.stdout:6/995: truncate d0/d21/d39/d44/d9a/da7/d45/d4d/d6d/d75/f10c 580263 0 2024-03-16T10:53:31.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/996: mknod d6/d5c/d96/c139 0 2024-03-16T10:53:31.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/997: mkdir d6/d14/d12f/d13a 0 2024-03-16T10:53:31.092 INFO:tasks.workunit.client.0.smithi017.stdout:9/992: write d8/dbf/d68/d98/ffc [3817269,20065] 0 2024-03-16T10:53:31.092 INFO:tasks.workunit.client.0.smithi017.stdout:9/993: truncate d8/df/f12e 924279 0 2024-03-16T10:53:31.093 INFO:tasks.workunit.client.0.smithi017.stdout:6/996: dread d0/d21/d39/d44/d9a/da7/f7b [0,4194304] 0 2024-03-16T10:53:31.094 INFO:tasks.workunit.client.0.smithi017.stdout:2/892: rename d4/d6/db/fcb to d4/d6/db/d24/d39/f127 0 2024-03-16T10:53:31.094 INFO:tasks.workunit.client.0.smithi017.stdout:2/893: chown d4/dd/d1e/da7/fcf 109007 1 2024-03-16T10:53:31.097 INFO:tasks.workunit.client.0.smithi017.stdout:8/998: rename d6/d16/d6c/dd4/d92/fa0 to d6/d5f/da4/d112/f13b 0 2024-03-16T10:53:31.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/894: dread d4/dd/df/f77 [0,4194304] 0 2024-03-16T10:53:31.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/895: chown d4/d6/db/d66/d2e/fea 3563 1 2024-03-16T10:53:31.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/896: fsync d4/d6/db/d66/d2e/f8b 0 2024-03-16T10:53:31.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/897: chown d4/d6/db/d24/d39/f3b 0 1 2024-03-16T10:53:31.101 INFO:tasks.workunit.client.0.smithi017.stdout:6/997: unlink d0/d21/d39/d44/d9a/da7/d45/d4d/d2e/f4b 0 2024-03-16T10:53:31.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/999: creat d6/d16/d6c/dd4/d10a/f13c x:0 0 0 2024-03-16T10:53:31.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/898: creat d4/d6/d30/d3f/f128 x:0 0 0 2024-03-16T10:53:31.105 INFO:tasks.workunit.client.0.smithi017.stdout:6/998: unlink d0/d3e/dee/ff6 0 2024-03-16T10:53:31.106 INFO:tasks.workunit.client.0.smithi017.stdout:9/994: rename d8/df/d46/c64 to d8/df/d46/d63/d94/dad/c14c 0 2024-03-16T10:53:31.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/899: truncate d4/d6/d30/d3f/f54 1648572 0 2024-03-16T10:53:31.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/900: write d4/dd/d1e/d4a/fa8 [973549,111766] 0 2024-03-16T10:53:31.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/995: dread d8/dbf/d68/d7f/fef [0,4194304] 0 2024-03-16T10:53:31.111 INFO:tasks.workunit.client.0.smithi017.stdout:6/999: rename d0/cd to d0/d21/d39/d44/d9a/da7/c13e 0 2024-03-16T10:53:31.118 INFO:tasks.workunit.client.0.smithi017.stdout:9/996: mkdir d8/df/d46/d14d 0 2024-03-16T10:53:31.122 INFO:tasks.workunit.client.0.smithi017.stdout:2/901: dwrite d4/d6/db/d66/d2e/fa9 [0,4194304] 0 2024-03-16T10:53:31.134 INFO:tasks.workunit.client.0.smithi017.stdout:9/997: dwrite d8/df/d5b/daf/db7/fbe [0,4194304] 0 2024-03-16T10:53:31.137 INFO:tasks.workunit.client.0.smithi017.stdout:2/902: dwrite d4/d6/db/dfb/fdd [0,4194304] 0 2024-03-16T10:53:31.140 INFO:tasks.workunit.client.0.smithi017.stdout:2/903: symlink d4/dd/d1e/d4a/df3/dc3/l129 0 2024-03-16T10:53:31.142 INFO:tasks.workunit.client.0.smithi017.stdout:9/998: dread d8/df/d66/dd1/ff1 [0,4194304] 0 2024-03-16T10:53:31.142 INFO:tasks.workunit.client.0.smithi017.stdout:2/904: symlink d4/d6/db/d66/d93/d63/d11a/l12a 0 2024-03-16T10:53:31.154 INFO:tasks.workunit.client.0.smithi017.stdout:2/905: link d4/d6/c50 d4/d6/db/d66/d2e/d78/df5/c12b 0 2024-03-16T10:53:31.154 INFO:tasks.workunit.client.0.smithi017.stdout:2/906: readlink d4/d6/d81/d8f/l106 0 2024-03-16T10:53:31.154 INFO:tasks.workunit.client.0.smithi017.stdout:2/907: write d4/f5e [1763594,115874] 0 2024-03-16T10:53:31.154 INFO:tasks.workunit.client.0.smithi017.stdout:2/908: mknod d4/dd/d1e/d4a/c12c 0 2024-03-16T10:53:31.156 INFO:tasks.workunit.client.0.smithi017.stdout:2/909: link d4/d6/db/dfb/f9c d4/d6/db/d24/d39/f12d 0 2024-03-16T10:53:31.157 INFO:tasks.workunit.client.0.smithi017.stdout:9/999: dwrite d8/d95/f13f [0,4194304] 0 2024-03-16T10:53:31.158 INFO:tasks.workunit.client.0.smithi017.stdout:2/910: symlink d4/dd/l12e 0 2024-03-16T10:53:31.158 INFO:tasks.workunit.client.0.smithi017.stdout:2/911: write d4/dd/d1e/d4a/df3/dc3/fe4 [1030122,9191] 0 2024-03-16T10:53:31.159 INFO:tasks.workunit.client.0.smithi017.stdout:2/912: creat d4/dd/df/dd9/f12f x:0 0 0 2024-03-16T10:53:31.162 INFO:tasks.workunit.client.0.smithi017.stdout:2/913: dread d4/d6/db/d66/d2e/f3c [0,4194304] 0 2024-03-16T10:53:31.165 INFO:tasks.workunit.client.0.smithi017.stdout:2/914: unlink d4/d6/db/dfb/fbc 0 2024-03-16T10:53:31.166 INFO:tasks.workunit.client.0.smithi017.stdout:2/915: creat d4/d6/db/d66/f130 x:0 0 0 2024-03-16T10:53:31.166 INFO:tasks.workunit.client.0.smithi017.stdout:2/916: stat d4/dd 0 2024-03-16T10:53:31.167 INFO:tasks.workunit.client.0.smithi017.stdout:2/917: symlink d4/d6/d30/l131 0 2024-03-16T10:53:31.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/918: dwrite d4/d6/db/d66/d93/d63/fb9 [0,4194304] 0 2024-03-16T10:53:31.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/919: write d4/d97/d9f/f10c [1589588,86229] 0 2024-03-16T10:53:31.182 INFO:tasks.workunit.client.0.smithi017.stdout:2/920: creat d4/d6/db/d66/d93/f132 x:0 0 0 2024-03-16T10:53:31.190 INFO:tasks.workunit.client.0.smithi017.stdout:2/921: dread d4/d6/d81/fec [0,4194304] 0 2024-03-16T10:53:31.192 INFO:tasks.workunit.client.0.smithi017.stdout:2/922: unlink d4/dd/df/dd9/f117 0 2024-03-16T10:53:31.192 INFO:tasks.workunit.client.0.smithi017.stdout:2/923: fdatasync d4/d6/db/fef 0 2024-03-16T10:53:31.204 INFO:tasks.workunit.client.0.smithi017.stdout:2/924: dwrite d4/d6/d30/fb2 [0,4194304] 0 2024-03-16T10:53:31.274 INFO:tasks.workunit.client.0.smithi017.stdout:2/925: sync 2024-03-16T10:53:31.275 INFO:tasks.workunit.client.0.smithi017.stdout:2/926: mknod d4/dd/df/d11f/c133 0 2024-03-16T10:53:31.277 INFO:tasks.workunit.client.0.smithi017.stdout:2/927: creat d4/d6/db/dfb/f134 x:0 0 0 2024-03-16T10:53:31.282 INFO:tasks.workunit.client.0.smithi017.stdout:2/928: write d4/dd/d1e/d4a/df3/f108 [581175,121792] 0 2024-03-16T10:53:31.283 INFO:tasks.workunit.client.0.smithi017.stdout:2/929: readlink d4/dd/df/dd9/l55 0 2024-03-16T10:53:31.283 INFO:tasks.workunit.client.0.smithi017.stdout:2/930: write d4/dd/d1e/ffa [505521,107219] 0 2024-03-16T10:53:31.285 INFO:tasks.workunit.client.0.smithi017.stdout:2/931: mkdir d4/dd/d1e/d135 0 2024-03-16T10:53:31.285 INFO:tasks.workunit.client.0.smithi017.stdout:2/932: stat d4/d6/db/d66/d93/d63/db0/fc7 0 2024-03-16T10:53:31.285 INFO:tasks.workunit.client.0.smithi017.stdout:2/933: getdents d4/d6/db 0 2024-03-16T10:53:31.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/934: readlink d4/dd/d1e/d4a/df3/l4c 0 2024-03-16T10:53:31.287 INFO:tasks.workunit.client.0.smithi017.stdout:2/935: mknod d4/d6/db/d66/d93/d100/c136 0 2024-03-16T10:53:31.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/936: dwrite d4/d6/db/d66/daf/fb7 [0,4194304] 0 2024-03-16T10:53:31.300 INFO:tasks.workunit.client.0.smithi017.stdout:2/937: write d4/d6/db/d66/d93/f70 [875029,27552] 0 2024-03-16T10:53:31.301 INFO:tasks.workunit.client.0.smithi017.stdout:2/938: symlink d4/d6/db/d66/d2e/d78/l137 0 2024-03-16T10:53:31.321 INFO:tasks.workunit.client.0.smithi017.stdout:2/939: dwrite d4/f56 [0,4194304] 0 2024-03-16T10:53:31.323 INFO:tasks.workunit.client.0.smithi017.stdout:2/940: creat d4/d97/f138 x:0 0 0 2024-03-16T10:53:31.332 INFO:tasks.workunit.client.0.smithi017.stdout:2/941: link d4/d6/db/d66/d2e/l46 d4/dd/df/d11f/l139 0 2024-03-16T10:53:31.332 INFO:tasks.workunit.client.0.smithi017.stdout:2/942: write d4/d6/db/d66/d93/f132 [368680,76750] 0 2024-03-16T10:53:31.332 INFO:tasks.workunit.client.0.smithi017.stdout:2/943: truncate d4/d6/db/d66/daf/fe0 632362 0 2024-03-16T10:53:31.333 INFO:tasks.workunit.client.0.smithi017.stdout:2/944: fsync d4/d6/db/d66/d2e/d78/df5/f113 0 2024-03-16T10:53:31.333 INFO:tasks.workunit.client.0.smithi017.stdout:2/945: stat d4/d6/db/d66/d93/f4e 0 2024-03-16T10:53:31.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/946: dread d4/dd/df/dd9/f116 [4194304,4194304] 0 2024-03-16T10:53:31.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/947: dread - d4/d6/db/d66/f130 zero size 2024-03-16T10:53:31.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/948: dread - d4/d6/db/d66/d2e/d78/df5/f118 zero size 2024-03-16T10:53:31.342 INFO:tasks.workunit.client.0.smithi017.stdout:2/949: chown d4/d6/f21 437849 1 2024-03-16T10:53:31.432 INFO:tasks.workunit.client.0.smithi017.stdout:2/950: sync 2024-03-16T10:53:31.441 INFO:tasks.workunit.client.0.smithi017.stdout:2/951: dread d4/d6/d30/fb2 [0,4194304] 0 2024-03-16T10:53:31.442 INFO:tasks.workunit.client.0.smithi017.stdout:2/952: mkdir d4/d6/db/d66/d93/d100/d13a 0 2024-03-16T10:53:31.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/953: dread d4/dd/df/dd9/f8a [0,4194304] 0 2024-03-16T10:53:31.454 INFO:tasks.workunit.client.0.smithi017.stdout:2/954: creat d4/dd/df/dd9/f13b x:0 0 0 2024-03-16T10:53:31.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/955: rmdir d4/d6/db/d66/d2e/d78/df5/d10e 0 2024-03-16T10:53:31.458 INFO:tasks.workunit.client.0.smithi017.stdout:2/956: creat d4/d6/db/d66/d93/d100/d13a/f13c x:0 0 0 2024-03-16T10:53:31.459 INFO:tasks.workunit.client.0.smithi017.stdout:2/957: symlink d4/d6/d81/l13d 0 2024-03-16T10:53:31.468 INFO:tasks.workunit.client.0.smithi017.stdout:2/958: write d4/dd/df/f80 [3239983,31530] 0 2024-03-16T10:53:31.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/959: rename d4/d6/d81/ff6 to d4/dca/f13e 0 2024-03-16T10:53:31.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/960: dread - d4/d6/db/d24/f102 zero size 2024-03-16T10:53:31.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/961: readlink d4/dd/df/d11f/l139 0 2024-03-16T10:53:31.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/962: fsync d4/dd/df/f77 0 2024-03-16T10:53:31.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/963: read d4/d6/f21 [1576516,49638] 0 2024-03-16T10:53:31.471 INFO:tasks.workunit.client.0.smithi017.stdout:2/964: mkdir d4/dca/deb/d13f 0 2024-03-16T10:53:31.471 INFO:tasks.workunit.client.0.smithi017.stdout:2/965: stat d4/d6/db/dfb/fdd 0 2024-03-16T10:53:31.471 INFO:tasks.workunit.client.0.smithi017.stdout:2/966: chown d4/dd/d1e/d4a/df3/dc3/f83 173374 1 2024-03-16T10:53:31.473 INFO:tasks.workunit.client.0.smithi017.stdout:2/967: unlink d4/d6/d30/d3f/f54 0 2024-03-16T10:53:31.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/968: getdents d4/dca 0 2024-03-16T10:53:31.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/969: chown d4/dd/d1e 0 1 2024-03-16T10:53:31.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/970: unlink d4/d6/db/dfb/f134 0 2024-03-16T10:53:31.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/971: readlink d4/dd/d1e/d4a/df3/l126 0 2024-03-16T10:53:31.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/972: chown d4/d6/db/d66/d93/d63/d11a/l12a 782 1 2024-03-16T10:53:31.480 INFO:tasks.workunit.client.0.smithi017.stdout:2/973: mkdir d4/d97/d9f/d140 0 2024-03-16T10:53:31.493 INFO:tasks.workunit.client.0.smithi017.stdout:2/974: dwrite d4/dd/fc0 [4194304,4194304] 0 2024-03-16T10:53:31.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/975: creat d4/dd/d1e/d135/f141 x:0 0 0 2024-03-16T10:53:31.506 INFO:tasks.workunit.client.0.smithi017.stdout:2/976: dwrite d4/dd/df/f77 [0,4194304] 0 2024-03-16T10:53:31.506 INFO:tasks.workunit.client.0.smithi017.stdout:2/977: fsync d4/dd/d1e/d4a/df3/dc3/fe4 0 2024-03-16T10:53:31.512 INFO:tasks.workunit.client.0.smithi017.stdout:2/978: dread d4/dd/d1e/f89 [0,4194304] 0 2024-03-16T10:53:31.513 INFO:tasks.workunit.client.0.smithi017.stdout:2/979: mknod d4/d97/d9f/c142 0 2024-03-16T10:53:31.513 INFO:tasks.workunit.client.0.smithi017.stdout:2/980: dread - d4/d6/db/d66/d2e/d78/df5/f113 zero size 2024-03-16T10:53:31.515 INFO:tasks.workunit.client.0.smithi017.stdout:2/981: write d4/d6/db/d66/d2e/f3a [4144782,82066] 0 2024-03-16T10:53:31.515 INFO:tasks.workunit.client.0.smithi017.stdout:2/982: chown d4/d6/d30/d3f/f69 46460514 1 2024-03-16T10:53:31.522 INFO:tasks.workunit.client.0.smithi017.stdout:2/983: dread d4/d6/db/f7a [0,4194304] 0 2024-03-16T10:53:31.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/984: symlink d4/d97/l143 0 2024-03-16T10:53:31.533 INFO:tasks.workunit.client.0.smithi017.stdout:2/985: dwrite d4/d6/db/d66/d2e/f3a [4194304,4194304] 0 2024-03-16T10:53:31.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/986: dread d4/d6/d81/fec [0,4194304] 0 2024-03-16T10:53:31.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/987: getdents d4/dd/d1e 0 2024-03-16T10:53:31.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/988: symlink d4/dd/d1e/d4a/df3/l144 0 2024-03-16T10:53:31.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/989: write d4/d6/db/d24/d39/f42 [1146414,84784] 0 2024-03-16T10:53:31.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/990: truncate d4/dd/df/f77 309699 0 2024-03-16T10:53:31.552 INFO:tasks.workunit.client.0.smithi017.stdout:2/991: dread d4/d6/db/d66/d93/f4e [0,4194304] 0 2024-03-16T10:53:31.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/992: symlink d4/d6/db/d24/db6/l145 0 2024-03-16T10:53:31.555 INFO:tasks.workunit.client.0.smithi017.stdout:2/993: dread d4/dd/d1e/ffa [0,4194304] 0 2024-03-16T10:53:31.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/994: creat d4/d6/d30/d3f/dba/f146 x:0 0 0 2024-03-16T10:53:31.558 INFO:tasks.workunit.client.0.smithi017.stdout:2/995: read d4/d6/db/dfb/f9e [89540,126798] 0 2024-03-16T10:53:31.566 INFO:tasks.workunit.client.0.smithi017.stdout:2/996: read d4/dd/d1e/d4a/df3/dc3/f83 [1258046,96124] 0 2024-03-16T10:53:31.566 INFO:tasks.workunit.client.0.smithi017.stdout:2/997: dread - d4/d6/d30/d3f/dba/f146 zero size 2024-03-16T10:53:31.566 INFO:tasks.workunit.client.0.smithi017.stdout:2/998: stat d4/d6/db/d66/d93/d63/db0 0 2024-03-16T10:53:31.567 INFO:tasks.workunit.client.0.smithi017.stdout:2/999: getdents d4/d6 0 2024-03-16T10:53:31.569 INFO:tasks.workunit.client.0.smithi017.stderr:+ rm -rf -- ./tmp.ezvm3RUn75 2024-03-16T10:53:32.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:32 smithi174 ceph-mon[36202]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 139 MiB/s wr, 1.10k op/s 2024-03-16T10:53:32.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:32 smithi017 ceph-mon[32078]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 139 MiB/s wr, 1.10k op/s 2024-03-16T10:53:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:32 smithi111 ceph-mon[36315]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 139 MiB/s wr, 1.10k op/s 2024-03-16T10:53:33.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:33 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:33.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:33 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:33.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:33 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:34.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:34 smithi017 ceph-mon[32078]: pgmap v433: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 180 MiB/s wr, 969 op/s 2024-03-16T10:53:34.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:34 smithi111 ceph-mon[36315]: pgmap v433: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 180 MiB/s wr, 969 op/s 2024-03-16T10:53:34.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:34 smithi174 ceph-mon[36202]: pgmap v433: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 MiB/s rd, 180 MiB/s wr, 969 op/s 2024-03-16T10:53:36.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:36 smithi017 ceph-mon[32078]: pgmap v434: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 131 MiB/s wr, 544 op/s 2024-03-16T10:53:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:36 smithi111 ceph-mon[36315]: pgmap v434: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 131 MiB/s wr, 544 op/s 2024-03-16T10:53:36.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:36 smithi174 ceph-mon[36202]: pgmap v434: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 MiB/s rd, 131 MiB/s wr, 544 op/s 2024-03-16T10:53:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:38 smithi017 ceph-mon[32078]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s rd, 125 MiB/s wr, 590 op/s 2024-03-16T10:53:38.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:38 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:38 smithi111 ceph-mon[36315]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s rd, 125 MiB/s wr, 590 op/s 2024-03-16T10:53:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:38 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:38 smithi174 ceph-mon[36202]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 94 MiB/s rd, 125 MiB/s wr, 590 op/s 2024-03-16T10:53:38.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:38 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:39.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-16T10:53:39.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-16T10:53:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 -- 172.21.15.17:0/2385792426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 msgr2=0x7f43200ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 --2- 172.21.15.17:0/2385792426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f43200ffed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4310009930 tx=0x7f431002bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 -- 172.21.15.17:0/2385792426 shutdown_connections 2024-03-16T10:53:39.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 --2- 172.21.15.17:0/2385792426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320103440 0x7f4320109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 --2- 172.21.15.17:0/2385792426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320102a80 0x7f4320102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 --2- 172.21.15.17:0/2385792426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f43200ffed0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 -- 172.21.15.17:0/2385792426 >> 172.21.15.17:0/2385792426 conn(0x7f43200fb400 msgr2=0x7f43200fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 -- 172.21.15.17:0/2385792426 shutdown_connections 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.484+0000 7f4326668640 1 -- 172.21.15.17:0/2385792426 wait complete. 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 Processor -- start 2024-03-16T10:53:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 -- start start 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320102a80 0x7f43201980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 0x7f432019f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f432010d4b0 con 0x7f43200ffab0 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f432010d330 con 0x7f4320102a80 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4326668640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f432010d630 con 0x7f4320103440 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35148/0 (socket says 172.21.15.17:35148) 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 -- 172.21.15.17:0/3111623735 learned_addr learned my addr 172.21.15.17:0/3111623735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431f7fe640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320102a80 0x7f43201980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4324c05640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 0x7f432019f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 -- 172.21.15.17:0/3111623735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 msgr2=0x7f432019f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 0x7f432019f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 -- 172.21.15.17:0/3111623735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320102a80 msgr2=0x7f43201980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320102a80 0x7f43201980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f431ffff640 1 -- 172.21.15.17:0/3111623735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432019f790 con 0x7f43200ffab0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.485+0000 7f4324c05640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 0x7f432019f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f431ffff640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4310009900 tx=0x7f431002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f431d7fa640 1 -- 172.21.15.17:0/3111623735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310043020 con 0x7f43200ffab0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f431d7fa640 1 -- 172.21.15.17:0/3111623735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43100054e0 con 0x7f43200ffab0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f431d7fa640 1 -- 172.21.15.17:0/3111623735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310003c40 con 0x7f43200ffab0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432019fa20 con 0x7f43200ffab0 2024-03-16T10:53:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.486+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432019fef0 con 0x7f43200ffab0 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f431d7fa640 1 -- 172.21.15.17:0/3111623735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f4310046020 con 0x7f43200ffab0 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 Processor -- start 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 -- start start 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6cf8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 0x5617c6cfb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5617c6c58500 con 0x5617c6cf3170 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5617c6c00be0 con 0x5617c6cf3b60 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.488+0000 7f4329250740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5617c6c545a0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431d7fa640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 0x7f43080a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6cf8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35158/0 (socket says 172.21.15.17:35158) 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 -- 172.21.15.17:0/688188544 learned_addr learned my addr 172.21.15.17:0/688188544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 0x5617c6cfb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 0x7f43080a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431d7fa640 1 -- 172.21.15.17:0/3111623735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f43100f0a20 con 0x7f43200ffab0 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 -- 172.21.15.17:0/688188544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 msgr2=0x5617c6cf8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6cf8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 -- 172.21.15.17:0/688188544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 msgr2=0x5617c6cf3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 -- 172.21.15.17:0/688188544 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c6c144b0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f431f7fe640 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 0x5617c6cfb160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4314009bf0 tx=0x7f4314011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7b296021c66434 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f4324c05640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 0x7f43080a4d40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5617c6cf43c0 tx=0x7f4318004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f43067fc640 1 -- 172.21.15.17:0/688188544 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314004310 con 0x5617c6cf8cd0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f43067fc640 1 -- 172.21.15.17:0/688188544 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43140044b0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.489+0000 7f43067fc640 1 -- 172.21.15.17:0/688188544 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314003850 con 0x5617c6cf8cd0 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 -- 172.21.15.17:0/688188544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 msgr2=0x5617c6cfb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 0x5617c6cfb160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4314009bf0 tx=0x7f4314011440 comp rx=0 tx=0).stop 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 -- 172.21.15.17:0/688188544 shutdown_connections 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf8cd0 0x5617c6cfb160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6cf8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 --2- 172.21.15.17:0/688188544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3170 0x5617c6cf3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 -- 172.21.15.17:0/688188544 >> 172.21.15.17:0/688188544 conn(0x5617c6cee6e0 msgr2=0x5617c6ceeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 -- 172.21.15.17:0/688188544 shutdown_connections 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.490+0000 7f4329250740 1 -- 172.21.15.17:0/688188544 wait complete. 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 -- start start 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 Processor -- start 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 0x5617c6cfd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5617c6cfbc80 con 0x5617c6cf8cd0 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5617c6c14160 con 0x5617c6cf3170 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5617c6cfbe00 con 0x5617c6cf3b60 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4329250740 10 client.0 _ll_register_callbacks cb 0x5617c6bf8150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f431ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 0x5617c6cfd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35168/0 (socket says 172.21.15.17:35168) 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f431ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 0x5617c6cfd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48614/0 (socket says 172.21.15.17:48614) 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:52782/0 (socket says 172.21.15.17:52782) 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.491+0000 7f4324c05640 1 -- 172.21.15.17:0/543817672 learned_addr learned my addr 172.21.15.17:0/543817672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 -- 172.21.15.17:0/543817672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 msgr2=0x5617c6cfdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 -- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 msgr2=0x5617c6cfd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 0x5617c6cfd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 -- 172.21.15.17:0/543817672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c6a367d0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f431f7fe640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4324c05640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4318012870 tx=0x7f4318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe01e12ee2c9fb45 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318024070 con 0x5617c6cf8cd0 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4318004d20 con 0x5617c6cf8cd0 2024-03-16T10:53:39.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43140044b0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f431802f050 con 0x5617c6cf8cd0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4329250740 10 client.16302 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5617c696c3f0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43140044b0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f431801e040 con 0x5617c6cf8cd0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.492+0000 7f4329250740 10 client.16302 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f4329250740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f4329250740 20 client.16302 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d091c0 0x5617c6d0b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f4329250740 4 client.16302 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617c6c65a40 con 0x5617c6d091c0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f431ffff640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d091c0 0x5617c6d0b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f42ff7fe640 10 client.16302 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.493+0000 7f431ffff640 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d091c0 0x5617c6d0b620 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1401eeb7c5b77f5d server_cookie=9cb8cef4df559e1f in_seq=0 out_seq=0 2024-03-16T10:53:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f42ff7fe640 1 -- 172.21.15.17:0/543817672 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5617c6c65a40 con 0x5617c6d091c0 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f42ff7fe640 10 client.16302 handle_command_reply: tid=0 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 client.16302 shutdown 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 msgr2=0x5617c6d04bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4318012870 tx=0x7f4318004a40 comp rx=0 tx=0).stop 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 shutdown_connections 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d091c0 0x5617c6d0b620 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6d04bd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3b60 0x5617c6cfdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f42ff7fe640 0 client.16302 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 --2- 172.21.15.17:0/543817672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3170 0x5617c6cfd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.494+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 >> 172.21.15.17:0/543817672 conn(0x5617c6cee6e0 msgr2=0x5617c6ced900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.495+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 shutdown_connections 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.495+0000 7f4329250740 1 -- 172.21.15.17:0/543817672 wait complete. 2024-03-16T10:53:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.495+0000 7f4329250740 20 client.16302 trim_cache size 0 max 16384 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 Processor -- start 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 -- start start 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6cfd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6d04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a8ba0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f43201aa8c0 con 0x5617c6cf3b60 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4329250740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a9270 con 0x5617c6cf3170 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35182/0 (socket says 172.21.15.17:35182) 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6d04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 -- 172.21.15.17:0/4247026117 learned_addr learned my addr 172.21.15.17:0/4247026117 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f431ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6cfd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 -- 172.21.15.17:0/4247026117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 msgr2=0x5617c6cfd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6cfd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 -- 172.21.15.17:0/4247026117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 msgr2=0x5617c6d04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6d04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 -- 172.21.15.17:0/4247026117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c692c0f0 con 0x5617c6cf8cd0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.513+0000 7f4324c05640 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4318005b40 tx=0x7f4318012320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2e9117e5b59572 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4305ffb640 1 -- 172.21.15.17:0/4247026117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318038070 con 0x5617c6cf8cd0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4305ffb640 1 -- 172.21.15.17:0/4247026117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f431800ed30 con 0x5617c6cf8cd0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4305ffb640 1 -- 172.21.15.17:0/4247026117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318024040 con 0x5617c6cf8cd0 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 -- 172.21.15.17:0/4247026117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 msgr2=0x5617c6ced070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4318005b40 tx=0x7f4318012320 comp rx=0 tx=0).stop 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 -- 172.21.15.17:0/4247026117 shutdown_connections 2024-03-16T10:53:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf8cd0 0x5617c6ced070 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf3b60 0x5617c6d04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 --2- 172.21.15.17:0/4247026117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6cfd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 -- 172.21.15.17:0/4247026117 >> 172.21.15.17:0/4247026117 conn(0x5617c6cee6e0 msgr2=0x5617c6cfc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 -- 172.21.15.17:0/4247026117 shutdown_connections 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.514+0000 7f4329250740 1 -- 172.21.15.17:0/4247026117 wait complete. 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 -- start start 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 Processor -- start 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6d02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf8cd0 0x5617c6d03a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43201aa130 con 0x5617c6cf3b60 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a9a00 con 0x5617c6cf8cd0 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a6b80 con 0x5617c6cf3170 2024-03-16T10:53:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4329250740 10 client.0 _ll_register_callbacks cb 0x7f4318012490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6d02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35192/0 (socket says 172.21.15.17:35192) 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431f7fe640 1 -- 172.21.15.17:0/943265056 learned_addr learned my addr 172.21.15.17:0/943265056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f4324c05640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf8cd0 0x5617c6d03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 -- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf8cd0 msgr2=0x5617c6d03a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf8cd0 0x5617c6d03a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 -- 172.21.15.17:0/943265056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 msgr2=0x5617c6d02ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.515+0000 7f431ffff640 1 -- 172.21.15.17:0/943265056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c6c1f9d0 con 0x5617c6cf3170 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f431f7fe640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f431ffff640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6d02580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43100ee610 tx=0x7f43100b9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ea8f1a9f099ade server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:53:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310004c60 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f43100bb760 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617c6c5fd90 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f43100bdb60 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 10 client.26122 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5617c6d6f630 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5617c6c5fd90 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f43100c5770 con 0x5617c6cf3170 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 10 client.26122 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 10 client.26122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 20 client.26122 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d70050 0x5617c6d72470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 4 client.26122 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.516+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617c6bdd540 con 0x5617c6d70050 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.517+0000 7f431f7fe640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d70050 0x5617c6d72470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.517+0000 7f431f7fe640 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d70050 0x5617c6d72470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18448b57171e26b1 server_cookie=1dc565b89e1d72ab in_seq=0 out_seq=0 2024-03-16T10:53:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.517+0000 7f42ff7fe640 10 client.26122 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f42ff7fe640 1 -- 172.21.15.17:0/943265056 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617c6bdd540 con 0x5617c6d70050 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f42ff7fe640 10 client.26122 handle_command_reply: tid=0 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 client.26122 shutdown 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 msgr2=0x5617c6d02580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6d02580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43100ee610 tx=0x7f43100b9040 comp rx=0 tx=0).stop 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 shutdown_connections 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x5617c6d70050 0x5617c6d72470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5617c6cf8cd0 0x5617c6d03a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f42ff7fe640 0 client.26122 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617c6cf3b60 0x5617c6d02ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 --2- 172.21.15.17:0/943265056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5617c6cf3170 0x5617c6d02580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 >> 172.21.15.17:0/943265056 conn(0x5617c6cee6e0 msgr2=0x5617c6cf1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 shutdown_connections 2024-03-16T10:53:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 1 -- 172.21.15.17:0/943265056 wait complete. 2024-03-16T10:53:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4329250740 20 client.26122 trim_cache size 0 max 16384 2024-03-16T10:53:39.525 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:53:39.525 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-03-16T10:53:39.525 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2024-03-16T10:53:39.525 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 msgr2=0x7f43080a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 0x7f43080a4d40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5617c6cf43c0 tx=0x7f4318004ab0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 msgr2=0x7f4320197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.520+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4310009900 tx=0x7f431002c650 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 shutdown_connections 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f43080a2880 0x7f43080a4d40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4320103440 0x7f432019f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4320102a80 0x7f43201980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 --2- 172.21.15.17:0/3111623735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43200ffab0 0x7f4320197b70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 >> 172.21.15.17:0/3111623735 conn(0x7f43200fb400 msgr2=0x7f4320105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 shutdown_connections 2024-03-16T10:53:39.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.521+0000 7f4326668640 1 -- 172.21.15.17:0/3111623735 wait complete. 2024-03-16T10:53:39.533 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-16T10:53:39.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:53:39.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 -- 172.21.15.17:0/925241173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 msgr2=0x7f0c54101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 --2- 172.21.15.17:0/925241173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c54101d70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009900 tx=0x7f0c3c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:39.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 -- 172.21.15.17:0/925241173 shutdown_connections 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 --2- 172.21.15.17:0/925241173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c541022b0 0x7f0c54108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 --2- 172.21.15.17:0/925241173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c54101d70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.639+0000 7f0c59612640 1 --2- 172.21.15.17:0/925241173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c54100700 0x7f0c54100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- 172.21.15.17:0/925241173 >> 172.21.15.17:0/925241173 conn(0x7f0c540fbc70 msgr2=0x7f0c540fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- 172.21.15.17:0/925241173 shutdown_connections 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- 172.21.15.17:0/925241173 wait complete. 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 Processor -- start 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- start start 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c54100700 0x7f0c54199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c541022b0 0x7f0c541a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410d4a0 con 0x7f0c541018f0 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410d320 con 0x7f0c541022b0 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c59612640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410d620 con 0x7f0c54100700 2024-03-16T10:53:39.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c4bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c4bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35222/0 (socket says 172.21.15.17:35222) 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c4bfff640 1 -- 172.21.15.17:0/1787409865 learned_addr learned my addr 172.21.15.17:0/1787409865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c52ffd640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c54100700 0x7f0c54199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.640+0000 7f0c537fe640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c541022b0 0x7f0c541a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 -- 172.21.15.17:0/1787409865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c54100700 msgr2=0x7f0c54199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c54100700 0x7f0c54199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 -- 172.21.15.17:0/1787409865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c541022b0 msgr2=0x7f0c541a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c541022b0 0x7f0c541a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 -- 172.21.15.17:0/1787409865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c541a1940 con 0x7f0c541018f0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c4bfff640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009230 tx=0x7f0c3c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c041070 con 0x7f0c541018f0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c3c004450 con 0x7f0c541018f0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c541a1bd0 con 0x7f0c541018f0 2024-03-16T10:53:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c003e20 con 0x7f0c541018f0 2024-03-16T10:53:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.641+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541a20c0 con 0x7f0c541018f0 2024-03-16T10:53:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.642+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c541a2290 con 0x7f0c541018f0 2024-03-16T10:53:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.643+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f0c3c044070 con 0x7f0c541018f0 2024-03-16T10:53:39.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.644+0000 7f0c50ff9640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 0x7f0c400a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:39.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.644+0000 7f0c52ffd640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 0x7f0c400a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:39.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.644+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f0c3c0f05d0 con 0x7f0c541018f0 2024-03-16T10:53:39.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.645+0000 7f0c52ffd640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 0x7f0c400a4cc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c5419b200 tx=0x7f0c44005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:39.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.649+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f0c3c0bd0c0 con 0x7f0c541018f0 2024-03-16T10:53:39.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.886+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c541a2620 con 0x7f0c541018f0 2024-03-16T10:53:39.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.886+0000 7f0c50ff9640 1 -- 172.21.15.17:0/1787409865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11968 (secure 0 0 0) 0x7f0c3c0c1160 con 0x7f0c541018f0 2024-03-16T10:53:39.887 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:53:39.887 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:53:36.378702+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":71,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":74,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":72,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24497,14655,24470,24536,24493]},"id":1}]} 2024-03-16T10:53:39.888 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 37 2024-03-16T10:53:39.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 msgr2=0x7f0c400a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 0x7f0c400a4cc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c5419b200 tx=0x7f0c44005f90 comp rx=0 tx=0).stop 2024-03-16T10:53:39.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 msgr2=0x7f0c5419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:39.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009230 tx=0x7f0c3c02c650 comp rx=0 tx=0).stop 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 shutdown_connections 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f0c400a2800 0x7f0c400a4cc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0c541022b0 0x7f0c541a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c541018f0 0x7f0c5419a270 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 --2- 172.21.15.17:0/1787409865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c54100700 0x7f0c54199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 >> 172.21.15.17:0/1787409865 conn(0x7f0c540fbc70 msgr2=0x7f0c54109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 shutdown_connections 2024-03-16T10:53:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:39.889+0000 7f0c59612640 1 -- 172.21.15.17:0/1787409865 wait complete. 2024-03-16T10:53:39.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-03-16T10:53:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 -- 172.21.15.17:0/3564564346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 msgr2=0x7f2f0c101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 --2- 172.21.15.17:0/3564564346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c101d50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009900 tx=0x7f2f0002bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 -- 172.21.15.17:0/3564564346 shutdown_connections 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 --2- 172.21.15.17:0/3564564346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 0x7f2f0c108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 --2- 172.21.15.17:0/3564564346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c101d50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 --2- 172.21.15.17:0/3564564346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 0x7f2f0c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 -- 172.21.15.17:0/3564564346 >> 172.21.15.17:0/3564564346 conn(0x7f2f0c0fbc70 msgr2=0x7f2f0c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 -- 172.21.15.17:0/3564564346 shutdown_connections 2024-03-16T10:53:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.043+0000 7f2f10e36640 1 -- 172.21.15.17:0/3564564346 wait complete. 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 Processor -- start 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 -- start start 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 0x7f2f0c10e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 0x7f2f0c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c10aa70 con 0x7f2f0c1018d0 2024-03-16T10:53:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c10a8f0 con 0x7f2f0c1006e0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.044+0000 7f2f10e36640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c10abf0 con 0x7f2f0c102290 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35244/0 (socket says 172.21.15.17:35244) 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 -- 172.21.15.17:0/165343430 learned_addr learned my addr 172.21.15.17:0/165343430 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 0x7f2f0c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 0x7f2f0c10e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 -- 172.21.15.17:0/165343430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 msgr2=0x7f2f0c115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 0x7f2f0c115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 -- 172.21.15.17:0/165343430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 msgr2=0x7f2f0c10e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 0x7f2f0c10e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.045+0000 7f2f09d9b640 1 -- 172.21.15.17:0/165343430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c1163e0 con 0x7f2f0c1018d0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f0002c240 tx=0x7f2f00004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2efb7fe640 1 -- 172.21.15.17:0/165343430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00043020 con 0x7f2f0c1018d0 2024-03-16T10:53:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c116670 con 0x7f2f0c1018d0 2024-03-16T10:53:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c1aef40 con 0x7f2f0c1018d0 2024-03-16T10:53:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2efb7fe640 1 -- 172.21.15.17:0/165343430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f00004c40 con 0x7f2f0c1018d0 2024-03-16T10:53:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.046+0000 7f2efb7fe640 1 -- 172.21.15.17:0/165343430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00003850 con 0x7f2f0c1018d0 2024-03-16T10:53:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.049+0000 7f2f13a29740 1 Processor -- start 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 -- start start 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce196c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce19c3b0 0x557dce19e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dce0fb490 con 0x557dce196850 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557dce0a3c90 con 0x557dce197240 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2f13a29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557dce0f7530 con 0x557dce19c3b0 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.050+0000 7f2efb7fe640 1 -- 172.21.15.17:0/165343430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f2f00046020 con 0x7f2f0c1018d0 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48682/0 (socket says 172.21.15.17:48682) 2024-03-16T10:53:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 -- 172.21.15.17:0/4285046172 learned_addr learned my addr 172.21.15.17:0/4285046172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 -- 172.21.15.17:0/4285046172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce19c3b0 msgr2=0x557dce19e840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce19c3b0 0x557dce19e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 -- 172.21.15.17:0/4285046172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 msgr2=0x557dce196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 -- 172.21.15.17:0/4285046172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dce15e500 con 0x557dce197240 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.051+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00bcb0 tx=0x7f2efc0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e6727ec3351f49 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.052+0000 7f2ef8ff9640 1 -- 172.21.15.17:0/4285046172 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc004020 con 0x557dce197240 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.052+0000 7f2ef8ff9640 1 -- 172.21.15.17:0/4285046172 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2efc0041c0 con 0x557dce197240 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.052+0000 7f2ef8ff9640 1 -- 172.21.15.17:0/4285046172 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0117b0 con 0x557dce197240 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.052+0000 7f2efb7fe640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 0x7f2ef40a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 0x7f2ef40a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 -- 172.21.15.17:0/4285046172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 msgr2=0x557dce19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00bcb0 tx=0x7f2efc0107a0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2efb7fe640 1 -- 172.21.15.17:0/165343430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f2f000f0a10 con 0x7f2f0c1018d0 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 -- 172.21.15.17:0/4285046172 shutdown_connections 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce19c3b0 0x557dce19e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce197240 0x557dce19bd40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 --2- 172.21.15.17:0/4285046172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f13a29740 1 -- 172.21.15.17:0/4285046172 >> 172.21.15.17:0/4285046172 conn(0x557dce191dc0 msgr2=0x557dce1921c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.053+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 0x7f2ef40a4d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557dce197aa0 tx=0x7f2f04009b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.054+0000 7f2f13a29740 1 -- 172.21.15.17:0/4285046172 shutdown_connections 2024-03-16T10:53:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.054+0000 7f2f13a29740 1 -- 172.21.15.17:0/4285046172 wait complete. 2024-03-16T10:53:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.054+0000 7f2f13a29740 1 -- start start 2024-03-16T10:53:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.054+0000 7f2f13a29740 1 Processor -- start 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce1a1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce19c3b0 0x557dce1a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557dce19f360 con 0x557dce196850 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557dce0b7230 con 0x557dce19c3b0 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.055+0000 7f2f13a29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557dce19f4e0 con 0x557dce197240 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35262/0 (socket says 172.21.15.17:35262) 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 -- 172.21.15.17:0/2320514869 learned_addr learned my addr 172.21.15.17:0/2320514869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce1a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f13a29740 10 client.0 _ll_register_callbacks cb 0x557dce0f3010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce19c3b0 0x557dce1a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 -- 172.21.15.17:0/2320514869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 msgr2=0x557dce1a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce1a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 -- 172.21.15.17:0/2320514869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce19c3b0 msgr2=0x557dce1a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce19c3b0 0x557dce1a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.056+0000 7f2f0a59c640 1 -- 172.21.15.17:0/2320514869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dce0c6100 con 0x557dce196850 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.057+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005890 tx=0x7f2efc00bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d746a97f634f494 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.057+0000 7f2ef1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.057+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0037f0 con 0x557dce196850 2024-03-16T10:53:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.057+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f2efc003990 con 0x557dce196850 2024-03-16T10:53:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.057+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2efc0041c0 con 0x557dce196850 2024-03-16T10:53:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.058+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2efc005040 con 0x557dce196850 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 10 client.16323 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557dcde0f3f0 con 0x557dce196850 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2efc029070 con 0x557dce196850 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f2efc0114b0 con 0x557dce196850 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 10 client.16323 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 10 client.16323 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 20 client.16323 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce1ac910 0x557dce1aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 4 client.16323 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.059+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2efc0041c0 con 0x557dce1ac910 2024-03-16T10:53:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.060+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce1ac910 0x557dce1aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.060+0000 7f2ef1ffb640 10 client.16323 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.060+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce1ac910 0x557dce1aed00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8966e901e0fdb910 server_cookie=8ffc022f93f94f77 in_seq=0 out_seq=0 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/2320514869 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f2efc0041c0 con 0x557dce1ac910 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2ef1ffb640 10 client.16323 handle_command_reply: tid=0 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 client.16323 shutdown 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 msgr2=0x557dce1a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005890 tx=0x7f2efc00bfb0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 shutdown_connections 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce1ac910 0x557dce1aed00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2ef1ffb640 0 client.16323 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce19c3b0 0x557dce1a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce1a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 --2- 172.21.15.17:0/2320514869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a0df0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 >> 172.21.15.17:0/2320514869 conn(0x557dce191dc0 msgr2=0x557dce190fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.062+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 shutdown_connections 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.063+0000 7f2f13a29740 1 -- 172.21.15.17:0/2320514869 wait complete. 2024-03-16T10:53:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.063+0000 7f2f13a29740 20 client.16323 trim_cache size 0 max 16384 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 Processor -- start 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 -- start start 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 0x557dce190750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce190c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00e3f0 con 0x557dce196850 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec010110 con 0x557dce191dc0 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f13a29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00eac0 con 0x557dce197240 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35266/0 (socket says 172.21.15.17:35266) 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f09d9b640 1 -- 172.21.15.17:0/1965013021 learned_addr learned my addr 172.21.15.17:0/1965013021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.088+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 0x557dce190750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce190c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 -- 172.21.15.17:0/1965013021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 msgr2=0x557dce190c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce190c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 -- 172.21.15.17:0/1965013021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 msgr2=0x557dce190750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 0x557dce190750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 -- 172.21.15.17:0/1965013021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dce1af070 con 0x557dce196850 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 0x557dce190750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f0ad9d640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce190c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2f000bd340 tx=0x7f2f0002c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90b99eb4d21801c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2ef3fff640 1 -- 172.21.15.17:0/1965013021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000bd3b0 con 0x557dce196850 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2ef3fff640 1 -- 172.21.15.17:0/1965013021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f000c1500 con 0x557dce196850 2024-03-16T10:53:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.089+0000 7f2ef3fff640 1 -- 172.21.15.17:0/1965013021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00004310 con 0x557dce196850 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- 172.21.15.17:0/1965013021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 msgr2=0x557dce1a8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2f000bd340 tx=0x7f2f0002c6d0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- 172.21.15.17:0/1965013021 shutdown_connections 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce190c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce196850 0x557dce1a8330 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 --2- 172.21.15.17:0/1965013021 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce191dc0 0x557dce190750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- 172.21.15.17:0/1965013021 >> 172.21.15.17:0/1965013021 conn(0x557dce198020 msgr2=0x557dce1921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- 172.21.15.17:0/1965013021 shutdown_connections 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- 172.21.15.17:0/1965013021 wait complete. 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 -- start start 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.090+0000 7f2f13a29740 1 Processor -- start 2024-03-16T10:53:40.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 0x557dce1a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce196850 0x557dce1a5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce210be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00f980 con 0x557dce191dc0 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00f250 con 0x557dce196850 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec00c3d0 con 0x557dce197240 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0ad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce210be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f09d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce196850 0x557dce1a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 0x557dce1a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0ad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce210be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:52878/0 (socket says 172.21.15.17:52878) 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0ad9d640 1 -- 172.21.15.17:0/631547826 learned_addr learned my addr 172.21.15.17:0/631547826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f13a29740 10 client.0 _ll_register_callbacks cb 0x7f2efc00bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 -- 172.21.15.17:0/631547826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 msgr2=0x557dce210be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce210be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 -- 172.21.15.17:0/631547826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce196850 msgr2=0x557dce1a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce196850 0x557dce1a5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 -- 172.21.15.17:0/631547826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dcded97d0 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2f0a59c640 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 0x557dce1a52e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2efc010ca0 tx=0x7f2efc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6212b4b9ef8941 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.091+0000 7f2ef1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc03c020 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f2efc004160 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f000c1500 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2efc0051e0 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 10 client.16329 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557dce212200 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f000c1500 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f2efc004600 con 0x557dce191dc0 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 10 client.16329 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 10 client.16329 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.092+0000 7f2f13a29740 20 client.16329 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce19c3b0 0x557dce214c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 4 client.16329 mds_command: new command op to 14655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 --> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dce1089d0 con 0x557dce19c3b0 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce19c3b0 0x557dce214c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2ef1ffb640 10 client.16329 ms_handle_connect on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f09d9b640 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce19c3b0 0x557dce214c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3f437d7ed2bb07e7 server_cookie=480460f48ee274a5 in_seq=0 out_seq=0 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2ef1ffb640 1 -- 172.21.15.17:0/631547826 <== mds.4 v2:172.21.15.17:6840/2050511049 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7487 (crc 0 0 0) 0x557dce1089d0 con 0x557dce19c3b0 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2ef1ffb640 10 client.16329 handle_command_reply: tid=0 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 1 client.16329 shutdown 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 msgr2=0x557dce1a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.093+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 0x557dce1a52e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2efc010ca0 tx=0x7f2efc011f90 comp rx=0 tx=0).stop 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 shutdown_connections 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:6840/2050511049,v1:172.21.15.17:6841/2050511049] conn(0x557dce19c3b0 0x557dce214c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557dce197240 0x557dce210be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557dce196850 0x557dce1a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 --2- 172.21.15.17:0/631547826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dce191dc0 0x557dce1a52e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 >> 172.21.15.17:0/631547826 conn(0x557dce198020 msgr2=0x557dce195020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2ef1ffb640 0 client.16329 ms_handle_reset on v2:172.21.15.17:6840/2050511049 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 shutdown_connections 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 1 -- 172.21.15.17:0/631547826 wait complete. 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f13a29740 20 client.16329 trim_cache size 0 max 16384 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 51101589, 2024-03-16T10:53:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633481, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c" 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 255632265, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633638, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c" 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 406369041, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633631, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c" 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1219516371, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637017, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns" 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1224568190, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633640, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh" 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1335120836, 2024-03-16T10:53:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633486, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c" 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1513163213, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633634, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c" 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1724070285, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633487, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c" 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.103 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1934037207, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633480, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h" 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2067094647, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633635, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c" 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2154905278, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633639, 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh" 2024-03-16T10:53:40.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2368103681, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633479, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c" 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2457324384, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633476, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c" 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.105 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2528143831, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633483, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c" 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2725510057, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633632, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt" 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2902130109, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633636, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c" 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2989150410, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633484, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c" 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3081558764, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633464, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c" 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3279002965, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633478, 2024-03-16T10:53:40.107 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt" 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3340423072, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633477, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c" 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3471098357, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633630, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh" 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.108 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3524836733, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633633, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh" 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3680926030, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637018, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns" 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3903285642, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633485, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml" 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.109 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4197337155, 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633637, 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml" 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4284225615, 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633482, 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c" 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:40.110 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-16T10:53:40.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 msgr2=0x7f2ef40a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 0x7f2ef40a4d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557dce197aa0 tx=0x7f2f04009b10 comp rx=0 tx=0).stop 2024-03-16T10:53:40.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 msgr2=0x7f2f0c10ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f0002c240 tx=0x7f2f00004e30 comp rx=0 tx=0).stop 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 shutdown_connections 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f2ef40a28b0 0x7f2ef40a4d70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c102290 0x7f2f0c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f0c1018d0 0x7f2f0c10ed00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 --2- 172.21.15.17:0/165343430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f0c1006e0 0x7f2f0c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.094+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 >> 172.21.15.17:0/165343430 conn(0x7f2f0c0fbc70 msgr2=0x7f2f0c102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.095+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 shutdown_connections 2024-03-16T10:53:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.095+0000 7f2f10e36640 1 -- 172.21.15.17:0/165343430 wait complete. 2024-03-16T10:53:40.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 -- 172.21.15.17:0/2869740616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 msgr2=0x7f99c8100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 --2- 172.21.15.17:0/2869740616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8100b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009900 tx=0x7f99bc02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 -- 172.21.15.17:0/2869740616 shutdown_connections 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 --2- 172.21.15.17:0/2869740616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c8108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 --2- 172.21.15.17:0/2869740616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 --2- 172.21.15.17:0/2869740616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8100b00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 -- 172.21.15.17:0/2869740616 >> 172.21.15.17:0/2869740616 conn(0x7f99c80fbc70 msgr2=0x7f99c80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 -- 172.21.15.17:0/2869740616 shutdown_connections 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.232+0000 7f99ced90640 1 -- 172.21.15.17:0/2869740616 wait complete. 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 Processor -- start 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 -- start start 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c81a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99c810b270 con 0x7f99c81006e0 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f99c810b0f0 con 0x7f99c81018d0 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ced90640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99c810b3f0 con 0x7f99c8102290 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35290/0 (socket says 172.21.15.17:35290) 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99ccb2c640 1 -- 172.21.15.17:0/1029967252 learned_addr learned my addr 172.21.15.17:0/1029967252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.233+0000 7f99cd32d640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c81a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 -- 172.21.15.17:0/1029967252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 msgr2=0x7f99c81a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c81a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 -- 172.21.15.17:0/1029967252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 msgr2=0x7f99c819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 -- 172.21.15.17:0/1029967252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c81a1960 con 0x7f99c81006e0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99cd32d640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c81a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc02c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99c5ffb640 1 -- 172.21.15.17:0/1029967252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc041070 con 0x7f99c81006e0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99c5ffb640 1 -- 172.21.15.17:0/1029967252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99bc004450 con 0x7f99c81006e0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81a1bf0 con 0x7f99c81006e0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99c5ffb640 1 -- 172.21.15.17:0/1029967252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc034440 con 0x7f99c81006e0 2024-03-16T10:53:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.234+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c81a2130 con 0x7f99c81006e0 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.237+0000 7f99c5ffb640 1 -- 172.21.15.17:0/1029967252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f99bc044070 con 0x7f99c81006e0 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.237+0000 7f99d197c740 1 Processor -- start 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.237+0000 7f99d197c740 1 -- start start 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.237+0000 7f99c5ffb640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 0x7f99b80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99c5ffb640 1 -- 172.21.15.17:0/1029967252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f99bc0f04b0 con 0x7f99c81006e0 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99cd32d640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 0x7f99b80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe302d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe305840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe262490 con 0x55c9fe2fd850 2024-03-16T10:53:40.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe20ac90 con 0x55c9fe2fe240 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99d197c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe25e530 con 0x55c9fe3033b0 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35298/0 (socket says 172.21.15.17:35298) 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 -- 172.21.15.17:0/2205155629 learned_addr learned my addr 172.21.15.17:0/2205155629 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99c7fff640 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe302d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99cd32d640 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe305840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 -- 172.21.15.17:0/2205155629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 msgr2=0x55c9fe305840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe305840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 -- 172.21.15.17:0/2205155629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 msgr2=0x55c9fe302d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe302d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99ccb2c640 1 -- 172.21.15.17:0/2205155629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9fe2c5500 con 0x55c9fe2fd850 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.238+0000 7f99cd32d640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 0x7f99b80a4d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99c0005fd0 tx=0x7f99c0011bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.239+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c5160 tx=0x7f99bc005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff7ae359bbe7077 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.239+0000 7f99b2ffd640 1 -- 172.21.15.17:0/2205155629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc04b040 con 0x55c9fe2fd850 2024-03-16T10:53:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.239+0000 7f99b2ffd640 1 -- 172.21.15.17:0/2205155629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99bc004c80 con 0x55c9fe2fd850 2024-03-16T10:53:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.239+0000 7f99b2ffd640 1 -- 172.21.15.17:0/2205155629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0b9610 con 0x55c9fe2fd850 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- 172.21.15.17:0/2205155629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 msgr2=0x55c9fe2fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0c5160 tx=0x7f99bc005e50 comp rx=0 tx=0).stop 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- 172.21.15.17:0/2205155629 shutdown_connections 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe305840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe302d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 --2- 172.21.15.17:0/2205155629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe2fdc70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- 172.21.15.17:0/2205155629 >> 172.21.15.17:0/2205155629 conn(0x55c9fe2f8dc0 msgr2=0x55c9fe2f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- 172.21.15.17:0/2205155629 shutdown_connections 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- 172.21.15.17:0/2205155629 wait complete. 2024-03-16T10:53:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 -- start start 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.240+0000 7f99d197c740 1 Processor -- start 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe30f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48736/0 (socket says 172.21.15.17:48736) 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:52912/0 (socket says 172.21.15.17:52912) 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe306120 con 0x55c9fe3033b0 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe21e230 con 0x55c9fe2fd850 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c9fe3062a0 con 0x55c9fe2fe240 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99cd32d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe30f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99ccb2c640 1 -- 172.21.15.17:0/2687573432 learned_addr learned my addr 172.21.15.17:0/2687573432 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.241+0000 7f99d197c740 10 client.0 _ll_register_callbacks cb 0x55c9fe25a010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 -- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 msgr2=0x55c9fe307b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 -- 172.21.15.17:0/2687573432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 msgr2=0x55c9fe30f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe30f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 -- 172.21.15.17:0/2687573432 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9fe22d100 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99cd32d640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe30f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99c7fff640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55c9fe2fe640 tx=0x7f99b4012d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb73a75bde154210 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004050 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f99b40041f0 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99bc004c80 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f99b40043f0 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99d197c740 10 client.26152 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c9fdf763f0 con 0x55c9fe2fe240 2024-03-16T10:53:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.242+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b400fd70 con 0x55c9fe2fe240 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f99b4003cc0 con 0x55c9fe2fe240 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 10 client.26152 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 10 client.26152 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 20 client.26152 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe3139d0 0x55c9fe315df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 4 client.26152 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f99bc004c80 con 0x55c9fe3139d0 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe3139d0 0x55c9fe315df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99a7fff640 10 client.26152 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.243+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe3139d0 0x55c9fe315df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=79a243453155c79a server_cookie=b4c4d3b4f96203 in_seq=0 out_seq=0 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99a7fff640 1 -- 172.21.15.17:0/2687573432 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f99bc004c80 con 0x55c9fe3139d0 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99a7fff640 10 client.26152 handle_command_reply: tid=0 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 client.26152 shutdown 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 msgr2=0x55c9fe308050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55c9fe2fe640 tx=0x7f99b4012d90 comp rx=0 tx=0).stop 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 shutdown_connections 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe3139d0 0x55c9fe315df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe30f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fe240 0x55c9fe308050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99a7fff640 0 client.26152 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 --2- 172.21.15.17:0/2687573432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fd850 0x55c9fe307b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 >> 172.21.15.17:0/2687573432 conn(0x55c9fe2f8dc0 msgr2=0x55c9fe2f7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 shutdown_connections 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 1 -- 172.21.15.17:0/2687573432 wait complete. 2024-03-16T10:53:40.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.244+0000 7f99d197c740 20 client.26152 trim_cache size 0 max 16384 2024-03-16T10:53:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 Processor -- start 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 -- start start 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fd850 0x55c9fe2ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe2ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81aae70 con 0x55c9fe3033b0 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81acb90 con 0x55c9fe2fe240 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99d197c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81ab540 con 0x55c9fe2fd850 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99cd32d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe2ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99c7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48746/0 (socket says 172.21.15.17:48746) 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fd850 0x55c9fe2ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99c7fff640 1 -- 172.21.15.17:0/1546046438 learned_addr learned my addr 172.21.15.17:0/1546046438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.265+0000 7f99cd32d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe2ffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35306/0 (socket says 172.21.15.17:35306) 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 -- 172.21.15.17:0/1546046438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fd850 msgr2=0x55c9fe2ff7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fd850 0x55c9fe2ff7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 -- 172.21.15.17:0/1546046438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 msgr2=0x55c9fe2ffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe2ffce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 -- 172.21.15.17:0/1546046438 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9fe0407d0 con 0x55c9fe2fe240 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99c7fff640 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001eb0 tx=0x7f99b40059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42dd96eab84ab61 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99b27fc640 1 -- 172.21.15.17:0/1546046438 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4010b70 con 0x55c9fe2fe240 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99b27fc640 1 -- 172.21.15.17:0/1546046438 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b4010d10 con 0x55c9fe2fe240 2024-03-16T10:53:40.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.266+0000 7f99b27fc640 1 -- 172.21.15.17:0/1546046438 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40056a0 con 0x55c9fe2fe240 2024-03-16T10:53:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- 172.21.15.17:0/1546046438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 msgr2=0x55c9fe30f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99b4001eb0 tx=0x7f99b40059b0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- 172.21.15.17:0/1546046438 shutdown_connections 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe3033b0 0x55c9fe2ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30f050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 --2- 172.21.15.17:0/1546046438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe2fd850 0x55c9fe2ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- 172.21.15.17:0/1546046438 >> 172.21.15.17:0/1546046438 conn(0x55c9fe2f8dc0 msgr2=0x55c9fe2f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- 172.21.15.17:0/1546046438 shutdown_connections 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- 172.21.15.17:0/1546046438 wait complete. 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 -- start start 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.267+0000 7f99d197c740 1 Processor -- start 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe30be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99ccb2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35308/0 (socket says 172.21.15.17:35308) 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81ac400 con 0x55c9fe2fd850 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99ccb2c640 1 -- 172.21.15.17:0/719404784 learned_addr learned my addr 172.21.15.17:0/719404784 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81abcd0 con 0x55c9fe2fe240 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81a8e50 con 0x55c9fe3033b0 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99c7fff640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99cd32d640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe30be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.268+0000 7f99d197c740 10 client.0 _ll_register_callbacks cb 0x7f99b4009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 -- 172.21.15.17:0/719404784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 msgr2=0x55c9fe30be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe30be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 -- 172.21.15.17:0/719404784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 msgr2=0x55c9fe30ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9fe30c480 con 0x55c9fe2fe240 2024-03-16T10:53:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99c7fff640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30b8d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f99b4010500 tx=0x7f99b400fa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ea5926b562251 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4010b70 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b4010d10 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f99b4004590 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f99b4004790 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99d197c740 10 client.26204 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c9fe378d80 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.269+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b4010d10 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f99b4027460 con 0x55c9fe2fe240 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 10 client.26204 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 10 client.26204 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 20 client.26204 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe379710 0x55c9fe37bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 4 client.26204 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 --> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9fe26f9d0 con 0x55c9fe379710 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe379710 0x55c9fe37bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99a7fff640 10 client.26204 ms_handle_connect on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.270+0000 7f99ccb2c640 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe379710 0x55c9fe37bb30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7fc9effe46306664 server_cookie=c18ddeb20bfacc7b in_seq=0 out_seq=0 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99a7fff640 1 -- 172.21.15.17:0/719404784 <== mds.3 v2:172.21.15.111:6834/3904744326 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6419 (crc 0 0 0) 0x55c9fe26f9d0 con 0x55c9fe379710 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99a7fff640 10 client.26204 handle_command_reply: tid=0 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 client.26204 shutdown 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 msgr2=0x55c9fe30b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30b8d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f99b4010500 tx=0x7f99b400fa40 comp rx=0 tx=0).stop 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 shutdown_connections 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:6834/3904744326,v1:172.21.15.111:6835/3904744326] conn(0x55c9fe379710 0x55c9fe37bb30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c9fe3033b0 0x55c9fe30be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c9fe2fe240 0x55c9fe30b8d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99a7fff640 0 client.26204 ms_handle_reset on v2:172.21.15.111:6834/3904744326 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 --2- 172.21.15.17:0/719404784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9fe2fd850 0x55c9fe30ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 >> 172.21.15.17:0/719404784 conn(0x55c9fe2f8dc0 msgr2=0x55c9fe307b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 shutdown_connections 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 1 -- 172.21.15.17:0/719404784 wait complete. 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.271+0000 7f99d197c740 20 client.26204 trim_cache size 0 max 16384 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 21526703, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633673, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh" 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 92608124, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632119, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl" 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 414184873, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511631933, 2024-03-16T10:53:40.278 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc" 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 521260192, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633671, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c" 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 613949761, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633669, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c" 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 668974752, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632268, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in" 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 725709094, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511631837, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog" 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1236744963, 2024-03-16T10:53:40.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633370, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml" 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1266972286, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633367, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c" 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1268980766, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632263, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs" 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.281 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1351791656, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633674, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh" 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1607248233, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632230, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas" 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2212278916, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633670, 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c" 2024-03-16T10:53:40.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2490645071, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632062, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap" 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2764667447, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511631842, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect" 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.283 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2795204625, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632139, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator" 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2795639302, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633368, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt" 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2863113169, 2024-03-16T10:53:40.284 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511632269, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am" 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2864409729, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633667, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt" 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3315500338, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511631803, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi" 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.285 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3419149690, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633672, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml" 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3899976564, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633369, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c" 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.286 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3939129138, 2024-03-16T10:53:40.287 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633668, 2024-03-16T10:53:40.287 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c" 2024-03-16T10:53:40.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:40.287 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-16T10:53:40.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 msgr2=0x7f99b80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 0x7f99b80a4d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99c0005fd0 tx=0x7f99c0011bd0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 msgr2=0x7f99c8199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f99bc000c00 tx=0x7f99bc02c640 comp rx=0 tx=0).stop 2024-03-16T10:53:40.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 shutdown_connections 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f99b80a2880 0x7f99b80a4d40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99c8102290 0x7f99c81a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99c81018d0 0x7f99c819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 --2- 172.21.15.17:0/1029967252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c81006e0 0x7f99c8199d50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 >> 172.21.15.17:0/1029967252 conn(0x7f99c80fbc70 msgr2=0x7f99c8104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 shutdown_connections 2024-03-16T10:53:40.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.272+0000 7f99ced90640 1 -- 172.21.15.17:0/1029967252 wait complete. 2024-03-16T10:53:40.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 -- 172.21.15.17:0/622728390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8107560 msgr2=0x7ff1c8109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/622728390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8107560 0x7ff1c8109950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009ca0 tx=0x7ff1c002c0f0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 -- 172.21.15.17:0/622728390 shutdown_connections 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/622728390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8107560 0x7ff1c8109950 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/622728390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8104c30 0x7ff1c8107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/622728390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8102300 0x7ff1c81046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 -- 172.21.15.17:0/622728390 >> 172.21.15.17:0/622728390 conn(0x7ff1c80fbc70 msgr2=0x7ff1c80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 -- 172.21.15.17:0/622728390 shutdown_connections 2024-03-16T10:53:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.406+0000 7ff1ce11b640 1 -- 172.21.15.17:0/622728390 wait complete. 2024-03-16T10:53:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 Processor -- start 2024-03-16T10:53:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 -- start start 2024-03-16T10:53:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8104c30 0x7ff1c8198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8107560 0x7ff1c819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c810d460 con 0x7ff1c8102300 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c810d2e0 con 0x7ff1c8107560 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1ce11b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c810d5e0 con 0x7ff1c8104c30 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35330/0 (socket says 172.21.15.17:35330) 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2694520027 learned_addr learned my addr 172.21.15.17:0/2694520027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8104c30 0x7ff1c8198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8107560 0x7ff1c819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2694520027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8104c30 msgr2=0x7ff1c8198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8104c30 0x7ff1c8198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2694520027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8107560 msgr2=0x7ff1c819f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8107560 0x7ff1c819f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.407+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2694520027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c819f720 con 0x7ff1c8102300 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800d950 tx=0x7ff1b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1c4ff9640 1 -- 172.21.15.17:0/2694520027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8017070 con 0x7ff1c8102300 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1c4ff9640 1 -- 172.21.15.17:0/2694520027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8009c30 con 0x7ff1c8102300 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c8100150 con 0x7ff1c8102300 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1c4ff9640 1 -- 172.21.15.17:0/2694520027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800f6b0 con 0x7ff1c8102300 2024-03-16T10:53:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.408+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c81006a0 con 0x7ff1c8102300 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.410+0000 7ff1c4ff9640 1 -- 172.21.15.17:0/2694520027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7ff1b80109d0 con 0x7ff1c8102300 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 Processor -- start 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 -- start start 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1c4ff9640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 0x7ff1b00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c89707d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c8970a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560c89667490 con 0x560c89703240 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560c8960fc90 con 0x560c89702850 2024-03-16T10:53:40.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.411+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560c89663530 con 0x560c897083b0 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c89707d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 0x7ff1b00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48796/0 (socket says 172.21.15.17:48796) 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2098881607 learned_addr learned my addr 172.21.15.17:0/2098881607 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c8970a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c4ff9640 1 -- 172.21.15.17:0/2694520027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff1b80ce5c0 con 0x7ff1c8102300 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2098881607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 msgr2=0x560c8970a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c8970a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2098881607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 msgr2=0x560c89707d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c89707d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 -- 172.21.15.17:0/2098881607 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c896ca500 con 0x560c89702850 2024-03-16T10:53:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff1b809b040 tx=0x7ff1b809ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6892664d2839c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 0x7ff1b00a4cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0005e30 tx=0x7ff1c002e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1adffb640 1 -- 172.21.15.17:0/2098881607 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8020070 con 0x560c89702850 2024-03-16T10:53:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1adffb640 1 -- 172.21.15.17:0/2098881607 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8009de0 con 0x560c89702850 2024-03-16T10:53:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.412+0000 7ff1adffb640 1 -- 172.21.15.17:0/2098881607 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80993b0 con 0x560c89702850 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 -- 172.21.15.17:0/2098881607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 msgr2=0x560c89702c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff1b809b040 tx=0x7ff1b809ad20 comp rx=0 tx=0).stop 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 -- 172.21.15.17:0/2098881607 shutdown_connections 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c8970a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c89707d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/2098881607 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c89702c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 -- 172.21.15.17:0/2098881607 >> 172.21.15.17:0/2098881607 conn(0x560c896fddc0 msgr2=0x560c896fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 -- 172.21.15.17:0/2098881607 shutdown_connections 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.413+0000 7ff1d0de6740 1 -- 172.21.15.17:0/2098881607 wait complete. 2024-03-16T10:53:40.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 -- start start 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 Processor -- start 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c8970d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c89714290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560c8970b2a0 con 0x560c89703240 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x560c89623230 con 0x560c89702850 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560c8970b420 con 0x560c897083b0 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1d0de6740 10 client.0 _ll_register_callbacks cb 0x560c8965f010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c8970d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48800/0 (socket says 172.21.15.17:48800) 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1373633925 learned_addr learned my addr 172.21.15.17:0/1373633925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.414+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c89714290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 msgr2=0x560c89714290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c89714290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1373633925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 msgr2=0x560c8970d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c8970d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1373633925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c89632100 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c8970d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a3270 tx=0x7ff1b8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470cc8fa948b9763 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8020050 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b8009de0 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff1b80ad570 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff1b809b0b0 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1d0de6740 10 client.26216 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.415+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560c8937b3f0 con 0x560c89702850 2024-03-16T10:53:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8009de0 con 0x560c89702850 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7ff1b80b9b00 con 0x560c89702850 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 10 client.26216 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 10 client.26216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 20 client.26216 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c8971ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 4 client.26216 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c896749d0 con 0x560c897187a0 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c8971ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1a6ffd640 10 client.26216 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.416+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c8971ab90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1421b37390925030 server_cookie=20377ce5b4f42f2f in_seq=0 out_seq=0 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/1373633925 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x560c896749d0 con 0x560c897187a0 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1a6ffd640 10 client.26216 handle_command_reply: tid=0 2024-03-16T10:53:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 client.26216 shutdown 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 msgr2=0x560c8970cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a3270 tx=0x7ff1b8000bc0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 shutdown_connections 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c8971ab90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1a6ffd640 0 client.26216 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c897083b0 0x560c89714290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c89703240 0x560c8970d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1373633925 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c8970cd50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 >> 172.21.15.17:0/1373633925 conn(0x560c896fddc0 msgr2=0x560c896fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.417+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 shutdown_connections 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.418+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1373633925 wait complete. 2024-03-16T10:53:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.418+0000 7ff1d0de6740 20 client.26216 trim_cache size 0 max 16384 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 Processor -- start 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 -- start start 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89703240 0x560c89714250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a69e0 con 0x560c897083b0 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a8700 con 0x560c89702850 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a70b0 con 0x560c89703240 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48808/0 (socket says 172.21.15.17:48808) 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35358/0 (socket says 172.21.15.17:35358) 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1459621810 learned_addr learned my addr 172.21.15.17:0/1459621810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.433+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89703240 0x560c89714250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1459621810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89703240 msgr2=0x560c89714250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89703240 0x560c89714250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1459621810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 msgr2=0x560c896fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 -- 172.21.15.17:0/1459621810 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c894457d0 con 0x560c89702850 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8099360 tx=0x7ff1b80a80d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c89da43f28a1157b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1ad7fa640 1 -- 172.21.15.17:0/1459621810 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8020070 con 0x560c89702850 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1ad7fa640 1 -- 172.21.15.17:0/1459621810 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8009de0 con 0x560c89702850 2024-03-16T10:53:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.434+0000 7ff1ad7fa640 1 -- 172.21.15.17:0/1459621810 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b809a500 con 0x560c89702850 2024-03-16T10:53:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1459621810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 msgr2=0x560c896fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8099360 tx=0x7ff1b80a80d0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1459621810 shutdown_connections 2024-03-16T10:53:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c896fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89703240 0x560c89714250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/1459621810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89702850 0x560c896fc750 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1459621810 >> 172.21.15.17:0/1459621810 conn(0x560c896fddc0 msgr2=0x560c897047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1459621810 shutdown_connections 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- 172.21.15.17:0/1459621810 wait complete. 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.435+0000 7ff1d0de6740 1 -- start start 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 Processor -- start 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89702850 0x560c89710e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a7f70 con 0x560c897083b0 2024-03-16T10:53:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a7840 con 0x560c89703240 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c81a49e0 con 0x560c89702850 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1d0de6740 10 client.0 _ll_register_callbacks cb 0x7ff1bc0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48824/0 (socket says 172.21.15.17:48824) 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35366/0 (socket says 172.21.15.17:35366) 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c6ffd640 1 -- 172.21.15.17:0/3257167760 learned_addr learned my addr 172.21.15.17:0/3257167760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.436+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89702850 0x560c89710e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 -- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89702850 msgr2=0x560c89710e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89702850 0x560c89710e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 -- 172.21.15.17:0/3257167760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 msgr2=0x560c8977ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 -- 172.21.15.17:0/3257167760 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c897144a0 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c7fff640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1c6ffd640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc004700 tx=0x7ff1bc012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e3fe15c6ec9daeb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0223d0 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff1bc022570 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b8009de0 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff1bc022770 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1d0de6740 10 client.26222 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560c8977e010 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.437+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8009de0 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7ff1bc010640 con 0x560c89703240 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 10 client.26222 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 10 client.26222 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 20 client.26222 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c89780ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 4 client.26222 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 --> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c8966ed20 con 0x560c897187a0 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c89780ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1a6ffd640 10 client.26222 ms_handle_connect on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.438+0000 7ff1c77fe640 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c89780ae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ffb7a894e68277b server_cookie=4f1dbd73168bf3fe in_seq=0 out_seq=0 2024-03-16T10:53:40.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.440+0000 7ff1a6ffd640 1 -- 172.21.15.17:0/3257167760 <== mds.2 v2:172.21.15.174:6838/2355684811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+49965 (crc 0 0 0) 0x560c8966ed20 con 0x560c897187a0 2024-03-16T10:53:40.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.440+0000 7ff1a6ffd640 10 client.26222 handle_command_reply: tid=0 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.440+0000 7ff1d0de6740 1 client.26222 shutdown 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 msgr2=0x560c897113d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc004700 tx=0x7ff1bc012b00 comp rx=0 tx=0).stop 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 shutdown_connections 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560c897083b0 0x560c8977ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x560c89703240 0x560c897113d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:6838/2355684811,v1:172.21.15.174:6839/2355684811] conn(0x560c897187a0 0x560c89780ae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 --2- 172.21.15.17:0/3257167760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c89702850 0x560c89710e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1a6ffd640 0 client.26222 ms_handle_reset on v2:172.21.15.174:6838/2355684811 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 >> 172.21.15.17:0/3257167760 conn(0x560c896fddc0 msgr2=0x560c89701020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 shutdown_connections 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 1 -- 172.21.15.17:0/3257167760 wait complete. 2024-03-16T10:53:40.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1d0de6740 20 client.26222 trim_cache size 0 max 16384 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 20565218, 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633797, 2024-03-16T10:53:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c" 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 52161196, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633767, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c" 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 81361069, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633807, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c" 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 86004309, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633744, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c" 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 91908927, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633748, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c" 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 115160941, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633867, 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c" 2024-03-16T10:53:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 165985887, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633759, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c" 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 214167512, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633708, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c" 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 216997907, 2024-03-16T10:53:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633712, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c" 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 222814055, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633841, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c" 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 246046708, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633726, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in" 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 255822126, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633775, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c" 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 258691499, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633720, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in" 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 281991470, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633834, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c" 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 311833187, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633719, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in" 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 323035859, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633768, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c" 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 349212254, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633859, 2024-03-16T10:53:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c" 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 367443007, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633769, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c" 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 394442849, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633856, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c" 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 438159772, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633851, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c" 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 501139499, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633710, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c" 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 519818694, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633742, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c" 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 544157178, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633874, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c" 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 612288175, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633778, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c" 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 632365513, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633872, 2024-03-16T10:53:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c" 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 651145901, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633812, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c" 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 689037939, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633752, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c" 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 730208581, 2024-03-16T10:53:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633853, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c" 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 791702985, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633855, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c" 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 793390233, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633750, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c" 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 806245942, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633776, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c" 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 806953807, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633791, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c" 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 818561192, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633715, 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c" 2024-03-16T10:53:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 821459749, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633733, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in" 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 825472767, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633814, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c" 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 845532627, 2024-03-16T10:53:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633842, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c" 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 861562189, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633746, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c" 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 868059183, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633850, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c" 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 933495426, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633862, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c" 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 952973717, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633771, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c" 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 979797062, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633751, 2024-03-16T10:53:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c" 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1031393356, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633833, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c" 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1058929243, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633848, 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c" 2024-03-16T10:53:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1063712573, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633835, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c" 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1065561000, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633801, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c" 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1097703569, 2024-03-16T10:53:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633772, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c" 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1099583094, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633755, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c" 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1106653105, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633785, 2024-03-16T10:53:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c" 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1128155589, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633782, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c" 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1184771510, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633845, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c" 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1210404043, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633730, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in" 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1225137959, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633829, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c" 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1230319211, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633821, 2024-03-16T10:53:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl" 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1232160460, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633764, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c" 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1269513852, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633704, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c" 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1304601350, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633760, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c" 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1321104765, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633822, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c" 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1325591180, 2024-03-16T10:53:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633793, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c" 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1362916076, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633786, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c" 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1368406470, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633865, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c" 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1384654740, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633749, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c" 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1432797225, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633830, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c" 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1434365939, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633796, 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c" 2024-03-16T10:53:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1455518271, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633711, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c" 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1479851382, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633798, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c" 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1518923065, 2024-03-16T10:53:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633729, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in" 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1519488320, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633869, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c" 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1520803237, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633826, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c" 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1596998050, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633823, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c" 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1606802029, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633773, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c" 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1609868586, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633819, 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c" 2024-03-16T10:53:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1658428503, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633732, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in" 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1728734846, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633837, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c" 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1750780231, 2024-03-16T10:53:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633813, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c" 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1759421214, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633743, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c" 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1774459549, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633858, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c" 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1825391763, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633866, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c" 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1833335524, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633795, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c" 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1901242492, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633864, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c" 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2035899848, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633721, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in" 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2044711096, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633780, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c" 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2087182510, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633728, 2024-03-16T10:53:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in" 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2122804958, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633703, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c" 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2130632407, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633713, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c" 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2158295485, 2024-03-16T10:53:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633846, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c" 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2169279420, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633779, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c" 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2173203956, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633763, 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c" 2024-03-16T10:53:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2221284324, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633854, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c" 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2229142244, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633753, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c" 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2238130953, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633838, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c" 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2254062703, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633781, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c" 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2263500788, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633774, 2024-03-16T10:53:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c" 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2308839163, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633707, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c" 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2317400750, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633836, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c" 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2321991891, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633870, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt" 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2343263373, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633783, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c" 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2348378661, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633840, 2024-03-16T10:53:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c" 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2364043235, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633802, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c" 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2368174808, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633873, 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c" 2024-03-16T10:53:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2404528363, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633805, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c" 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2421256089, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633716, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c" 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2437704017, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633809, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c" 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2441043849, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633717, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c" 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2487221572, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633860, 2024-03-16T10:53:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c" 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2531451181, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633815, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c" 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2579867504, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633723, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in" 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2583762455, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633705, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c" 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2597897142, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633734, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in" 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2599738548, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633745, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c" 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2647670399, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633827, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c" 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2663114552, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633852, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c" 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2664451469, 2024-03-16T10:53:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633765, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c" 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2683898274, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633808, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c" 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2692296284, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633818, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c" 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2703599744, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633816, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c" 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2729152886, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633737, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in" 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2736423867, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633739, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c" 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2748070418, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633770, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c" 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2774709255, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633735, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in" 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2849239389, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633731, 2024-03-16T10:53:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in" 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2913100447, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633766, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c" 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2989413859, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633727, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in" 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2991719971, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633804, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c" 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2996711075, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633740, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c" 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3067961446, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633714, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c" 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3111814787, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633843, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c" 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3131457258, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633832, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c" 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3138067419, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633738, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in" 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3169977404, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633824, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c" 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3197459250, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633811, 2024-03-16T10:53:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c" 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3201632472, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633839, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c" 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3252898899, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633747, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c" 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3256959525, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633787, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c" 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3262796050, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633844, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c" 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3341216531, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633817, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c" 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3380834383, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633863, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c" 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3464462489, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633857, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c" 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3473602469, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633861, 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c" 2024-03-16T10:53:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3474510108, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633800, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c" 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3483829674, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633718, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates" 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3587996914, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633788, 2024-03-16T10:53:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c" 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3602197767, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633831, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c" 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3610204932, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633758, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c" 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3612943033, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633777, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c" 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3620620494, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633847, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c" 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3629244340, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633757, 2024-03-16T10:53:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c" 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3645499809, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633794, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c" 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3668893937, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633799, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c" 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3696759716, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633724, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in" 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3703232861, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633741, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c" 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3718093460, 2024-03-16T10:53:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633756, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c" 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3732989814, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633820, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c" 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3760056071, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633810, 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c" 2024-03-16T10:53:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3760657985, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633868, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c" 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3806856156, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633806, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c" 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3820439817, 2024-03-16T10:53:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633762, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c" 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3837663686, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633784, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c" 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3880431858, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633790, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c" 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3896200545, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633725, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in" 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3906599448, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633736, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in" 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3916495099, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633792, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c" 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3919233273, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633761, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c" 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3997017895, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633825, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c" 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4041060153, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633722, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in" 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4043261717, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633754, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c" 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4062511145, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633849, 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c" 2024-03-16T10:53:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4088252088, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633448, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c" 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4125351868, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633789, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c" 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4146420557, 2024-03-16T10:53:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633871, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c" 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4156330060, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633828, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c" 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4221317800, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633706, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c" 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4273382325, 2024-03-16T10:53:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633709, 2024-03-16T10:53:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c" 2024-03-16T10:53:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:40.514 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 msgr2=0x7ff1b00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 0x7ff1b00a4cc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0005e30 tx=0x7ff1c002e040 comp rx=0 tx=0).stop 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 msgr2=0x7ff1c8197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.441+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800d950 tx=0x7ff1b800de10 comp rx=0 tx=0).stop 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 shutdown_connections 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff1b00a2800 0x7ff1b00a4cc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1c8107560 0x7ff1c819f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1c8104c30 0x7ff1c8198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 --2- 172.21.15.17:0/2694520027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c8102300 0x7ff1c8197b00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 >> 172.21.15.17:0/2694520027 conn(0x7ff1c80fbc70 msgr2=0x7ff1c8102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 shutdown_connections 2024-03-16T10:53:40.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.442+0000 7ff1ce11b640 1 -- 172.21.15.17:0/2694520027 wait complete. 2024-03-16T10:53:40.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-16T10:53:40.541 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:40 smithi017 ceph-mon[32078]: pgmap v436: 97 pgs: 97 active+clean; 1.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 104 MiB/s wr, 574 op/s 2024-03-16T10:53:40.542 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:40 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1787409865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 -- 172.21.15.17:0/1757215999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01018d0 msgr2=0x7f76f0101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 --2- 172.21.15.17:0/1757215999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01018d0 0x7f76f0101d50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009900 tx=0x7f76e002bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 -- 172.21.15.17:0/1757215999 shutdown_connections 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 --2- 172.21.15.17:0/1757215999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 0x7f76f0108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 --2- 172.21.15.17:0/1757215999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01018d0 0x7f76f0101d50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 --2- 172.21.15.17:0/1757215999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01006e0 0x7f76f0100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.630+0000 7f76f85d3640 1 -- 172.21.15.17:0/1757215999 >> 172.21.15.17:0/1757215999 conn(0x7f76f00fbc70 msgr2=0x7f76f00fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- 172.21.15.17:0/1757215999 shutdown_connections 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- 172.21.15.17:0/1757215999 wait complete. 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 Processor -- start 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- start start 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 0x7f76f0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 0x7f76f01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f010c340 con 0x7f76f01006e0 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f76f010c1c0 con 0x7f76f01018d0 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f85d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f76f010c4c0 con 0x7f76f0102290 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.631+0000 7f76f636f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f636f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35384/0 (socket says 172.21.15.17:35384) 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 0x7f76f0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f636f640 1 -- 172.21.15.17:0/2039245157 learned_addr learned my addr 172.21.15.17:0/2039245157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f6b70640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 0x7f76f01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 -- 172.21.15.17:0/2039245157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 msgr2=0x7f76f01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 0x7f76f01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 -- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 msgr2=0x7f76f0104670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 -- 172.21.15.17:0/2039245157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f0103a80 con 0x7f76f01018d0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f636f640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 0x7f76f0102cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009230 tx=0x7f76e002c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76e77fe640 1 -- 172.21.15.17:0/2039245157 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0041070 con 0x7f76f01018d0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f01a1bd0 con 0x7f76f01018d0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76e77fe640 1 -- 172.21.15.17:0/2039245157 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e0004450 con 0x7f76f01018d0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76e77fe640 1 -- 172.21.15.17:0/2039245157 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0003df0 con 0x7f76f01018d0 2024-03-16T10:53:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.632+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f01a2170 con 0x7f76f01018d0 2024-03-16T10:53:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.635+0000 7f76e77fe640 1 -- 172.21.15.17:0/2039245157 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f76e0044070 con 0x7f76f01018d0 2024-03-16T10:53:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 Processor -- start 2024-03-16T10:53:40.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 -- start start 2024-03-16T10:53:40.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663546240 0x55c66354ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66354d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6634aa490 con 0x55c663546240 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c663452c90 con 0x55c66354b3b0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c6634a6530 con 0x55c663545850 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.636+0000 7f76e77fe640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 0x7f76dc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f636f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663546240 0x55c66354ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53050/0 (socket says 172.21.15.17:53050) 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 -- 172.21.15.17:0/1274463872 learned_addr learned my addr 172.21.15.17:0/1274463872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66354d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 0x7f76dc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76e77fe640 1 -- 172.21.15.17:0/2039245157 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f76e00f0410 con 0x7f76f01018d0 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 -- 172.21.15.17:0/1274463872 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 msgr2=0x55c66354d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66354d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 -- 172.21.15.17:0/1274463872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663546240 msgr2=0x55c66354ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663546240 0x55c66354ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 -- 172.21.15.17:0/1274463872 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66350d500 con 0x55c663545850 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011e00 tx=0x7f76e800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f7e421bd69274b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.637+0000 7f76f6b70640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 0x7f76dc0a4cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76e800fc90 tx=0x7f76e8018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.638+0000 7f76e4bfe640 1 -- 172.21.15.17:0/1274463872 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8022070 con 0x55c663545850 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.638+0000 7f76e4bfe640 1 -- 172.21.15.17:0/1274463872 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e800ec50 con 0x55c663545850 2024-03-16T10:53:40.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.638+0000 7f76e4bfe640 1 -- 172.21.15.17:0/1274463872 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8005780 con 0x55c663545850 2024-03-16T10:53:40.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.638+0000 7f76fb1b7740 1 -- 172.21.15.17:0/1274463872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 msgr2=0x55c663545c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.638+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011e00 tx=0x7f76e800f790 comp rx=0 tx=0).stop 2024-03-16T10:53:40.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- 172.21.15.17:0/1274463872 shutdown_connections 2024-03-16T10:53:40.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66354d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663546240 0x55c66354ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/1274463872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663545c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- 172.21.15.17:0/1274463872 >> 172.21.15.17:0/1274463872 conn(0x55c663540dc0 msgr2=0x55c6635411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- 172.21.15.17:0/1274463872 shutdown_connections 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- 172.21.15.17:0/1274463872 wait complete. 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- start start 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 Processor -- start 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 0x55c66354fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c66354e300 con 0x55c66354b3b0 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c663466230 con 0x55c663545850 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c66354e480 con 0x55c663546240 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76fb1b7740 10 client.0 _ll_register_callbacks cb 0x55c6634a2010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76f6b70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.639+0000 7f76f636f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 0x55c66354fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f636f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 0x55c66354fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48858/0 (socket says 172.21.15.17:48858) 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f6b70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35404/0 (socket says 172.21.15.17:35404) 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f636f640 1 -- 172.21.15.17:0/873203006 learned_addr learned my addr 172.21.15.17:0/873203006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53066/0 (socket says 172.21.15.17:53066) 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 -- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 msgr2=0x55c66354fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 0x55c66354fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 -- 172.21.15.17:0/873203006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 msgr2=0x55c663557380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 -- 172.21.15.17:0/873203006 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c663475100 con 0x55c663546240 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f6b70640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76e00edfe0 tx=0x7f76e0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851f8ecb21337bc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e004b040 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f76e00c5140 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e800ec50 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.640+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f76e00bc840 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 10 client.26188 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c6631be3f0 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e800ec50 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f76e00bc330 con 0x55c663546240 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 10 client.26188 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 10 client.26188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 20 client.26188 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c66355bcd0 0x55c66355e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 4 client.26188 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6634b79d0 con 0x55c66355bcd0 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.641+0000 7f76f636f640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c66355bcd0 0x55c66355e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76d9ffb640 10 client.26188 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76f636f640 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c66355bcd0 0x55c66355e110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=149ca1519bd3acda server_cookie=da5e5be1684e642a in_seq=0 out_seq=0 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76d9ffb640 1 -- 172.21.15.17:0/873203006 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c6634b79d0 con 0x55c66355bcd0 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76d9ffb640 10 client.26188 handle_command_reply: tid=0 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76fb1b7740 1 client.26188 shutdown 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 msgr2=0x55c663550340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.642+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76e00edfe0 tx=0x7f76e0009260 comp rx=0 tx=0).stop 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 shutdown_connections 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c663557380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663550340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c66355bcd0 0x55c66355e110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/873203006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663545850 0x55c66354fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 >> 172.21.15.17:0/873203006 conn(0x55c663540dc0 msgr2=0x55c66353ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76d9ffb640 0 client.26188 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:40.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 shutdown_connections 2024-03-16T10:53:40.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 1 -- 172.21.15.17:0/873203006 wait complete. 2024-03-16T10:53:40.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.643+0000 7f76fb1b7740 20 client.26188 trim_cache size 0 max 16384 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 Processor -- start 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 -- start start 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663557340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66353fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01aad50 con 0x55c663545850 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01aca70 con 0x55c66354b3b0 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01ab420 con 0x55c663546240 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76f636f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76f636f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35418/0 (socket says 172.21.15.17:35418) 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76f636f640 1 -- 172.21.15.17:0/2483929059 learned_addr learned my addr 172.21.15.17:0/2483929059 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.657+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663557340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f6b70640 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66353fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 -- 172.21.15.17:0/2483929059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 msgr2=0x55c663557340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663557340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 -- 172.21.15.17:0/2483929059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 msgr2=0x55c66353fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66353fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 -- 172.21.15.17:0/2483929059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6632887d0 con 0x55c663545850 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76f636f640 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005e00 tx=0x7f76ec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802d39e831b6c415 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76dbfff640 1 -- 172.21.15.17:0/2483929059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec010b00 con 0x55c663545850 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76dbfff640 1 -- 172.21.15.17:0/2483929059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76ec005500 con 0x55c663545850 2024-03-16T10:53:40.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.658+0000 7f76dbfff640 1 -- 172.21.15.17:0/2483929059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec004e00 con 0x55c663545850 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- 172.21.15.17:0/2483929059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 msgr2=0x55c66353f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005e00 tx=0x7f76ec005f90 comp rx=0 tx=0).stop 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- 172.21.15.17:0/2483929059 shutdown_connections 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c66354b3b0 0x55c66353fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663546240 0x55c663557340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/2483929059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c663545850 0x55c66353f750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- 172.21.15.17:0/2483929059 >> 172.21.15.17:0/2483929059 conn(0x55c663540dc0 msgr2=0x55c6635477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- 172.21.15.17:0/2483929059 shutdown_connections 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- 172.21.15.17:0/2483929059 wait complete. 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 -- start start 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.659+0000 7f76fb1b7740 1 Processor -- start 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c6635559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01ac2e0 con 0x55c66354b3b0 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01abbb0 con 0x55c663546240 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f76f01a8d30 con 0x55c663545850 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76fb1b7740 10 client.0 _ll_register_callbacks cb 0x7f76e0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f636f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48874/0 (socket says 172.21.15.17:48874) 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 -- 172.21.15.17:0/780753584 learned_addr learned my addr 172.21.15.17:0/780753584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f636f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53078/0 (socket says 172.21.15.17:53078) 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f6b70640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c6635559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 -- 172.21.15.17:0/780753584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 msgr2=0x55c663554460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 -- 172.21.15.17:0/780753584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 msgr2=0x55c6635559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c6635559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 -- 172.21.15.17:0/780753584 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c663555fa0 con 0x55c663546240 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f636f640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76f5b6e640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76e0006010 tx=0x7f76e00c53f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ebe88856329164 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.660+0000 7f76d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e004b070 con 0x55c663546240 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76ec005500 con 0x55c663546240 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f76e00b8c30 con 0x55c663546240 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f76e00ca1d0 con 0x55c663546240 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 10 client.26240 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c6635572f0 con 0x55c663546240 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76ec005500 con 0x55c663546240 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7f76e00b8e30 con 0x55c663546240 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 10 client.26240 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 10 client.26240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 20 client.26240 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c6635c23e0 0x55c6635c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 4 client.26240 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 --> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6634b1d20 con 0x55c6635c23e0 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.661+0000 7f76f636f640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c6635c23e0 0x55c6635c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.662+0000 7f76f636f640 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c6635c23e0 0x55c6635c47d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=603d8cd8d0df2b0b server_cookie=680631893d276e7 in_seq=0 out_seq=0 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.662+0000 7f76d9ffb640 10 client.26240 ms_handle_connect on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.662+0000 7f76d9ffb640 1 -- 172.21.15.17:0/780753584 <== mds.1 v2:172.21.15.111:6836/2446703423 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22832 (crc 0 0 0) 0x55c6634b1d20 con 0x55c6635c23e0 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.662+0000 7f76d9ffb640 10 client.26240 handle_command_reply: tid=0 2024-03-16T10:53:40.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.662+0000 7f76fb1b7740 1 client.26240 shutdown 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 msgr2=0x55c6635549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f76e0006010 tx=0x7f76e00c53f0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 shutdown_connections 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c66354b3b0 0x55c6635559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:6836/2446703423,v1:172.21.15.111:6837/2446703423] conn(0x55c6635c23e0 0x55c6635c47d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c663546240 0x55c6635549a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76d9ffb640 0 client.26240 ms_handle_reset on v2:172.21.15.111:6836/2446703423 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 --2- 172.21.15.17:0/780753584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c663545850 0x55c663554460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 >> 172.21.15.17:0/780753584 conn(0x55c663540dc0 msgr2=0x55c663544020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 shutdown_connections 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 1 -- 172.21.15.17:0/780753584 wait complete. 2024-03-16T10:53:40.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76fb1b7740 20 client.26240 trim_cache size 0 max 16384 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 82925783, 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637013, 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop" 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 121656995, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637062, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la" 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 156829642, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637021, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug" 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 183559756, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637005, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh" 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 335411489, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637063, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm" 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 356443679, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637054, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c" 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 401763183, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637041, 2024-03-16T10:53:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m" 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 419024628, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637012, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts" 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 436181480, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637044, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m" 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 445383737, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637011, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop" 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 467688704, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637050, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts" 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 520086985, 2024-03-16T10:53:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637004, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh" 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 563912166, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637031, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch" 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 613551156, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637064, 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2" 2024-03-16T10:53:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 647763273, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637069, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c" 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 737843232, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637045, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g" 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 797068243, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637037, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p" 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 911064470, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637035, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch" 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 920257051, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637016, 2024-03-16T10:53:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include" 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 922339090, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636996, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt" 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 996910071, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637007, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh" 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1039194568, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637051, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3" 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1083101186, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637048, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h" 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1100378614, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637052, 2024-03-16T10:53:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l" 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1231243811, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637252, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile" 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1323942625, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637022, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING" 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1589009906, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637025, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests" 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1640433323, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636997, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt" 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1643478462, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636998, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt" 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1707768705, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637023, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h" 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1750022084, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637029, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p" 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1766147776, 2024-03-16T10:53:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637058, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m" 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1822192712, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637008, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh" 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1938537100, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637061, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1" 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1970008495, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637026, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m" 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2156461339, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633576, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml" 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2160842152, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636993, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt" 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2197745264, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637020, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile" 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2223294084, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637002, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh" 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2248492698, 2024-03-16T10:53:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637060, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4" 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2306349933, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637015, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog" 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2309114920, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637024, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile" 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2406362834, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637040, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved" 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2435322117, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637000, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional" 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2478625155, 2024-03-16T10:53:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637034, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p" 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2481297230, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636991, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING" 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2515007003, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637042, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m" 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2559273382, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637066, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h" 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2677547466, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637043, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p" 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2678679093, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637067, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c" 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2716159954, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637053, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f" 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2722360243, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637055, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8" 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2796744715, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636990, 2024-03-16T10:53:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug" 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2800306897, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637068, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c" 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2910919224, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637049, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO" 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3036661813, 2024-03-16T10:53:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637059, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l" 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3066342670, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637003, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh" 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3143218132, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637006, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh" 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3152591068, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636992, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc" 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3216473865, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637039, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch" 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3301688157, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637253, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh" 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3394561581, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637027, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m" 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3412470040, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637036, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch" 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3439635960, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637047, 2024-03-16T10:53:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README" 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3440846564, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637028, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p" 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3481283523, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633574, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt" 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3485453610, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637009, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools" 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3503939717, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637033, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g" 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3548706371, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637019, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh" 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3737843725, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637038, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved" 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3761915294, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637065, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h" 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3823564282, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637001, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh" 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3839245848, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637030, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m" 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3861367907, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637056, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f" 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3872375772, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637032, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig" 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4005535560, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637046, 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p" 2024-03-16T10:53:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4012138688, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636994, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt" 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4029046182, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637010, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop" 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4045752845, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636999, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt" 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4123013863, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637057, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l" 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4183552683, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511636995, 2024-03-16T10:53:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt" 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4188754685, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511633575, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c" 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4202330915, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511637014, 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README" 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:53:40.702 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-16T10:53:40.703 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:40 smithi111 ceph-mon[36315]: pgmap v436: 97 pgs: 97 active+clean; 1.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 104 MiB/s wr, 574 op/s 2024-03-16T10:53:40.703 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:40 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1787409865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 msgr2=0x7f76dc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 0x7f76dc0a4cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76e800fc90 tx=0x7f76e8018000 comp rx=0 tx=0).stop 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 msgr2=0x7f76f0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 0x7f76f0102cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009230 tx=0x7f76e002c650 comp rx=0 tx=0).stop 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 shutdown_connections 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.663+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f76dc0a2800 0x7f76dc0a4cc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76f0102290 0x7f76f01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76f01018d0 0x7f76f0102cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 --2- 172.21.15.17:0/2039245157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f01006e0 0x7f76f0104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 >> 172.21.15.17:0/2039245157 conn(0x7f76f00fbc70 msgr2=0x7f76f00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 shutdown_connections 2024-03-16T10:53:40.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.664+0000 7f76f85d3640 1 -- 172.21.15.17:0/2039245157 wait complete. 2024-03-16T10:53:40.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-16T10:53:40.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:40 smithi174 ceph-mon[36202]: pgmap v436: 97 pgs: 97 active+clean; 1.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 MiB/s rd, 104 MiB/s wr, 574 op/s 2024-03-16T10:53:40.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:40 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1787409865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 -- 172.21.15.17:0/1295434543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 msgr2=0x7fd724108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 --2- 172.21.15.17:0/1295434543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd724108b20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009ca0 tx=0x7fd71c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 -- 172.21.15.17:0/1295434543 shutdown_connections 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 --2- 172.21.15.17:0/1295434543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd724108b20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 --2- 172.21.15.17:0/1295434543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241018d0 0x7fd724101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 --2- 172.21.15.17:0/1295434543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241006e0 0x7fd724100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 -- 172.21.15.17:0/1295434543 >> 172.21.15.17:0/1295434543 conn(0x7fd7240fbc70 msgr2=0x7fd7240fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 -- 172.21.15.17:0/1295434543 shutdown_connections 2024-03-16T10:53:40.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.878+0000 7fd72bb90640 1 -- 172.21.15.17:0/1295434543 wait complete. 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 Processor -- start 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 -- start start 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241006e0 0x7fd724197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241018d0 0x7fd724198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410c360 con 0x7fd724102290 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410c1e0 con 0x7fd7241006e0 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72bb90640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd72410c4e0 con 0x7fd7241018d0 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35444/0 (socket says 172.21.15.17:35444) 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 -- 172.21.15.17:0/3725626392 learned_addr learned my addr 172.21.15.17:0/3725626392 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72992c640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241006e0 0x7fd724197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72912b640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241018d0 0x7fd724198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 -- 172.21.15.17:0/3725626392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241018d0 msgr2=0x7fd724198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241018d0 0x7fd724198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 -- 172.21.15.17:0/3725626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241006e0 msgr2=0x7fd724197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241006e0 0x7fd724197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.879+0000 7fd72a12d640 1 -- 172.21.15.17:0/3725626392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72419f720 con 0x7fd724102290 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd72a12d640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd71c037040 tx=0x7fd71c032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd71affd640 1 -- 172.21.15.17:0/3725626392 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c041020 con 0x7fd724102290 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd71affd640 1 -- 172.21.15.17:0/3725626392 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd71c034cd0 con 0x7fd724102290 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72419f9b0 con 0x7fd724102290 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd71affd640 1 -- 172.21.15.17:0/3725626392 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c039040 con 0x7fd724102290 2024-03-16T10:53:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.880+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72419fea0 con 0x7fd724102290 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.882+0000 7fd72e778740 1 Processor -- start 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.882+0000 7fd71affd640 1 -- 172.21.15.17:0/3725626392 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fd71c044020 con 0x7fd724102290 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 -- start start 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84f3b0 0x56237e851840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56237e7ae490 con 0x56237e849850 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56237e756c90 con 0x56237e84f3b0 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72e778740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56237e7aa530 con 0x56237e84a240 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35452/0 (socket says 172.21.15.17:35452) 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72912b640 1 -- 172.21.15.17:0/445758659 learned_addr learned my addr 172.21.15.17:0/445758659 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53096/0 (socket says 172.21.15.17:53096) 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd72912b640 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84f3b0 0x56237e851840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.883+0000 7fd71affd640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 0x7fd7100a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 -- 172.21.15.17:0/445758659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84f3b0 msgr2=0x56237e851840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84f3b0 0x56237e851840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 -- 172.21.15.17:0/445758659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 msgr2=0x56237e849c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72a12d640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 0x7fd7100a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 -- 172.21.15.17:0/445758659 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237e811500 con 0x56237e84a240 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72912b640 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd71affd640 1 -- 172.21.15.17:0/3725626392 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd71c0f0860 con 0x7fd724102290 2024-03-16T10:53:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72992c640 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd720009bd0 tx=0x7fd720011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74b4b708362f4d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd72a12d640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 0x7fd7100a4cc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0bd030 tx=0x7fd71c0b7cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd70ffff640 1 -- 172.21.15.17:0/445758659 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720004230 con 0x56237e84a240 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd70ffff640 1 -- 172.21.15.17:0/445758659 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd720009e40 con 0x56237e84a240 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.884+0000 7fd70ffff640 1 -- 172.21.15.17:0/445758659 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720019750 con 0x56237e84a240 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- 172.21.15.17:0/445758659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 msgr2=0x56237e84ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd720009bd0 tx=0x7fd720011810 comp rx=0 tx=0).stop 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- 172.21.15.17:0/445758659 shutdown_connections 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84f3b0 0x56237e851840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e84ed40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 --2- 172.21.15.17:0/445758659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e849c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- 172.21.15.17:0/445758659 >> 172.21.15.17:0/445758659 conn(0x56237e844dc0 msgr2=0x56237e8451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- 172.21.15.17:0/445758659 shutdown_connections 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- 172.21.15.17:0/445758659 wait complete. 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 -- start start 2024-03-16T10:53:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.885+0000 7fd72e778740 1 Processor -- start 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e853d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e85b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56237e852360 con 0x56237e84f3b0 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x56237e76a230 con 0x56237e849850 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56237e8524e0 con 0x56237e84a240 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72e778740 10 client.0 _ll_register_callbacks cb 0x56237e7a6010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e85b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72912b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e853d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53102/0 (socket says 172.21.15.17:53102) 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 -- 172.21.15.17:0/3390044579 learned_addr learned my addr 172.21.15.17:0/3390044579 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 -- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 msgr2=0x56237e853d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e853d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 -- 172.21.15.17:0/3390044579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 msgr2=0x56237e85b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e85b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72992c640 1 -- 172.21.15.17:0/3390044579 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237e779100 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.886+0000 7fd72912b640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e853d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd72992c640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd72001b040 tx=0x7fd720004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e096ec60291b8e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd70d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720028070 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd720005250 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56237e7bb9d0 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd720003a60 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd72e778740 10 client.26206 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56237e4c23f0 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.887+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd720034070 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7fd720004ba0 con 0x56237e84a240 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 10 client.26206 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:40.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 20 client.26206 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e85fa90 0x56237e861ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 4 client.26206 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56237e7b5d20 con 0x56237e85fa90 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72912b640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e85fa90 0x56237e861ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd70d7fa640 10 client.26206 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:40.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.888+0000 7fd72912b640 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e85fa90 0x56237e861ef0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3539396dacbfcc server_cookie=bac520ee5cd85d36 in_seq=0 out_seq=0 2024-03-16T10:53:40.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3390044579 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56237e7b5d20 con 0x56237e85fa90 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd70d7fa640 10 client.26206 handle_command_reply: tid=0 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 client.26206 shutdown 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 msgr2=0x56237e8542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd72001b040 tx=0x7fd720004250 comp rx=0 tx=0).stop 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 shutdown_connections 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e85fa90 0x56237e861ef0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd70d7fa640 0 client.26206 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e85b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e8542a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 --2- 172.21.15.17:0/3390044579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e853d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 >> 172.21.15.17:0/3390044579 conn(0x56237e844dc0 msgr2=0x56237e843fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.889+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 shutdown_connections 2024-03-16T10:53:40.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.890+0000 7fd72e778740 1 -- 172.21.15.17:0/3390044579 wait complete. 2024-03-16T10:53:40.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.890+0000 7fd72e778740 20 client.26206 trim_cache size 0 max 16384 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 Processor -- start 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 -- start start 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e848730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e8667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a68c0 con 0x56237e84f3b0 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a85e0 con 0x56237e849850 2024-03-16T10:53:40.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72e778740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a6f90 con 0x56237e84a240 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e8667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72912b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e848730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72992c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:53110/0 (socket says 172.21.15.17:53110) 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72912b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e848730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:48896/0 (socket says 172.21.15.17:48896) 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.903+0000 7fd72992c640 1 -- 172.21.15.17:0/705576355 learned_addr learned my addr 172.21.15.17:0/705576355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 -- 172.21.15.17:0/705576355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 msgr2=0x56237e848730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e848730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 -- 172.21.15.17:0/705576355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 msgr2=0x56237e8667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e8667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 -- 172.21.15.17:0/705576355 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237e58c7d0 con 0x56237e84a240 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd72992c640 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd720019460 tx=0x7fd720019560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f04e912fab30a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd70f7fe640 1 -- 172.21.15.17:0/705576355 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720028040 con 0x56237e84a240 2024-03-16T10:53:40.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd70f7fe640 1 -- 172.21.15.17:0/705576355 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd720034040 con 0x56237e84a240 2024-03-16T10:53:40.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.904+0000 7fd70f7fe640 1 -- 172.21.15.17:0/705576355 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720019a00 con 0x56237e84a240 2024-03-16T10:53:40.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- 172.21.15.17:0/705576355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 msgr2=0x56237e85b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd720019460 tx=0x7fd720019560 comp rx=0 tx=0).stop 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- 172.21.15.17:0/705576355 shutdown_connections 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e84f3b0 0x56237e8667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84a240 0x56237e85b260 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 --2- 172.21.15.17:0/705576355 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e849850 0x56237e848730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- 172.21.15.17:0/705576355 >> 172.21.15.17:0/705576355 conn(0x56237e844dc0 msgr2=0x56237e848020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- 172.21.15.17:0/705576355 shutdown_connections 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- 172.21.15.17:0/705576355 wait complete. 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 -- start start 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.905+0000 7fd72e778740 1 Processor -- start 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 0x56237e859310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84f3b0 0x56237e85a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a7e50 con 0x56237e849850 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a7720 con 0x56237e84a240 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7241a48a0 con 0x56237e84f3b0 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72e778740 10 client.0 _ll_register_callbacks cb 0x7fd714009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35484/0 (socket says 172.21.15.17:35484) 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 -- 172.21.15.17:0/3310907619 learned_addr learned my addr 172.21.15.17:0/3310907619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72992c640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 0x56237e859310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84f3b0 0x56237e85a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 -- 172.21.15.17:0/3310907619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84f3b0 msgr2=0x56237e85a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84f3b0 0x56237e85a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 -- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 msgr2=0x56237e859310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 0x56237e859310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 -- 172.21.15.17:0/3310907619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237e85a910 con 0x56237e849850 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72992c640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 0x56237e859310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd72912b640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd714005b90 tx=0x7fd714012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2f09010b352205 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.906+0000 7fd70d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714025e10 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd71401c040 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd720034040 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd714014b60 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd72e778740 10 client.16401 fetch_fsmap learned FSMap version 37 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.907+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56237e8c62d0 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd720034040 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) ==== 8422+0+0 (secure 0 0 0) 0x7fd7140035f0 con 0x56237e849850 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 10 client.16401 fetch_fsmap finished waiting for FSMap version 37 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 20 client.16401 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e8c6d60 0x56237e8c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:40.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 4 client.16401 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.908+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56237e7336a0 con 0x56237e8c6d60 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd72992c640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e8c6d60 0x56237e8c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd70d7fa640 10 client.16401 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd72992c640 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e8c6d60 0x56237e8c9180 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460a709b96a6b63 server_cookie=db5364fb12cb131 in_seq=0 out_seq=0 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd70d7fa640 1 -- 172.21.15.17:0/3310907619 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56237e7336a0 con 0x56237e8c6d60 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd70d7fa640 10 client.16401 handle_command_reply: tid=0 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.909+0000 7fd72e778740 1 client.16401 shutdown 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 msgr2=0x56237e858dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd714005b90 tx=0x7fd714012040 comp rx=0 tx=0).stop 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 shutdown_connections 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x56237e8c6d60 0x56237e8c9180 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56237e84f3b0 0x56237e85a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x56237e84a240 0x56237e859310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 --2- 172.21.15.17:0/3310907619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56237e849850 0x56237e858dd0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd70d7fa640 0 client.16401 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 >> 172.21.15.17:0/3310907619 conn(0x56237e844dc0 msgr2=0x56237e8488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 shutdown_connections 2024-03-16T10:53:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 1 -- 172.21.15.17:0/3310907619 wait complete. 2024-03-16T10:53:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.910+0000 7fd72e778740 20 client.16401 trim_cache size 0 max 16384 2024-03-16T10:53:40.916 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 msgr2=0x7fd7100a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 0x7fd7100a4cc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0bd030 tx=0x7fd71c0b7cf0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 msgr2=0x7fd72419f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd71c037040 tx=0x7fd71c032f40 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 shutdown_connections 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd7100a2800 0x7fd7100a4cc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd724102290 0x7fd72419f0b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7241018d0 0x7fd724198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 --2- 172.21.15.17:0/3725626392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7241006e0 0x7fd724197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 >> 172.21.15.17:0/3725626392 conn(0x7fd7240fbc70 msgr2=0x7fd7240fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 shutdown_connections 2024-03-16T10:53:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:53:40.911+0000 7fd72bb90640 1 -- 172.21.15.17:0/3725626392 wait complete. 2024-03-16T10:53:40.923 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 51101589, 'ino': 1099511633481, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/2-1.c'}, {'damage_type': 'backtrace', 'id': 255632265, 'ino': 1099511633638, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/4-1.c'}, {'damage_type': 'backtrace', 'id': 406369041, 'ino': 1099511633631, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-2.c'}, {'damage_type': 'backtrace', 'id': 1219516371, 'ino': 1099511637017, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/testsuite.fns'}, {'damage_type': 'backtrace', 'id': 1224568190, 'ino': 1099511633640, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-2.sh'}, {'damage_type': 'backtrace', 'id': 1335120836, 'ino': 1099511633486, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/7-1.c'}, {'damage_type': 'backtrace', 'id': 1513163213, 'ino': 1099511633634, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-core-buildonly.c'}, {'damage_type': 'backtrace', 'id': 1724070285, 'ino': 1099511633487, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/4-1.c'}, {'damage_type': 'backtrace', 'id': 1934037207, 'ino': 1099511633480, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2067094647, 'ino': 1099511633635, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/6-1.c'}, {'damage_type': 'backtrace', 'id': 2154905278, 'ino': 1099511633639, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-4.sh'}, {'damage_type': 'backtrace', 'id': 2368103681, 'ino': 1099511633479, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2457324384, 'ino': 1099511633476, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/3-1.c'}, {'damage_type': 'backtrace', 'id': 2528143831, 'ino': 1099511633483, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/1-1.c'}, {'damage_type': 'backtrace', 'id': 2725510057, 'ino': 1099511633632, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2902130109, 'ino': 1099511633636, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/1-1.c'}, {'damage_type': 'backtrace', 'id': 2989150410, 'ino': 1099511633484, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/8-1.c'}, {'damage_type': 'backtrace', 'id': 3081558764, 'ino': 1099511633464, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c'}, {'damage_type': 'backtrace', 'id': 3279002965, 'ino': 1099511633478, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3340423072, 'ino': 1099511633477, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-2.c'}, {'damage_type': 'backtrace', 'id': 3471098357, 'ino': 1099511633630, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-3.sh'}, {'damage_type': 'backtrace', 'id': 3524836733, 'ino': 1099511633633, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/5-1.sh'}, {'damage_type': 'backtrace', 'id': 3680926030, 'ino': 1099511637018, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include/hotplug.fns'}, {'damage_type': 'backtrace', 'id': 3903285642, 'ino': 1099511633485, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/assertions.xml'}, {'damage_type': 'backtrace', 'id': 4197337155, 'ino': 1099511633637, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigignore/assertions.xml'}, {'damage_type': 'backtrace', 'id': 4284225615, 'ino': 1099511633482, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigwait/6-1.c'}] 2024-03-16T10:53:40.923 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 21526703, 'ino': 1099511633673, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/3-1.sh'}, {'damage_type': 'backtrace', 'id': 92608124, 'ino': 1099511632119, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ilo2_ribcl'}, {'damage_type': 'backtrace', 'id': 414184873, 'ino': 1099511631933, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/snmp_bc'}, {'damage_type': 'backtrace', 'id': 521260192, 'ino': 1099511633671, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-1.c'}, {'damage_type': 'backtrace', 'id': 613949761, 'ino': 1099511633669, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/2-1.c'}, {'damage_type': 'backtrace', 'id': 668974752, 'ino': 1099511632268, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.in'}, {'damage_type': 'backtrace', 'id': 725709094, 'ino': 1099511631837, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog'}, {'damage_type': 'backtrace', 'id': 1236744963, 'ino': 1099511633370, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1266972286, 'ino': 1099511633367, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/3-1.c'}, {'damage_type': 'backtrace', 'id': 1268980766, 'ino': 1099511632263, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/sysfs'}, {'damage_type': 'backtrace', 'id': 1351791656, 'ino': 1099511633674, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/4-1.sh'}, {'damage_type': 'backtrace', 'id': 1607248233, 'ino': 1099511632230, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/rtas'}, {'damage_type': 'backtrace', 'id': 2212278916, 'ino': 1099511633670, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/5-1.c'}, {'damage_type': 'backtrace', 'id': 2490645071, 'ino': 1099511632062, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/oa_soap'}, {'damage_type': 'backtrace', 'id': 2764667447, 'ino': 1099511631842, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect'}, {'damage_type': 'backtrace', 'id': 2795204625, 'ino': 1099511632139, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/simulator'}, {'damage_type': 'backtrace', 'id': 2795639302, 'ino': 1099511633368, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2863113169, 'ino': 1099511632269, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2864409729, 'ino': 1099511633667, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3315500338, 'ino': 1099511631803, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi'}, {'damage_type': 'backtrace', 'id': 3419149690, 'ino': 1099511633672, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3899976564, 'ino': 1099511633369, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_init/1-1.c'}, {'damage_type': 'backtrace', 'id': 3939129138, 'ino': 1099511633668, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_setattr/1-2.c'}] 2024-03-16T10:53:40.923 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 20565218, 'ino': 1099511633797, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c'}, {'damage_type': 'backtrace', 'id': 52161196, 'ino': 1099511633767, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c'}, {'damage_type': 'backtrace', 'id': 81361069, 'ino': 1099511633807, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c'}, {'damage_type': 'backtrace', 'id': 86004309, 'ino': 1099511633744, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c'}, {'damage_type': 'backtrace', 'id': 91908927, 'ino': 1099511633748, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c'}, {'damage_type': 'backtrace', 'id': 115160941, 'ino': 1099511633867, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c'}, {'damage_type': 'backtrace', 'id': 165985887, 'ino': 1099511633759, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c'}, {'damage_type': 'backtrace', 'id': 214167512, 'ino': 1099511633708, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c'}, {'damage_type': 'backtrace', 'id': 216997907, 'ino': 1099511633712, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c'}, {'damage_type': 'backtrace', 'id': 222814055, 'ino': 1099511633841, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c'}, {'damage_type': 'backtrace', 'id': 246046708, 'ino': 1099511633726, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in'}, {'damage_type': 'backtrace', 'id': 255822126, 'ino': 1099511633775, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c'}, {'damage_type': 'backtrace', 'id': 258691499, 'ino': 1099511633720, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in'}, {'damage_type': 'backtrace', 'id': 281991470, 'ino': 1099511633834, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c'}, {'damage_type': 'backtrace', 'id': 311833187, 'ino': 1099511633719, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in'}, {'damage_type': 'backtrace', 'id': 323035859, 'ino': 1099511633768, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c'}, {'damage_type': 'backtrace', 'id': 349212254, 'ino': 1099511633859, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c'}, {'damage_type': 'backtrace', 'id': 367443007, 'ino': 1099511633769, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c'}, {'damage_type': 'backtrace', 'id': 394442849, 'ino': 1099511633856, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c'}, {'damage_type': 'backtrace', 'id': 438159772, 'ino': 1099511633851, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c'}, {'damage_type': 'backtrace', 'id': 501139499, 'ino': 1099511633710, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c'}, {'damage_type': 'backtrace', 'id': 519818694, 'ino': 1099511633742, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c'}, {'damage_type': 'backtrace', 'id': 544157178, 'ino': 1099511633874, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c'}, {'damage_type': 'backtrace', 'id': 612288175, 'ino': 1099511633778, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c'}, {'damage_type': 'backtrace', 'id': 632365513, 'ino': 1099511633872, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c'}, {'damage_type': 'backtrace', 'id': 651145901, 'ino': 1099511633812, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c'}, {'damage_type': 'backtrace', 'id': 689037939, 'ino': 1099511633752, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c'}, {'damage_type': 'backtrace', 'id': 730208581, 'ino': 1099511633853, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c'}, {'damage_type': 'backtrace', 'id': 791702985, 'ino': 1099511633855, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c'}, {'damage_type': 'backtrace', 'id': 793390233, 'ino': 1099511633750, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c'}, {'damage_type': 'backtrace', 'id': 806245942, 'ino': 1099511633776, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c'}, {'damage_type': 'backtrace', 'id': 806953807, 'ino': 1099511633791, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c'}, {'damage_type': 'backtrace', 'id': 818561192, 'ino': 1099511633715, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c'}, {'damage_type': 'backtrace', 'id': 821459749, 'ino': 1099511633733, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in'}, {'damage_type': 'backtrace', 'id': 825472767, 'ino': 1099511633814, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c'}, {'damage_type': 'backtrace', 'id': 845532627, 'ino': 1099511633842, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c'}, {'damage_type': 'backtrace', 'id': 861562189, 'ino': 1099511633746, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c'}, {'damage_type': 'backtrace', 'id': 868059183, 'ino': 1099511633850, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c'}, {'damage_type': 'backtrace', 'id': 933495426, 'ino': 1099511633862, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c'}, {'damage_type': 'backtrace', 'id': 952973717, 'ino': 1099511633771, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c'}, {'damage_type': 'backtrace', 'id': 979797062, 'ino': 1099511633751, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c'}, {'damage_type': 'backtrace', 'id': 1031393356, 'ino': 1099511633833, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c'}, {'damage_type': 'backtrace', 'id': 1058929243, 'ino': 1099511633848, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c'}, {'damage_type': 'backtrace', 'id': 1063712573, 'ino': 1099511633835, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c'}, {'damage_type': 'backtrace', 'id': 1065561000, 'ino': 1099511633801, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c'}, {'damage_type': 'backtrace', 'id': 1097703569, 'ino': 1099511633772, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c'}, {'damage_type': 'backtrace', 'id': 1099583094, 'ino': 1099511633755, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c'}, {'damage_type': 'backtrace', 'id': 1106653105, 'ino': 1099511633785, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c'}, {'damage_type': 'backtrace', 'id': 1128155589, 'ino': 1099511633782, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c'}, {'damage_type': 'backtrace', 'id': 1184771510, 'ino': 1099511633845, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c'}, {'damage_type': 'backtrace', 'id': 1210404043, 'ino': 1099511633730, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in'}, {'damage_type': 'backtrace', 'id': 1225137959, 'ino': 1099511633829, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c'}, {'damage_type': 'backtrace', 'id': 1230319211, 'ino': 1099511633821, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl'}, {'damage_type': 'backtrace', 'id': 1232160460, 'ino': 1099511633764, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c'}, {'damage_type': 'backtrace', 'id': 1269513852, 'ino': 1099511633704, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c'}, {'damage_type': 'backtrace', 'id': 1304601350, 'ino': 1099511633760, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c'}, {'damage_type': 'backtrace', 'id': 1321104765, 'ino': 1099511633822, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c'}, {'damage_type': 'backtrace', 'id': 1325591180, 'ino': 1099511633793, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c'}, {'damage_type': 'backtrace', 'id': 1362916076, 'ino': 1099511633786, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c'}, {'damage_type': 'backtrace', 'id': 1368406470, 'ino': 1099511633865, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c'}, {'damage_type': 'backtrace', 'id': 1384654740, 'ino': 1099511633749, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c'}, {'damage_type': 'backtrace', 'id': 1432797225, 'ino': 1099511633830, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c'}, {'damage_type': 'backtrace', 'id': 1434365939, 'ino': 1099511633796, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c'}, {'damage_type': 'backtrace', 'id': 1455518271, 'ino': 1099511633711, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c'}, {'damage_type': 'backtrace', 'id': 1479851382, 'ino': 1099511633798, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c'}, {'damage_type': 'backtrace', 'id': 1518923065, 'ino': 1099511633729, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in'}, {'damage_type': 'backtrace', 'id': 1519488320, 'ino': 1099511633869, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c'}, {'damage_type': 'backtrace', 'id': 1520803237, 'ino': 1099511633826, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c'}, {'damage_type': 'backtrace', 'id': 1596998050, 'ino': 1099511633823, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c'}, {'damage_type': 'backtrace', 'id': 1606802029, 'ino': 1099511633773, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c'}, {'damage_type': 'backtrace', 'id': 1609868586, 'ino': 1099511633819, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c'}, {'damage_type': 'backtrace', 'id': 1658428503, 'ino': 1099511633732, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in'}, {'damage_type': 'backtrace', 'id': 1728734846, 'ino': 1099511633837, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c'}, {'damage_type': 'backtrace', 'id': 1750780231, 'ino': 1099511633813, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c'}, {'damage_type': 'backtrace', 'id': 1759421214, 'ino': 1099511633743, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c'}, {'damage_type': 'backtrace', 'id': 1774459549, 'ino': 1099511633858, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c'}, {'damage_type': 'backtrace', 'id': 1825391763, 'ino': 1099511633866, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c'}, {'damage_type': 'backtrace', 'id': 1833335524, 'ino': 1099511633795, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c'}, {'damage_type': 'backtrace', 'id': 1901242492, 'ino': 1099511633864, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c'}, {'damage_type': 'backtrace', 'id': 2035899848, 'ino': 1099511633721, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in'}, {'damage_type': 'backtrace', 'id': 2044711096, 'ino': 1099511633780, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c'}, {'damage_type': 'backtrace', 'id': 2087182510, 'ino': 1099511633728, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in'}, {'damage_type': 'backtrace', 'id': 2122804958, 'ino': 1099511633703, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c'}, {'damage_type': 'backtrace', 'id': 2130632407, 'ino': 1099511633713, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c'}, {'damage_type': 'backtrace', 'id': 2158295485, 'ino': 1099511633846, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c'}, {'damage_type': 'backtrace', 'id': 2169279420, 'ino': 1099511633779, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c'}, {'damage_type': 'backtrace', 'id': 2173203956, 'ino': 1099511633763, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c'}, {'damage_type': 'backtrace', 'id': 2221284324, 'ino': 1099511633854, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c'}, {'damage_type': 'backtrace', 'id': 2229142244, 'ino': 1099511633753, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c'}, {'damage_type': 'backtrace', 'id': 2238130953, 'ino': 1099511633838, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c'}, {'damage_type': 'backtrace', 'id': 2254062703, 'ino': 1099511633781, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c'}, {'damage_type': 'backtrace', 'id': 2263500788, 'ino': 1099511633774, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c'}, {'damage_type': 'backtrace', 'id': 2308839163, 'ino': 1099511633707, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c'}, {'damage_type': 'backtrace', 'id': 2317400750, 'ino': 1099511633836, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c'}, {'damage_type': 'backtrace', 'id': 2321991891, 'ino': 1099511633870, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2343263373, 'ino': 1099511633783, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c'}, {'damage_type': 'backtrace', 'id': 2348378661, 'ino': 1099511633840, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c'}, {'damage_type': 'backtrace', 'id': 2364043235, 'ino': 1099511633802, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c'}, {'damage_type': 'backtrace', 'id': 2368174808, 'ino': 1099511633873, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c'}, {'damage_type': 'backtrace', 'id': 2404528363, 'ino': 1099511633805, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c'}, {'damage_type': 'backtrace', 'id': 2421256089, 'ino': 1099511633716, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c'}, {'damage_type': 'backtrace', 'id': 2437704017, 'ino': 1099511633809, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c'}, {'damage_type': 'backtrace', 'id': 2441043849, 'ino': 1099511633717, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c'}, {'damage_type': 'backtrace', 'id': 2487221572, 'ino': 1099511633860, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c'}, {'damage_type': 'backtrace', 'id': 2531451181, 'ino': 1099511633815, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c'}, {'damage_type': 'backtrace', 'id': 2579867504, 'ino': 1099511633723, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in'}, {'damage_type': 'backtrace', 'id': 2583762455, 'ino': 1099511633705, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c'}, {'damage_type': 'backtrace', 'id': 2597897142, 'ino': 1099511633734, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in'}, {'damage_type': 'backtrace', 'id': 2599738548, 'ino': 1099511633745, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c'}, {'damage_type': 'backtrace', 'id': 2647670399, 'ino': 1099511633827, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c'}, {'damage_type': 'backtrace', 'id': 2663114552, 'ino': 1099511633852, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c'}, {'damage_type': 'backtrace', 'id': 2664451469, 'ino': 1099511633765, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c'}, {'damage_type': 'backtrace', 'id': 2683898274, 'ino': 1099511633808, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c'}, {'damage_type': 'backtrace', 'id': 2692296284, 'ino': 1099511633818, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c'}, {'damage_type': 'backtrace', 'id': 2703599744, 'ino': 1099511633816, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c'}, {'damage_type': 'backtrace', 'id': 2729152886, 'ino': 1099511633737, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in'}, {'damage_type': 'backtrace', 'id': 2736423867, 'ino': 1099511633739, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c'}, {'damage_type': 'backtrace', 'id': 2748070418, 'ino': 1099511633770, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c'}, {'damage_type': 'backtrace', 'id': 2774709255, 'ino': 1099511633735, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in'}, {'damage_type': 'backtrace', 'id': 2849239389, 'ino': 1099511633731, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in'}, {'damage_type': 'backtrace', 'id': 2913100447, 'ino': 1099511633766, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c'}, {'damage_type': 'backtrace', 'id': 2989413859, 'ino': 1099511633727, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in'}, {'damage_type': 'backtrace', 'id': 2991719971, 'ino': 1099511633804, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c'}, {'damage_type': 'backtrace', 'id': 2996711075, 'ino': 1099511633740, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c'}, {'damage_type': 'backtrace', 'id': 3067961446, 'ino': 1099511633714, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c'}, {'damage_type': 'backtrace', 'id': 3111814787, 'ino': 1099511633843, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c'}, {'damage_type': 'backtrace', 'id': 3131457258, 'ino': 1099511633832, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c'}, {'damage_type': 'backtrace', 'id': 3138067419, 'ino': 1099511633738, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in'}, {'damage_type': 'backtrace', 'id': 3169977404, 'ino': 1099511633824, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c'}, {'damage_type': 'backtrace', 'id': 3197459250, 'ino': 1099511633811, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c'}, {'damage_type': 'backtrace', 'id': 3201632472, 'ino': 1099511633839, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c'}, {'damage_type': 'backtrace', 'id': 3252898899, 'ino': 1099511633747, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c'}, {'damage_type': 'backtrace', 'id': 3256959525, 'ino': 1099511633787, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c'}, {'damage_type': 'backtrace', 'id': 3262796050, 'ino': 1099511633844, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c'}, {'damage_type': 'backtrace', 'id': 3341216531, 'ino': 1099511633817, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c'}, {'damage_type': 'backtrace', 'id': 3380834383, 'ino': 1099511633863, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c'}, {'damage_type': 'backtrace', 'id': 3464462489, 'ino': 1099511633857, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c'}, {'damage_type': 'backtrace', 'id': 3473602469, 'ino': 1099511633861, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c'}, {'damage_type': 'backtrace', 'id': 3474510108, 'ino': 1099511633800, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c'}, {'damage_type': 'backtrace', 'id': 3483829674, 'ino': 1099511633718, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates'}, {'damage_type': 'backtrace', 'id': 3587996914, 'ino': 1099511633788, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c'}, {'damage_type': 'backtrace', 'id': 3602197767, 'ino': 1099511633831, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c'}, {'damage_type': 'backtrace', 'id': 3610204932, 'ino': 1099511633758, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c'}, {'damage_type': 'backtrace', 'id': 3612943033, 'ino': 1099511633777, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c'}, {'damage_type': 'backtrace', 'id': 3620620494, 'ino': 1099511633847, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c'}, {'damage_type': 'backtrace', 'id': 3629244340, 'ino': 1099511633757, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c'}, {'damage_type': 'backtrace', 'id': 3645499809, 'ino': 1099511633794, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c'}, {'damage_type': 'backtrace', 'id': 3668893937, 'ino': 1099511633799, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c'}, {'damage_type': 'backtrace', 'id': 3696759716, 'ino': 1099511633724, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in'}, {'damage_type': 'backtrace', 'id': 3703232861, 'ino': 1099511633741, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c'}, {'damage_type': 'backtrace', 'id': 3718093460, 'ino': 1099511633756, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c'}, {'damage_type': 'backtrace', 'id': 3732989814, 'ino': 1099511633820, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c'}, {'damage_type': 'backtrace', 'id': 3760056071, 'ino': 1099511633810, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c'}, {'damage_type': 'backtrace', 'id': 3760657985, 'ino': 1099511633868, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c'}, {'damage_type': 'backtrace', 'id': 3806856156, 'ino': 1099511633806, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c'}, {'damage_type': 'backtrace', 'id': 3820439817, 'ino': 1099511633762, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c'}, {'damage_type': 'backtrace', 'id': 3837663686, 'ino': 1099511633784, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c'}, {'damage_type': 'backtrace', 'id': 3880431858, 'ino': 1099511633790, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c'}, {'damage_type': 'backtrace', 'id': 3896200545, 'ino': 1099511633725, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in'}, {'damage_type': 'backtrace', 'id': 3906599448, 'ino': 1099511633736, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in'}, {'damage_type': 'backtrace', 'id': 3916495099, 'ino': 1099511633792, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c'}, {'damage_type': 'backtrace', 'id': 3919233273, 'ino': 1099511633761, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c'}, {'damage_type': 'backtrace', 'id': 3997017895, 'ino': 1099511633825, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c'}, {'damage_type': 'backtrace', 'id': 4041060153, 'ino': 1099511633722, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in'}, {'damage_type': 'backtrace', 'id': 4043261717, 'ino': 1099511633754, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c'}, {'damage_type': 'backtrace', 'id': 4062511145, 'ino': 1099511633849, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c'}, {'damage_type': 'backtrace', 'id': 4088252088, 'ino': 1099511633448, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_getattr/speculative/7-1.c'}, {'damage_type': 'backtrace', 'id': 4125351868, 'ino': 1099511633789, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c'}, {'damage_type': 'backtrace', 'id': 4146420557, 'ino': 1099511633871, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c'}, {'damage_type': 'backtrace', 'id': 4156330060, 'ino': 1099511633828, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c'}, {'damage_type': 'backtrace', 'id': 4221317800, 'ino': 1099511633706, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c'}, {'damage_type': 'backtrace', 'id': 4273382325, 'ino': 1099511633709, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c'}] 2024-03-16T10:53:40.924 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 82925783, 'ino': 1099511637013, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_kcompile_loop'}, {'damage_type': 'backtrace', 'id': 121656995, 'ino': 1099511637062, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1la'}, {'damage_type': 'backtrace', 'id': 156829642, 'ino': 1099511637021, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug'}, {'damage_type': 'backtrace', 'id': 183559756, 'ino': 1099511637005, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sar.sh'}, {'damage_type': 'backtrace', 'id': 335411489, 'ino': 1099511637063, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1shm'}, {'damage_type': 'backtrace', 'id': 356443679, 'ino': 1099511637054, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c'}, {'damage_type': 'backtrace', 'id': 401763183, 'ino': 1099511637041, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m'}, {'damage_type': 'backtrace', 'id': 419024628, 'ino': 1099511637012, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/report_proc_interrupts'}, {'damage_type': 'backtrace', 'id': 436181480, 'ino': 1099511637044, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m'}, {'damage_type': 'backtrace', 'id': 445383737, 'ino': 1099511637011, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_spin_loop'}, {'damage_type': 'backtrace', 'id': 467688704, 'ino': 1099511637050, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts'}, {'damage_type': 'backtrace', 'id': 520086985, 'ino': 1099511637004, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug01.sh'}, {'damage_type': 'backtrace', 'id': 563912166, 'ino': 1099511637031, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch'}, {'damage_type': 'backtrace', 'id': 613551156, 'ino': 1099511637064, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2'}, {'damage_type': 'backtrace', 'id': 647763273, 'ino': 1099511637069, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.c'}, {'damage_type': 'backtrace', 'id': 737843232, 'ino': 1099511637045, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g'}, {'damage_type': 'backtrace', 'id': 797068243, 'ino': 1099511637037, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p'}, {'damage_type': 'backtrace', 'id': 911064470, 'ino': 1099511637035, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch'}, {'damage_type': 'backtrace', 'id': 920257051, 'ino': 1099511637016, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/include'}, {'damage_type': 'backtrace', 'id': 922339090, 'ino': 1099511636996, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug06.txt'}, {'damage_type': 'backtrace', 'id': 996910071, 'ino': 1099511637007, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.sh'}, {'damage_type': 'backtrace', 'id': 1039194568, 'ino': 1099511637051, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3'}, {'damage_type': 'backtrace', 'id': 1083101186, 'ino': 1099511637048, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/segment.h'}, {'damage_type': 'backtrace', 'id': 1100378614, 'ino': 1099511637052, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1l'}, {'damage_type': 'backtrace', 'id': 1231243811, 'ino': 1099511637252, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/Makefile'}, {'damage_type': 'backtrace', 'id': 1323942625, 'ino': 1099511637022, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/COPYING'}, {'damage_type': 'backtrace', 'id': 1589009906, 'ino': 1099511637025, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests'}, {'damage_type': 'backtrace', 'id': 1640433323, 'ino': 1099511636997, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug02.txt'}, {'damage_type': 'backtrace', 'id': 1643478462, 'ino': 1099511636998, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug01.txt'}, {'damage_type': 'backtrace', 'id': 1707768705, 'ino': 1099511637023, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/version.h'}, {'damage_type': 'backtrace', 'id': 1750022084, 'ino': 1099511637029, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p'}, {'damage_type': 'backtrace', 'id': 1766147776, 'ino': 1099511637058, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3-1m'}, {'damage_type': 'backtrace', 'id': 1822192712, 'ino': 1099511637008, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug03.sh'}, {'damage_type': 'backtrace', 'id': 1938537100, 'ino': 1099511637061, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1'}, {'damage_type': 'backtrace', 'id': 1970008495, 'ino': 1099511637026, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m'}, {'damage_type': 'backtrace', 'id': 2156461339, 'ino': 1099511633576, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2160842152, 'ino': 1099511636993, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug05.txt'}, {'damage_type': 'backtrace', 'id': 2197745264, 'ino': 1099511637020, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/Makefile'}, {'damage_type': 'backtrace', 'id': 2223294084, 'ino': 1099511637002, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug04.sh'}, {'damage_type': 'backtrace', 'id': 2248492698, 'ino': 1099511637060, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4'}, {'damage_type': 'backtrace', 'id': 2306349933, 'ino': 1099511637015, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/ChangeLog'}, {'damage_type': 'backtrace', 'id': 2309114920, 'ino': 1099511637024, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Makefile'}, {'damage_type': 'backtrace', 'id': 2406362834, 'ino': 1099511637040, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved'}, {'damage_type': 'backtrace', 'id': 2435322117, 'ino': 1099511637000, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional'}, {'damage_type': 'backtrace', 'id': 2478625155, 'ino': 1099511637034, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p'}, {'damage_type': 'backtrace', 'id': 2481297230, 'ino': 1099511636991, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/COPYING'}, {'damage_type': 'backtrace', 'id': 2515007003, 'ino': 1099511637042, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m'}, {'damage_type': 'backtrace', 'id': 2559273382, 'ino': 1099511637066, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/debug.h'}, {'damage_type': 'backtrace', 'id': 2677547466, 'ino': 1099511637043, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p'}, {'damage_type': 'backtrace', 'id': 2678679093, 'ino': 1099511637067, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.c'}, {'damage_type': 'backtrace', 'id': 2716159954, 'ino': 1099511637053, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1f'}, {'damage_type': 'backtrace', 'id': 2722360243, 'ino': 1099511637055, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test1c8'}, {'damage_type': 'backtrace', 'id': 2796744715, 'ino': 1099511636990, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug'}, {'damage_type': 'backtrace', 'id': 2800306897, 'ino': 1099511637068, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/commands.c'}, {'damage_type': 'backtrace', 'id': 2910919224, 'ino': 1099511637049, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/TODO'}, {'damage_type': 'backtrace', 'id': 3036661813, 'ino': 1099511637059, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test3l'}, {'damage_type': 'backtrace', 'id': 3066342670, 'ino': 1099511637003, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug07.sh'}, {'damage_type': 'backtrace', 'id': 3143218132, 'ino': 1099511637006, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug02.sh'}, {'damage_type': 'backtrace', 'id': 3152591068, 'ino': 1099511636992, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc'}, {'damage_type': 'backtrace', 'id': 3216473865, 'ino': 1099511637039, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch'}, {'damage_type': 'backtrace', 'id': 3301688157, 'ino': 1099511637253, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/relabel/selinux_relabel.sh'}, {'damage_type': 'backtrace', 'id': 3394561581, 'ino': 1099511637027, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m'}, {'damage_type': 'backtrace', 'id': 3412470040, 'ino': 1099511637036, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch'}, {'damage_type': 'backtrace', 'id': 3439635960, 'ino': 1099511637047, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/README'}, {'damage_type': 'backtrace', 'id': 3440846564, 'ino': 1099511637028, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p'}, {'damage_type': 'backtrace', 'id': 3481283523, 'ino': 1099511633574, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3485453610, 'ino': 1099511637009, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools'}, {'damage_type': 'backtrace', 'id': 3503939717, 'ino': 1099511637033, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g'}, {'damage_type': 'backtrace', 'id': 3548706371, 'ino': 1099511637019, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/runtests.sh'}, {'damage_type': 'backtrace', 'id': 3737843725, 'ino': 1099511637038, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved'}, {'damage_type': 'backtrace', 'id': 3761915294, 'ino': 1099511637065, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/memtoy.h'}, {'damage_type': 'backtrace', 'id': 3823564282, 'ino': 1099511637001, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/functional/hotplug06.top.sh'}, {'damage_type': 'backtrace', 'id': 3839245848, 'ino': 1099511637030, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m'}, {'damage_type': 'backtrace', 'id': 3861367907, 'ino': 1099511637056, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test4f'}, {'damage_type': 'backtrace', 'id': 3872375772, 'ino': 1099511637032, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig'}, {'damage_type': 'backtrace', 'id': 4005535560, 'ino': 1099511637046, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p'}, {'damage_type': 'backtrace', 'id': 4012138688, 'ino': 1099511636994, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug04.txt'}, {'damage_type': 'backtrace', 'id': 4029046182, 'ino': 1099511637010, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/tools/do_disk_write_loop'}, {'damage_type': 'backtrace', 'id': 4045752845, 'ino': 1099511636999, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/hotplug03.txt'}, {'damage_type': 'backtrace', 'id': 4123013863, 'ino': 1099511637057, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Scripts/test2l'}, {'damage_type': 'backtrace', 'id': 4183552683, 'ino': 1099511636995, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/doc/todo.txt'}, {'damage_type': 'backtrace', 'id': 4188754685, 'ino': 1099511633575, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/asctime/1-1.c'}, {'damage_type': 'backtrace', 'id': 4202330915, 'ino': 1099511637014, 'path': '/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/cpu_hotplug/README'}] 2024-03-16T10:53:40.924 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-03-16T10:53:42.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:42 smithi017 ceph-mon[32078]: pgmap v437: 97 pgs: 97 active+clean; 1.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 MiB/s rd, 85 MiB/s wr, 609 op/s 2024-03-16T10:53:42.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:42 smithi111 ceph-mon[36315]: pgmap v437: 97 pgs: 97 active+clean; 1.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 MiB/s rd, 85 MiB/s wr, 609 op/s 2024-03-16T10:53:42.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:42 smithi174 ceph-mon[36202]: pgmap v437: 97 pgs: 97 active+clean; 1.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 66 MiB/s rd, 85 MiB/s wr, 609 op/s 2024-03-16T10:53:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 -- 172.21.15.17:0/1451411666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c1018f0 msgr2=0x7fa53c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 --2- 172.21.15.17:0/1451411666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c1018f0 0x7fa53c101d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009900 tx=0x7fa52c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:53:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 -- 172.21.15.17:0/1451411666 shutdown_connections 2024-03-16T10:53:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 --2- 172.21.15.17:0/1451411666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 0x7fa53c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 --2- 172.21.15.17:0/1451411666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c1018f0 0x7fa53c101d70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 --2- 172.21.15.17:0/1451411666 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c100700 0x7fa53c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.289+0000 7fa544510640 1 -- 172.21.15.17:0/1451411666 >> 172.21.15.17:0/1451411666 conn(0x7fa53c0fbc70 msgr2=0x7fa53c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- 172.21.15.17:0/1451411666 shutdown_connections 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- 172.21.15.17:0/1451411666 wait complete. 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 Processor -- start 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- start start 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c1018f0 0x7fa53c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 0x7fa53c1a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d4a0 con 0x7fa53c100700 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d320 con 0x7fa53c1018f0 2024-03-16T10:53:43.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa544510640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c10d620 con 0x7fa53c1022b0 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35496/0 (socket says 172.21.15.17:35496) 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa5422ac640 1 -- 172.21.15.17:0/2606833431 learned_addr learned my addr 172.21.15.17:0/2606833431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa541aab640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c1018f0 0x7fa53c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.290+0000 7fa542aad640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 0x7fa53c1a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 -- 172.21.15.17:0/2606833431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 msgr2=0x7fa53c1a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 0x7fa53c1a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 -- 172.21.15.17:0/2606833431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c1018f0 msgr2=0x7fa53c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c1018f0 0x7fa53c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 -- 172.21.15.17:0/2606833431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c1a18f0 con 0x7fa53c100700 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa53800e9c0 tx=0x7fa53800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5337fe640 1 -- 172.21.15.17:0/2606833431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53800cd80 con 0x7fa53c100700 2024-03-16T10:53:43.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c1a1be0 con 0x7fa53c100700 2024-03-16T10:53:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5337fe640 1 -- 172.21.15.17:0/2606833431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5380035f0 con 0x7fa53c100700 2024-03-16T10:53:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa5337fe640 1 -- 172.21.15.17:0/2606833431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538010690 con 0x7fa53c100700 2024-03-16T10:53:43.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.291+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c1a2150 con 0x7fa53c100700 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.293+0000 7fa5337fe640 1 -- 172.21.15.17:0/2606833431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fa5380037a0 con 0x7fa53c100700 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 Processor -- start 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5337fe640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 0x7fa5280a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5337fe640 1 -- 172.21.15.17:0/2606833431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa5380ceda0 con 0x7fa53c100700 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 -- start start 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa542aad640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 0x7fa5280a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 0x55b5593bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b559319a40 con 0x55b5593b4d30 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b5592c2920 con 0x55b5593b4340 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5471d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b559315ae0 con 0x55b5593b9ea0 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa541aab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa541aab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35498/0 (socket says 172.21.15.17:35498) 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa541aab640 1 -- 172.21.15.17:0/3401154447 learned_addr learned my addr 172.21.15.17:0/3401154447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.294+0000 7fa542aad640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 0x55b5593bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa542aad640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 0x7fa5280a4d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa534005fd0 tx=0x7fa534009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 -- 172.21.15.17:0/3401154447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 msgr2=0x55b5593bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 0x55b5593bc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 -- 172.21.15.17:0/3401154447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 msgr2=0x55b5593b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 -- 172.21.15.17:0/3401154447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5592da460 con 0x55b5593b4d30 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa542aad640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 0x55b5593bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa5422ac640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa541aab640 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009900 tx=0x7fa52c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b521ef6bb9564035 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa530bfe640 1 -- 172.21.15.17:0/3401154447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c02cb80 con 0x55b5593b4d30 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa530bfe640 1 -- 172.21.15.17:0/3401154447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa52c005040 con 0x55b5593b4d30 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.295+0000 7fa530bfe640 1 -- 172.21.15.17:0/3401154447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c004920 con 0x55b5593b4d30 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 -- 172.21.15.17:0/3401154447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 msgr2=0x55b5593b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009900 tx=0x7fa52c009560 comp rx=0 tx=0).stop 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 -- 172.21.15.17:0/3401154447 shutdown_connections 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b9ea0 0x55b5593bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4d30 0x55b5593b9830 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 --2- 172.21.15.17:0/3401154447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 -- 172.21.15.17:0/3401154447 >> 172.21.15.17:0/3401154447 conn(0x55b5593af8b0 msgr2=0x55b5593afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 -- 172.21.15.17:0/3401154447 shutdown_connections 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.296+0000 7fa5471d8740 1 -- 172.21.15.17:0/3401154447 wait complete. 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 -- start start 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 Processor -- start 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593beb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b5593bcdf0 con 0x55b5593b4340 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55b5592d5d70 con 0x55b5593b9ea0 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5593bcf70 con 0x55b5593b4d30 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5471d8740 10 client.0 _ll_register_callbacks cb 0x55b55902da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35508/0 (socket says 172.21.15.17:35508) 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 -- 172.21.15.17:0/1585022843 learned_addr learned my addr 172.21.15.17:0/1585022843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa541aab640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593beb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa542aad640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 -- 172.21.15.17:0/1585022843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 msgr2=0x55b5593beb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593beb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 -- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 msgr2=0x55b5593c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 -- 172.21.15.17:0/1585022843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b55902e210 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa53809b4e0 tx=0x7fa53809bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cbb1daf2e52566 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.297+0000 7fa525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380a3f80 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa5380860b0 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa52c005040 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa538097e50 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 10 client.16413 fetch_fsmap learned FSMap version 38 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b5590fa620 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa52c005040 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 38) ==== 8426+0+0 (secure 0 0 0) 0x7fa53809ac30 con 0x55b5593b4340 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 10 client.16413 fetch_fsmap finished waiting for FSMap version 38 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 20 client.16413 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5593ca520 0x55b5593cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 4 client.16413 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b559326f80 con 0x55b5593ca520 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.298+0000 7fa541aab640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5593ca520 0x55b5593cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.299+0000 7fa525ffb640 10 client.16413 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.299+0000 7fa541aab640 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5593ca520 0x55b5593cc9c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20006adb76cd986d server_cookie=bca45e1ca3aeda13 in_seq=0 out_seq=0 2024-03-16T10:53:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.301+0000 7fa525ffb640 1 -- 172.21.15.17:0/1585022843 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b559326f80 con 0x55b5593ca520 2024-03-16T10:53:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.301+0000 7fa525ffb640 10 client.16413 handle_command_reply: tid=0 2024-03-16T10:53:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 client.16413 shutdown 2024-03-16T10:53:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 msgr2=0x55b5593be5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa53809b4e0 tx=0x7fa53809bfa0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 shutdown_connections 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b5593ca520 0x55b5593cc9c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593beb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1585022843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593be5f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 >> 172.21.15.17:0/1585022843 conn(0x55b5593af8b0 msgr2=0x55b5593aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa525ffb640 0 client.16413 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 shutdown_connections 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 1 -- 172.21.15.17:0/1585022843 wait complete. 2024-03-16T10:53:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.302+0000 7fa5471d8740 20 client.16413 trim_cache size 0 max 16384 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 Processor -- start 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 -- start start 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593bea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1aac00 con 0x55b5593b9ea0 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1ac920 con 0x55b5593b4340 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.322+0000 7fa5471d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1ab2d0 con 0x55b5593b4d30 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa542aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa542aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35518/0 (socket says 172.21.15.17:35518) 2024-03-16T10:53:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa542aad640 1 -- 172.21.15.17:0/2088685648 learned_addr learned my addr 172.21.15.17:0/2088685648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593bea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa541aab640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 -- 172.21.15.17:0/2088685648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 msgr2=0x55b5593aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 -- 172.21.15.17:0/2088685648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 msgr2=0x55b5593ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 -- 172.21.15.17:0/2088685648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5593b0300 con 0x55b5593b4340 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa542aad640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa5422ac640 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593bea90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa538097c40 tx=0x7fa538099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=883eee9f964eefe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa527fff640 1 -- 172.21.15.17:0/2088685648 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538097ff0 con 0x55b5593b4340 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa527fff640 1 -- 172.21.15.17:0/2088685648 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5380a3f80 con 0x55b5593b4340 2024-03-16T10:53:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.323+0000 7fa527fff640 1 -- 172.21.15.17:0/2088685648 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380afbc0 con 0x55b5593b4340 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- 172.21.15.17:0/2088685648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 msgr2=0x55b5593bea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593bea90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa538097c40 tx=0x7fa538099cf0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- 172.21.15.17:0/2088685648 shutdown_connections 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b9ea0 0x55b5593ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 --2- 172.21.15.17:0/2088685648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b4340 0x55b5593bea90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- 172.21.15.17:0/2088685648 >> 172.21.15.17:0/2088685648 conn(0x55b5593af8b0 msgr2=0x55b5593bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- 172.21.15.17:0/2088685648 shutdown_connections 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- 172.21.15.17:0/2088685648 wait complete. 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.324+0000 7fa5471d8740 1 -- start start 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 Processor -- start 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1ac190 con 0x55b5593b4340 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1aba60 con 0x55b5593b9ea0 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c1a8be0 con 0x55b5593b4d30 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5471d8740 10 client.0 _ll_register_callbacks cb 0x7fa5380046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa542aad640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35534/0 (socket says 172.21.15.17:35534) 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa541aab640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 -- 172.21.15.17:0/1619988213 learned_addr learned my addr 172.21.15.17:0/1619988213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 -- 172.21.15.17:0/1619988213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 msgr2=0x55b5593c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 -- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 msgr2=0x55b5593c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 -- 172.21.15.17:0/1619988213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5593c3ce0 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa5422ac640 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa5380058c0 tx=0x7fa53809ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2084d5875fe0d03 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.325+0000 7fa525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538097ff0 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fa5380afbc0 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5380a3f80 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa5380977a0 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa5471d8740 10 client.16419 fetch_fsmap learned FSMap version 38 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b559431270 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.326+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5380a3f80 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 38) ==== 8426+0+0 (secure 0 0 0) 0x7fa5380a9030 con 0x55b5593b4340 2024-03-16T10:53:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 10 client.16419 fetch_fsmap finished waiting for FSMap version 38 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 20 client.16419 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b559431b00 0x55b559433f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 4 client.16419 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5593212d0 con 0x55b559431b00 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa541aab640 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b559431b00 0x55b559433f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa525ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.327+0000 7fa541aab640 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b559431b00 0x55b559433f20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=604b6ff8f01c3259 server_cookie=ceb2ee474faadbae in_seq=0 out_seq=0 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.437+0000 7fa525ffb640 1 -- 172.21.15.17:0/1619988213 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5593212d0 con 0x55b559431b00 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.437+0000 7fa525ffb640 10 client.16419 handle_command_reply: tid=0 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.437+0000 7fa5471d8740 1 client.16419 shutdown 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 msgr2=0x55b5593c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa5380058c0 tx=0x7fa53809ac30 comp rx=0 tx=0).stop 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 shutdown_connections 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55b559431b00 0x55b559433f20 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa525ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55b5593b9ea0 0x55b5593c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5593b4d30 0x55b5593c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 --2- 172.21.15.17:0/1619988213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b5593b4340 0x55b5593c5060 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 >> 172.21.15.17:0/1619988213 conn(0x55b5593af8b0 msgr2=0x55b5593aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 shutdown_connections 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 1 -- 172.21.15.17:0/1619988213 wait complete. 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.438+0000 7fa5471d8740 20 client.16419 trim_cache size 0 max 16384 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:53:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 msgr2=0x7fa5280a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 0x7fa5280a4d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa534005fd0 tx=0x7fa534009500 comp rx=0 tx=0).stop 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 msgr2=0x7fa53c199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa53800e9c0 tx=0x7fa53800ee80 comp rx=0 tx=0).stop 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 shutdown_connections 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fa5280a28a0 0x7fa5280a4d60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa53c1022b0 0x7fa53c1a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa53c1018f0 0x7fa53c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 --2- 172.21.15.17:0/2606833431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100700 0x7fa53c199d00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 >> 172.21.15.17:0/2606833431 conn(0x7fa53c0fbc70 msgr2=0x7fa53c109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 shutdown_connections 2024-03-16T10:53:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:43.439+0000 7fa544510640 1 -- 172.21.15.17:0/2606833431 wait complete. 2024-03-16T10:53:43.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:43 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:43.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:43 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:43.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:43 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:44.119 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-16T10:53:44.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-16T10:53:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:44 smithi017 ceph-mon[32078]: pgmap v438: 97 pgs: 97 active+clean; 678 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 567 op/s 2024-03-16T10:53:44.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:44 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:44 smithi111 ceph-mon[36315]: pgmap v438: 97 pgs: 97 active+clean; 678 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 567 op/s 2024-03-16T10:53:44.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:44 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:44 smithi174 ceph-mon[36202]: pgmap v438: 97 pgs: 97 active+clean; 678 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 51 MiB/s rd, 68 MiB/s wr, 567 op/s 2024-03-16T10:53:44.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:44 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:53:46.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:46 smithi111 ceph-mon[36315]: pgmap v439: 97 pgs: 97 active+clean; 549 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 304 op/s 2024-03-16T10:53:46.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:46 smithi174 ceph-mon[36202]: pgmap v439: 97 pgs: 97 active+clean; 549 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 304 op/s 2024-03-16T10:53:46.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:46 smithi017 ceph-mon[32078]: pgmap v439: 97 pgs: 97 active+clean; 549 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 304 op/s 2024-03-16T10:53:48.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:48 smithi017 ceph-mon[32078]: pgmap v440: 97 pgs: 97 active+clean; 258 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.3 MiB/s wr, 367 op/s 2024-03-16T10:53:48.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:48 smithi111 ceph-mon[36315]: pgmap v440: 97 pgs: 97 active+clean; 258 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.3 MiB/s wr, 367 op/s 2024-03-16T10:53:48.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:48 smithi174 ceph-mon[36202]: pgmap v440: 97 pgs: 97 active+clean; 258 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.3 MiB/s wr, 367 op/s 2024-03-16T10:53:50.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:50 smithi111 ceph-mon[36315]: pgmap v441: 97 pgs: 97 active+clean; 109 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-03-16T10:53:50.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:50 smithi174 ceph-mon[36202]: pgmap v441: 97 pgs: 97 active+clean; 109 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-03-16T10:53:50.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:50 smithi017 ceph-mon[32078]: pgmap v441: 97 pgs: 97 active+clean; 109 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 365 op/s 2024-03-16T10:53:52.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:52 smithi111 ceph-mon[36315]: pgmap v442: 97 pgs: 97 active+clean; 83 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1.1 MiB/s wr, 364 op/s 2024-03-16T10:53:52.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:52 smithi174 ceph-mon[36202]: pgmap v442: 97 pgs: 97 active+clean; 83 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1.1 MiB/s wr, 364 op/s 2024-03-16T10:53:52.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:52 smithi017 ceph-mon[32078]: pgmap v442: 97 pgs: 97 active+clean; 83 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 1.1 MiB/s wr, 364 op/s 2024-03-16T10:53:54.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:54 smithi174 ceph-mon[36202]: pgmap v443: 97 pgs: 97 active+clean; 85 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 963 KiB/s wr, 384 op/s 2024-03-16T10:53:54.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:54 smithi111 ceph-mon[36315]: pgmap v443: 97 pgs: 97 active+clean; 85 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 963 KiB/s wr, 384 op/s 2024-03-16T10:53:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:54 smithi017 ceph-mon[32078]: pgmap v443: 97 pgs: 97 active+clean; 85 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 963 KiB/s wr, 384 op/s 2024-03-16T10:53:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.553+0000 7f5db119b640 1 -- 172.21.15.17:0/4236886603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c02cc90 con 0x7f5dac102150 2024-03-16T10:53:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 -- 172.21.15.17:0/4236886603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac102150 msgr2=0x7f5dac104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 --2- 172.21.15.17:0/4236886603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac102150 0x7f5dac104540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009900 tx=0x7f5d9c02bc40 comp rx=0 tx=0).stop 2024-03-16T10:53:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 -- 172.21.15.17:0/4236886603 shutdown_connections 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 --2- 172.21.15.17:0/4236886603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac1073b0 0x7f5dac1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 --2- 172.21.15.17:0/4236886603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac104a80 0x7f5dac106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 --2- 172.21.15.17:0/4236886603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac102150 0x7f5dac104540 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 -- 172.21.15.17:0/4236886603 >> 172.21.15.17:0/4236886603 conn(0x7f5dac0fbac0 msgr2=0x7f5dac0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.554+0000 7f5db319f640 1 -- 172.21.15.17:0/4236886603 shutdown_connections 2024-03-16T10:53:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.555+0000 7f5db319f640 1 -- 172.21.15.17:0/4236886603 wait complete. 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.555+0000 7f5db319f640 1 Processor -- start 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.555+0000 7f5db319f640 1 -- start start 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac104a80 0x7f5dac197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac1073b0 0x7f5dac19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10d320 con 0x7f5dac1073b0 2024-03-16T10:53:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10d1a0 con 0x7f5dac102150 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db319f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac10d4a0 con 0x7f5dac104a80 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:58810/0 (socket says 172.21.15.17:58810) 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 -- 172.21.15.17:0/3969624707 learned_addr learned my addr 172.21.15.17:0/3969624707 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db299e640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac1073b0 0x7f5dac19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 -- 172.21.15.17:0/3969624707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac104a80 msgr2=0x7f5dac197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac104a80 0x7f5dac197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 -- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac1073b0 msgr2=0x7f5dac19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac1073b0 0x7f5dac19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 -- 172.21.15.17:0/3969624707 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac19f590 con 0x7f5dac102150 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.556+0000 7f5db219d640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009230 tx=0x7f5d9c02c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.557+0000 7f5da37fe640 1 -- 172.21.15.17:0/3969624707 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c041070 con 0x7f5dac102150 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.557+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac19f820 con 0x7f5dac102150 2024-03-16T10:53:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.557+0000 7f5da37fe640 1 -- 172.21.15.17:0/3969624707 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9c004450 con 0x7f5dac102150 2024-03-16T10:53:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.557+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac19fd60 con 0x7f5dac102150 2024-03-16T10:53:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.557+0000 7f5da37fe640 1 -- 172.21.15.17:0/3969624707 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c04b060 con 0x7f5dac102150 2024-03-16T10:53:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.559+0000 7f5da37fe640 1 -- 172.21.15.17:0/3969624707 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f5d9c044070 con 0x7f5dac102150 2024-03-16T10:53:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.559+0000 7f5db6fdf740 1 Processor -- start 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.559+0000 7f5db6fdf740 1 -- start start 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d36c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ce40 0x55845d36f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d37ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55845d2d1a40 con 0x55845d36c450 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55845d27a920 con 0x55845d36ffa0 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55845d2cdae0 con 0x55845d36ce40 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db299e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d36c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db299e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d36c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53840/0 (socket says 172.21.15.17:53840) 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db299e640 1 -- 172.21.15.17:0/2023431953 learned_addr learned my addr 172.21.15.17:0/2023431953 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d37ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5da37fe640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 0x7f5d980a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db219d640 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ce40 0x55845d36f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db299e640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 0x7f5d980a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5da37fe640 1 -- 172.21.15.17:0/3969624707 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5d9c0f0930 con 0x7f5dac102150 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 -- 172.21.15.17:0/2023431953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ce40 msgr2=0x55845d36f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ce40 0x55845d36f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 -- 172.21.15.17:0/2023431953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 msgr2=0x55845d36c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d36c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 -- 172.21.15.17:0/2023431953 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845d292460 con 0x55845d36ffa0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.560+0000 7f5db199c640 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d37ce10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5dac069920 tx=0x7f5da800e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c409c9592ce0184d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5da0bfe640 1 -- 172.21.15.17:0/2023431953 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da800ed20 con 0x55845d36ffa0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5da0bfe640 1 -- 172.21.15.17:0/2023431953 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5da8005020 con 0x55845d36ffa0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5da0bfe640 1 -- 172.21.15.17:0/2023431953 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8004af0 con 0x55845d36ffa0 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2023431953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 msgr2=0x55845d37ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d37ce10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5dac069920 tx=0x7f5da800e350 comp rx=0 tx=0).stop 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db299e640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 0x7f5d980a4cb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55845d36d6a0 tx=0x7f5da4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2023431953 shutdown_connections 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d37ce10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ce40 0x55845d36f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2023431953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d36c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.561+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2023431953 >> 172.21.15.17:0/2023431953 conn(0x55845d367a40 msgr2=0x55845d367e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2023431953 shutdown_connections 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2023431953 wait complete. 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- start start 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 Processor -- start 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d37f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ffa0 0x55845d386560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55845d37d810 con 0x55845d36c450 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55845d28dd70 con 0x55845d36ce40 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55845d37d990 con 0x55845d36ffa0 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db6fdf740 10 client.0 _ll_register_callbacks cb 0x55845cfe5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db219d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db219d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53856/0 (socket says 172.21.15.17:53856) 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db219d640 1 -- 172.21.15.17:0/2347239411 learned_addr learned my addr 172.21.15.17:0/2347239411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db199c640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d37f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.562+0000 7f5db299e640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ffa0 0x55845d386560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 -- 172.21.15.17:0/2347239411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ffa0 msgr2=0x55845d386560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ffa0 0x55845d386560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 -- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 msgr2=0x55845d37f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d37f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 -- 172.21.15.17:0/2347239411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845cfe6210 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db219d640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0bd300 tx=0x7f5d9c0bcf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429310667fe87c04 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0bd370 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5d9c0c1120 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5da8005020 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5d9c0c14c0 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db6fdf740 10 client.16431 fetch_fsmap learned FSMap version 39 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55845d0b2620 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5da8005020 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.563+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) ==== 8430+0+0 (secure 0 0 0) 0x7f5d9c0dd0b0 con 0x55845d36c450 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 10 client.16431 fetch_fsmap finished waiting for FSMap version 39 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 20 client.16431 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d38d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 4 client.16431 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55845d2def80 con 0x55845d38b060 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db199c640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d38d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5db199c640 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d38d520 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f5755f6004223b server_cookie=249ad5a35014d2f6 in_seq=0 out_seq=0 2024-03-16T10:53:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.564+0000 7f5d95ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5d95ffb640 1 -- 172.21.15.17:0/2347239411 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55845d2def80 con 0x55845d38b060 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5d95ffb640 10 client.16431 handle_command_reply: tid=0 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 client.16431 shutdown 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 msgr2=0x55845d37efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0bd300 tx=0x7f5d9c0bcf70 comp rx=0 tx=0).stop 2024-03-16T10:53:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 shutdown_connections 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d38d520 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5d95ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36ffa0 0x55845d386560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d37f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/2347239411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36c450 0x55845d37efe0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 >> 172.21.15.17:0/2347239411 conn(0x55845d367a40 msgr2=0x55845d366c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 shutdown_connections 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 1 -- 172.21.15.17:0/2347239411 wait complete. 2024-03-16T10:53:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.565+0000 7f5db6fdf740 20 client.16431 trim_cache size 0 max 16384 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 Processor -- start 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 -- start start 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d391b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a6780 con 0x55845d36ce40 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a84d0 con 0x55845d36ffa0 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a6e50 con 0x55845d36c450 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db219d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db219d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33056/0 (socket says 172.21.15.17:33056) 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53872/0 (socket says 172.21.15.17:53872) 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db219d640 1 -- 172.21.15.17:0/1801868734 learned_addr learned my addr 172.21.15.17:0/1801868734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db299e640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d391b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 -- 172.21.15.17:0/1801868734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 msgr2=0x55845d37ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 -- 172.21.15.17:0/1801868734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 msgr2=0x55845d391b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d391b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db199c640 1 -- 172.21.15.17:0/1801868734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845d36c090 con 0x55845d36ce40 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db219d640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.580+0000 7f5db299e640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d391b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db199c640 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5da8005770 tx=0x7f5da800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25636468ab47796 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5d97fff640 1 -- 172.21.15.17:0/1801868734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8029020 con 0x55845d36ce40 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5d97fff640 1 -- 172.21.15.17:0/1801868734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5da80097c0 con 0x55845d36ce40 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5d97fff640 1 -- 172.21.15.17:0/1801868734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8029740 con 0x55845d36ce40 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1801868734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 msgr2=0x55845d37f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5da8005770 tx=0x7f5da800e980 comp rx=0 tx=0).stop 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1801868734 shutdown_connections 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ffa0 0x55845d391b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ce40 0x55845d37f130 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1801868734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d37ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1801868734 >> 172.21.15.17:0/1801868734 conn(0x55845d367a40 msgr2=0x55845d36aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1801868734 shutdown_connections 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.581+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1801868734 wait complete. 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 -- start start 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 Processor -- start 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 0x55845d3efe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a7d40 con 0x55845d36ffa0 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a75e0 con 0x55845d36ce40 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1a4760 con 0x55845d36c450 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db6fdf740 10 client.0 _ll_register_callbacks cb 0x7f5d9c0b96e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db219d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db299e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 0x55845d3efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:58856/0 (socket says 172.21.15.17:58856) 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db219d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33068/0 (socket says 172.21.15.17:33068) 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 -- 172.21.15.17:0/1040149669 learned_addr learned my addr 172.21.15.17:0/1040149669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 -- 172.21.15.17:0/1040149669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 msgr2=0x55845d3eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 -- 172.21.15.17:0/1040149669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 msgr2=0x55845d3efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 0x55845d3efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db199c640 1 -- 172.21.15.17:0/1040149669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845d386950 con 0x55845d36ce40 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db219d640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.582+0000 7f5db299e640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 0x55845d3efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db199c640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009ae0 tx=0x7f5da800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dbda8c9c6339f8e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8037060 con 0x55845d36ce40 2024-03-16T10:53:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mon.2 v2:172.21.15.111:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f5da8029640 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55845d2d92d0 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5da8018470 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 10 client.26294 fetch_fsmap learned FSMap version 39 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55845d3f1790 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mon.2 v2:172.21.15.111:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55845d2d92d0 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mon.2 v2:172.21.15.111:3300/0 5 ==== fsmap(e 39) ==== 8430+0+0 (secure 0 0 0) 0x7f5da803c070 con 0x55845d36ce40 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 10 client.26294 fetch_fsmap finished waiting for FSMap version 39 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 10 client.26294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 20 client.26294 populate_metadata read hostname 'smithi017' 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d3f4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 4 client.26294 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.583+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55845d257770 con 0x55845d38b060 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.584+0000 7f5db219d640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d3f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:53:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.584+0000 7f5db219d640 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d3f4090 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc12d6f1c1736a2f server_cookie=a2adef0587999c26 in_seq=0 out_seq=0 2024-03-16T10:53:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.584+0000 7f5d95ffb640 10 client.26294 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:56.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:56 smithi111 ceph-mon[36315]: pgmap v444: 97 pgs: 97 active+clean; 84 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5d95ffb640 1 -- 172.21.15.17:0/1040149669 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55845d257770 con 0x55845d38b060 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5d95ffb640 10 client.26294 handle_command_reply: tid=0 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 client.26294 shutdown 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 msgr2=0x55845d3ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009ae0 tx=0x7f5da800ef10 comp rx=0 tx=0).stop 2024-03-16T10:53:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 shutdown_connections 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55845d38b060 0x55845d3f4090 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55845d36ffa0 0x55845d3efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55845d36ce40 0x55845d3ed8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5d95ffb640 0 client.26294 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 --2- 172.21.15.17:0/1040149669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55845d36c450 0x55845d3eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 >> 172.21.15.17:0/1040149669 conn(0x55845d367a40 msgr2=0x55845d37eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 shutdown_connections 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.672+0000 7f5db6fdf740 1 -- 172.21.15.17:0/1040149669 wait complete. 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db6fdf740 20 client.26294 trim_cache size 0 max 16384 2024-03-16T10:53:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:53:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:53:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:53:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:53:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 msgr2=0x7f5d980a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 0x7f5d980a4cb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55845d36d6a0 tx=0x7f5da4004ab0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 msgr2=0x7f5dac197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009230 tx=0x7f5d9c02c660 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 shutdown_connections 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f5d980a27f0 0x7f5d980a4cb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dac1073b0 0x7f5dac19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dac104a80 0x7f5dac197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 --2- 172.21.15.17:0/3969624707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dac102150 0x7f5dac197970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.673+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 >> 172.21.15.17:0/3969624707 conn(0x7f5dac0fbac0 msgr2=0x7f5dac102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.674+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 shutdown_connections 2024-03-16T10:53:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:53:56.674+0000 7f5db319f640 1 -- 172.21.15.17:0/3969624707 wait complete. 2024-03-16T10:53:56.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:56 smithi174 ceph-mon[36202]: pgmap v444: 97 pgs: 97 active+clean; 84 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:53:56.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:56 smithi017 ceph-mon[32078]: pgmap v444: 97 pgs: 97 active+clean; 84 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:53:58.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:53:58 smithi111 ceph-mon[36315]: pgmap v445: 97 pgs: 97 active+clean; 83 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 389 op/s 2024-03-16T10:53:58.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:53:58 smithi174 ceph-mon[36202]: pgmap v445: 97 pgs: 97 active+clean; 83 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 389 op/s 2024-03-16T10:53:58.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:53:58 smithi017 ceph-mon[32078]: pgmap v445: 97 pgs: 97 active+clean; 83 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 389 op/s 2024-03-16T10:54:00.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:00 smithi111 ceph-mon[36315]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 768 KiB/s wr, 319 op/s 2024-03-16T10:54:00.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:00 smithi174 ceph-mon[36202]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 768 KiB/s wr, 319 op/s 2024-03-16T10:54:00.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:00 smithi017 ceph-mon[32078]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 768 KiB/s wr, 319 op/s 2024-03-16T10:54:02.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:02 smithi111 ceph-mon[36315]: pgmap v447: 97 pgs: 97 active+clean; 75 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-03-16T10:54:02.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:02 smithi174 ceph-mon[36202]: pgmap v447: 97 pgs: 97 active+clean; 75 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-03-16T10:54:02.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:02 smithi017 ceph-mon[32078]: pgmap v447: 97 pgs: 97 active+clean; 75 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-03-16T10:54:04.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:04 smithi111 ceph-mon[36315]: pgmap v448: 97 pgs: 97 active+clean; 70 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 356 op/s 2024-03-16T10:54:04.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:04 smithi174 ceph-mon[36202]: pgmap v448: 97 pgs: 97 active+clean; 70 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 356 op/s 2024-03-16T10:54:04.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:04 smithi017 ceph-mon[32078]: pgmap v448: 97 pgs: 97 active+clean; 70 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 356 op/s 2024-03-16T10:54:06.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:06 smithi111 ceph-mon[36315]: pgmap v449: 97 pgs: 97 active+clean; 71 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-03-16T10:54:06.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:06 smithi174 ceph-mon[36202]: pgmap v449: 97 pgs: 97 active+clean; 71 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-03-16T10:54:06.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:06 smithi017 ceph-mon[32078]: pgmap v449: 97 pgs: 97 active+clean; 71 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-03-16T10:54:08.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:08 smithi111 ceph-mon[36315]: pgmap v450: 97 pgs: 97 active+clean; 68 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-03-16T10:54:08.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:08 smithi174 ceph-mon[36202]: pgmap v450: 97 pgs: 97 active+clean; 68 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-03-16T10:54:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:08 smithi017 ceph-mon[32078]: pgmap v450: 97 pgs: 97 active+clean; 68 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-03-16T10:54:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2869340522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 msgr2=0x7f469c100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2869340522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c100b20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f468c009ca0 tx=0x7f468c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2869340522 shutdown_connections 2024-03-16T10:54:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2869340522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 0x7f469c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2869340522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 0x7f469c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2869340522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c100b20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2869340522 >> 172.21.15.17:0/2869340522 conn(0x7f469c0fbc70 msgr2=0x7f469c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2869340522 shutdown_connections 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2869340522 wait complete. 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 Processor -- start 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.766+0000 7f46a1bdf640 1 -- start start 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 0x7f469c198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 0x7f469c19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f469c10d460 con 0x7f469c100700 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f469c10d2e0 con 0x7f469c1018f0 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f469c10d5e0 con 0x7f469c1022b0 2024-03-16T10:54:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45004/0 (socket says 172.21.15.17:45004) 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 -- 172.21.15.17:0/2082334610 learned_addr learned my addr 172.21.15.17:0/2082334610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469affd640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 0x7f469c198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469bfff640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 0x7f469c19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 -- 172.21.15.17:0/2082334610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 msgr2=0x7f469c19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 0x7f469c19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 -- 172.21.15.17:0/2082334610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 msgr2=0x7f469c198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 0x7f469c198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 -- 172.21.15.17:0/2082334610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c19f6e0 con 0x7f469c100700 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f469b7fe640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468c0324c0 tx=0x7f468c032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f4698ff9640 1 -- 172.21.15.17:0/2082334610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c041020 con 0x7f469c100700 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f4698ff9640 1 -- 172.21.15.17:0/2082334610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f468c034cd0 con 0x7f469c100700 2024-03-16T10:54:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c19f970 con 0x7f469c100700 2024-03-16T10:54:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.767+0000 7f4698ff9640 1 -- 172.21.15.17:0/2082334610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c039040 con 0x7f469c100700 2024-03-16T10:54:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.768+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c19fe60 con 0x7f469c100700 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f4698ff9640 1 -- 172.21.15.17:0/2082334610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f468c044020 con 0x7f469c100700 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 Processor -- start 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 -- start start 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d860830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d863330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a92d7c0a40 con 0x55a92d85b340 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a92d769920 con 0x55a92d85bd30 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f46a47c9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a92d7bcae0 con 0x55a92d860ea0 2024-03-16T10:54:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45014/0 (socket says 172.21.15.17:45014) 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 -- 172.21.15.17:0/3414321525 learned_addr learned my addr 172.21.15.17:0/3414321525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d860830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469affd640 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d863330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 -- 172.21.15.17:0/3414321525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 msgr2=0x55a92d863330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d863330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 -- 172.21.15.17:0/3414321525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 msgr2=0x55a92d860830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d860830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f469bfff640 1 -- 172.21.15.17:0/3414321525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92d781460 con 0x55a92d85b340 2024-03-16T10:54:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.770+0000 7f4698ff9640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 0x7f46840a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f469b7fe640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 0x7f46840a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f469bfff640 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f469400b6b0 tx=0x7f469400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02162457ef2ba72 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f4698ff9640 1 -- 172.21.15.17:0/2082334610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f468c0f0810 con 0x7f469c100700 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f4681ffb640 1 -- 172.21.15.17:0/3414321525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694003bd0 con 0x55a92d85b340 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f4681ffb640 1 -- 172.21.15.17:0/3414321525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4694015070 con 0x55a92d85b340 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.771+0000 7f4681ffb640 1 -- 172.21.15.17:0/3414321525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694011680 con 0x55a92d85b340 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- 172.21.15.17:0/3414321525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 msgr2=0x55a92d85b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f469b7fe640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 0x7f46840a4d60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a92d85c130 tx=0x7f468c0dd040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f469400b6b0 tx=0x7f469400bb70 comp rx=0 tx=0).stop 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- 172.21.15.17:0/3414321525 shutdown_connections 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d863330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d860830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3414321525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d85b760 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- 172.21.15.17:0/3414321525 >> 172.21.15.17:0/3414321525 conn(0x55a92d8568b0 msgr2=0x55a92d856cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- 172.21.15.17:0/3414321525 shutdown_connections 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- 172.21.15.17:0/3414321525 wait complete. 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- start start 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 Processor -- start 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d865ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d86cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a92d863e50 con 0x55a92d85b340 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55a92d77cd70 con 0x55a92d85bd30 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a92d863fd0 con 0x55a92d860ea0 2024-03-16T10:54:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.772+0000 7f46a47c9740 10 client.0 _ll_register_callbacks cb 0x55a92d4d4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45024/0 (socket says 172.21.15.17:45024) 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d865ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 -- 172.21.15.17:0/4048816374 learned_addr learned my addr 172.21.15.17:0/4048816374 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d86cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 -- 172.21.15.17:0/4048816374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 msgr2=0x55a92d86cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d86cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 -- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 msgr2=0x55a92d865ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d865ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 -- 172.21.15.17:0/4048816374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92d4d5210 con 0x55a92d85b340 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f469bfff640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f46940039c0 tx=0x7f4694005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e531eed4cec4a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f467affd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694020070 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f469401a470 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4694015070 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4694032050 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f46a47c9740 10 client.16449 fetch_fsmap learned FSMap version 39 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.773+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a92d5a1620 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4694015070 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) ==== 8430+0+0 (secure 0 0 0) 0x7f4694010440 con 0x55a92d85b340 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 10 client.16449 fetch_fsmap finished waiting for FSMap version 39 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 20 client.16449 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d871290 0x55a92d8736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 4 client.16449 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92d7cdf80 con 0x55a92d871290 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f469affd640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d871290 0x55a92d8736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f467affd640 10 client.16449 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.774+0000 7f469affd640 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d871290 0x55a92d8736b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20cd17b6ee6be332 server_cookie=6cc064ab632293df in_seq=0 out_seq=0 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f467affd640 1 -- 172.21.15.17:0/4048816374 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a92d7cdf80 con 0x55a92d871290 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f467affd640 10 client.16449 handle_command_reply: tid=0 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 client.16449 shutdown 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 msgr2=0x55a92d865660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f46940039c0 tx=0x7f4694005fb0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 shutdown_connections 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d871290 0x55a92d8736b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d86cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f467affd640 0 client.16449 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d865ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 --2- 172.21.15.17:0/4048816374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865660 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 >> 172.21.15.17:0/4048816374 conn(0x55a92d8568b0 msgr2=0x55a92d855bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 shutdown_connections 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 1 -- 172.21.15.17:0/4048816374 wait complete. 2024-03-16T10:54:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.776+0000 7f46a47c9740 20 client.16449 trim_cache size 0 max 16384 2024-03-16T10:54:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 Processor -- start 2024-03-16T10:54:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 -- start start 2024-03-16T10:54:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d86cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d877fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1a8b60 con 0x55a92d85b340 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1aa8b0 con 0x55a92d85bd30 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f46a47c9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1a9230 con 0x55a92d860ea0 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45034/0 (socket says 172.21.15.17:45034) 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f469bfff640 1 -- 172.21.15.17:0/3163538924 learned_addr learned my addr 172.21.15.17:0/3163538924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f469affd640 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d86cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.805+0000 7f469bfff640 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d877fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 -- 172.21.15.17:0/3163538924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 msgr2=0x55a92d877fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d877fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 -- 172.21.15.17:0/3163538924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 msgr2=0x55a92d86cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d86cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 -- 172.21.15.17:0/3163538924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92d873a20 con 0x55a92d85b340 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f469bfff640 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f469400bbb0 tx=0x7f469400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa67b2af7295ccb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46817fa640 1 -- 172.21.15.17:0/3163538924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694020040 con 0x55a92d85b340 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46817fa640 1 -- 172.21.15.17:0/3163538924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4694015070 con 0x55a92d85b340 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46817fa640 1 -- 172.21.15.17:0/3163538924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694010600 con 0x55a92d85b340 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 -- 172.21.15.17:0/3163538924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 msgr2=0x55a92d865980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f469400bbb0 tx=0x7f469400b450 comp rx=0 tx=0).stop 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 -- 172.21.15.17:0/3163538924 shutdown_connections 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d860ea0 0x55a92d877fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85bd30 0x55a92d86cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 --2- 172.21.15.17:0/3163538924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d85b340 0x55a92d865980 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.806+0000 7f46a47c9740 1 -- 172.21.15.17:0/3163538924 >> 172.21.15.17:0/3163538924 conn(0x55a92d8568b0 msgr2=0x55a92d865270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- 172.21.15.17:0/3163538924 shutdown_connections 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- 172.21.15.17:0/3163538924 wait complete. 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- start start 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 Processor -- start 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85b340 0x55a92d86c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 0x55a92d86af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1aa120 con 0x55a92d860ea0 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1a99c0 con 0x55a92d85b340 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1a6b40 con 0x55a92d85bd30 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f46a47c9740 10 client.0 _ll_register_callbacks cb 0x7f468c0f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f469bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45040/0 (socket says 172.21.15.17:45040) 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f469bfff640 1 -- 172.21.15.17:0/932733949 learned_addr learned my addr 172.21.15.17:0/932733949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.807+0000 7f469affd640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 0x55a92d86af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469bfff640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85b340 0x55a92d86c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 -- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85b340 msgr2=0x55a92d86c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85b340 0x55a92d86c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 -- 172.21.15.17:0/932733949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 msgr2=0x55a92d86b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 -- 172.21.15.17:0/932733949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92d86bb00 con 0x55a92d85bd30 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469bfff640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f469affd640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 0x55a92d86af80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a92d873f30 tx=0x7f4690009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b4565b4e55971e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f467affd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-03-16T10:54:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690023030 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4694015070 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f4690005020 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4690005240 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f46a47c9740 10 client.26263 fetch_fsmap learned FSMap version 39 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.808+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a92d8d84d0 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4694015070 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 39) ==== 8430+0+0 (secure 0 0 0) 0x7f46900048c0 con 0x55a92d85bd30 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 10 client.26263 fetch_fsmap finished waiting for FSMap version 39 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 10 client.26263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 20 client.26263 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d8d8f40 0x55a92d8db360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 4 client.26263 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a92d7c82d0 con 0x55a92d8d8f40 2024-03-16T10:54:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f469bfff640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d8d8f40 0x55a92d8db360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f467affd640 10 client.26263 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:09.809+0000 7f469bfff640 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d8d8f40 0x55a92d8db360 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781e6ff6cc1985db server_cookie=7d4898e85d3cf576 in_seq=0 out_seq=0 2024-03-16T10:54:10.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:10 smithi111 ceph-mon[36315]: pgmap v451: 97 pgs: 97 active+clean; 63 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-03-16T10:54:10.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:10 smithi174 ceph-mon[36202]: pgmap v451: 97 pgs: 97 active+clean; 63 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-03-16T10:54:10.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:10 smithi017 ceph-mon[32078]: pgmap v451: 97 pgs: 97 active+clean; 63 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 336 op/s 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.456+0000 7f467affd640 1 -- 172.21.15.17:0/932733949 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a92d7c82d0 con 0x55a92d8d8f40 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.456+0000 7f467affd640 10 client.26263 handle_command_reply: tid=0 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.456+0000 7f46a47c9740 1 client.26263 shutdown 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 msgr2=0x55a92d86af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 0x55a92d86af80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55a92d873f30 tx=0x7f4690009c50 comp rx=0 tx=0).stop 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 shutdown_connections 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55a92d8d8f40 0x55a92d8db360 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a92d860ea0 0x55a92d86b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a92d85bd30 0x55a92d86af80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 --2- 172.21.15.17:0/932733949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55a92d85b340 0x55a92d86c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f467affd640 0 client.26263 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 >> 172.21.15.17:0/932733949 conn(0x55a92d8568b0 msgr2=0x55a92d855320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 shutdown_connections 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 1 -- 172.21.15.17:0/932733949 wait complete. 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a47c9740 20 client.26263 trim_cache size 0 max 16384 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:54:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:54:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 msgr2=0x7f46840a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 0x7f46840a4d60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a92d85c130 tx=0x7f468c0dd040 comp rx=0 tx=0).stop 2024-03-16T10:54:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 msgr2=0x7f469c197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468c0324c0 tx=0x7f468c032f40 comp rx=0 tx=0).stop 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 shutdown_connections 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f46840a28a0 0x7f46840a4d60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f469c1022b0 0x7f469c19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f469c1018f0 0x7f469c198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 --2- 172.21.15.17:0/2082334610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f469c100700 0x7f469c197b10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.457+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 >> 172.21.15.17:0/2082334610 conn(0x7f469c0fbc70 msgr2=0x7f469c104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.458+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 shutdown_connections 2024-03-16T10:54:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:11.458+0000 7f46a1bdf640 1 -- 172.21.15.17:0/2082334610 wait complete. 2024-03-16T10:54:12.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:12 smithi111 ceph-mon[36315]: pgmap v452: 97 pgs: 97 active+clean; 62 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-03-16T10:54:12.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:12 smithi174 ceph-mon[36202]: pgmap v452: 97 pgs: 97 active+clean; 62 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-03-16T10:54:12.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:12 smithi017 ceph-mon[32078]: pgmap v452: 97 pgs: 97 active+clean; 62 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 316 op/s 2024-03-16T10:54:14.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:14 smithi111 ceph-mon[36315]: pgmap v453: 97 pgs: 97 active+clean; 63 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-03-16T10:54:14.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:14 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:54:14.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:14 smithi174 ceph-mon[36202]: pgmap v453: 97 pgs: 97 active+clean; 63 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-03-16T10:54:14.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:14 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:54:14.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:14 smithi017 ceph-mon[32078]: pgmap v453: 97 pgs: 97 active+clean; 63 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-03-16T10:54:14.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:14 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:54:15.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:54:15.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:54:15.662 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:54:15.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:54:15.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:54:15.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:54:15.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:54:15.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:54:15.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:54:16.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:16 smithi111 ceph-mon[36315]: pgmap v454: 97 pgs: 97 active+clean; 62 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 298 op/s 2024-03-16T10:54:16.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:16 smithi174 ceph-mon[36202]: pgmap v454: 97 pgs: 97 active+clean; 62 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 298 op/s 2024-03-16T10:54:16.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:16 smithi017 ceph-mon[32078]: pgmap v454: 97 pgs: 97 active+clean; 62 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 298 op/s 2024-03-16T10:54:18.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:18 smithi017 ceph-mon[32078]: pgmap v455: 97 pgs: 97 active+clean; 57 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 380 op/s 2024-03-16T10:54:18.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:18 smithi111 ceph-mon[36315]: pgmap v455: 97 pgs: 97 active+clean; 57 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 380 op/s 2024-03-16T10:54:18.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:18 smithi174 ceph-mon[36202]: pgmap v455: 97 pgs: 97 active+clean; 57 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 380 op/s 2024-03-16T10:54:19.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:19 smithi111 ceph-mon[36315]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:54:19.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:19 smithi174 ceph-mon[36202]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:54:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:19 smithi017 ceph-mon[32078]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-16T10:54:20.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:20 smithi111 ceph-mon[36315]: pgmap v456: 97 pgs: 97 active+clean; 57 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 354 op/s 2024-03-16T10:54:20.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:20 smithi174 ceph-mon[36202]: pgmap v456: 97 pgs: 97 active+clean; 57 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 354 op/s 2024-03-16T10:54:20.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:20 smithi017 ceph-mon[32078]: pgmap v456: 97 pgs: 97 active+clean; 57 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 354 op/s 2024-03-16T10:54:22.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:22 smithi111 ceph-mon[36315]: pgmap v457: 97 pgs: 97 active+clean; 58 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T10:54:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:22 smithi174 ceph-mon[36202]: pgmap v457: 97 pgs: 97 active+clean; 58 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T10:54:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:22 smithi017 ceph-mon[32078]: pgmap v457: 97 pgs: 97 active+clean; 58 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 335 op/s 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2515172443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01018f0 msgr2=0x7f7ed0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2515172443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01018f0 0x7f7ed0101d70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009900 tx=0x7f7eb802bc30 comp rx=0 tx=0).stop 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2515172443 shutdown_connections 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2515172443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed01022b0 0x7f7ed0108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2515172443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01018f0 0x7f7ed0101d70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2515172443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed0100700 0x7f7ed0100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2515172443 >> 172.21.15.17:0/2515172443 conn(0x7f7ed00fbc70 msgr2=0x7f7ed00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2515172443 shutdown_connections 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2515172443 wait complete. 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 Processor -- start 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.545+0000 7f7ed5a0b640 1 -- start start 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 0x7f7ed00699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01022b0 0x7f7ed019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c3b0 con 0x7f7ed01022b0 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c230 con 0x7f7ed0100700 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ed5a0b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c530 con 0x7f7ed01018f0 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 0x7f7ed00699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:49632/0 (socket says 172.21.15.17:49632) 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 0x7f7ed00699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:37682/0 (socket says 172.21.15.17:37682) 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2162069752 learned_addr learned my addr 172.21.15.17:0/2162069752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ecf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01022b0 0x7f7ed019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2162069752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 msgr2=0x7f7ed00699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 0x7f7ed00699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01022b0 msgr2=0x7f7ed019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01022b0 0x7f7ed019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.546+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2162069752 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed019f720 con 0x7f7ed01018f0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8005ab0 tx=0x7f7eb802c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ed4a09640 1 -- 172.21.15.17:0/2162069752 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8043020 con 0x7f7ed01018f0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed019f950 con 0x7f7ed01018f0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ed4a09640 1 -- 172.21.15.17:0/2162069752 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb80054e0 con 0x7f7ed01018f0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ed4a09640 1 -- 172.21.15.17:0/2162069752 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8003ce0 con 0x7f7ed01018f0 2024-03-16T10:54:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.547+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed019fea0 con 0x7f7ed01018f0 2024-03-16T10:54:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.549+0000 7f7ed4a09640 1 -- 172.21.15.17:0/2162069752 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f7eb8046020 con 0x7f7ed01018f0 2024-03-16T10:54:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.549+0000 7f7ed85fa740 1 Processor -- start 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.549+0000 7f7ed85fa740 1 -- start start 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.549+0000 7f7ed4a09640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 0x7f7ebc0a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.549+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 0x55c628856830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628856ea0 0x55c628859330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 0x7f7ebc0a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6287b6a40 con 0x55c628851340 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c62875f920 con 0x55c628851d30 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c6287b2ae0 con 0x55c628856ea0 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ed4a09640 1 -- 172.21.15.17:0/2162069752 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7eb80f0ab0 con 0x7f7ed01018f0 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40524/0 (socket says 172.21.15.17:40524) 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 -- 172.21.15.17:0/2992820540 learned_addr learned my addr 172.21.15.17:0/2992820540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628856ea0 0x55c628859330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 0x55c628856830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 -- 172.21.15.17:0/2992820540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628856ea0 msgr2=0x55c628859330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628856ea0 0x55c628859330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 -- 172.21.15.17:0/2992820540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 msgr2=0x55c628856830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 0x55c628856830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 -- 172.21.15.17:0/2992820540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c628777460 con 0x55c628851340 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 0x55c628856830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 0x7f7ebc0a4d60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009fd0 tx=0x7f7ec8009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b7d0 tx=0x7f7ec0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651b19ab97f9de07 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ec5ffb640 1 -- 172.21.15.17:0/2992820540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0003dd0 con 0x55c628851340 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ec5ffb640 1 -- 172.21.15.17:0/2992820540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ec0015070 con 0x55c628851340 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.550+0000 7f7ec5ffb640 1 -- 172.21.15.17:0/2992820540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00106a0 con 0x55c628851340 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2992820540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 msgr2=0x55c628851760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000b7d0 tx=0x7f7ec0004610 comp rx=0 tx=0).stop 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2992820540 shutdown_connections 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628856ea0 0x55c628859330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628851d30 0x55c628856830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2992820540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851340 0x55c628851760 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2992820540 >> 172.21.15.17:0/2992820540 conn(0x55c62884c8b0 msgr2=0x55c62884ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2992820540 shutdown_connections 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2992820540 wait complete. 2024-03-16T10:54:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.551+0000 7f7ed85fa740 1 -- start start 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 Processor -- start 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c62885fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628866fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c628859e50 con 0x55c628851d30 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55c628772d70 con 0x55c628856ea0 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c628859fd0 con 0x55c628851340 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ed85fa740 10 client.0 _ll_register_callbacks cb 0x55c6284caa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40528/0 (socket says 172.21.15.17:40528) 2024-03-16T10:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 -- 172.21.15.17:0/138584637 learned_addr learned my addr 172.21.15.17:0/138584637 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7eceffd640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c62885fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628866fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 -- 172.21.15.17:0/138584637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 msgr2=0x55c62885fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c62885fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 -- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 msgr2=0x55c628866fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628866fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ec67fc640 1 -- 172.21.15.17:0/138584637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6284cb210 con 0x55c628851d30 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628866fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.552+0000 7f7eceffd640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c62885fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006010 tx=0x7f7eb80bd2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73aaf1bfe95c1d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80d6020 con 0x55c628851d30 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7eb80bb7f0 con 0x55c628851d30 2024-03-16T10:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ec0015070 con 0x55c628851d30 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7eb8004c80 con 0x55c628851d30 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 10 client.16467 fetch_fsmap learned FSMap version 40 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c628597620 con 0x55c628851d30 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ec0015070 con 0x55c628851d30 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f7eb80d61c0 con 0x55c628851d30 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 10 client.16467 fetch_fsmap finished waiting for FSMap version 40 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 20 client.16467 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c62886b900 0x55c62886ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 4 client.16467 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6287c3f80 con 0x55c62886b900 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.553+0000 7f7eceffd640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c62886b900 0x55c62886ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.554+0000 7f7eceffd640 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c62886b900 0x55c62886ddc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f613b83e38ff0c1e server_cookie=37e7def95020dd44 in_seq=0 out_seq=0 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.554+0000 7f7eaeffd640 10 client.16467 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7eaeffd640 1 -- 172.21.15.17:0/138584637 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c6287c3f80 con 0x55c62886b900 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7eaeffd640 10 client.16467 handle_command_reply: tid=0 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 client.16467 shutdown 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 msgr2=0x55c62885ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006010 tx=0x7f7eb80bd2c0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 shutdown_connections 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c62886b900 0x55c62886ddc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628866fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c62885ff60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7eaeffd640 0 client.16467 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/138584637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c62885fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 >> 172.21.15.17:0/138584637 conn(0x55c62884c8b0 msgr2=0x55c62884bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 shutdown_connections 2024-03-16T10:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 1 -- 172.21.15.17:0/138584637 wait complete. 2024-03-16T10:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.555+0000 7f7ed85fa740 20 client.16467 trim_cache size 0 max 16384 2024-03-16T10:54:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 Processor -- start 2024-03-16T10:54:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 -- start start 2024-03-16T10:54:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628872680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628872bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a6900 con 0x55c628851d30 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a8680 con 0x55c628856ea0 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.570+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a6fd0 con 0x55c628851340 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40532/0 (socket says 172.21.15.17:40532) 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2104551552 learned_addr learned my addr 172.21.15.17:0/2104551552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628872680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628872bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2104551552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 msgr2=0x55c628872680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628872680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2104551552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 msgr2=0x55c628872bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628872bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2104551552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62885a110 con 0x55c628851d30 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80b9ec0 tx=0x7f7eb80b9810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e66cc76648f82b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec57fa640 1 -- 172.21.15.17:0/2104551552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80bd030 con 0x55c628851d30 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec57fa640 1 -- 172.21.15.17:0/2104551552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb8004c80 con 0x55c628851d30 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.571+0000 7f7ec57fa640 1 -- 172.21.15.17:0/2104551552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80bdbf0 con 0x55c628851d30 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2104551552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 msgr2=0x55c628866f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80b9ec0 tx=0x7f7eb80b9810 comp rx=0 tx=0).stop 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2104551552 shutdown_connections 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c628872bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628866f60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2104551552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628872680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2104551552 >> 172.21.15.17:0/2104551552 conn(0x55c62884c8b0 msgr2=0x55c62885e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2104551552 shutdown_connections 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2104551552 wait complete. 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 -- start start 2024-03-16T10:54:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 Processor -- start 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.572+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628864bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c6288660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a7ef0 con 0x55c628851d30 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a7760 con 0x55c628856ea0 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed01a4900 con 0x55c628851340 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 10 client.0 _ll_register_callbacks cb 0x7f7eb8005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40538/0 (socket says 172.21.15.17:40538) 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2032685015 learned_addr learned my addr 172.21.15.17:0/2032685015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628864bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ecf7fe640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c6288660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2032685015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 msgr2=0x55c628864bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628864bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 msgr2=0x55c6288660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c6288660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 -- 172.21.15.17:0/2032685015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6288666e0 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628864bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ec67fc640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80bd480 tx=0x7f7eb80bd3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64e5bbdab9b350e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80bd030 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f7eb80c1370 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb8004c80 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7eb80c58c0 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.573+0000 7f7ed85fa740 10 client.16473 fetch_fsmap learned FSMap version 40 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c6288666e0 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb8004c80 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f7eb80bc940 con 0x55c628851d30 2024-03-16T10:54:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 10 client.16473 fetch_fsmap finished waiting for FSMap version 40 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 20 client.16473 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c6288d27f0 0x55c6288d4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 4 client.16473 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6287be2d0 con 0x55c6288d27f0 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c6288d27f0 0x55c6288d4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7eaeffd640 10 client.16473 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.574+0000 7f7eceffd640 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c6288d27f0 0x55c6288d4c10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb279df89f85f0f server_cookie=39dfb21232c9af83 in_seq=0 out_seq=0 2024-03-16T10:54:24.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:24 smithi111 ceph-mon[36315]: pgmap v458: 97 pgs: 97 active+clean; 59 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 391 op/s 2024-03-16T10:54:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7eaeffd640 1 -- 172.21.15.17:0/2032685015 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c6287be2d0 con 0x55c6288d27f0 2024-03-16T10:54:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7eaeffd640 10 client.16473 handle_command_reply: tid=0 2024-03-16T10:54:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 client.16473 shutdown 2024-03-16T10:54:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 msgr2=0x55c628865130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80bd480 tx=0x7f7eb80bd3f0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 shutdown_connections 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x55c6288d27f0 0x55c6288d4c10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55c628856ea0 0x55c6288660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c628851d30 0x55c628865130 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 --2- 172.21.15.17:0/2032685015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c628851340 0x55c628864bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 >> 172.21.15.17:0/2032685015 conn(0x55c62884c8b0 msgr2=0x55c62884bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7eaeffd640 0 client.16473 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.671+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 shutdown_connections 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed85fa740 1 -- 172.21.15.17:0/2032685015 wait complete. 2024-03-16T10:54:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed85fa740 20 client.16473 trim_cache size 0 max 16384 2024-03-16T10:54:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:54:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:54:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:54:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 msgr2=0x7f7ebc0a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 0x7f7ebc0a4d60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009fd0 tx=0x7f7ec8009d80 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 msgr2=0x7f7ed019c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8005ab0 tx=0x7f7eb802c6c0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 shutdown_connections 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7ebc0a28a0 0x7f7ebc0a4d60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ed01022b0 0x7f7ed019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ed01018f0 0x7f7ed019c7f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 --2- 172.21.15.17:0/2162069752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ed0100700 0x7f7ed00699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 >> 172.21.15.17:0/2162069752 conn(0x7f7ed00fbc70 msgr2=0x7f7ed0104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 shutdown_connections 2024-03-16T10:54:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:24.672+0000 7f7ed5a0b640 1 -- 172.21.15.17:0/2162069752 wait complete. 2024-03-16T10:54:24.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:24 smithi174 ceph-mon[36202]: pgmap v458: 97 pgs: 97 active+clean; 59 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 391 op/s 2024-03-16T10:54:24.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:24 smithi017 ceph-mon[32078]: pgmap v458: 97 pgs: 97 active+clean; 59 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 391 op/s 2024-03-16T10:54:26.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:26 smithi111 ceph-mon[36315]: pgmap v459: 97 pgs: 97 active+clean; 58 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-03-16T10:54:26.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:26 smithi174 ceph-mon[36202]: pgmap v459: 97 pgs: 97 active+clean; 58 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-03-16T10:54:26.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:26 smithi017 ceph-mon[32078]: pgmap v459: 97 pgs: 97 active+clean; 58 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-03-16T10:54:28.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:28 smithi111 ceph-mon[36315]: pgmap v460: 97 pgs: 97 active+clean; 51 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 394 op/s 2024-03-16T10:54:28.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:28 smithi174 ceph-mon[36202]: pgmap v460: 97 pgs: 97 active+clean; 51 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 394 op/s 2024-03-16T10:54:28.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:28 smithi017 ceph-mon[32078]: pgmap v460: 97 pgs: 97 active+clean; 51 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 394 op/s 2024-03-16T10:54:30.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:30 smithi111 ceph-mon[36315]: pgmap v461: 97 pgs: 97 active+clean; 53 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-03-16T10:54:30.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:30 smithi174 ceph-mon[36202]: pgmap v461: 97 pgs: 97 active+clean; 53 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-03-16T10:54:30.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:30 smithi017 ceph-mon[32078]: pgmap v461: 97 pgs: 97 active+clean; 53 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-03-16T10:54:32.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:32 smithi111 ceph-mon[36315]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-03-16T10:54:32.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:32 smithi174 ceph-mon[36202]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-03-16T10:54:32.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:32 smithi017 ceph-mon[32078]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-03-16T10:54:34.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:34 smithi111 ceph-mon[36315]: pgmap v463: 97 pgs: 97 active+clean; 44 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 393 op/s 2024-03-16T10:54:34.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:34 smithi174 ceph-mon[36202]: pgmap v463: 97 pgs: 97 active+clean; 44 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 393 op/s 2024-03-16T10:54:34.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:34 smithi017 ceph-mon[32078]: pgmap v463: 97 pgs: 97 active+clean; 44 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 393 op/s 2024-03-16T10:54:36.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:36 smithi111 ceph-mon[36315]: pgmap v464: 97 pgs: 97 active+clean; 46 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 339 op/s 2024-03-16T10:54:36.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:36 smithi174 ceph-mon[36202]: pgmap v464: 97 pgs: 97 active+clean; 46 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 339 op/s 2024-03-16T10:54:36.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:36 smithi017 ceph-mon[32078]: pgmap v464: 97 pgs: 97 active+clean; 46 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 339 op/s 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- 172.21.15.17:0/867152974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c1033e0 msgr2=0x7f910c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 --2- 172.21.15.17:0/867152974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c1033e0 0x7f910c109c70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9104009ca0 tx=0x7f910402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- 172.21.15.17:0/867152974 shutdown_connections 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 --2- 172.21.15.17:0/867152974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c1033e0 0x7f910c109c70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 --2- 172.21.15.17:0/867152974 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c102a20 0x7f910c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 --2- 172.21.15.17:0/867152974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c101830 0x7f910c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- 172.21.15.17:0/867152974 >> 172.21.15.17:0/867152974 conn(0x7f910c0fcda0 msgr2=0x7f910c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- 172.21.15.17:0/867152974 shutdown_connections 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- 172.21.15.17:0/867152974 wait complete. 2024-03-16T10:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 Processor -- start 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.761+0000 7f9112759640 1 -- start start 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 0x7f910c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 0x7f910c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d490 con 0x7f910c101830 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d310 con 0x7f910c1033e0 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9112759640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f910c10d610 con 0x7f910c102a20 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42280/0 (socket says 172.21.15.17:42280) 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 -- 172.21.15.17:0/3293433892 learned_addr learned my addr 172.21.15.17:0/3293433892 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9110cf6640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 0x7f910c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910b7fe640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 0x7f910c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 -- 172.21.15.17:0/3293433892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 msgr2=0x7f910c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 0x7f910c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 -- 172.21.15.17:0/3293433892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 msgr2=0x7f910c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 0x7f910c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910bfff640 1 -- 172.21.15.17:0/3293433892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c19f610 con 0x7f910c101830 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f9110cf6640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 0x7f910c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.762+0000 7f910b7fe640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 0x7f910c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f910bfff640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00e9c0 tx=0x7f90fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f91097fa640 1 -- 172.21.15.17:0/3293433892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00cd80 con 0x7f910c101830 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f91097fa640 1 -- 172.21.15.17:0/3293433892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc0035f0 con 0x7f910c101830 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c19f900 con 0x7f910c101830 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f91097fa640 1 -- 172.21.15.17:0/3293433892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc010690 con 0x7f910c101830 2024-03-16T10:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.763+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c19fe50 con 0x7f910c101830 2024-03-16T10:54:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.765+0000 7f91097fa640 1 -- 172.21.15.17:0/3293433892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f90fc0037a0 con 0x7f910c101830 2024-03-16T10:54:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.765+0000 7f9115414740 1 Processor -- start 2024-03-16T10:54:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 -- start start 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 0x557507ca9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f91097fa640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 0x7f90f40a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557507c0ea40 con 0x557507caeea0 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557507bb7920 con 0x557507ca9d30 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9115414740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557507c0aae0 con 0x557507ca9340 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9110cf6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 0x557507ca9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42284/0 (socket says 172.21.15.17:42284) 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9110cf6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 0x557507ca9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33780/0 (socket says 172.21.15.17:33780) 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910b7fe640 1 -- 172.21.15.17:0/3866021578 learned_addr learned my addr 172.21.15.17:0/3866021578 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:37.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9110cf6640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 0x7f90f40a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f91097fa640 1 -- 172.21.15.17:0/3293433892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f90fc0ced50 con 0x7f910c101830 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 -- 172.21.15.17:0/3866021578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 msgr2=0x557507ca9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 0x557507ca9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 -- 172.21.15.17:0/3866021578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 msgr2=0x557507cb1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910bfff640 1 -- 172.21.15.17:0/3866021578 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557507bcf460 con 0x557507ca9d30 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f910b7fe640 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.766+0000 7f9110cf6640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 0x7f90f40a4d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f910402c630 tx=0x7f9104032590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f910bfff640 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cae830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0cc940 tx=0x7f90fc06a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bb523597397abc server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f90f27fc640 1 -- 172.21.15.17:0/3866021578 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0a0800 con 0x557507ca9d30 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f90f27fc640 1 -- 172.21.15.17:0/3866021578 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc09be90 con 0x557507ca9d30 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f90f27fc640 1 -- 172.21.15.17:0/3866021578 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc09bc30 con 0x557507ca9d30 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 -- 172.21.15.17:0/3866021578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 msgr2=0x557507cae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cae830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0cc940 tx=0x7f90fc06a5f0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 -- 172.21.15.17:0/3866021578 shutdown_connections 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507caeea0 0x557507cb1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cae830 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 --2- 172.21.15.17:0/3866021578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507ca9340 0x557507ca9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.767+0000 7f9115414740 1 -- 172.21.15.17:0/3866021578 >> 172.21.15.17:0/3866021578 conn(0x557507ca48b0 msgr2=0x557507ca4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- 172.21.15.17:0/3866021578 shutdown_connections 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- 172.21.15.17:0/3866021578 wait complete. 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- start start 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 Processor -- start 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cb7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557507cb1df0 con 0x557507ca9d30 2024-03-16T10:54:37.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x557507bcad70 con 0x557507ca9340 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557507cb1f70 con 0x557507caeea0 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f9115414740 10 client.0 _ll_register_callbacks cb 0x557507922a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42290/0 (socket says 172.21.15.17:42290) 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f910b7fe640 1 -- 172.21.15.17:0/1029001743 learned_addr learned my addr 172.21.15.17:0/1029001743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.768+0000 7f910bfff640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cb7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f9110cf6640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 -- 172.21.15.17:0/1029001743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 msgr2=0x557507cbefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 -- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 msgr2=0x557507cb7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cb7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 -- 172.21.15.17:0/1029001743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557507923210 con 0x557507ca9d30 2024-03-16T10:54:37.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910bfff640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cb7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f910b7fe640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9100012d20 tx=0x7f910000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2580820019ac3dc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f90eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91000120d0 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f91000047a0 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90fc09be90 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9100012270 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f9115414740 10 client.16485 fetch_fsmap learned FSMap version 40 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.769+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5575079ef620 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc09be90 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f91000105c0 con 0x557507ca9d30 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 10 client.16485 fetch_fsmap finished waiting for FSMap version 40 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 20 client.16485 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507cc39c0 0x557507cc5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 4 client.16485 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557507c1bf80 con 0x557507cc39c0 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f910bfff640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507cc39c0 0x557507cc5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f910bfff640 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507cc39c0 0x557507cc5e40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e150822d562bbb server_cookie=21ee5e0cc9083b37 in_seq=0 out_seq=0 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.770+0000 7f90eb7fe640 10 client.16485 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.771+0000 7f90eb7fe640 1 -- 172.21.15.17:0/1029001743 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557507c1bf80 con 0x557507cc39c0 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.771+0000 7f90eb7fe640 10 client.16485 handle_command_reply: tid=0 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.771+0000 7f9115414740 1 client.16485 shutdown 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 msgr2=0x557507cb7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9100012d20 tx=0x7f910000f790 comp rx=0 tx=0).stop 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 shutdown_connections 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507cc39c0 0x557507cc5e40 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cb7f60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f90eb7fe640 0 client.16485 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 --2- 172.21.15.17:0/1029001743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cb7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 >> 172.21.15.17:0/1029001743 conn(0x557507ca48b0 msgr2=0x557507ca3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 shutdown_connections 2024-03-16T10:54:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 1 -- 172.21.15.17:0/1029001743 wait complete. 2024-03-16T10:54:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.772+0000 7f9115414740 20 client.16485 trim_cache size 0 max 16384 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 Processor -- start 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 -- start start 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cbef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a6950 con 0x557507ca9340 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a86d0 con 0x557507ca9d30 2024-03-16T10:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9115414740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a7020 con 0x557507caeea0 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42306/0 (socket says 172.21.15.17:42306) 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 -- 172.21.15.17:0/2105159465 learned_addr learned my addr 172.21.15.17:0/2105159465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910b7fe640 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cbef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f9110cf6640 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 -- 172.21.15.17:0/2105159465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 msgr2=0x557507cca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 -- 172.21.15.17:0/2105159465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 msgr2=0x557507cbef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cbef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 -- 172.21.15.17:0/2105159465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557507c96140 con 0x557507ca9340 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f910bfff640 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0058c0 tx=0x7f90fc09b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b72a318389a2365 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.787+0000 7f90f1ffb640 1 -- 172.21.15.17:0/2105159465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc097a30 con 0x557507ca9340 2024-03-16T10:54:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f90f1ffb640 1 -- 172.21.15.17:0/2105159465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc09be90 con 0x557507ca9340 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f90f1ffb640 1 -- 172.21.15.17:0/2105159465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc09c7e0 con 0x557507ca9340 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- 172.21.15.17:0/2105159465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 msgr2=0x557507ca8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0058c0 tx=0x7f90fc09b790 comp rx=0 tx=0).stop 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- 172.21.15.17:0/2105159465 shutdown_connections 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9d30 0x557507cbef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 --2- 172.21.15.17:0/2105159465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9340 0x557507ca8220 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- 172.21.15.17:0/2105159465 >> 172.21.15.17:0/2105159465 conn(0x557507ca48b0 msgr2=0x557507ca7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- 172.21.15.17:0/2105159465 shutdown_connections 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- 172.21.15.17:0/2105159465 wait complete. 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.788+0000 7f9115414740 1 -- start start 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 Processor -- start 2024-03-16T10:54:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cbcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a7f40 con 0x557507ca9d30 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a77b0 con 0x557507ca9340 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f910c1a4930 con 0x557507caeea0 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9115414740 10 client.0 _ll_register_callbacks cb 0x7f9100009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42310/0 (socket says 172.21.15.17:42310) 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cbcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 -- 172.21.15.17:0/670096796 learned_addr learned my addr 172.21.15.17:0/670096796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f9110cf6640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 -- 172.21.15.17:0/670096796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 msgr2=0x557507cbe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 -- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 msgr2=0x557507cbcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T10:54:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cbcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 -- 172.21.15.17:0/670096796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557507cbe6f0 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f910b7fe640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9100009730 tx=0x7f9100010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf599204c5dba81 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.789+0000 7f90eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910000fe80 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f9100012870 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90fc09be90 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f9100005250 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 10 client.16491 fetch_fsmap learned FSMap version 40 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557507d2a340 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc09be90 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f910002f060 con 0x557507ca9d30 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 10 client.16491 fetch_fsmap finished waiting for FSMap version 40 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 20 client.16491 populate_metadata read hostname 'smithi017' 2024-03-16T10:54:37.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507d2add0 0x557507d2d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 4 client.16491 mds_command: new command op to 24536 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-16T10:54:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 --> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557507c162d0 con 0x557507d2add0 2024-03-16T10:54:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.790+0000 7f910bfff640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507d2add0 0x557507d2d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.791+0000 7f910bfff640 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507d2add0 0x557507d2d1f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a1f8bd8f1b03d3d server_cookie=cf88c291791c17ed in_seq=0 out_seq=0 2024-03-16T10:54:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.791+0000 7f90eb7fe640 10 client.16491 ms_handle_connect on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.945+0000 7f90eb7fe640 1 -- 172.21.15.17:0/670096796 <== mds.0 v2:172.21.15.111:6838/1155010688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557507c162d0 con 0x557507d2add0 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.945+0000 7f90eb7fe640 10 client.16491 handle_command_reply: tid=0 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.945+0000 7f9115414740 1 client.16491 shutdown 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.945+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 msgr2=0x557507cbd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.945+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9100009730 tx=0x7f9100010660 comp rx=0 tx=0).stop 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 shutdown_connections 2024-03-16T10:54:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:6838/1155010688,v1:172.21.15.111:6839/1155010688] conn(0x557507d2add0 0x557507d2d1f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557507caeea0 0x557507cbe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557507ca9d30 0x557507cbd0f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 --2- 172.21.15.17:0/670096796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557507ca9340 0x557507cbcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 >> 172.21.15.17:0/670096796 conn(0x557507ca48b0 msgr2=0x557507ca83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f90eb7fe640 0 client.16491 ms_handle_reset on v2:172.21.15.111:6838/1155010688 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 shutdown_connections 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 1 -- 172.21.15.17:0/670096796 wait complete. 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.946+0000 7f9115414740 20 client.16491 trim_cache size 0 max 16384 2024-03-16T10:54:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2024-03-16T10:54:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2024-03-16T10:54:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2024-03-16T10:54:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 msgr2=0x7f90f40a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 0x7f90f40a4d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f910402c630 tx=0x7f9104032590 comp rx=0 tx=0).stop 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 msgr2=0x7f910c1979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00e9c0 tx=0x7f90fc00ee80 comp rx=0 tx=0).stop 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 shutdown_connections 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f90f40a28a0 0x7f90f40a4d60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f910c1033e0 0x7f910c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f910c102a20 0x7f910c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 --2- 172.21.15.17:0/3293433892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f910c101830 0x7f910c1979f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 >> 172.21.15.17:0/3293433892 conn(0x7f910c0fcda0 msgr2=0x7f910c105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 shutdown_connections 2024-03-16T10:54:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2024-03-16T10:54:37.947+0000 7f9112759640 1 -- 172.21.15.17:0/3293433892 wait complete. 2024-03-16T10:54:38.112 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-16T10:54:38.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-16T10:54:38.489 DEBUG:teuthology.parallel:result is None 2024-03-16T10:54:38.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-16T10:54:38.535 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-16T10:54:38.536 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-03-16T10:54:38.547 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:54:38.583 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-16T10:54:38.592 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-16T10:54:38.592 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-16T10:54:38.593 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-16T10:54:38.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:54:38.661 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:38 smithi111 ceph-mon[36315]: pgmap v465: 97 pgs: 97 active+clean; 48 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-03-16T10:54:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 -- 172.21.15.17:0/1121237978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe88100700 msgr2=0x7fbe88100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/1121237978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe88100700 0x7fbe88100b20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009900 tx=0x7fbe7802bc30 comp rx=0 tx=0).stop 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 -- 172.21.15.17:0/1121237978 shutdown_connections 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/1121237978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe88108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/1121237978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe881018f0 0x7fbe88101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/1121237978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe88100700 0x7fbe88100b20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.725+0000 7fbe8e35b640 1 -- 172.21.15.17:0/1121237978 >> 172.21.15.17:0/1121237978 conn(0x7fbe880fbc70 msgr2=0x7fbe880fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- 172.21.15.17:0/1121237978 shutdown_connections 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- 172.21.15.17:0/1121237978 wait complete. 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 Processor -- start 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- start start 2024-03-16T10:54:38.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe88100700 0x7fbe88199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810d4a0 con 0x7fbe881018f0 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810d320 con 0x7fbe88100700 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe8e35b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8810d620 con 0x7fbe881022b0 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.726+0000 7fbe877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42314/0 (socket says 172.21.15.17:42314) 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.17:33832/0 (socket says 172.21.15.17:33832) 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe87fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe88100700 0x7fbe88199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe877fe640 1 -- 172.21.15.17:0/2866375976 learned_addr learned my addr 172.21.15.17:0/2866375976 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 -- 172.21.15.17:0/2866375976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe88100700 msgr2=0x7fbe88199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe88100700 0x7fbe88199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 -- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 msgr2=0x7fbe8819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 -- 172.21.15.17:0/2866375976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881a1980 con 0x7fbe881022b0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe877fe640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8c8f8640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009fd0 tx=0x7fbe8000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000ce20 con 0x7fbe881022b0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe80005020 con 0x7fbe881022b0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881a1c70 con 0x7fbe881022b0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80010720 con 0x7fbe881022b0 2024-03-16T10:54:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.727+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881a21c0 con 0x7fbe881022b0 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.729+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe881a23f0 con 0x7fbe881022b0 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.729+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fbe80005540 con 0x7fbe881022b0 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.730+0000 7fbe857fa640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 0x7fbe700a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.730+0000 7fbe87fff640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 0x7fbe700a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.730+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fbe800ceff0 con 0x7fbe881022b0 2024-03-16T10:54:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.731+0000 7fbe87fff640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 0x7fbe700a4cc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe78005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:38.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.734+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fbe8009c130 con 0x7fbe881022b0 2024-03-16T10:54:38.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:38 smithi174 ceph-mon[36202]: pgmap v465: 97 pgs: 97 active+clean; 48 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-03-16T10:54:38.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:38 smithi017 ceph-mon[32078]: pgmap v465: 97 pgs: 97 active+clean; 48 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 397 op/s 2024-03-16T10:54:38.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.919+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe881a25c0 con 0x7fbe881022b0 2024-03-16T10:54:38.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.922+0000 7fbe857fa640 1 -- 172.21.15.17:0/2866375976 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7fbe8009ba30 con 0x7fbe881022b0 2024-03-16T10:54:38.924 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:54:38.924 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 msgr2=0x7fbe700a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 0x7fbe700a4cc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe78005fd0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 msgr2=0x7fbe881a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009fd0 tx=0x7fbe8000ef10 comp rx=0 tx=0).stop 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 shutdown_connections 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fbe700a2800 0x7fbe700a4cc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe881022b0 0x7fbe881a1310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe881018f0 0x7fbe8819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 --2- 172.21.15.17:0/2866375976 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe88100700 0x7fbe88199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 >> 172.21.15.17:0/2866375976 conn(0x7fbe880fbc70 msgr2=0x7fbe88109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 shutdown_connections 2024-03-16T10:54:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:38.924+0000 7fbe8e35b640 1 -- 172.21.15.17:0/2866375976 wait complete. 2024-03-16T10:54:38.938 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:54:38.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:54:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- 172.21.15.17:0/1517037956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f81022c0 msgr2=0x7fb7f81046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1517037956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f81022c0 0x7fb7f81046b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009900 tx=0x7fb7f402bc30 comp rx=0 tx=0).stop 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- 172.21.15.17:0/1517037956 shutdown_connections 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1517037956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f8107520 0x7fb7f8109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1517037956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8104bf0 0x7fb7f8106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1517037956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f81022c0 0x7fb7f81046b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- 172.21.15.17:0/1517037956 >> 172.21.15.17:0/1517037956 conn(0x7fb7f80fbc70 msgr2=0x7fb7f80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- 172.21.15.17:0/1517037956 shutdown_connections 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- 172.21.15.17:0/1517037956 wait complete. 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 Processor -- start 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.043+0000 7fb8004c0640 1 -- start start 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f81022c0 0x7fb7f8197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8107520 0x7fb7f819f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f810d450 con 0x7fb7f8104bf0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f810d2d0 con 0x7fb7f81022c0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f810d5d0 con 0x7fb7f8107520 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fe25c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f81022c0 0x7fb7f8197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42330/0 (socket says 172.21.15.17:42330) 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 -- 172.21.15.17:0/1556983083 learned_addr learned my addr 172.21.15.17:0/1556983083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fea5d640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8107520 0x7fb7f819f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 -- 172.21.15.17:0/1556983083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8107520 msgr2=0x7fb7f819f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8107520 0x7fb7f819f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 -- 172.21.15.17:0/1556983083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f81022c0 msgr2=0x7fb7f8197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f81022c0 0x7fb7f8197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 -- 172.21.15.17:0/1556983083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f819f7a0 con 0x7fb7f8104bf0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7fda5b640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800e9c0 tx=0x7fb7e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800cd80 con 0x7fb7f8104bf0 2024-03-16T10:54:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e8005500 con 0x7fb7f8104bf0 2024-03-16T10:54:39.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f819fa90 con 0x7fb7f8104bf0 2024-03-16T10:54:39.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8010690 con 0x7fb7f8104bf0 2024-03-16T10:54:39.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.044+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f81a0030 con 0x7fb7f8104bf0 2024-03-16T10:54:39.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.045+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f80fd760 con 0x7fb7f8104bf0 2024-03-16T10:54:39.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.047+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fb7e80046c0 con 0x7fb7f8104bf0 2024-03-16T10:54:39.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.047+0000 7fb7ef7fe640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 0x7fb7e40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.047+0000 7fb7fe25c640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 0x7fb7e40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.047+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fb7e80ceec0 con 0x7fb7f8104bf0 2024-03-16T10:54:39.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.048+0000 7fb7fe25c640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 0x7fb7e40a4d40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402c7b0 tx=0x7fb7f4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.054+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fb7e8053740 con 0x7fb7f8104bf0 2024-03-16T10:54:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.252+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7f802d1b0 con 0x7fb7f8104bf0 2024-03-16T10:54:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.253+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/1556983083 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fb7e809c000 con 0x7fb7f8104bf0 2024-03-16T10:54:39.254 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:54:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.254+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 msgr2=0x7fb7e40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.254+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 0x7fb7e40a4d40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402c7b0 tx=0x7fb7f4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.254+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 msgr2=0x7fb7f81980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.254+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800e9c0 tx=0x7fb7e800ee80 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 shutdown_connections 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fb7e40a2880 0x7fb7e40a4d40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7f8107520 0x7fb7f819f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8104bf0 0x7fb7f81980c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 --2- 172.21.15.17:0/1556983083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7f81022c0 0x7fb7f8197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 >> 172.21.15.17:0/1556983083 conn(0x7fb7f80fbc70 msgr2=0x7fb7f8102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 shutdown_connections 2024-03-16T10:54:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.255+0000 7fb8004c0640 1 -- 172.21.15.17:0/1556983083 wait complete. 2024-03-16T10:54:39.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:54:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 -- 172.21.15.17:0/1127005750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006e890 msgr2=0x7f354006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 --2- 172.21.15.17:0/1127005750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006e890 0x7f354006ecf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3534009900 tx=0x7f353402bc30 comp rx=0 tx=0).stop 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 -- 172.21.15.17:0/1127005750 shutdown_connections 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 --2- 172.21.15.17:0/1127005750 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f354006f230 0x7f354006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 --2- 172.21.15.17:0/1127005750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006e890 0x7f354006ecf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 --2- 172.21.15.17:0/1127005750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 0x7f354006da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 -- 172.21.15.17:0/1127005750 >> 172.21.15.17:0/1127005750 conn(0x7f354006c1c0 msgr2=0x7f354006c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.385+0000 7f3546374640 1 -- 172.21.15.17:0/1127005750 shutdown_connections 2024-03-16T10:54:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.386+0000 7f3546374640 1 -- 172.21.15.17:0/1127005750 wait complete. 2024-03-16T10:54:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.386+0000 7f3546374640 1 Processor -- start 2024-03-16T10:54:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.386+0000 7f3546374640 1 -- start start 2024-03-16T10:54:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 0x7f35401a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 0x7f35401ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f354011c2e0 con 0x7f354006f230 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f354011c160 con 0x7f35401ac0b0 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3546374640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f354011c460 con 0x7f354006d650 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f353f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f353f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42346/0 (socket says 172.21.15.17:42346) 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3544911640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 0x7f35401ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f353f7fe640 1 -- 172.21.15.17:0/3243398756 learned_addr learned my addr 172.21.15.17:0/3243398756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f353ffff640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 0x7f35401a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3544911640 1 -- 172.21.15.17:0/3243398756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 msgr2=0x7f35401a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3544911640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 0x7f35401a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.387+0000 7f3544911640 1 -- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 msgr2=0x7f35401a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f3544911640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f3544911640 1 -- 172.21.15.17:0/3243398756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401aeb10 con 0x7f35401ac0b0 2024-03-16T10:54:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f353f7fe640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f3544911640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 0x7f35401ae4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f353800e940 tx=0x7f353800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538004d20 con 0x7f35401ac0b0 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.388+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3538005020 con 0x7f35401ac0b0 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.389+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35380116b0 con 0x7f35401ac0b0 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.389+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35401aee00 con 0x7f35401ac0b0 2024-03-16T10:54:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.389+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35401af2c0 con 0x7f35401ac0b0 2024-03-16T10:54:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.390+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540118b80 con 0x7f35401ac0b0 2024-03-16T10:54:39.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.392+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f35380054d0 con 0x7f35401ac0b0 2024-03-16T10:54:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.392+0000 7f353d7fa640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 0x7f35280a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.393+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f35380ced40 con 0x7f35401ac0b0 2024-03-16T10:54:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.393+0000 7f353ffff640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 0x7f35280a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.393+0000 7f353ffff640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 0x7f35280a4e10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3530009aa0 tx=0x7f3530005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.401+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f3538016030 con 0x7f35401ac0b0 2024-03-16T10:54:39.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:39 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2866375976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:54:39.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:39 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1556983083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:54:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.593+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f354002d1b0 con 0x7f35401ac0b0 2024-03-16T10:54:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.593+0000 7f353d7fa640 1 -- 172.21.15.17:0/3243398756 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f353809bfe0 con 0x7f35401ac0b0 2024-03-16T10:54:39.595 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 msgr2=0x7f35280a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 0x7f35280a4e10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3530009aa0 tx=0x7f3530005f90 comp rx=0 tx=0).stop 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 msgr2=0x7f35401ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 0x7f35401ae4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f353800e940 tx=0x7f353800ee00 comp rx=0 tx=0).stop 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 shutdown_connections 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f35280a2950 0x7f35280a4e10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35401ac0b0 0x7f35401ae4a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f354006f230 0x7f35401a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 --2- 172.21.15.17:0/3243398756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f354006d650 0x7f35401a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 >> 172.21.15.17:0/3243398756 conn(0x7f354006c1c0 msgr2=0x7f354010a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 shutdown_connections 2024-03-16T10:54:39.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.596+0000 7f3546374640 1 -- 172.21.15.17:0/3243398756 wait complete. 2024-03-16T10:54:39.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:54:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 -- 172.21.15.17:0/2251242562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41005f0 msgr2=0x7fcec4100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 --2- 172.21.15.17:0/2251242562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41005f0 0x7fcec4100a10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb402bc30 comp rx=0 tx=0).stop 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 -- 172.21.15.17:0/2251242562 shutdown_connections 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 --2- 172.21.15.17:0/2251242562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 0x7fcec4108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 --2- 172.21.15.17:0/2251242562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41017e0 0x7fcec4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 --2- 172.21.15.17:0/2251242562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41005f0 0x7fcec4100a10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 -- 172.21.15.17:0/2251242562 >> 172.21.15.17:0/2251242562 conn(0x7fcec40fbb80 msgr2=0x7fcec40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 -- 172.21.15.17:0/2251242562 shutdown_connections 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.713+0000 7fcec93ff640 1 -- 172.21.15.17:0/2251242562 wait complete. 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 Processor -- start 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 -- start start 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 0x7fcec41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 0x7fcec419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410c260 con 0x7fcec41017e0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410c0e0 con 0x7fcec41005f0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec93ff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410c3e0 con 0x7fcec41021a0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56064/0 (socket says 172.21.15.17:56064) 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec27fc640 1 -- 172.21.15.17:0/3805477232 learned_addr learned my addr 172.21.15.17:0/3805477232 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec2ffd640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 0x7fcec41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.714+0000 7fcec37fe640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 0x7fcec419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 -- 172.21.15.17:0/3805477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 msgr2=0x7fcec419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 0x7fcec419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 -- 172.21.15.17:0/3805477232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 msgr2=0x7fcec41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 0x7fcec41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 -- 172.21.15.17:0/3805477232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec419f5f0 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec2ffd640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 0x7fcec41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec27fc640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800cd80 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb8010910 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec419f8e0 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8018990 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.715+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec419fe30 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.716+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec41a0000 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.717+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fceb8010ac0 con 0x7fcec41017e0 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.718+0000 7fceabfff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 0x7fceac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.718+0000 7fcec2ffd640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 0x7fceac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.718+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fceb80cf0e0 con 0x7fcec41017e0 2024-03-16T10:54:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.719+0000 7fcec2ffd640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 0x7fceac0a4cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000c00 tx=0x7fceb4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.722+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fceb809bbd0 con 0x7fcec41017e0 2024-03-16T10:54:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:39 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2866375976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:54:39.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:39 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1556983083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:54:39.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.906+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcec41a02f0 con 0x7fcec41017e0 2024-03-16T10:54:39.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.907+0000 7fceabfff640 1 -- 172.21.15.17:0/3805477232 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fceb809fc70 con 0x7fcec41017e0 2024-03-16T10:54:39.908 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 msgr2=0x7fceac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 0x7fceac0a4cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000c00 tx=0x7fceb4005fd0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 msgr2=0x7fcec4197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 shutdown_connections 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fceac0a2800 0x7fceac0a4cc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcec41021a0 0x7fcec419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcec41017e0 0x7fcec4197f10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 --2- 172.21.15.17:0/3805477232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcec41005f0 0x7fcec41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:39.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 >> 172.21.15.17:0/3805477232 conn(0x7fcec40fbb80 msgr2=0x7fcec40fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:39.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 shutdown_connections 2024-03-16T10:54:39.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:39.909+0000 7fcec93ff640 1 -- 172.21.15.17:0/3805477232 wait complete. 2024-03-16T10:54:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:39 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2866375976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:54:39.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:39 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1556983083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:54:39.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 -- 172.21.15.17:0/164960491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8102a10 msgr2=0x7feee8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 --2- 172.21.15.17:0/164960491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8102a10 0x7feee8102e90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feedc009860 tx=0x7feedc02bb70 comp rx=0 tx=0).stop 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 -- 172.21.15.17:0/164960491 shutdown_connections 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 --2- 172.21.15.17:0/164960491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee8109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 --2- 172.21.15.17:0/164960491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8102a10 0x7feee8102e90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 --2- 172.21.15.17:0/164960491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8101820 0x7feee8101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 -- 172.21.15.17:0/164960491 >> 172.21.15.17:0/164960491 conn(0x7feee80fcd90 msgr2=0x7feee80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 -- 172.21.15.17:0/164960491 shutdown_connections 2024-03-16T10:54:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 -- 172.21.15.17:0/164960491 wait complete. 2024-03-16T10:54:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.052+0000 7feeee0d1640 1 Processor -- start 2024-03-16T10:54:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 -- start start 2024-03-16T10:54:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 0x7feee8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feee810d480 con 0x7feee8102a10 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7feee810d300 con 0x7feee81033d0 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feeee0d1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feee810d600 con 0x7feee8101820 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 0x7feee8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56072/0 (socket says 172.21.15.17:56072) 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee6ffd640 1 -- 172.21.15.17:0/2948562420 learned_addr learned my addr 172.21.15.17:0/2948562420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 -- 172.21.15.17:0/2948562420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 msgr2=0x7feee819f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee819f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 -- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 msgr2=0x7feee8198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 -- 172.21.15.17:0/2948562420 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee819f770 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee7fff640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee6ffd640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.053+0000 7feee77fe640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 0x7feee8197b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feee8102870 tx=0x7feed800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.054+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed801b070 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.054+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee819fa60 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.054+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feed8003b80 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.054+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80168d0 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.054+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a0000 con 0x7feee8101820 2024-03-16T10:54:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.055+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee8108be0 con 0x7feee8101820 2024-03-16T10:54:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.057+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7feed801e070 con 0x7feee8101820 2024-03-16T10:54:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.057+0000 7feee4ff9640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 0x7feed00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:54:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.057+0000 7feee6ffd640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 0x7feed00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:54:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.057+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7feed80ce7a0 con 0x7feee8101820 2024-03-16T10:54:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.058+0000 7feee6ffd640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 0x7feed00a4cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feee8199060 tx=0x7feedc02e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:54:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.060+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7feed809b290 con 0x7feee8101820 2024-03-16T10:54:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.361+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7feee802d410 con 0x7feee8101820 2024-03-16T10:54:40.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.370+0000 7feee4ff9640 1 -- 172.21.15.17:0/2948562420 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+739830 (secure 0 0 0) 0x7feed809f330 con 0x7feee8101820 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 20, 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 14150, 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2024-03-16T10:54:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3813203524 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3813203524 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/3813203524", 2024-03-16T10:54:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2024-03-16T10:41:40.392146+0000", 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540701547738038271, 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24118, 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-03-16T10:54:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-03-16T10:54:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-03-16T10:54:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-03-16T10:54:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-03-16T10:54:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-03-16T10:54:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-03-16T10:54:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-03-16T10:54:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-03-16T10:54:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T10:54:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-03-16T10:54:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-03-16T10:54:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-03-16T10:54:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-03-16T10:54:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T10:54:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-03-16T10:54:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-03-16T10:54:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-03-16T10:54:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-03-16T10:54:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T10:54:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T10:54:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-03-16T10:54:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T10:54:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T10:54:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.490 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T10:54:40.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T10:54:40.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.499 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T10:54:40.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.509 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.510 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T10:54:40.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-03-16T10:54:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-03-16T10:54:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.528 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T10:54:40.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:40.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.534 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-03-16T10:54:40.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:40.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-03-16T10:54:40.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.544 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T10:54:40.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-03-16T10:54:40.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-03-16T10:54:40.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.554 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-03-16T10:54:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.561 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.562 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-03-16T10:54:40.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:40.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.577 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.581 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.582 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.584 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.588 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T10:54:40.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.594 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.596 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T10:54:40.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.605 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.606 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.611 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-03-16T10:54:40.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.620 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.635 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.638 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:40.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.642 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.645 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-03-16T10:54:40.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T10:54:40.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.662 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.665 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.667 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.674 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.685 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.693 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-03-16T10:54:40.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-03-16T10:54:40.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-03-16T10:54:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-03-16T10:54:40.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.710 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-03-16T10:54:40.712 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.713 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.718 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.725 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.728 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.731 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.741 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-03-16T10:54:40.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.744 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.745 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T10:54:40.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.753 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.757 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.758 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.763 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-03-16T10:54:40.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24119, 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540701547738038271, 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T10:54:40.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.778 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.784 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-03-16T10:54:40.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.786 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-03-16T10:54:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.793 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-03-16T10:54:40.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:40.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-03-16T10:54:40.804 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:40.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-03-16T10:54:40.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T10:54:40.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-03-16T10:54:40.815 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-03-16T10:54:40.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-03-16T10:54:40.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-03-16T10:54:40.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-03-16T10:54:40.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.828 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-03-16T10:54:40.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.832 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-03-16T10:54:40.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-03-16T10:54:40.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-03-16T10:54:40.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.846 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-03-16T10:54:40.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T10:54:40.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.854 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.866 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-03-16T10:54:40.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T10:54:40.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.878 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.888 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-03-16T10:54:40.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.896 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-03-16T10:54:40.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T10:54:40.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:40.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-03-16T10:54:40.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:40.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-03-16T10:54:40.926 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:40.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.933 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-03-16T10:54:40.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.940 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.941 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-03-16T10:54:40.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T10:54:40.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.952 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-03-16T10:54:40.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:40.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.977 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-03-16T10:54:40.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.983 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-03-16T10:54:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.993 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:40.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:40.998 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:40.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.006 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.020 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.022 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.025 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:41.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-03-16T10:54:41.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.040 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-03-16T10:54:41.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:41.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.055 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.061 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.068 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.075 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-03-16T10:54:41.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.078 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.081 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.085 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-03-16T10:54:41.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-03-16T10:54:41.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.095 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.098 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.101 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-03-16T10:54:41.105 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.106 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.108 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.115 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.121 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-03-16T10:54:41.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.129 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.137 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.140 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.145 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.148 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-03-16T10:54:41.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2024-03-16T10:54:41.163 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "restful" 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-03-16T10:54:41.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-03-16T10:54:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-03-16T10:54:41.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-03-16T10:54:41.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.177 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:41.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-03-16T10:54:41.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-16T10:54:41.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-16T10:54:41.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.186 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.189 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-03-16T10:54:41.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-03-16T10:54:41.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.194 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-03-16T10:54:41.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-03-16T10:54:41.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-03-16T10:54:41.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-03-16T10:54:41.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-03-16T10:54:41.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:41.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.217 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.218 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-03-16T10:54:41.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-03-16T10:54:41.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.229 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.231 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-03-16T10:54:41.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-16T10:54:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-03-16T10:54:41.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-03-16T10:54:41.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.248 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.253 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.254 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-16T10:54:41.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.267 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-16T10:54:41.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.270 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-03-16T10:54:41.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-16T10:54:41.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-16T10:54:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-03-16T10:54:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-03-16T10:54:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-16T10:54:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-03-16T10:54:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-03-16T10:54:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-03-16T10:54:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-03-16T10:54:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-03-16T10:54:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-03-16T10:54:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-16T10:54:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-03-16T10:54:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-16T10:54:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-03-16T10:54:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-03-16T10:54:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-03-16T10:54:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-03-16T10:54:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-03-16T10:54:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-03-16T10:54:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-03-16T10:54:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-03-16T10:54:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-03-16T10:54:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-03-16T10:54:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-03-16T10:54:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-03-16T10:54:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-03-16T10:54:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-03-16T10:54:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2024-03-16T10:54:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-03-16T10:54:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-03-16T10:54:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-03-16T10:54:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "squid": [ 2024-03-16T10:54:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 3, 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 765455589 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1996049653 2024-03-16T10:54:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2536654620 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-03-16T10:54:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4080420466 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-16T10:54:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:54:41.561 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:40 smithi111 ceph-mon[36315]: pgmap v466: 97 pgs: 97 active+clean; 46 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:54:41.561 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:40 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3243398756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.561 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:40 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3805477232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.561 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:40 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2948562420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T10:54:41.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:40 smithi174 ceph-mon[36202]: pgmap v466: 97 pgs: 97 active+clean; 46 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:54:41.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:40 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3243398756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:40 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3805477232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.562 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:40 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2948562420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T10:54:41.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 msgr2=0x7feed00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 0x7feed00a4cc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feee8199060 tx=0x7feedc02e040 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 msgr2=0x7feee8197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 0x7feee8197b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feee8102870 tx=0x7feed800c800 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 shutdown_connections 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7feed00a2800 0x7feed00a4cc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feee81033d0 0x7feee819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee8102a10 0x7feee8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 --2- 172.21.15.17:0/2948562420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feee8101820 0x7feee8197b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 >> 172.21.15.17:0/2948562420 conn(0x7feee80fcd90 msgr2=0x7feee8105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 shutdown_connections 2024-03-16T10:54:41.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:54:40.375+0000 7feeee0d1640 1 -- 172.21.15.17:0/2948562420 wait complete. 2024-03-16T10:54:41.569 DEBUG:tasks.check_counter:Getting stats from a 2024-03-16T10:54:41.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-16T10:54:41.569 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:40 smithi017 ceph-mon[32078]: pgmap v466: 97 pgs: 97 active+clean; 46 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 344 op/s 2024-03-16T10:54:41.569 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:40 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3243398756' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.569 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:40 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3805477232' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:54:41.570 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:40 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2948562420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-16T10:54:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:54:42.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:42 smithi017 ceph-mon[32078]: pgmap v467: 97 pgs: 97 active+clean; 39 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 884 KiB/s wr, 325 op/s 2024-03-16T10:54:42.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:42 smithi174 ceph-mon[36202]: pgmap v467: 97 pgs: 97 active+clean; 39 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 884 KiB/s wr, 325 op/s 2024-03-16T10:54:42.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:42 smithi111 ceph-mon[36315]: pgmap v467: 97 pgs: 97 active+clean; 39 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 884 KiB/s wr, 325 op/s 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 9086, 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 6409, 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 4191512, 2024-03-16T10:54:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 5840615, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 9, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 5, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.604254162, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.172284424, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.320685576, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.188325740, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6409, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.139758951, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000021806 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 13149, 2024-03-16T10:54:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001738843, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000132 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 852144, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 90960 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 3363, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 5509, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1112563, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 2965157, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 13, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 7, 2024-03-16T10:54:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.515101451, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.237820694, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.138069002, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.171500013, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 5507, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.161779875, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000029377 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 5730, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001181417, 2024-03-16T10:54:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000206 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 213648 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1115, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1117, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 418664, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 1247157, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 18, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 7, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.078835222, 2024-03-16T10:54:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.026138582, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.037614599, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.014832250, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1115, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.053806949, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000048257 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1025, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000187791, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000183 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:54:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1383, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.170694793, 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000846489 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1324, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.157866909, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000119234 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 1312, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 1296, 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-03-16T10:54:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1296, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2.898037980, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002236140 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 16, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 11, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 86, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 28, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 32, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 26, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 45, 2024-03-16T10:54:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 323, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 1, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 1, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 7, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 2671, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 2083, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 11, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 100, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 3, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 1, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 35, 2024-03-16T10:54:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 20, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 51, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 564, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 448, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 16, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 6662, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 43717742, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 448, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 15, 2024-03-16T10:54:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 15, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 433, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 32, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 209, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 786, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 10, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 548, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 315, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 48, 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 991 2024-03-16T10:54:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 137, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 47, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 12, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 583, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 569, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 3, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-03-16T10:54:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 35, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 2328, 2024-03-16T10:54:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 2328, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 4, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 4, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 9038405, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-03-16T10:54:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 467, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.651730457, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003536896 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 50, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 767, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 717, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 49, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 219, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 170, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 69, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 1556, 2024-03-16T10:54:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 1487, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 1, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 899, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 898, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 72112, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 223612 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 2177, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 252, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 1312, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 31, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 794, 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-03-16T10:54:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 26, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.066617039, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002562193 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.014760491, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001845061 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-03-16T10:54:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.031721703, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.007930425 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 525, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.265792055, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000506270 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-03-16T10:54:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 9, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.024571175, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002730130 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 11, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.018403277, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001673025 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 75, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.067708331, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000902777 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 25, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.547307357, 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.021892294 2024-03-16T10:54:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 47, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.684739063, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.014568916 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 10, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.020762802, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002076280 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-03-16T10:54:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.009738779, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001217347 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 548, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.145915908, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002091087 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-03-16T10:54:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 875, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 875, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 231, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-03-16T10:54:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 447889, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 186, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 176, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 2, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 7336, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 154, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 291405, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 5642, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 1869, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 4985277, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 33, 2024-03-16T10:54:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 1869, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1869, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 5.769945299, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003087183 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1869, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1986 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 1869, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 525, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 1344, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-03-16T10:54:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 10, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 77, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 544, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 57, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 637, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 448, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 20, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-03-16T10:54:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 11, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-03-16T10:54:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 87, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 2, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 12, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 12, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 139, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 43 2024-03-16T10:54:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 10, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 6, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 624, 2024-03-16T10:54:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 569, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 13560, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 4522153, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 13560, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 13560, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 4522153, 2024-03-16T10:54:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1869, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 5042746, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1869, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 5042746, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1869, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 1869, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1869, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1869, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 569, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 57469, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 569, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 77, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 57469, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55c49f19c500": { 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 2328, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 4844101, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 2328, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 467, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 4844101, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:43.794 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:54:44.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:44 smithi017 ceph-mon[32078]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 355 op/s 2024-03-16T10:54:44.692 INFO:tasks.check_counter:Daemon mds.a mds.exported=35 2024-03-16T10:54:44.692 INFO:tasks.check_counter:Daemon mds.a mds.imported=51 2024-03-16T10:54:44.692 DEBUG:tasks.check_counter:Getting stats from d 2024-03-16T10:54:44.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.d perf dump 2024-03-16T10:54:44.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:44 smithi174 ceph-mon[36202]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 355 op/s 2024-03-16T10:54:44.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:44 smithi111 ceph-mon[36315]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 355 op/s 2024-03-16T10:54:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:54:46.771 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:46 smithi017 ceph-mon[32078]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 907 KiB/s wr, 284 op/s 2024-03-16T10:54:46.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:46 smithi174 ceph-mon[36202]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 907 KiB/s wr, 284 op/s 2024-03-16T10:54:46.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:46 smithi111 ceph-mon[36315]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 907 KiB/s wr, 284 op/s 2024-03-16T10:54:47.063 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:54:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3024, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 448, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001398035, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000030492, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000550855, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-03-16T10:54:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000685298, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000228432 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 112, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 107, 2024-03-16T10:54:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 720416, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 64688, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.017208757, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.004597739, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.015590175, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.001913132, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 106, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003117523, 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000029410 2024-03-16T10:54:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 720416, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 64688 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 81, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 160, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 91968, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-03-16T10:54:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.005842523, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.003886575, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001321819, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 79, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002727038, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000034519 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 91968 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148840, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 28, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 113, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 704662, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 113, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 113, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 704662, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:47.075 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:54:47.866 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-16T10:54:47.867 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-16T10:54:47.867 DEBUG:tasks.check_counter:Getting stats from g 2024-03-16T10:54:47.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.g perf dump 2024-03-16T10:54:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:54:48.495 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:48 smithi017 ceph-mon[32078]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 616 KiB/s wr, 253 op/s 2024-03-16T10:54:48.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:48 smithi174 ceph-mon[36202]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 616 KiB/s wr, 253 op/s 2024-03-16T10:54:48.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:48 smithi111 ceph-mon[36315]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 616 KiB/s wr, 253 op/s 2024-03-16T10:54:50.088 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:54:50.088 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:50.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 481, 2024-03-16T10:54:50.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 462, 2024-03-16T10:54:50.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 948976, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 175248, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.049207759, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.015916009, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.025393010, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.010578314, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 461, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.015977168, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000034657 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.089 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 830704, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 63312 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 677, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 752, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 5018517, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 429657, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-03-16T10:54:50.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.045691715, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.014302161, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.014775503, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.013294794, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 751, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017392625, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000023159 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-03-16T10:54:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 215904 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 6, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1629, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 1284, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001151294, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000067856, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000938521, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000064436, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001898450, 2024-03-16T10:54:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000474612 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-03-16T10:54:50.093 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1806, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.037047796, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000020513 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-03-16T10:54:50.094 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-03-16T10:54:50.095 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 687, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 687, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 686, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 1, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2024-03-16T10:54:50.096 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:54:50.097 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.098 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-03-16T10:54:50.099 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 2328, 2024-03-16T10:54:50.100 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 4, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 9038405, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 9037267, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.101 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 2328 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 20, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 773, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 753, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 18, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 223, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 205, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 687, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 1408, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 721, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 0, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 0, 2024-03-16T10:54:50.102 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 56148, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 215420 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-03-16T10:54:50.103 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.105 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-03-16T10:54:50.106 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-03-16T10:54:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.109 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-03-16T10:54:50.111 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.112 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.113 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 0, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 0, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 1351, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.114 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:50.115 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:50.116 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 197763, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 64, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:50.117 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 7336, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 154, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 555274, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 4604, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.118 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 1028, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 21, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 3, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 1028, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1028, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2.602975299, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002532077 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-03-16T10:54:50.119 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1028, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1029 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 1028, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 1028, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 590, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 436, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-03-16T10:54:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-03-16T10:54:50.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-03-16T10:54:50.122 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 87, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 2, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 6, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 6, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 0, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 2, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 0 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-03-16T10:54:50.123 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2024-03-16T10:54:50.124 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1158, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 5855348, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1158, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1158, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 5855348, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.125 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1028, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 4844106, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1028, 2024-03-16T10:54:50.126 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 4844106, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 1028, 2024-03-16T10:54:50.127 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 1028, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1028, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1028, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:50.128 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55a3d857e6e0": { 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:50.129 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:50.130 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:54:50.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:50 smithi174 ceph-mon[36202]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 293 KiB/s wr, 175 op/s 2024-03-16T10:54:50.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:50 smithi017 ceph-mon[32078]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 293 KiB/s wr, 175 op/s 2024-03-16T10:54:50.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:50 smithi111 ceph-mon[36315]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 293 KiB/s wr, 175 op/s 2024-03-16T10:54:51.022 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-03-16T10:54:51.022 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-03-16T10:54:51.022 DEBUG:tasks.check_counter:Getting stats from j 2024-03-16T10:54:51.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.j perf dump 2024-03-16T10:54:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.a/config 2024-03-16T10:54:52.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:52 smithi017 ceph-mon[32078]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 271 KiB/s wr, 135 op/s 2024-03-16T10:54:52.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:52 smithi174 ceph-mon[36202]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 271 KiB/s wr, 135 op/s 2024-03-16T10:54:52.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:52 smithi111 ceph-mon[36315]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 271 KiB/s wr, 135 op/s 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 118, 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 111, 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 723984, 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 66416, 2024-03-16T10:54:53.053 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.020389832, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.005354884, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.017869054, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.001857258, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 111, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.004386935, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000039521 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:53.054 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 723984, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 66416 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 82, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 160, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 92144, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.005347356, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.003446301, 2024-03-16T10:54:53.055 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001245505, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 80, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002462581, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000030782 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 92144 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.056 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000378297, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000320061, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:53.057 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:53.058 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:53.059 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:53.060 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148823, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 27, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2024-03-16T10:54:53.061 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 115, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 704922, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 115, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-03-16T10:54:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 115, 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 704922, 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-16T10:54:53.063 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-16T10:54:53.858 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-16T10:54:53.858 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-16T10:54:53.858 DEBUG:tasks.check_counter:Getting stats from b 2024-03-16T10:54:53.858 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.b perf dump 2024-03-16T10:54:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:54:54.747 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:54 smithi111 ceph-mon[36315]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 232 KiB/s wr, 92 op/s 2024-03-16T10:54:54.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:54 smithi174 ceph-mon[36202]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 232 KiB/s wr, 92 op/s 2024-03-16T10:54:54.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:54 smithi017 ceph-mon[32078]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 232 KiB/s wr, 92 op/s 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 26063, 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 30666, 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 8347088, 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 70191486, 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 40, 2024-03-16T10:54:56.105 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 3, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 2.511165313, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 1.018644206, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.833592871, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.644638212, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 30668, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 11.014877457, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000359165 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 25883, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.005149039, 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000198 2024-03-16T10:54:56.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 75495, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 127992, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 26897104, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 121110053, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 14, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 7, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 4.997149053, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 2.260702399, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 4.169560863, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.856675616, 2024-03-16T10:54:56.107 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 127991, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 21.564148725, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000168481 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 97792, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.020626693, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000210 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 925552, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 105072 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.108 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 22301, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 25346, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 6804357, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 42905120, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 52, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 9, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 2.246278323, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 1.050467266, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.809023096, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.441600188, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 25341, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 9.892188744, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000390362 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.109 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 29542, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.005489500, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000185 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 37616, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 223312 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "cct": { 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "total_workers": 1, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "unhealthy_workers": 0 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-MDSRank": { 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 11575, 2024-03-16T10:54:56.110 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 52.841082275, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.004565104 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-PurgeQueue": { 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 19136, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.702969265, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000245765 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "request": 36110, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "reply": 35898, 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "reply_latency": { 2024-03-16T10:54:56.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 35898, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 130.299509915, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.003629715 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_reply": 0, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "forward": 212, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_complete": 11, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_keys": 4, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_commit": 2673, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_split": 7, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_merge": 3, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes": 385, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_top": 49, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_bottom": 326, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pin_tail": 10, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pinned": 314, 2024-03-16T10:54:56.112 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_expired": 3359, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_with_caps": 2, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": 2, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "subtrees": 6, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse": 46431, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_hit": 45368, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_forward": 96, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_discover": 103, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_remote_ino": 2, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_lock": 11, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "load_cent": 0, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "q": 0, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "exported": 227, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "exported_inodes": 3113, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "imported": 140, 2024-03-16T10:54:56.113 INFO:teuthology.orchestra.run.smithi111.stdout: "imported_inodes": 523, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_dir_fetch": 0, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_backtrace_fetch": 10182, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_peer_discover": 5, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rfiles": 4, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rbytes": 234, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rsnaps": 0, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_fetch": 10182, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_set_tag": 0, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_inodes": 1346, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_base_inodes": 5, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dirfrag_rstats": 1341, 2024-03-16T10:54:56.114 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_file_inodes": 8836, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_inode_file_caps": 269, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_revoke": 3711, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_grant": 26483, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_trunc": 200, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps": 18876, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps_dirty": 12762, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_cap_release": 143, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "process_request_cap_release": 16735 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache": { 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update": 0, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update_receipt": 0, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_try_discover": 0, 2024-03-16T10:54:56.115 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_send_discover": 115, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_handle_discover": 408, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays": 3, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_delayed": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_created": 10986, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_enqueued": 10913, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_reintegrated": 71, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_migrated": 7, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_processing": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_started": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_completed": 0, 2024-03-16T10:54:56.116 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_enqueue_scrub": 5, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_exportdir": 227, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_flush": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragmentdir": 10, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragstats": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_inodestats": 0 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log": { 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evlrg": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evadd": 61009, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evex": 60567, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evtrm": 60567, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "ev": 442, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evexg": 0, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "evexd": 7207, 2024-03-16T10:54:56.117 INFO:teuthology.orchestra.run.smithi111.stdout: "segadd": 84, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "segex": 83, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "segtrm": 83, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "seg": 1, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "segmjr": 1, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "segexg": 0, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "segexd": 9, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "expos": 131581967, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "wrpos": 132052287, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "rdpos": 0, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "jlat": { 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 5138, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 290.534986556, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.056546318 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: "replayed": 0 2024-03-16T10:54:56.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_mem": { 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "ino": 45, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "ino+": 14130, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "ino-": 14085, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dir": 47, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dir+": 1893, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dir-": 1846, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dn": 385, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dn+": 26420, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "dn-": 26035, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "cap": 2, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "cap+": 14114, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "cap-": 14112, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "rss": 143460, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "heap": 231804 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.119 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_server": { 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_client_request": 43997, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_server_request": 2816, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_request": 36110, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_session": 471, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_peer_request": 5301, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_create_latency": { 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 11449, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 40.938532360, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.003575729 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getattr_latency": { 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 185, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.145623112, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.006192557 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getfilelock_latency": { 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_link_latency": { 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 199, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 3.510782850, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.017642124 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookup_latency": { 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 7925, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 7.010468193, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000884601 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookuphash_latency": { 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupino_latency": { 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000160832, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000160832 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupname_latency": { 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupparent_latency": { 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupsnap_latency": { 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lssnap_latency": { 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mkdir_latency": { 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1752, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 7.417446078, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.004233702 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mknod_latency": { 2024-03-16T10:54:56.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 382, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.086233226, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.010696945 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mksnap_latency": { 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "req_open_latency": { 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 49, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.057546461, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001174417 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "req_readdir_latency": { 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1528, 2024-03-16T10:54:56.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.153536747, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002718283 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rename_latency": { 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 501, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 6.105287278, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.012186202 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "req_renamesnap_latency": { 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "req_snapdiff_latency": { 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.126 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmdir_latency": { 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1728, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 27.103167194, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.015684703 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmsnap_latency": { 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmxattr_latency": { 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.127 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setattr_latency": { 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 203, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 5.320629106, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.026209995 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setdirlayout_latency": { 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setfilelock_latency": { 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setlayout_latency": { 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setxattr_latency": { 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 8, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.018940380, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002367547 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "req_symlink_latency": { 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 413, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 2.698051204, 2024-03-16T10:54:56.129 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.006532811 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "req_unlink_latency": { 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 9575, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 20.733104894, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002165337 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getvxattr_latency": { 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sessions": { 2024-03-16T10:54:56.130 INFO:teuthology.orchestra.run.smithi111.stdout: "session_count": 1, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "session_add": 3, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "session_remove": 2, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_open": 1, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_stale": 0, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "total_load": 18819, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "average_load": 18819, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "avg_session_uptime": 244, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "mdthresh_evicted": 0 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "mempool": { 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:56.131 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:56.132 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_bytes": 320499, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_items": 121, 2024-03-16T10:54:56.133 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_bytes": 176, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_items": 2, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bytes": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_items": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_bytes": 7336, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_items": 154, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_items": 0, 2024-03-16T10:54:56.134 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_bytes": 453240, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_items": 4230, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_items": 0, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_items": 0 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter": { 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_active": 0, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_laggy": 0, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send": 43638, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send_bytes": 151402567, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_resend": 35, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_reply": 43638, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "op_latency": { 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 43638, 2024-03-16T10:54:56.135 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 2951.080070684, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.067626382 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op_inflight": 0, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "oplen_avg": { 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 43638, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 72197 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op": 43638, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op_r": 10556, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op_w": 33082, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op_rmw": 0, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "op_pg": 0, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_stat": 1194, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_create": 11935, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_read": 354, 2024-03-16T10:54:56.136 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_write": 5487, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writefull": 233, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writesame": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_append": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_zero": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_truncate": 7, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_delete": 12337, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_mapext": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_sparse_read": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_clonerange": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_getxattr": 10202, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_setxattr": 24276, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_rmxattr": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_call": 0, 2024-03-16T10:54:56.137 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_watch": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_notify": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_other": 243, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_active": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_send": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_resend": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_ping": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_active": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_send": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_resend": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_active": 0, 2024-03-16T10:54:56.138 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_send": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_resend": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_active": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_send": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_resend": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "command_active": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "command_send": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "command_resend": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "map_epoch": 87, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "map_full": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "map_inc": 3, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_sessions": 12, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_open": 12, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_close": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_laggy": 0, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_wr": 5486, 2024-03-16T10:54:56.139 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_rd": 30, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_del": 413 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "oft": { 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_objs": 1, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_updates": 0, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_removes": 0 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "osd-slow-ops": { 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_ops_count": 0 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "purge_queue": { 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops": 0, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops_high_water": 14, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing": 0, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_high_water": 6, 2024-03-16T10:54:56.140 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed_ops": 11755, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed": 10913, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_item_in_journal": 0 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 123855, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 31768292, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 123855, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:56.141 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 123855, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 31768292, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_bytes": { 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:56.142 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 43638, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 152504660, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 43638, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 152504660, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_ops": { 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 1024, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:56.143 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 43638, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 43638, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 43638, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 43638, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:56.144 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 10913, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 1102285, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 10913, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 349, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 1102285, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle-0x56071b626500": { 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:54:56.145 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 61009, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 127857983, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 61009, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 5138, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 127857983, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:56.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-03-16T10:54:56.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:56 smithi174 ceph-mon[36202]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-03-16T10:54:56.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:56 smithi017 ceph-mon[32078]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-03-16T10:54:56.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:56 smithi111 ceph-mon[36315]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-03-16T10:54:56.985 INFO:tasks.check_counter:Daemon mds.b mds.exported=227 2024-03-16T10:54:56.985 INFO:tasks.check_counter:Daemon mds.b mds.imported=140 2024-03-16T10:54:56.985 DEBUG:tasks.check_counter:Getting stats from e 2024-03-16T10:54:56.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.e perf dump 2024-03-16T10:54:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:54:58.726 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:54:58 smithi111 ceph-mon[36315]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-03-16T10:54:58.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:54:58 smithi174 ceph-mon[36202]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-03-16T10:54:58.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:54:58 smithi017 ceph-mon[32078]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-03-16T10:54:59.146 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 8853, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 6406, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 3479662, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 5548118, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 10, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 4, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.566381028, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.230739176, 2024-03-16T10:54:59.147 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.348181497, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.057469333, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 6408, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.236056330, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000036837 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 12795, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.002598561, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000203 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.148 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 2278, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 2103, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 1593705, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 2937986, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 8, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 7, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.162235595, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.064256014, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.096631255, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.018429056, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2103, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.132627984, 2024-03-16T10:54:59.149 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000063066 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2901, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000466760, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000160 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 863056, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 95264 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 3266, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 5803, 2024-03-16T10:54:59.150 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 968050, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 3364390, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 23, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 9, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.221911537, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.102304268, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.113696956, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.015444812, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 5797, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.359681996, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000062046 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 4330, 2024-03-16T10:54:59.151 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.001109976, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000256 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 219584 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "cct": { 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "total_workers": 1, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "unhealthy_workers": 0 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-MDSRank": { 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1687, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.523895732, 2024-03-16T10:54:59.152 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000903316 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-PurgeQueue": { 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1444, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.133796885, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000092657 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "request": 1657, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "reply": 1634, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "reply_latency": { 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1634, 2024-03-16T10:54:59.153 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.042646833, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002474080 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_reply": 0, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "forward": 23, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_complete": 0, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_keys": 0, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_commit": 11, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_split": 0, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_merge": 0, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes": 52, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_top": 18, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_bottom": 11, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pin_tail": 23, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pinned": 25, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_expired": 422, 2024-03-16T10:54:59.154 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_with_caps": 0, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": 0, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "subtrees": 7, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse": 2924, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_hit": 2432, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_forward": 19, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_discover": 94, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_remote_ino": 1, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_lock": 1, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "load_cent": 0, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "q": 0, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "exported": 45, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "exported_inodes": 121, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "imported": 58, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "imported_inodes": 589, 2024-03-16T10:54:59.155 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_dir_fetch": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_backtrace_fetch": 557, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_peer_discover": 1, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rfiles": 4, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rbytes": 234, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rsnaps": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_fetch": 557, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_set_tag": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_inodes": 27, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dirfrag_rstats": 27, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_file_inodes": 530, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_inode_file_caps": 27, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_revoke": 262, 2024-03-16T10:54:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_grant": 975, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_trunc": 14, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps": 844, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps_dirty": 563, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_cap_release": 60, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "process_request_cap_release": 1085 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache": { 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update": 0, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update_receipt": 0, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_try_discover": 0, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_send_discover": 98, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_handle_discover": 61, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays": 7, 2024-03-16T10:54:59.157 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_delayed": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_created": 671, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_enqueued": 657, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_reintegrated": 6, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_migrated": 2, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_processing": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_started": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_completed": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_exportdir": 45, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_flush": 0, 2024-03-16T10:54:59.158 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragstats": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_inodestats": 0 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log": { 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evlrg": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evadd": 2829, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evex": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evtrm": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "ev": 2829, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evexg": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "evexd": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "segadd": 5, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "segex": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "segtrm": 0, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "seg": 5, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "segmjr": 2, 2024-03-16T10:54:59.159 INFO:teuthology.orchestra.run.smithi111.stdout: "segexg": 0, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "segexd": 0, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "expos": 4194304, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "wrpos": 10549114, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "rdpos": 0, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "jlat": { 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 580, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.556766916, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002684080 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "replayed": 0 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_mem": { 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "ino": 43, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "ino+": 929, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "ino-": 886, 2024-03-16T10:54:59.160 INFO:teuthology.orchestra.run.smithi111.stdout: "dir": 42, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dir+": 254, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dir-": 212, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dn": 52, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dn+": 1813, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dn-": 1761, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "cap": 0, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "cap+": 1249, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "cap-": 1249, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "rss": 70268, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "heap": 223612 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_server": { 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_client_request": 2382, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_server_request": 347, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_request": 1657, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_session": 75, 2024-03-16T10:54:59.161 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_peer_request": 788, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "req_create_latency": { 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 70, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.120459888, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001720855 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getattr_latency": { 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 16, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.054516336, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.003407271 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getfilelock_latency": { 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.162 INFO:teuthology.orchestra.run.smithi111.stdout: "req_link_latency": { 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 20, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.148604621, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.007430231 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookup_latency": { 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 584, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.272719517, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000466985 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookuphash_latency": { 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupino_latency": { 2024-03-16T10:54:59.163 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupname_latency": { 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupparent_latency": { 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupsnap_latency": { 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lssnap_latency": { 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mkdir_latency": { 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 42, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.064043289, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001524840 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mknod_latency": { 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 35, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.049033813, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001400966 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mksnap_latency": { 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "req_open_latency": { 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "req_readdir_latency": { 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 96, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.077758062, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000809979 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rename_latency": { 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 32, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.674229078, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.021069658 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.167 INFO:teuthology.orchestra.run.smithi111.stdout: "req_renamesnap_latency": { 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "req_snapdiff_latency": { 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmdir_latency": { 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 70, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.041859912, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.014883713 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmsnap_latency": { 2024-03-16T10:54:59.168 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmxattr_latency": { 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setattr_latency": { 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 15, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.050889025, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.003392601 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setdirlayout_latency": { 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.169 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setfilelock_latency": { 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setlayout_latency": { 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.170 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setxattr_latency": { 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "req_symlink_latency": { 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 32, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.093181559, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002911923 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "req_unlink_latency": { 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 622, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.395351733, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002243330 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:54:59.171 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getvxattr_latency": { 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sessions": { 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "session_count": 1, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "session_add": 1, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "session_remove": 0, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_open": 1, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_stale": 0, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "total_load": 1022, 2024-03-16T10:54:59.172 INFO:teuthology.orchestra.run.smithi111.stdout: "average_load": 1022, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "avg_session_uptime": 1706, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "mdthresh_evicted": 0 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "mempool": { 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_items": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:54:59.173 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_items": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:54:59.174 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_bytes": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_bytes": 299017, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_items": 127, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_bytes": 440, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_items": 5, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bytes": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_items": 0, 2024-03-16T10:54:59.175 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_items": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_items": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_bytes": 7336, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_items": 154, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_bytes": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_items": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_bytes": 190905, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_items": 1786, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_bytes": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_items": 0, 2024-03-16T10:54:59.176 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_bytes": 0, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_items": 0 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter": { 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_active": 0, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_laggy": 0, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send": 2203, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send_bytes": 6524823, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_resend": 33, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_reply": 2203, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_latency": { 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2203, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.979919277, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002260517 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.177 INFO:teuthology.orchestra.run.smithi111.stdout: "op_inflight": 0, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "oplen_avg": { 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2203, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 2337 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "op": 2203, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "op_r": 641, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "op_w": 1562, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "op_rmw": 0, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "op_pg": 0, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_stat": 0, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_create": 10, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_read": 84, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_write": 664, 2024-03-16T10:54:59.178 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writefull": 63, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writesame": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_append": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_zero": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_truncate": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_delete": 714, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_mapext": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_sparse_read": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_clonerange": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_getxattr": 557, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_setxattr": 20, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_rmxattr": 0, 2024-03-16T10:54:59.179 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_call": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_watch": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_notify": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_other": 19, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_active": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_send": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_resend": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_ping": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_active": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_send": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_resend": 0, 2024-03-16T10:54:59.180 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_active": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_send": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_resend": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_active": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_send": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_resend": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "command_active": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "command_send": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "command_resend": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "map_epoch": 87, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "map_full": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "map_inc": 2, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_sessions": 12, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_open": 12, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_close": 0, 2024-03-16T10:54:59.181 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_laggy": 0, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_wr": 152, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_rd": 0, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_del": 54 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "oft": { 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_objs": 1, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_updates": 0, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_removes": 0 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "osd-slow-ops": { 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_ops_count": 0 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "purge_queue": { 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops": 0, 2024-03-16T10:54:59.182 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops_high_water": 8, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing": 0, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_high_water": 6, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed_ops": 701, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed": 657, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_item_in_journal": 0 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 14393, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 4776643, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 14393, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:59.183 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 14393, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 4776643, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_bytes": { 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:54:59.184 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 2203, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 6591180, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 2203, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 6591180, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_ops": { 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 1024, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:59.185 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 2203, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 2203, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 2203, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 2203, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:54:59.186 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 657, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 66357, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 657, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 84, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 66357, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.187 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle-0x55ab8aad2500": { 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 2829, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 6354810, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 2829, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:54:59.188 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 580, 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 6354810, 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:54:59.189 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-03-16T10:55:00.035 INFO:tasks.check_counter:Daemon mds.e mds.exported=45 2024-03-16T10:55:00.035 INFO:tasks.check_counter:Daemon mds.e mds.imported=58 2024-03-16T10:55:00.035 DEBUG:tasks.check_counter:Getting stats from h 2024-03-16T10:55:00.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.h perf dump 2024-03-16T10:55:00.348 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:55:00.692 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:00 smithi111 ceph-mon[36315]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:00.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:00 smithi174 ceph-mon[36202]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:00.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:00 smithi017 ceph-mon[32078]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:02.086 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-03-16T10:55:02.086 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:02.086 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 9729, 2024-03-16T10:55:02.086 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 7708, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 4649140, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 8473385, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 13, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 5, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.613998581, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.265671613, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.406193216, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.031011909, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 7707, 2024-03-16T10:55:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.332778942, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000043178 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 14676, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.002780893, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000189 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 868816, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 115648 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 1605, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 1749, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 578338, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 913113, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 18, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 6, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.129885654, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.053083091, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.063447518, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.016762610, 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:02.089 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1747, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.114286079, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000065418 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1776, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000341947, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000192 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 3600, 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 225200 2024-03-16T10:55:02.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 3914, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 6499, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 1234457, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 3747983, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 12, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 10, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.243275003, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.106898142, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.136741020, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.027688176, 2024-03-16T10:55:02.091 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 6498, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.244219130, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000037583 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 4533, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.001128608, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000248 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.092 INFO:teuthology.orchestra.run.smithi111.stdout: "cct": { 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "total_workers": 1, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "unhealthy_workers": 0 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-MDSRank": { 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1738, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.672263029, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000962176 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.093 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1665, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.145724891, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000087522 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "request": 1895, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "reply": 1878, 2024-03-16T10:55:02.094 INFO:teuthology.orchestra.run.smithi111.stdout: "reply_latency": { 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1878, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 4.430533225, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002359176 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_reply": 0, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "forward": 17, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_commit": 20, 2024-03-16T10:55:02.095 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_split": 1, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_merge": 0, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes": 49, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_top": 17, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_bottom": 9, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pin_tail": 23, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pinned": 24, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_expired": 322, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_with_caps": 1, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": 1, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "subtrees": 6, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse": 3692, 2024-03-16T10:55:02.096 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_hit": 2882, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_forward": 8, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_discover": 99, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_remote_ino": 1, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_lock": 3, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "load_cent": 0, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "q": 0, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "exported": 44, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "exported_inodes": 19, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "imported": 58, 2024-03-16T10:55:02.097 INFO:teuthology.orchestra.run.smithi111.stdout: "imported_inodes": 720, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_backtrace_fetch": 1047, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_peer_discover": 1, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rfiles": 4, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rbytes": 234, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rsnaps": 0, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_fetch": 1047, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:02.098 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_inodes": 58, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dirfrag_rstats": 58, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_file_inodes": 989, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_inode_file_caps": 33, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_revoke": 252, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_grant": 1132, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_trunc": 2, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps": 853, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps_dirty": 448, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_cap_release": 51, 2024-03-16T10:55:02.099 INFO:teuthology.orchestra.run.smithi111.stdout: "process_request_cap_release": 1422 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache": { 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update": 0, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_try_discover": 0, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_send_discover": 114, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_handle_discover": 47, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays": 9, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:02.100 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_created": 844, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_enqueued": 832, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_reintegrated": 5, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_migrated": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_started": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_completed": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:02.101 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_exportdir": 44, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_flush": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragmentdir": 1, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_inodestats": 0 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log": { 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "evlrg": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "evadd": 3432, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "evex": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "evtrm": 0, 2024-03-16T10:55:02.102 INFO:teuthology.orchestra.run.smithi111.stdout: "ev": 3432, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "evexg": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "evexd": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segadd": 5, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segex": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segtrm": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "seg": 5, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segmjr": 2, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segexg": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "segexd": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "expos": 4194304, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "wrpos": 10821546, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "rdpos": 0, 2024-03-16T10:55:02.103 INFO:teuthology.orchestra.run.smithi111.stdout: "jlat": { 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 485, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.270281969, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002619138 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "replayed": 0 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_mem": { 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "ino": 44, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "ino+": 1028, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "ino-": 984, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "dir": 43, 2024-03-16T10:55:02.104 INFO:teuthology.orchestra.run.smithi111.stdout: "dir+": 259, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "dir-": 216, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "dn": 49, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "dn+": 2045, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "dn-": 1996, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "cap": 1, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "cap+": 1266, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "cap-": 1265, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "rss": 69516, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "heap": 223612 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.105 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_server": { 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_client_request": 3068, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_server_request": 218, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_request": 1895, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_session": 87, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_peer_request": 1000, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "req_create_latency": { 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 93, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.186512830, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002005514 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.106 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getattr_latency": { 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 6, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.005933342, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000988890 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "req_link_latency": { 2024-03-16T10:55:02.107 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 4, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.198205598, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.049551399 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookup_latency": { 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 755, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.384003491, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000508613 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupino_latency": { 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000145120, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000145120 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupname_latency": { 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lssnap_latency": { 2024-03-16T10:55:02.110 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mkdir_latency": { 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 13, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.024761605, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001904738 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mknod_latency": { 2024-03-16T10:55:02.111 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 14, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.022667402, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001619100 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mksnap_latency": { 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "req_open_latency": { 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.112 INFO:teuthology.orchestra.run.smithi111.stdout: "req_readdir_latency": { 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 101, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.095580375, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000946340 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rename_latency": { 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 23, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.750111889, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.032613560 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmdir_latency": { 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 62, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.893042150, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.014403905 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:02.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setattr_latency": { 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.006427644, 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.003213822 2024-03-16T10:55:02.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setlayout_latency": { 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setxattr_latency": { 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "req_symlink_latency": { 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 15, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.029420777, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.001961385 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "req_unlink_latency": { 2024-03-16T10:55:02.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 789, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1.833721002, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002324107 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.118 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sessions": { 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "session_count": 1, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "session_add": 3, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "session_remove": 2, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_open": 1, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_stale": 0, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "total_load": 1351, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "average_load": 1351, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avg_session_uptime": 239, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "mempool": { 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:02.119 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:02.120 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:02.121 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_items": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_bytes": 323596, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_items": 141, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_bytes": 88, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_items": 1, 2024-03-16T10:55:02.122 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bytes": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_items": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_items": 154, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_items": 0, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_bytes": 194456, 2024-03-16T10:55:02.123 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_items": 2308, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_items": 0, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_items": 0 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter": { 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_active": 0, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_laggy": 0, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send": 2771, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send_bytes": 6986161, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_resend": 33, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_reply": 2771, 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "op_latency": { 2024-03-16T10:55:02.124 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2771, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 5.918903989, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.002136017 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_inflight": 0, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "oplen_avg": { 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 2771, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 2908 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op": 2771, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_r": 1139, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_w": 1632, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_rmw": 0, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_pg": 0, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_stat": 0, 2024-03-16T10:55:02.125 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_create": 10, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_read": 92, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_write": 577, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writefull": 67, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writesame": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_append": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_zero": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_truncate": 1, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_delete": 877, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_mapext": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:02.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_getxattr": 1047, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_setxattr": 20, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_call": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_watch": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_notify": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_other": 2, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_active": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_send": 0, 2024-03-16T10:55:02.127 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_resend": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_ping": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_active": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_send": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_resend": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_active": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_send": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_resend": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_active": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_send": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_resend": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "command_active": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "command_send": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "command_resend": 0, 2024-03-16T10:55:02.128 INFO:teuthology.orchestra.run.smithi111.stdout: "map_epoch": 87, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "map_full": 0, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "map_inc": 2, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_sessions": 12, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_open": 12, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_close": 0, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_laggy": 0, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_wr": 165, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_rd": 0, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_del": 50 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "oft": { 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_objs": 1, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:02.129 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_updates": 0, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_removes": 0 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osd-slow-ops": { 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_ops_count": 0 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "purge_queue": { 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops_high_water": 14, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing": 0, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_high_water": 6, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed_ops": 864, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed": 832, 2024-03-16T10:55:02.130 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 15244, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 5123574, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 15244, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 15244, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 5123574, 2024-03-16T10:55:02.131 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:02.132 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 2771, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 7070201, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 2771, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 7070201, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:02.133 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 1024, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 2771, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 2771, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 2771, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 2771, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.134 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 832, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 84040, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 832, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:02.135 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 92, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 84040, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle-0x564635a6e500": { 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 3432, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 6627242, 2024-03-16T10:55:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 3432, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 485, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 6627242, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:02.137 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-03-16T10:55:02.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:02 smithi174 ceph-mon[36202]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:02.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:02 smithi017 ceph-mon[32078]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:02.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:02 smithi111 ceph-mon[36315]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:02.942 INFO:tasks.check_counter:Daemon mds.h mds.exported=44 2024-03-16T10:55:02.942 INFO:tasks.check_counter:Daemon mds.h mds.imported=58 2024-03-16T10:55:02.942 DEBUG:tasks.check_counter:Getting stats from k 2024-03-16T10:55:02.943 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.k perf dump 2024-03-16T10:55:03.274 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.b/config 2024-03-16T10:55:04.757 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:04 smithi111 ceph-mon[36315]: pgmap v478: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:55:04.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:04 smithi174 ceph-mon[36202]: pgmap v478: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:55:04.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:04 smithi017 ceph-mon[32078]: pgmap v478: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-03-16T10:55:05.094 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 323, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 325, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 4279009, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 102778, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 6, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 2, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.025583167, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.007982295, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.008231762, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.006897604, 2024-03-16T10:55:05.095 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 323, 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.008344497, 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000025834 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.096 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 470, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 448, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 5127110, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 174021, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 4, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 3, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.044302132, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.010759278, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.025702555, 2024-03-16T10:55:05.097 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.011540074, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 447, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.011567696, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000025878 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 851248, 2024-03-16T10:55:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 69712 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_messages": 471, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages": 553, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_bytes": 2328840, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_bytes": 370172, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_created_connections": 5, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_active_connections": 4, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_total_time": 0.039373871, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_send_time": 0.013334227, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_recv_time": 0.010943695, 2024-03-16T10:55:05.099 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_running_fast_dispatch_time": 0.011875397, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 552, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.015741892, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000028517 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "msgr_send_encrypted_bytes": 221984 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "cct": { 2024-03-16T10:55:05.100 INFO:teuthology.orchestra.run.smithi111.stdout: "total_workers": 1, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "unhealthy_workers": 0 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-MDSRank": { 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1908, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.043381398, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000022736 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "queue_len": 0, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "complete_latency": { 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.101 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "request": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "reply": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "reply_latency": { 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_reply": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "forward": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:05.102 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_commit": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_split": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_merge": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes": 1524, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_top": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_bottom": 1524, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pin_tail": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_pinned": 1524, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_expired": 2, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "inodes_with_caps": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "subtrees": 1, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_hit": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_forward": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_discover": 0, 2024-03-16T10:55:05.103 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_remote_ino": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "traverse_lock": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "load_cent": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "q": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "exported": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "exported_inodes": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "imported": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "imported_inodes": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_backtrace_fetch": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "openino_peer_discover": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rfiles": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rbytes": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "root_rsnaps": 0, 2024-03-16T10:55:05.104 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_inodes": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "scrub_file_inodes": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_inode_file_caps": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_grant": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:05.105 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_caps_dirty": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_cap_release": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "process_request_cap_release": 0 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_cache": { 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_try_discover": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_send_discover": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "dir_handle_discover": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:05.106 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_created": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_enqueued": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_reintegrated": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "strays_migrated": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_started": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_completed": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_exportdir": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_flush": 0, 2024-03-16T10:55:05.107 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "ireq_inodestats": 0 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_log": { 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evlrg": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evadd": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evex": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evtrm": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "ev": 4983, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evexg": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "evexd": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "segadd": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "segex": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "segtrm": 0, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "seg": 8, 2024-03-16T10:55:05.108 INFO:teuthology.orchestra.run.smithi111.stdout: "segmjr": 2, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "segexg": 0, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "segexd": 0, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "expos": 4194304, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "wrpos": 14759938, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "rdpos": 14758800, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "jlat": { 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "replayed": 4983 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_mem": { 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "ino": 12, 2024-03-16T10:55:05.109 INFO:teuthology.orchestra.run.smithi111.stdout: "ino+": 1764, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "ino-": 1752, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dir": 10, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dir+": 345, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dir-": 335, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dn": 1524, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dn+": 3334, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dn-": 1810, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "cap": 0, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "cap+": 0, 2024-03-16T10:55:05.110 INFO:teuthology.orchestra.run.smithi111.stdout: "cap-": 0, 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: "rss": 54520, 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: "heap": 215420 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_server": { 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_client_request": 0, 2024-03-16T10:55:05.111 INFO:teuthology.orchestra.run.smithi111.stdout: "dispatch_server_request": 0, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_request": 0, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_client_session": 0, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "handle_peer_request": 0, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "req_create_latency": { 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.112 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getattr_latency": { 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "req_link_latency": { 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookup_latency": { 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupino_latency": { 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupname_latency": { 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.115 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: "req_lssnap_latency": { 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.116 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mkdir_latency": { 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mknod_latency": { 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "req_mksnap_latency": { 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "req_open_latency": { 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "req_readdir_latency": { 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rename_latency": { 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.118 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmdir_latency": { 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.119 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setattr_latency": { 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setlayout_latency": { 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.121 INFO:teuthology.orchestra.run.smithi111.stdout: "req_setxattr_latency": { 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "req_symlink_latency": { 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "req_unlink_latency": { 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.122 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_sessions": { 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "session_count": 1, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "session_add": 2, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "session_remove": 1, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_open": 1, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "sessions_stale": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "total_load": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "average_load": 0, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "avg_session_uptime": 1713, 2024-03-16T10:55:05.123 INFO:teuthology.orchestra.run.smithi111.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "mempool": { 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:05.124 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:05.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_bytes": 198118, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_anon_items": 55, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "buffer_meta_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:05.126 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_items": 154, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "pgmap_items": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_bytes": 1113170, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_co_items": 6422, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_1_items": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "unittest_2_items": 0 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "objecter": { 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "op_active": 0, 2024-03-16T10:55:05.127 INFO:teuthology.orchestra.run.smithi111.stdout: "op_laggy": 0, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send": 1117, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_send_bytes": 21, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_resend": 3, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_reply": 1117, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_latency": { 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1117, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.745987883, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000667849 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "op_inflight": 0, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "oplen_avg": { 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 1117, 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 1118 2024-03-16T10:55:05.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "op": 1117, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "op_r": 1117, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "op_w": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "op_rmw": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "op_pg": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_stat": 662, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_create": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_read": 453, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_write": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writefull": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_writesame": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_append": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_zero": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_truncate": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_delete": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_mapext": 0, 2024-03-16T10:55:05.129 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_getxattr": 1, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_setxattr": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_call": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_watch": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_notify": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "osdop_other": 0, 2024-03-16T10:55:05.130 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_active": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_send": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_resend": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "linger_ping": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_active": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_send": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolop_resend": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_active": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_send": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "poolstat_resend": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_active": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_send": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "statfs_resend": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "command_active": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "command_send": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "command_resend": 0, 2024-03-16T10:55:05.131 INFO:teuthology.orchestra.run.smithi111.stdout: "map_epoch": 87, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "map_full": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "map_inc": 2, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_sessions": 6, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_open": 6, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_session_close": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_laggy": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_wr": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_rd": 2, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_del": 0 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "oft": { 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_objs": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_updates": 0, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "omap_total_removes": 0 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.132 INFO:teuthology.orchestra.run.smithi111.stdout: "osd-slow-ops": { 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "slow_ops_count": 0 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "purge_queue": { 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executing_high_water": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed_ops": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_executed": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:05.133 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 1260, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 11611358, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 1260, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 1260, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 11611358, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:05.134 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 104857600, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 1117, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 10565639, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 1117, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 10565639, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.135 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 1024, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 1117, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 1117, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 1117, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 1117, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "throttle-write_buf_throttle-0x55595868c6e0": { 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "val": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "max": 3758096384, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "get_started": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "get": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "get_sum": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "take": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "take_sum": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "put": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "put_sum": 0, 2024-03-16T10:55:05.138 INFO:teuthology.orchestra.run.smithi111.stdout: "wait": { 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout: "avgcount": 0, 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout: "sum": 0.000000000, 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout: "avgtime": 0.000000000 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-03-16T10:55:05.139 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-03-16T10:55:05.893 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-03-16T10:55:05.893 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-03-16T10:55:05.893 DEBUG:tasks.check_counter:Getting stats from c 2024-03-16T10:55:05.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.c perf dump 2024-03-16T10:55:06.137 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:55:06.537 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:06 smithi174 ceph-mon[36202]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:06.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:06 smithi017 ceph-mon[32078]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:06.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:06 smithi111 ceph-mon[36315]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-03-16T10:55:07.993 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 882, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 882, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 61015522, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 279662, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 8, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.085513785, 2024-03-16T10:55:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.015316168, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.046486257, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.018352225, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 881, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.023027303, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000026137 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:07.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 148, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 230, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 37787664, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 267996, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-03-16T10:55:07.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.028643646, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.005290802, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.018944463, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.003043007, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 228, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.019822817, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000086942 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:07.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 221184 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 468, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 446, 2024-03-16T10:55:07.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 30293208, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 172257, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.053499166, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.011171607, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.035398717, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.009837929, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 445, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.012279518, 2024-03-16T10:55:07.999 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000027594 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 850592, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 67952 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-03-16T10:55:08.000 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2177, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.221111728, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000101567 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:08.001 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-03-16T10:55:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-03-16T10:55:08.003 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 11446, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 7765, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 3681, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 353, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 2, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-03-16T10:55:08.004 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-03-16T10:55:08.005 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 234, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:08.006 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-03-16T10:55:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:08.008 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:08.009 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-03-16T10:55:08.010 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 61010, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 2, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 18, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-03-16T10:55:08.011 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 131581967, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 132054784, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 132052287, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 61010 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 26, 2024-03-16T10:55:08.012 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 14083, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 14057, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 28, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 1864, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 1836, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 11446, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 26143, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 14697, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-03-16T10:55:08.013 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 80624, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 215420 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-03-16T10:55:08.014 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-03-16T10:55:08.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.021 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:08.022 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.023 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.024 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:08.025 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.026 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-03-16T10:55:08.028 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 3263, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:08.029 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:08.030 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:08.031 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:08.032 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 230552, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 74, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:08.033 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 154, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 8149640, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 46052, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-03-16T10:55:08.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 1353, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 26, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 4, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 1353, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1353, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.907973273, 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001410179 2024-03-16T10:55:08.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1353, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1354 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 1353, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 1353, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 808, 2024-03-16T10:55:08.036 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 542, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:08.037 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 2, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:08.038 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-03-16T10:55:08.039 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 2, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 10, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 10, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-03-16T10:55:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-03-16T10:55:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:08.042 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1494, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 128951843, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1494, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1494, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 128951843, 2024-03-16T10:55:08.043 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1353, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 127866808, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1353, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 127866808, 2024-03-16T10:55:08.045 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1353, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 1353, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1353, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1353, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.047 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:08.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x561259a246e0": { 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:08.049 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:08.050 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-03-16T10:55:08.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:08 smithi174 ceph-mon[36202]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:55:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:08 smithi017 ceph-mon[32078]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:55:08.844 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-03-16T10:55:08.845 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-03-16T10:55:08.845 DEBUG:tasks.check_counter:Getting stats from f 2024-03-16T10:55:08.845 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.f perf dump 2024-03-16T10:55:08.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:08 smithi111 ceph-mon[36315]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-03-16T10:55:09.138 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:55:10.659 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:10 smithi174 ceph-mon[36202]: pgmap v481: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:10.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:10 smithi017 ceph-mon[32078]: pgmap v481: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:10.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:10 smithi111 ceph-mon[36315]: pgmap v481: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1144, 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1146, 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 6952055, 2024-03-16T10:55:11.045 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 363799, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.069344477, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.019887782, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.021006415, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.023203810, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1144, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.023357613, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000020417 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.046 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 3, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 86, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 716, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 223674, 2024-03-16T10:55:11.047 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.004291429, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.002477855, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.001150843, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000054887, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 84, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.004680058, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000055714 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 222976 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 146, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 122, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 854268, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 69838, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 3, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.019454615, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.004538107, 2024-03-16T10:55:11.049 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.019400757, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.001907167, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 122, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.006278266, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000051461 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.050 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 854000, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 69520 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1987, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.036448790, 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000018343 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-03-16T10:55:11.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 901, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 0, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 901, 2024-03-16T10:55:11.053 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 901, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-03-16T10:55:11.054 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:11.055 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-03-16T10:55:11.056 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-03-16T10:55:11.057 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-03-16T10:55:11.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 3432, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 5, 2024-03-16T10:55:11.059 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 10821546, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 10820408, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 3432 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 16, 2024-03-16T10:55:11.060 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 1031, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 1015, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 14, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 263, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 249, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 901, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 1898, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 997, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 50896, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 215420 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-03-16T10:55:11.061 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.062 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.063 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:11.064 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.066 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.067 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.069 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.070 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.071 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.072 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 3265, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:11.073 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:11.074 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-03-16T10:55:11.075 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 181526, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 55, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:11.076 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 154, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 691123, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 5047, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-03-16T10:55:11.077 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.642990989, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000560584 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1148 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 1147, 2024-03-16T10:55:11.078 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 674, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 471, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:11.079 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-03-16T10:55:11.080 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-03-16T10:55:11.081 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 2, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 4, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 4, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-03-16T10:55:11.082 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:11.083 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1289, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 7680880, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1289, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1289, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 7680880, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1147, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 6630071, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1147, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 6630071, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.085 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1147, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 1147, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1147, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1147, 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:11.086 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:11.087 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x56471fbea6e0": { 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:11.088 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:11.089 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-03-16T10:55:11.928 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-03-16T10:55:11.928 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-03-16T10:55:11.929 DEBUG:tasks.check_counter:Getting stats from i 2024-03-16T10:55:11.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.i perf dump 2024-03-16T10:55:12.174 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:55:12.563 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:12 smithi174 ceph-mon[36202]: pgmap v482: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:12.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:12 smithi017 ceph-mon[32078]: pgmap v482: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:12.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:12 smithi111 ceph-mon[36315]: pgmap v482: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 6391, 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 11293, 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1937764, 2024-03-16T10:55:13.892 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 10307510, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 21, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.357641599, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.172079722, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.182796821, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.029069161, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 11291, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.254773045, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000022564 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 8732, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.001720947, 2024-03-16T10:55:13.893 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000197 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1936, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 1584 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2871, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 3075, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 963934, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 5052085, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 9, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 7, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.183954941, 2024-03-16T10:55:13.894 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.074184209, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.073371923, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.036060329, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3074, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.096340741, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000031340 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2644, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000348181, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000131 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-03-16T10:55:13.895 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 225024 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 11265, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 10536, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 5891967, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 5443353, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 11, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 8, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.559203676, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.219985181, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.368803107, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.037800625, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 10535, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.218582110, 2024-03-16T10:55:13.896 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000020748 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 17834, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.002267500, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000127 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 865504, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 153008 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.897 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2738, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2.637461412, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000963280 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3041, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.475939307, 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000156507 2024-03-16T10:55:13.898 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 3317, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 3298, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3298, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 7.457681744, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002261274 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 19, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:13.899 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 11, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 30, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 8, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 4, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 18, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 18, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 935, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 4, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 6540, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 5064, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 9, 2024-03-16T10:55:13.900 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 159, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 6, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 9, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 57, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 565, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 101, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 1442, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 1715, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 11, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 234, 2024-03-16T10:55:13.901 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 1715, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 204, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 204, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 1511, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 47, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 480, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 2018, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 8, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:13.902 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 1058, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 371, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 69, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 2880 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 178, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 83, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 1, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:13.903 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 1514, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 1509, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 8, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 1, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 57, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:55:13.904 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 4983, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 4983, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 8, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 8, 2024-03-16T10:55:13.905 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 14759938, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 764, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 3.136596649, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.004105492 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 31, 2024-03-16T10:55:13.906 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 1776, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 1745, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 28, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 355, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 327, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 30, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 3523, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 3493, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 2587, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 2587, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 78464, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 223612 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-03-16T10:55:13.907 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 5544, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 419, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 3317, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 100, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 1808, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 74, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.192664789, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002603578 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 27, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.076136321, 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002819863 2024-03-16T10:55:13.908 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 9, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.207139695, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.023015521 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1329, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.646753085, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000486646 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.909 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.910 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-03-16T10:55:13.911 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 27, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.059389622, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002199615 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-03-16T10:55:13.912 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 29, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.050558898, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001743410 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.913 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 191, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.175722571, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000920013 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 40, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.289394222, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.032234855 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.914 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 157, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.580891105, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.010069370 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.915 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 10, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.027160217, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002716021 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.916 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.917 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 28, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.046918607, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001675664 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1377, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 3.104952612, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002254867 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:13.918 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 2, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 1, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 1, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 2183, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 2183, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 1764, 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:13.919 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:13.920 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:13.921 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 314936, 2024-03-16T10:55:13.922 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 128, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 528, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 6, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 154, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:13.923 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 128935, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 842, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 4477, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 10856003, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 33, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 4477, 2024-03-16T10:55:13.924 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4477, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 7.895889627, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001763656 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4477, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 4609 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 4477, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 1818, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 2659, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-03-16T10:55:13.925 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 103, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 867, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 69, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 1618, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1715, 2024-03-16T10:55:13.926 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 8, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-03-16T10:55:13.927 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 2, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-03-16T10:55:13.928 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 147, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 52 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-03-16T10:55:13.929 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 10, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 6, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 1604, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 1509, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 20523, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 7007619, 2024-03-16T10:55:13.930 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 20523, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 20523, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 7007619, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:13.931 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 4477, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 11008412, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 4477, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 11008412, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:13.932 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 4477, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 4477, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 4477, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 4477, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.933 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1509, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 152409, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1509, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 103, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 152409, 2024-03-16T10:55:13.934 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x5638d9ffa500": { 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 4983, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 10565634, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 4983, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:13.935 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 764, 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 10565634, 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:13.936 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-03-16T10:55:14.698 INFO:tasks.check_counter:Daemon mds.i mds.exported=57 2024-03-16T10:55:14.698 INFO:tasks.check_counter:Daemon mds.i mds.imported=101 2024-03-16T10:55:14.698 DEBUG:tasks.check_counter:Getting stats from l 2024-03-16T10:55:14.699 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af shell --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 -- ceph daemon mds.l perf dump 2024-03-16T10:55:14.723 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:14 smithi174 ceph-mon[36202]: pgmap v483: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:14.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:14 smithi017 ceph-mon[32078]: pgmap v483: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:14.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:14 smithi111 ceph-mon[36315]: pgmap v483: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:14.945 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/mon.c/config 2024-03-16T10:55:15.789 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:15 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:55:15.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:15 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:55:15.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:15 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-16T10:55:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:16 smithi174 ceph-mon[36202]: pgmap v484: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:55:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:16 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:55:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:16 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:55:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:16 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 526, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 504, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 980080, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 192790, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.046766159, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.012941059, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.024712416, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.011154604, 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:16.645 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 503, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.016795187, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000033390 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 852064, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 71632 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-03-16T10:55:16.646 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 193, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 280, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 2209782, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 286420, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.018076487, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.006869261, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.005197684, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.004376367, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 278, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.011291730, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000040617 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:16.647 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 225296 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 443, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 443, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 4310467, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 140051, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-03-16T10:55:16.648 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.031253001, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.009585988, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.010467840, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.008876024, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 442, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.012721148, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000028780 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.649 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1844, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.036637363, 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000019868 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.650 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.651 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 758, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 758, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 758, 2024-03-16T10:55:16.652 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-03-16T10:55:16.653 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-03-16T10:55:16.654 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-03-16T10:55:16.655 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-03-16T10:55:16.656 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 2829, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-03-16T10:55:16.657 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 5, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 10549114, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 10547976, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.658 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 2829 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 14, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 950, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 936, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 12, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 273, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 261, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 758, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 1676, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 918, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-03-16T10:55:16.659 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 50980, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 215420 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-03-16T10:55:16.660 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-03-16T10:55:16.661 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-03-16T10:55:16.662 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.663 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.665 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.666 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.667 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.668 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.669 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.670 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-03-16T10:55:16.671 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 1, 2024-03-16T10:55:16.672 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 1, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 1766, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-03-16T10:55:16.673 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T10:55:16.674 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 197578, 2024-03-16T10:55:16.675 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 59, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7336, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 154, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 582620, 2024-03-16T10:55:16.676 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 3999, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 1012, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 1012, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1012, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.825988438, 2024-03-16T10:55:16.677 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000816194 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1012, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1013 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 1012, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 1012, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 541, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-03-16T10:55:16.678 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 469, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-03-16T10:55:16.679 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-03-16T10:55:16.680 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 2, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 6, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 6, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-03-16T10:55:16.681 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-03-16T10:55:16.682 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1158, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 7385752, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1158, 2024-03-16T10:55:16.683 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1158, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 7385752, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:16.684 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1012, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 6354815, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1012, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 6354815, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-03-16T10:55:16.685 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1012, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 1012, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1012, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1012, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.686 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.687 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x5610f94c06e0": { 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-03-16T10:55:16.688 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-03-16T10:55:16.689 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-03-16T10:55:16.689 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-03-16T10:55:16.689 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.689 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-03-16T10:55:16.689 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-03-16T10:55:16.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:16 smithi017 ceph-mon[32078]: pgmap v484: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:55:16.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:16 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:55:16.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:16 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:55:16.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:16 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:55:16.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:16 smithi111 ceph-mon[36315]: pgmap v484: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-16T10:55:16.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:16 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-16T10:55:16.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:16 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-16T10:55:16.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:16 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' 2024-03-16T10:55:17.483 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-03-16T10:55:17.483 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-03-16T10:55:17.484 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-16T10:55:17.494 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-16T10:55:17.494 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:55:17.494 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T10:55:17.511 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:55:17.511 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T10:55:17.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.713+0000 7ff4855bc640 1 -- 172.21.15.17:0/4284511820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801017f0 msgr2=0x7ff480101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.713+0000 7ff4855bc640 1 --2- 172.21.15.17:0/4284511820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801017f0 0x7ff480101c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff470009900 tx=0x7ff47002bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.713+0000 7ff4855bc640 1 -- 172.21.15.17:0/4284511820 shutdown_connections 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 --2- 172.21.15.17:0/4284511820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801033a0 0x7ff480109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 --2- 172.21.15.17:0/4284511820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801029e0 0x7ff480102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 --2- 172.21.15.17:0/4284511820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801017f0 0x7ff480101c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 -- 172.21.15.17:0/4284511820 >> 172.21.15.17:0/4284511820 conn(0x7ff4800fcdc0 msgr2=0x7ff4800ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 -- 172.21.15.17:0/4284511820 shutdown_connections 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 -- 172.21.15.17:0/4284511820 wait complete. 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 Processor -- start 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 -- start start 2024-03-16T10:55:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.714+0000 7ff4855bc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 0x7ff480073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801033a0 0x7ff480074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff48010d470 con 0x7ff4801017f0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff48010d2f0 con 0x7ff4801033a0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff48010d5f0 con 0x7ff4801029e0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44976/0 (socket says 172.21.15.17:44976) 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 -- 172.21.15.17:0/1906685592 learned_addr learned my addr 172.21.15.17:0/1906685592 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47f7fe640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801033a0 0x7ff480074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47e7fc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 0x7ff480073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 -- 172.21.15.17:0/1906685592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 msgr2=0x7ff480073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 0x7ff480073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 -- 172.21.15.17:0/1906685592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801033a0 msgr2=0x7ff480074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801033a0 0x7ff480074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 -- 172.21.15.17:0/1906685592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4800749a0 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47e7fc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 0x7ff480073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff47effd640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff470000c00 tx=0x7ff47002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470041070 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4801a1ba0 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff470004450 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470034440 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.715+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4801a2140 con 0x7ff4801017f0 2024-03-16T10:55:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.716+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff480108b10 con 0x7ff4801017f0 2024-03-16T10:55:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.718+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7ff470044070 con 0x7ff4801017f0 2024-03-16T10:55:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.718+0000 7ff467fff640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 0x7ff4680a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.719+0000 7ff47e7fc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 0x7ff4680a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.719+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ff4700f0740 con 0x7ff4801017f0 2024-03-16T10:55:17.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.719+0000 7ff47e7fc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 0x7ff4680a4cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff480075300 tx=0x7ff474005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:17.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.723+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ff4700bd910 con 0x7ff4801017f0 2024-03-16T10:55:17.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.908+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff48002d330 con 0x7ff4801017f0 2024-03-16T10:55:17.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.910+0000 7ff467fff640 1 -- 172.21.15.17:0/1906685592 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7ff4700bd210 con 0x7ff4801017f0 2024-03-16T10:55:17.911 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:55:17.911 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 msgr2=0x7ff4680a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 0x7ff4680a4cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff480075300 tx=0x7ff474005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 msgr2=0x7ff480075590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff470000c00 tx=0x7ff47002c640 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 shutdown_connections 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ff4680a2800 0x7ff4680a4cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff4801033a0 0x7ff480074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4801029e0 0x7ff480073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 --2- 172.21.15.17:0/1906685592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4801017f0 0x7ff480075590 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 >> 172.21.15.17:0/1906685592 conn(0x7ff4800fcdc0 msgr2=0x7ff480105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:17.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 shutdown_connections 2024-03-16T10:55:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:17.912+0000 7ff4855bc640 1 -- 172.21.15.17:0/1906685592 wait complete. 2024-03-16T10:55:17.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T10:44:06.736875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T10:48:46.632422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T10:48:47.945990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T10:55:17.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- 172.21.15.17:0/3794363114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 msgr2=0x7fd704100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 --2- 172.21.15.17:0/3794363114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704100b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009860 tx=0x7fd6fc02bb70 comp rx=0 tx=0).stop 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- 172.21.15.17:0/3794363114 shutdown_connections 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 --2- 172.21.15.17:0/3794363114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041022b0 0x7fd704108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 --2- 172.21.15.17:0/3794363114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041018f0 0x7fd704101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 --2- 172.21.15.17:0/3794363114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704100b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- 172.21.15.17:0/3794363114 >> 172.21.15.17:0/3794363114 conn(0x7fd7040fbc70 msgr2=0x7fd7040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- 172.21.15.17:0/3794363114 shutdown_connections 2024-03-16T10:55:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- 172.21.15.17:0/3794363114 wait complete. 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 Processor -- start 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.030+0000 7fd708cdc640 1 -- start start 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041018f0 0x7fd704198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 0x7fd70419f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd70410c370 con 0x7fd7041018f0 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd70410c1f0 con 0x7fd704100700 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd70410c4f0 con 0x7fd7041022b0 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.17:52982/0 (socket says 172.21.15.17:52982) 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 -- 172.21.15.17:0/2077177292 learned_addr learned my addr 172.21.15.17:0/2077177292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd701d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041018f0 0x7fd704198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd702d9d640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 0x7fd70419f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 -- 172.21.15.17:0/2077177292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 msgr2=0x7fd70419f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 0x7fd70419f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 -- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041018f0 msgr2=0x7fd704198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041018f0 0x7fd704198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 -- 172.21.15.17:0/2077177292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70419f7c0 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd702d9d640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 0x7fd70419f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd70259c640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0349e0 tx=0x7fd6fc032430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc041020 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6fc02c9f0 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70419fa50 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.031+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc039040 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.032+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70419ff40 con 0x7fd704100700 2024-03-16T10:55:18.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.032+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7041a0170 con 0x7fd704100700 2024-03-16T10:55:18.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.033+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fd6fc044020 con 0x7fd704100700 2024-03-16T10:55:18.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.034+0000 7fd6f37fe640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 0x7fd6ec0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.034+0000 7fd701d9b640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 0x7fd6ec0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.034+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fd6fc0f0650 con 0x7fd704100700 2024-03-16T10:55:18.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.034+0000 7fd701d9b640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 0x7fd6ec0a4cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd7041990b0 tx=0x7fd6f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.038+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fd6fc04b020 con 0x7fd704100700 2024-03-16T10:55:18.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.226+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7041a0340 con 0x7fd704100700 2024-03-16T10:55:18.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.226+0000 7fd6f37fe640 1 -- 172.21.15.17:0/2077177292 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fd6fc0bd790 con 0x7fd704100700 2024-03-16T10:55:18.227 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 msgr2=0x7fd6ec0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 0x7fd6ec0a4cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd7041990b0 tx=0x7fd6f8005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 msgr2=0x7fd704197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0349e0 tx=0x7fd6fc032430 comp rx=0 tx=0).stop 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 shutdown_connections 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fd6ec0a2800 0x7fd6ec0a4cc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7041022b0 0x7fd70419f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7041018f0 0x7fd704198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 --2- 172.21.15.17:0/2077177292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd704100700 0x7fd704197bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 >> 172.21.15.17:0/2077177292 conn(0x7fd7040fbc70 msgr2=0x7fd704069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.228+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 shutdown_connections 2024-03-16T10:55:18.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.229+0000 7fd708cdc640 1 -- 172.21.15.17:0/2077177292 wait complete. 2024-03-16T10:55:18.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T10:55:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 -- 172.21.15.17:0/2424494333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 msgr2=0x7f1274106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 --2- 172.21.15.17:0/2424494333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274106ea0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1268009900 tx=0x7f126802bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 -- 172.21.15.17:0/2424494333 shutdown_connections 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 --2- 172.21.15.17:0/2424494333 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12741073e0 0x7f1274109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 --2- 172.21.15.17:0/2424494333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274106ea0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 --2- 172.21.15.17:0/2424494333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1274102180 0x7f1274104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 -- 172.21.15.17:0/2424494333 >> 172.21.15.17:0/2424494333 conn(0x7f12740fbb90 msgr2=0x7f12740fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 -- 172.21.15.17:0/2424494333 shutdown_connections 2024-03-16T10:55:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 -- 172.21.15.17:0/2424494333 wait complete. 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.349+0000 7f1279401640 1 Processor -- start 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 -- start start 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 0x7f1274197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 0x7f127419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f127410d380 con 0x7f1274104ab0 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f127410d200 con 0x7f12741073e0 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1279401640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f127410d500 con 0x7f1274102180 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12727fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 0x7f127419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1272ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 0x7f1274197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12727fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45020/0 (socket says 172.21.15.17:45020) 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12727fc640 1 -- 172.21.15.17:0/2818394793 learned_addr learned my addr 172.21.15.17:0/2818394793 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 -- 172.21.15.17:0/2818394793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 msgr2=0x7f1274197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 0x7f1274197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 -- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 msgr2=0x7f1274197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f12737fe640 1 -- 172.21.15.17:0/2818394793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127419f620 con 0x7f12741073e0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.350+0000 7f1272ffd640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 0x7f1274197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f12737fe640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 0x7f127419efb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f126c009fd0 tx=0x7f126c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c00ce20 con 0x7f12741073e0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127419f910 con 0x7f12741073e0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c005020 con 0x7f12741073e0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c010720 con 0x7f12741073e0 2024-03-16T10:55:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.351+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127419fe30 con 0x7f12741073e0 2024-03-16T10:55:18.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.352+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1274068940 con 0x7f12741073e0 2024-03-16T10:55:18.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.353+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f126c005540 con 0x7f12741073e0 2024-03-16T10:55:18.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.353+0000 7f125bfff640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 0x7f125c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.353+0000 7f1272ffd640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 0x7f125c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.354+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f126c0cefe0 con 0x7f12741073e0 2024-03-16T10:55:18.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.354+0000 7f1272ffd640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 0x7f125c0a4cc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f12640095f0 tx=0x7f1264005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.358+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f126c09c100 con 0x7f12741073e0 2024-03-16T10:55:18.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:18 smithi017 ceph-mon[32078]: pgmap v485: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:18.517 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1906685592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:18.518 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:18 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2077177292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.546+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f127402d1b0 con 0x7f12741073e0 2024-03-16T10:55:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.546+0000 7f125bfff640 1 -- 172.21.15.17:0/2818394793 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f126c09ba00 con 0x7f12741073e0 2024-03-16T10:55:18.547 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 msgr2=0x7f125c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 0x7f125c0a4cc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f12640095f0 tx=0x7f1264005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 msgr2=0x7f127419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 0x7f127419efb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f126c009fd0 tx=0x7f126c00ef10 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 shutdown_connections 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f125c0a2800 0x7f125c0a4cc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12741073e0 0x7f127419efb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1274104ab0 0x7f1274197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 --2- 172.21.15.17:0/2818394793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1274102180 0x7f1274197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 >> 172.21.15.17:0/2818394793 conn(0x7f12740fbb90 msgr2=0x7f1274102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 shutdown_connections 2024-03-16T10:55:18.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.549+0000 7f1279401640 1 -- 172.21.15.17:0/2818394793 wait complete. 2024-03-16T10:55:18.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 -- 172.21.15.17:0/2284346832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501018d0 msgr2=0x7f5750101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 --2- 172.21.15.17:0/2284346832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501018d0 0x7f5750101d50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f573c009900 tx=0x7f573c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 -- 172.21.15.17:0/2284346832 shutdown_connections 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 --2- 172.21.15.17:0/2284346832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 0x7f5750108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 --2- 172.21.15.17:0/2284346832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501018d0 0x7f5750101d50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 --2- 172.21.15.17:0/2284346832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501006e0 0x7f5750100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 -- 172.21.15.17:0/2284346832 >> 172.21.15.17:0/2284346832 conn(0x7f57500fbc70 msgr2=0x7f57500fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.674+0000 7f575721f640 1 -- 172.21.15.17:0/2284346832 shutdown_connections 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 -- 172.21.15.17:0/2284346832 wait complete. 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 Processor -- start 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 -- start start 2024-03-16T10:55:18.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501018d0 0x7f5750198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 0x7f575019f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57500695f0 con 0x7f57501006e0 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5750069470 con 0x7f5750102290 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f575721f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5750069770 con 0x7f57501018d0 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f5754fbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f5754fbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45042/0 (socket says 172.21.15.17:45042) 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f5754fbb640 1 -- 172.21.15.17:0/4102437147 learned_addr learned my addr 172.21.15.17:0/4102437147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f574ffff640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501018d0 0x7f5750198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.675+0000 7f57557bc640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 0x7f575019f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 -- 172.21.15.17:0/4102437147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501018d0 msgr2=0x7f5750198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501018d0 0x7f5750198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 -- 172.21.15.17:0/4102437147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 msgr2=0x7f575019f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 0x7f575019f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 -- 172.21.15.17:0/4102437147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575019f740 con 0x7f57501006e0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f5754fbb640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f574400e9c0 tx=0x7f574400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574400cd80 con 0x7f57501006e0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57440035f0 con 0x7f57501006e0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575019fa30 con 0x7f57501006e0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744010690 con 0x7f57501006e0 2024-03-16T10:55:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.676+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575019ff50 con 0x7f57501006e0 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.677+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5750107ad0 con 0x7f57501006e0 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.678+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f57440037a0 con 0x7f57501006e0 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.679+0000 7f574dffb640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 0x7f57400a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.679+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f57440cec90 con 0x7f57501006e0 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.679+0000 7f574ffff640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 0x7f57400a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.680+0000 7f574ffff640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 0x7f57400a4d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f573c02c7b0 tx=0x7f573c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.685+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f574409bdd0 con 0x7f57501006e0 2024-03-16T10:55:18.712 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:18 smithi174 ceph-mon[36202]: pgmap v485: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:18.712 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1906685592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:18.712 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:18 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2077177292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:55:18.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:18 smithi111 ceph-mon[36315]: pgmap v485: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-03-16T10:55:18.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1906685592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:18.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:18 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2077177292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-16T10:55:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.919+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57500623e0 con 0x7f57501006e0 2024-03-16T10:55:18.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.919+0000 7f574dffb640 1 -- 172.21.15.17:0/4102437147 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f574409b6d0 con 0x7f57501006e0 2024-03-16T10:55:18.920 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-16T10:55:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 msgr2=0x7f57400a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 0x7f57400a4d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f573c02c7b0 tx=0x7f573c005fd0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 msgr2=0x7f5750197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f574400e9c0 tx=0x7f574400ee80 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 shutdown_connections 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f57400a2880 0x7f57400a4d40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5750102290 0x7f575019f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57501018d0 0x7f5750198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 --2- 172.21.15.17:0/4102437147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57501006e0 0x7f5750197b20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 >> 172.21.15.17:0/4102437147 conn(0x7f57500fbc70 msgr2=0x7f5750104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 shutdown_connections 2024-03-16T10:55:18.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:18.922+0000 7f575721f640 1 -- 172.21.15.17:0/4102437147 wait complete. 2024-03-16T10:55:18.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 -- 172.21.15.17:0/3421474560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 msgr2=0x7fae8c101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 --2- 172.21.15.17:0/3421474560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c101d50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009900 tx=0x7fae7c02bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 -- 172.21.15.17:0/3421474560 shutdown_connections 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 --2- 172.21.15.17:0/3421474560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 0x7fae8c108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 --2- 172.21.15.17:0/3421474560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c101d50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 --2- 172.21.15.17:0/3421474560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 -- 172.21.15.17:0/3421474560 >> 172.21.15.17:0/3421474560 conn(0x7fae8c0fbc70 msgr2=0x7fae8c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 -- 172.21.15.17:0/3421474560 shutdown_connections 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.051+0000 7fae93d5b640 1 -- 172.21.15.17:0/3421474560 wait complete. 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 Processor -- start 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 -- start start 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 0x7fae8c1a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c10c360 con 0x7fae8c1018d0 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c10c1e0 con 0x7fae8c1006e0 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae93d5b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c10c4e0 con 0x7fae8c102290 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae91af7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45058/0 (socket says 172.21.15.17:45058) 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 -- 172.21.15.17:0/51740568 learned_addr learned my addr 172.21.15.17:0/51740568 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae922f8640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 0x7fae8c1a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 -- 172.21.15.17:0/51740568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 msgr2=0x7fae8c1a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 0x7fae8c1a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 -- 172.21.15.17:0/51740568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 msgr2=0x7fae8c199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae912f6640 1 -- 172.21.15.17:0/51740568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1a1910 con 0x7fae8c1018d0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.052+0000 7fae91af7640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae912f6640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009230 tx=0x7fae7c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c041070 con 0x7fae8c1018d0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae7c004450 con 0x7fae8c1018d0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c003e20 con 0x7fae8c1018d0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c1a1ba0 con 0x7fae8c1018d0 2024-03-16T10:55:19.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.053+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1a2090 con 0x7fae8c1018d0 2024-03-16T10:55:19.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.054+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8c1a2320 con 0x7fae8c1018d0 2024-03-16T10:55:19.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.055+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fae7c044070 con 0x7fae8c1018d0 2024-03-16T10:55:19.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.055+0000 7fae82ffd640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 0x7fae780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:19.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.056+0000 7fae91af7640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 0x7fae780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:19.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.056+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fae7c0f0970 con 0x7fae8c1018d0 2024-03-16T10:55:19.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.056+0000 7fae91af7640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 0x7fae780a4cc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fae8c101730 tx=0x7fae88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:19.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.059+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fae7c0bd3c0 con 0x7fae8c1018d0 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.278+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae8c1a2610 con 0x7fae8c1018d0 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.278+0000 7fae82ffd640 1 -- 172.21.15.17:0/51740568 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+590 (secure 0 0 0) 0x7fae7c0c1460 con 0x7fae8c1018d0 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1123613371 2024-03-17T10:41:40.391994+0000 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1123613371 2024-03-17T10:41:40.391994+0000 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4191018145 2024-03-17T10:41:40.391994+0000 2024-03-16T10:55:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2689612240 2024-03-17T10:41:40.391994+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1267658658 2024-03-17T10:41:12.324893+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3497137081 2024-03-17T10:41:12.324893+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2804979263 2024-03-17T10:41:12.324893+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3497137081 2024-03-17T10:41:12.324893+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/435172589 2024-03-17T10:41:12.324893+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/520901211 2024-03-17T10:41:40.391994+0000 2024-03-16T10:55:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-03-16T10:55:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 msgr2=0x7fae780a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 0x7fae780a4cc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fae8c101730 tx=0x7fae88005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 msgr2=0x7fae8c19a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009230 tx=0x7fae7c02c650 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 shutdown_connections 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fae780a2800 0x7fae780a4cc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae8c102290 0x7fae8c1a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae8c1018d0 0x7fae8c19a2a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 --2- 172.21.15.17:0/51740568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae8c1006e0 0x7fae8c199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 >> 172.21.15.17:0/51740568 conn(0x7fae8c0fbc70 msgr2=0x7fae8c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 shutdown_connections 2024-03-16T10:55:19.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:19.281+0000 7fae93d5b640 1 -- 172.21.15.17:0/51740568 wait complete. 2024-03-16T10:55:19.293 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-16T10:55:19.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-16T10:55:19.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2818394793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.552 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/4102437147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.553 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:19 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/51740568' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T10:55:19.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:55:19.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.554 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T10:55:19.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.588 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-16T10:55:19.649 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T10:55:19.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T10:55:19.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-16T10:55:19.809 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-16T10:55:19.809 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-16T10:55:19.809 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T10:55:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2818394793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/4102437147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:19 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/51740568' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T10:55:19.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057145,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1276 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/a638236341234fd050b4b46b56f51c3a03d4584e5181ca31124d747ae9fadc91/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/a638236341234fd050b4b46b56f51c3a03d4584e5181ca31124d747ae9fadc91/diff,workdir=/var/lib/containers/storage/overlay/a638236341234fd050b4b46b56f51c3a03d4584e5181ca31124d747ae9fadc91/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5aa039b8340f5316919356c4d65d9f096ae2b47a22343210cd2461312501100d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/5aa039b8340f5316919356c4d65d9f096ae2b47a22343210cd2461312501100d/diff,workdir=/var/lib/containers/storage/overlay/5aa039b8340f5316919356c4d65d9f096ae2b47a22343210cd2461312501100d/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/968ab876b63f4d79173a5df4275d76e256c90f172f27471c15865d93c9551a78/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/968ab876b63f4d79173a5df4275d76e256c90f172f27471c15865d93c9551a78/diff,workdir=/var/lib/containers/storage/overlay/968ab876b63f4d79173a5df4275d76e256c90f172f27471c15865d93c9551a78/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d2629460d639b1847d9ade39d7d1ac5ff62fcdddb730cb07abfa5f70c8ac008b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/d2629460d639b1847d9ade39d7d1ac5ff62fcdddb730cb07abfa5f70c8ac008b/diff,workdir=/var/lib/containers/storage/overlay/d2629460d639b1847d9ade39d7d1ac5ff62fcdddb730cb07abfa5f70c8ac008b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a7727f3fb11a80f2b57170f87509ba2b65b57ebb60ccc2e087280a05f5b9dfb2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/a7727f3fb11a80f2b57170f87509ba2b65b57ebb60ccc2e087280a05f5b9dfb2/diff,workdir=/var/lib/containers/storage/overlay/a7727f3fb11a80f2b57170f87509ba2b65b57ebb60ccc2e087280a05f5b9dfb2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b96cdc75761c55996ed3e8ca7d6674325c46adbb4ff24c846913776549f9edde/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/b96cdc75761c55996ed3e8ca7d6674325c46adbb4ff24c846913776549f9edde/diff,workdir=/var/lib/containers/storage/overlay/b96cdc75761c55996ed3e8ca7d6674325c46adbb4ff24c846913776549f9edde/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/99e7b4d5c04f6645b7b7bb9a97aafb979b9905bc648d82184b3a4eede3414c0d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/99e7b4d5c04f6645b7b7bb9a97aafb979b9905bc648d82184b3a4eede3414c0d/diff,workdir=/var/lib/containers/storage/overlay/99e7b4d5c04f6645b7b7bb9a97aafb979b9905bc648d82184b3a4eede3414c0d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/138f555544d3a9146257e12f3c473968c7fd78ce9830743d63f10f854bdff4ab/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/138f555544d3a9146257e12f3c473968c7fd78ce9830743d63f10f854bdff4ab/diff,workdir=/var/lib/containers/storage/overlay/138f555544d3a9146257e12f3c473968c7fd78ce9830743d63f10f854bdff4ab/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bbc0d27e444d313d34fdedcf5977acbe819d7c5c13a83a8be7352987f11f70da/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/bbc0d27e444d313d34fdedcf5977acbe819d7c5c13a83a8be7352987f11f70da/diff,workdir=/var/lib/containers/storage/overlay/bbc0d27e444d313d34fdedcf5977acbe819d7c5c13a83a8be7352987f11f70da/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/63e6ff7ea88b45643aff7bfea25a4e45dae48eac2f0f0cf6e3112618f3831e0c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/LZJYI7F4T4ROR6RODCPJHQM7HV:/var/lib/containers/storage/overlay/l/4KRPSZ27QT7GH2VLQAVU464PLT,upperdir=/var/lib/containers/storage/overlay/63e6ff7ea88b45643aff7bfea25a4e45dae48eac2f0f0cf6e3112618f3831e0c/diff,workdir=/var/lib/containers/storage/overlay/63e6ff7ea88b45643aff7bfea25a4e45dae48eac2f0f0cf6e3112618f3831e0c/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498928k,nr_inodes=819200,mode=755,inode64 0 0 2024-03-16T10:55:19.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.825 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-16T10:55:19.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T10:55:19.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-16T10:55:19.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2818394793' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/4102437147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-16T10:55:19.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:19 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/51740568' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-16T10:55:19.949 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-03-16T10:55:19.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:55:19.951 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-16T10:55:19.961 INFO:tasks.cephadm:Teardown begin 2024-03-16T10:55:19.961 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T10:55:19.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 -- 172.21.15.17:0/2068308752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe900100700 msgr2=0x7fe900100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 --2- 172.21.15.17:0/2068308752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe900100700 0x7fe900100b20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009900 tx=0x7fe8f402bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 -- 172.21.15.17:0/2068308752 shutdown_connections 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 --2- 172.21.15.17:0/2068308752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001022b0 0x7fe900108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 --2- 172.21.15.17:0/2068308752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9001018f0 0x7fe900101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 --2- 172.21.15.17:0/2068308752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe900100700 0x7fe900100b20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 -- 172.21.15.17:0/2068308752 >> 172.21.15.17:0/2068308752 conn(0x7fe9000fbc70 msgr2=0x7fe9000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 -- 172.21.15.17:0/2068308752 shutdown_connections 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.108+0000 7fe906ac6640 1 -- 172.21.15.17:0/2068308752 wait complete. 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 Processor -- start 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 -- start start 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe900100700 0x7fe90010b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001018f0 0x7fe9001096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe90010d500 con 0x7fe9001022b0 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe90010d380 con 0x7fe9001018f0 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe906ac6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe90010d680 con 0x7fe900100700 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49012/0 (socket says 172.21.15.17:49012) 2024-03-16T10:55:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 -- 172.21.15.17:0/805934646 learned_addr learned my addr 172.21.15.17:0/805934646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe8fffff640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001018f0 0x7fe9001096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe904862640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe900100700 0x7fe90010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 -- 172.21.15.17:0/805934646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe900100700 msgr2=0x7fe90010b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe900100700 0x7fe90010b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 -- 172.21.15.17:0/805934646 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001018f0 msgr2=0x7fe9001096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001018f0 0x7fe9001096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.109+0000 7fe905063640 1 -- 172.21.15.17:0/805934646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90010a490 con 0x7fe9001022b0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe905063640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eb10 tx=0x7fe8f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8004b20 con 0x7fe9001022b0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9001a1c80 con 0x7fe9001022b0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8f8004cc0 con 0x7fe9001022b0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010760 con 0x7fe9001022b0 2024-03-16T10:55:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.110+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001a21d0 con 0x7fe9001022b0 2024-03-16T10:55:20.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.111+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe900107a20 con 0x7fe9001022b0 2024-03-16T10:55:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.112+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fe8f8005020 con 0x7fe9001022b0 2024-03-16T10:55:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.113+0000 7fe8fdffb640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 0x7fe8f00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.113+0000 7fe904862640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 0x7fe8f00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.113+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fe8f80cefa0 con 0x7fe9001022b0 2024-03-16T10:55:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.114+0000 7fe904862640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 0x7fe8f00a4cc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe8f402c170 tx=0x7fe8f402df90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.117+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe8f809c0e0 con 0x7fe9001022b0 2024-03-16T10:55:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.434+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe90002d3b0 con 0x7fe9001022b0 2024-03-16T10:55:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.435+0000 7fe8fdffb640 1 -- 172.21.15.17:0/805934646 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11974 (secure 0 0 0) 0x7fe8f809b9e0 con 0x7fe9001022b0 2024-03-16T10:55:20.436 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:55:20.436 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:54:17.817620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":71,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":74,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":72,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24536,24493,24470,14655,24497]},"id":1}]} 2024-03-16T10:55:20.436 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-03-16T10:55:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 msgr2=0x7fe8f00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 0x7fe8f00a4cc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe8f402c170 tx=0x7fe8f402df90 comp rx=0 tx=0).stop 2024-03-16T10:55:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 msgr2=0x7fe900109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eb10 tx=0x7fe8f800c2d0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 shutdown_connections 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe8f00a2800 0x7fe8f00a4cc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9001022b0 0x7fe900109c00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9001018f0 0x7fe9001096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 --2- 172.21.15.17:0/805934646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe900100700 0x7fe90010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.437+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 >> 172.21.15.17:0/805934646 conn(0x7fe9000fbc70 msgr2=0x7fe900104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.438+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 shutdown_connections 2024-03-16T10:55:20.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.438+0000 7fe906ac6640 1 -- 172.21.15.17:0/805934646 wait complete. 2024-03-16T10:55:20.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 -- 172.21.15.17:0/3574747524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb401018f0 msgr2=0x7ffb40101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 --2- 172.21.15.17:0/3574747524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb401018f0 0x7ffb40101d70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009900 tx=0x7ffb3402bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 -- 172.21.15.17:0/3574747524 shutdown_connections 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 --2- 172.21.15.17:0/3574747524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401022b0 0x7ffb40108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 --2- 172.21.15.17:0/3574747524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb401018f0 0x7ffb40101d70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 --2- 172.21.15.17:0/3574747524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb40100700 0x7ffb40100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 -- 172.21.15.17:0/3574747524 >> 172.21.15.17:0/3574747524 conn(0x7ffb400fbc70 msgr2=0x7ffb400fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 -- 172.21.15.17:0/3574747524 shutdown_connections 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.553+0000 7ffb45710640 1 -- 172.21.15.17:0/3574747524 wait complete. 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 Processor -- start 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 -- start start 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401018f0 0x7ffb401980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb401022b0 0x7ffb4019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4010c360 con 0x7ffb40100700 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4010c1e0 con 0x7ffb401022b0 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb45710640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4010c4e0 con 0x7ffb401018f0 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb3effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49032/0 (socket says 172.21.15.17:49032) 2024-03-16T10:55:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb3effd640 1 -- 172.21.15.17:0/2848118936 learned_addr learned my addr 172.21.15.17:0/2848118936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb3f7fe640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb401022b0 0x7ffb4019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.554+0000 7ffb3e7fc640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401018f0 0x7ffb401980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 -- 172.21.15.17:0/2848118936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401018f0 msgr2=0x7ffb401980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401018f0 0x7ffb401980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 -- 172.21.15.17:0/2848118936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb401022b0 msgr2=0x7ffb4019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb401022b0 0x7ffb4019f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 -- 172.21.15.17:0/2848118936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4019f7a0 con 0x7ffb40100700 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb3effd640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000e9c0 tx=0x7ffb3000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000ccc0 con 0x7ffb40100700 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4019fa90 con 0x7ffb40100700 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb300035f0 con 0x7ffb40100700 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000ce60 con 0x7ffb40100700 2024-03-16T10:55:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.555+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb401a0000 con 0x7ffb40100700 2024-03-16T10:55:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.556+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb401a01d0 con 0x7ffb40100700 2024-03-16T10:55:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.557+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7ffb300037a0 con 0x7ffb40100700 2024-03-16T10:55:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.558+0000 7ffb27fff640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 0x7ffb280a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.558+0000 7ffb3e7fc640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 0x7ffb280a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.558+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7ffb300ceec0 con 0x7ffb40100700 2024-03-16T10:55:20.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.558+0000 7ffb3e7fc640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 0x7ffb280a4cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffb3402c7b0 tx=0x7ffb34005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.562+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7ffb3009bff0 con 0x7ffb40100700 2024-03-16T10:55:20.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.786+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb401a03a0 con 0x7ffb40100700 2024-03-16T10:55:20.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.787+0000 7ffb27fff640 1 -- 172.21.15.17:0/2848118936 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11974 (secure 0 0 0) 0x7ffb3009b8f0 con 0x7ffb40100700 2024-03-16T10:55:20.788 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:55:20.788 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/234575221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":234575221},{"type":"v1","addr":"172.21.15.17:6835","nonce":234575221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14574,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3386509633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3386509633},{"type":"v1","addr":"172.21.15.17:6837","nonce":3386509633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-16T10:48:48.817905+0000","modified":"2024-03-16T10:54:17.817620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24536,"mds_1":24497,"mds_2":24493,"mds_3":24470,"mds_4":14655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14643":{"gid":14643,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6839/3638042020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3638042020},{"type":"v1","addr":"172.21.15.17:6839","nonce":3638042020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14655":{"gid":14655,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":71,"addr":"172.21.15.17:6841/2050511049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2050511049},{"type":"v1","addr":"172.21.15.17:6841","nonce":2050511049}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6833/760873641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":760873641},{"type":"v1","addr":"172.21.15.174:6833","nonce":760873641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.111:6833/1048472977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":1048472977},{"type":"v1","addr":"172.21.15.111:6833","nonce":1048472977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/330421208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":330421208},{"type":"v1","addr":"172.21.15.174:6835","nonce":330421208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/3507552570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":3507552570},{"type":"v1","addr":"172.21.15.174:6837","nonce":3507552570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":74,"addr":"172.21.15.111:6835/3904744326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":3904744326},{"type":"v1","addr":"172.21.15.111:6835","nonce":3904744326}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6839/2355684811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2355684811},{"type":"v1","addr":"172.21.15.174:6839","nonce":2355684811}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":72,"addr":"172.21.15.111:6837/2446703423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":2446703423},{"type":"v1","addr":"172.21.15.111:6837","nonce":2446703423}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24536":{"gid":24536,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.111:6839/1155010688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6838","nonce":1155010688},{"type":"v1","addr":"172.21.15.111:6839","nonce":1155010688}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24536,"qdb_cluster":[24536,24493,24470,14655,24497]},"id":1}]} 2024-03-16T10:55:20.788 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 msgr2=0x7ffb280a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 0x7ffb280a4cc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffb3402c7b0 tx=0x7ffb34005fd0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 msgr2=0x7ffb40197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000e9c0 tx=0x7ffb3000edc0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 shutdown_connections 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7ffb280a2800 0x7ffb280a4cc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb401022b0 0x7ffb4019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb401018f0 0x7ffb401980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 --2- 172.21.15.17:0/2848118936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb40100700 0x7ffb40197b80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 >> 172.21.15.17:0/2848118936 conn(0x7ffb400fbc70 msgr2=0x7ffb400fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 shutdown_connections 2024-03-16T10:55:20.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.789+0000 7ffb45710640 1 -- 172.21.15.17:0/2848118936 wait complete. 2024-03-16T10:55:20.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:20 smithi017 ceph-mon[32078]: pgmap v486: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-16T10:55:20.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:20 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/805934646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:20.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T10:55:20.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:20 smithi174 ceph-mon[36202]: pgmap v486: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-16T10:55:20.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:20 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/805934646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- 172.21.15.17:0/948872868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c101820 msgr2=0x7f659c101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 --2- 172.21.15.17:0/948872868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c101820 0x7f659c101c40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6594009ca0 tx=0x7f659402c0f0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- 172.21.15.17:0/948872868 shutdown_connections 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 --2- 172.21.15.17:0/948872868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c1033d0 0x7f659c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 --2- 172.21.15.17:0/948872868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 0x7f659c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 --2- 172.21.15.17:0/948872868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c101820 0x7f659c101c40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- 172.21.15.17:0/948872868 >> 172.21.15.17:0/948872868 conn(0x7f659c0fcd90 msgr2=0x7f659c0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- 172.21.15.17:0/948872868 shutdown_connections 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- 172.21.15.17:0/948872868 wait complete. 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 Processor -- start 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.906+0000 7f65a30ff640 1 -- start start 2024-03-16T10:55:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 0x7f659c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 0x7f659c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f659c10d470 con 0x7f659c1033d0 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f659c10d2f0 con 0x7f659c101820 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f659c10d5f0 con 0x7f659c102a10 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a169c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 0x7f659c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a169c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49042/0 (socket says 172.21.15.17:49042) 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a169c640 1 -- 172.21.15.17:0/1221468781 learned_addr learned my addr 172.21.15.17:0/1221468781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f659bfff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 0x7f659c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 -- 172.21.15.17:0/1221468781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 msgr2=0x7f659c1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 0x7f659c1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 -- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 msgr2=0x7f659c19f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 -- 172.21.15.17:0/1221468781 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659c19f790 con 0x7f659c101820 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a169c640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a0e9b640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 0x7f659c197b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f659402c630 tx=0x7f6594032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594041020 con 0x7f659c101820 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.907+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659c19fa20 con 0x7f659c101820 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.908+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6594034cd0 con 0x7f659c101820 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.908+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594039040 con 0x7f659c101820 2024-03-16T10:55:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.908+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659c19ff60 con 0x7f659c101820 2024-03-16T10:55:20.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:20 smithi111 ceph-mon[36315]: pgmap v486: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-03-16T10:55:20.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:20 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/805934646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.909+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659c108c10 con 0x7f659c101820 2024-03-16T10:55:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.910+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f6594044020 con 0x7f659c101820 2024-03-16T10:55:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.910+0000 7f6599ffb640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 0x7f65840a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.911+0000 7f659bfff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 0x7f65840a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.911+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7f65940f0c40 con 0x7f659c101820 2024-03-16T10:55:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.911+0000 7f659bfff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 0x7f65840a4cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f659c199080 tx=0x7f6590005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:20.917+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f659404b020 con 0x7f659c101820 2024-03-16T10:55:21.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.124+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f659c02d3b0 con 0x7f659c101820 2024-03-16T10:55:21.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.127+0000 7f6599ffb640 1 -- 172.21.15.17:0/1221468781 <== mon.2 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22572 (secure 0 0 0) 0x7f65940bde10 con 0x7f659c101820 2024-03-16T10:55:21.128 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-16T10:55:21.128 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"811ebd0c-e381-11ee-95c9-87774f69a715","created":"2024-03-16T10:40:45.482093+0000","modified":"2024-03-16T10:49:42.268666+0000","last_up_change":"2024-03-16T10:47:57.182227+0000","last_in_change":"2024-03-16T10:47:36.464845+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T10:44:06.736875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T10:48:46.632422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T10:48:47.945990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e80ee777-191c-4297-a64a-666a31e8fb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6803","nonce":1731197906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6805","nonce":1731197906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6809","nonce":1731197906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1731197906},{"type":"v1","addr":"172.21.15.17:6807","nonce":1731197906}]},"public_addr":"172.21.15.17:6803/1731197906","cluster_addr":"172.21.15.17:6805/1731197906","heartbeat_back_addr":"172.21.15.17:6809/1731197906","heartbeat_front_addr":"172.21.15.17:6807/1731197906","state":["exists","up"]},{"osd":1,"uuid":"779bf596-8e58-42dc-bf10-e0ef94c86c9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6801","nonce":135053879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6803","nonce":135053879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6807","nonce":135053879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":135053879},{"type":"v1","addr":"172.21.15.111:6805","nonce":135053879}]},"public_addr":"172.21.15.111:6801/135053879","cluster_addr":"172.21.15.111:6803/135053879","heartbeat_back_addr":"172.21.15.111:6807/135053879","heartbeat_front_addr":"172.21.15.111:6805/135053879","state":["exists","up"]},{"osd":2,"uuid":"5448fc77-cae4-481f-a7e0-fe2af1de6d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6801","nonce":1400344146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6803","nonce":1400344146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6807","nonce":1400344146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1400344146},{"type":"v1","addr":"172.21.15.174:6805","nonce":1400344146}]},"public_addr":"172.21.15.174:6801/1400344146","cluster_addr":"172.21.15.174:6803/1400344146","heartbeat_back_addr":"172.21.15.174:6807/1400344146","heartbeat_front_addr":"172.21.15.174:6805/1400344146","state":["exists","up"]},{"osd":3,"uuid":"1b2b5e3b-24b9-4122-aa88-fbfad12dc540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6811","nonce":3346256775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6813","nonce":3346256775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6817","nonce":3346256775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":3346256775},{"type":"v1","addr":"172.21.15.17:6815","nonce":3346256775}]},"public_addr":"172.21.15.17:6811/3346256775","cluster_addr":"172.21.15.17:6813/3346256775","heartbeat_back_addr":"172.21.15.17:6817/3346256775","heartbeat_front_addr":"172.21.15.17:6815/3346256775","state":["exists","up"]},{"osd":4,"uuid":"378c14d6-4057-4205-96df-afbe86d97234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6809","nonce":4209940365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6811","nonce":4209940365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6815","nonce":4209940365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":4209940365},{"type":"v1","addr":"172.21.15.111:6813","nonce":4209940365}]},"public_addr":"172.21.15.111:6809/4209940365","cluster_addr":"172.21.15.111:6811/4209940365","heartbeat_back_addr":"172.21.15.111:6815/4209940365","heartbeat_front_addr":"172.21.15.111:6813/4209940365","state":["exists","up"]},{"osd":5,"uuid":"250babd9-c57e-4a5a-b6e8-61da501066a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6809","nonce":3274269229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6811","nonce":3274269229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6815","nonce":3274269229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3274269229},{"type":"v1","addr":"172.21.15.174:6813","nonce":3274269229}]},"public_addr":"172.21.15.174:6809/3274269229","cluster_addr":"172.21.15.174:6811/3274269229","heartbeat_back_addr":"172.21.15.174:6815/3274269229","heartbeat_front_addr":"172.21.15.174:6813/3274269229","state":["exists","up"]},{"osd":6,"uuid":"fbed0a5f-2a68-41e2-a105-431f47433d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6819","nonce":3796077791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6821","nonce":3796077791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6825","nonce":3796077791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3796077791},{"type":"v1","addr":"172.21.15.17:6823","nonce":3796077791}]},"public_addr":"172.21.15.17:6819/3796077791","cluster_addr":"172.21.15.17:6821/3796077791","heartbeat_back_addr":"172.21.15.17:6825/3796077791","heartbeat_front_addr":"172.21.15.17:6823/3796077791","state":["exists","up"]},{"osd":7,"uuid":"9926c51c-4954-470c-a6d2-cd4ec79d50bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6817","nonce":2270288694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6819","nonce":2270288694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6823","nonce":2270288694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":2270288694},{"type":"v1","addr":"172.21.15.111:6821","nonce":2270288694}]},"public_addr":"172.21.15.111:6817/2270288694","cluster_addr":"172.21.15.111:6819/2270288694","heartbeat_back_addr":"172.21.15.111:6823/2270288694","heartbeat_front_addr":"172.21.15.111:6821/2270288694","state":["exists","up"]},{"osd":8,"uuid":"c482b95a-bcfd-4b86-806e-e5e11694b585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6817","nonce":3711712891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6819","nonce":3711712891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6823","nonce":3711712891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3711712891},{"type":"v1","addr":"172.21.15.174:6821","nonce":3711712891}]},"public_addr":"172.21.15.174:6817/3711712891","cluster_addr":"172.21.15.174:6819/3711712891","heartbeat_back_addr":"172.21.15.174:6823/3711712891","heartbeat_front_addr":"172.21.15.174:6821/3711712891","state":["exists","up"]},{"osd":9,"uuid":"126cff44-91f0-49a3-8ff3-762baa059349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6827","nonce":4098561509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6829","nonce":4098561509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6833","nonce":4098561509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":4098561509},{"type":"v1","addr":"172.21.15.17:6831","nonce":4098561509}]},"public_addr":"172.21.15.17:6827/4098561509","cluster_addr":"172.21.15.17:6829/4098561509","heartbeat_back_addr":"172.21.15.17:6833/4098561509","heartbeat_front_addr":"172.21.15.17:6831/4098561509","state":["exists","up"]},{"osd":10,"uuid":"1209c41f-8100-49bf-9d4b-f422fd725d71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6825","nonce":3614977703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6827","nonce":3614977703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6831","nonce":3614977703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3614977703},{"type":"v1","addr":"172.21.15.111:6829","nonce":3614977703}]},"public_addr":"172.21.15.111:6825/3614977703","cluster_addr":"172.21.15.111:6827/3614977703","heartbeat_back_addr":"172.21.15.111:6831/3614977703","heartbeat_front_addr":"172.21.15.111:6829/3614977703","state":["exists","up"]},{"osd":11,"uuid":"bb52cfa5-7b9d-4008-bbff-17225492bb2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6825","nonce":850467808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6827","nonce":850467808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6831","nonce":850467808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":850467808},{"type":"v1","addr":"172.21.15.174:6829","nonce":850467808}]},"public_addr":"172.21.15.174:6825/850467808","cluster_addr":"172.21.15.174:6827/850467808","heartbeat_back_addr":"172.21.15.174:6831/850467808","heartbeat_front_addr":"172.21.15.174:6829/850467808","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:15.637655+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:43:39.624602+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:03.117348+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:28.157993+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:44:52.919008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:18.318831+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:45:43.651492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:09.957213+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:46:35.875897+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:02.681010+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:28.575232+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T10:47:55.276027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:6800/1123613371":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/4191018145":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/2689612240":"2024-03-17T10:41:40.391994+0000","172.21.15.17:0/1267658658":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6800/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/2804979263":"2024-03-17T10:41:12.324893+0000","172.21.15.17:6801/3497137081":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/435172589":"2024-03-17T10:41:12.324893+0000","172.21.15.17:0/520901211":"2024-03-17T10:41:40.391994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 msgr2=0x7f65840a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 0x7f65840a4cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f659c199080 tx=0x7f6590005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 msgr2=0x7f659c197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 0x7f659c197b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f659402c630 tx=0x7f6594032f20 comp rx=0 tx=0).stop 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 shutdown_connections 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f65840a2800 0x7f65840a4cc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f659c1033d0 0x7f659c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f659c102a10 0x7f659c1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 --2- 172.21.15.17:0/1221468781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f659c101820 0x7f659c197b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 >> 172.21.15.17:0/1221468781 conn(0x7f659c0fcd90 msgr2=0x7f659c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 shutdown_connections 2024-03-16T10:55:21.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.129+0000 7f65a30ff640 1 -- 172.21.15.17:0/1221468781 wait complete. 2024-03-16T10:55:21.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T10:55:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 -- 172.21.15.17:0/2180521763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 msgr2=0x7fce84109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/2180521763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84109dc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009ca0 tx=0x7fce7c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 -- 172.21.15.17:0/2180521763 shutdown_connections 2024-03-16T10:55:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/2180521763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84109dc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/2180521763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce840ff850 0x7fce840ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/2180521763 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce84102de0 0x7fce84103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 -- 172.21.15.17:0/2180521763 >> 172.21.15.17:0/2180521763 conn(0x7fce840fb3d0 msgr2=0x7fce840fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 -- 172.21.15.17:0/2180521763 shutdown_connections 2024-03-16T10:55:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.244+0000 7fce8b9f4640 1 -- 172.21.15.17:0/2180521763 wait complete. 2024-03-16T10:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 Processor -- start 2024-03-16T10:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 -- start start 2024-03-16T10:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce840ff850 0x7fce84197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce84102de0 0x7fce8419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce8410d470 con 0x7fce84100210 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fce8410d2f0 con 0x7fce840ff850 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce8b9f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce8410d5f0 con 0x7fce84102de0 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce88f8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce88f8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49058/0 (socket says 172.21.15.17:49058) 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce89790640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce840ff850 0x7fce84197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.245+0000 7fce88f8f640 1 -- 172.21.15.17:0/994178453 learned_addr learned my addr 172.21.15.17:0/994178453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce89f91640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce84102de0 0x7fce8419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 -- 172.21.15.17:0/994178453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce84102de0 msgr2=0x7fce8419f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce84102de0 0x7fce8419f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 -- 172.21.15.17:0/994178453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce840ff850 msgr2=0x7fce84197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce840ff850 0x7fce84197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 -- 172.21.15.17:0/994178453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8419f740 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce88f8f640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fce7400e9f0 tx=0x7fce7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7400cd80 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce74005500 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8419fa30 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74010690 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.246+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8419ff30 con 0x7fce84100210 2024-03-16T10:55:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.247+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce84108c40 con 0x7fce84100210 2024-03-16T10:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.248+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fce740046c0 con 0x7fce84100210 2024-03-16T10:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.249+0000 7fce7a7fc640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 0x7fce700a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.249+0000 7fce89790640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 0x7fce700a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.249+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8153+0+0 (secure 0 0 0) 0x7fce740cedb0 con 0x7fce84100210 2024-03-16T10:55:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.249+0000 7fce89790640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 0x7fce700a4cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce800095f0 tx=0x7fce80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.257+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fce7409bef0 con 0x7fce84100210 2024-03-16T10:55:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.501+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fce8402d390 con 0x7fce84100210 2024-03-16T10:55:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.503+0000 7fce7a7fc640 1 -- 172.21.15.17:0/994178453 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7fce7409b7f0 con 0x7fce84100210 2024-03-16T10:55:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T10:55:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.506+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 msgr2=0x7fce700a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.506+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 0x7fce700a4cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce800095f0 tx=0x7fce80005f90 comp rx=0 tx=0).stop 2024-03-16T10:55:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 msgr2=0x7fce84198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fce7400e9f0 tx=0x7fce7400edf0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 shutdown_connections 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fce700a2800 0x7fce700a4cc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce84102de0 0x7fce8419f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce84100210 0x7fce84198060 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 --2- 172.21.15.17:0/994178453 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce840ff850 0x7fce84197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 >> 172.21.15.17:0/994178453 conn(0x7fce840fb3d0 msgr2=0x7fce84105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 shutdown_connections 2024-03-16T10:55:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.507+0000 7fce8b9f4640 1 -- 172.21.15.17:0/994178453 wait complete. 2024-03-16T10:55:21.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 -- 172.21.15.17:0/741045993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b801029f0 msgr2=0x7f8b80102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 --2- 172.21.15.17:0/741045993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b801029f0 0x7f8b80102e70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009900 tx=0x7f8b7402bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 -- 172.21.15.17:0/741045993 shutdown_connections 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 --2- 172.21.15.17:0/741045993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801033b0 0x7f8b80109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 --2- 172.21.15.17:0/741045993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b801029f0 0x7f8b80102e70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 --2- 172.21.15.17:0/741045993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b80101800 0x7f8b80101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 -- 172.21.15.17:0/741045993 >> 172.21.15.17:0/741045993 conn(0x7f8b800fcd70 msgr2=0x7f8b800ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 -- 172.21.15.17:0/741045993 shutdown_connections 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 -- 172.21.15.17:0/741045993 wait complete. 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.635+0000 7f8b860f8640 1 Processor -- start 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 -- start start 2024-03-16T10:55:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801029f0 0x7f8b80198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b801033b0 0x7f8b8019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d480 con 0x7f8b80101800 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d300 con 0x7f8b801029f0 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b860f8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d600 con 0x7f8b801033b0 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49118/0 (socket says 172.21.15.17:49118) 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 -- 172.21.15.17:0/2223262713 learned_addr learned my addr 172.21.15.17:0/2223262713 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7effd640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801029f0 0x7f8b80198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7ffff640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b801033b0 0x7f8b8019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 -- 172.21.15.17:0/2223262713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b801033b0 msgr2=0x7f8b8019f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b801033b0 0x7f8b8019f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 -- 172.21.15.17:0/2223262713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801029f0 msgr2=0x7f8b80198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801029f0 0x7f8b80198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 -- 172.21.15.17:0/2223262713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8019f720 con 0x7f8b80101800 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.636+0000 7f8b7f7fe640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000e9c0 tx=0x7f8b7000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.637+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000cd80 con 0x7f8b80101800 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.637+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8019fa10 con 0x7f8b80101800 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.637+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b700035f0 con 0x7f8b80101800 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.637+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70010690 con 0x7f8b80101800 2024-03-16T10:55:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.637+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8019fee0 con 0x7f8b80101800 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.638+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b80108b20 con 0x7f8b80101800 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.639+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f8b700037a0 con 0x7f8b80101800 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.639+0000 7f8b7cff9640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 0x7f8b680a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.639+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8583+0+0 (secure 0 0 0) 0x7f8b700cf0a0 con 0x7f8b80101800 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.639+0000 7f8b7effd640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 0x7f8b680a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.640+0000 7f8b7effd640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 0x7f8b680a4cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8b7402c7b0 tx=0x7f8b74005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:21.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.643+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f8b7009bfe0 con 0x7f8b80101800 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2848118936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/1221468781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mds[66864]: -- 172.21.15.174:0/2693977868 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c904209a40 con 0x55c9041dcc00 2024-03-16T10:55:21.813 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: starting mds.c at 2024-03-16T10:55:21.814 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.814 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.814 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mds[66243]: -- 172.21.15.174:0/1177752232 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8876afa40 con 0x55b887682c00 2024-03-16T10:55:21.814 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: starting mds.l at 2024-03-16T10:55:21.814 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mds[66558]: -- 172.21.15.174:0/2423336685 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55631e24ba40 con 0x55631e21e800 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: starting mds.f at 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-mds[67176]: -- 172.21.15.174:0/1893734832 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a84e3da40 con 0x559a84e10c00 2024-03-16T10:55:21.815 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:55:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: starting mds.i at 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2848118936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/1221468781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[32074]: 2024-03-16T10:55:21.502+0000 7f146acee700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.840 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-mds[73527]: -- 172.21.15.17:0/3155062576 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d1cbe89a40 con 0x55d1cbe5cc00 2024-03-16T10:55:21.841 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: starting mds.a at 2024-03-16T10:55:21.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-mds[73169]: -- 172.21.15.17:0/1655478711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601bf4bda40 con 0x5601bf490c00 2024-03-16T10:55:21.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:55:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: starting mds.g at 2024-03-16T10:55:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:21.864+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8b8002d1e0 con 0x7f8b80101800 2024-03-16T10:55:21.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2848118936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/1221468781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mds[66842]: -- 172.21.15.111:0/3270436131 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b91dafa40 con 0x562b91d82800 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: starting mds.b at 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.912 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mds[65906]: -- 172.21.15.111:0/2014845740 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d4c6a9a40 con 0x558d4c67d000 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: starting mds.k at 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mds[66228]: -- 172.21.15.111:0/2583175463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562cb9c27a40 con 0x562cb9bfa800 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: starting mds.e at 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: ignoring --setuser ceph since I am not root 2024-03-16T10:55:21.913 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: ignoring --setgroup ceph since I am not root 2024-03-16T10:55:21.914 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-mds[66532]: -- 172.21.15.111:0/3869967752 <== mon.2 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592915d3a40 con 0x5592915a6800 2024-03-16T10:55:21.914 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:55:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: starting mds.h at 2024-03-16T10:55:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.505+0000 7f8b7cff9640 1 -- 172.21.15.17:0/2223262713 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f8b7009b8e0 con 0x7f8b80101800 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 msgr2=0x7f8b680a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 0x7f8b680a4cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8b7402c7b0 tx=0x7f8b74005fd0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 msgr2=0x7f8b80197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000e9c0 tx=0x7f8b7000ee80 comp rx=0 tx=0).stop 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 shutdown_connections 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f8b680a2800 0x7f8b680a4cc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b801033b0 0x7f8b8019f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b801029f0 0x7f8b80198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 --2- 172.21.15.17:0/2223262713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b80101800 0x7f8b80197b00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 >> 172.21.15.17:0/2223262713 conn(0x7f8b800fcd70 msgr2=0x7f8b80105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 shutdown_connections 2024-03-16T10:55:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.508+0000 7f8b860f8640 1 -- 172.21.15.17:0/2223262713 wait complete. 2024-03-16T10:55:22.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 -- 172.21.15.17:0/4185744466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 msgr2=0x7f7e10100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 --2- 172.21.15.17:0/4185744466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10100b00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009900 tx=0x7f7e0002bc30 comp rx=0 tx=0).stop 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 -- 172.21.15.17:0/4185744466 shutdown_connections 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 --2- 172.21.15.17:0/4185744466 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 0x7f7e10108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 --2- 172.21.15.17:0/4185744466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e10101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 --2- 172.21.15.17:0/4185744466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10100b00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 -- 172.21.15.17:0/4185744466 >> 172.21.15.17:0/4185744466 conn(0x7f7e100fbc50 msgr2=0x7f7e100fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 -- 172.21.15.17:0/4185744466 shutdown_connections 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.638+0000 7f7e15859640 1 -- 172.21.15.17:0/4185744466 wait complete. 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 Processor -- start 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 -- start start 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e1019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 0x7f7e1019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1010c330 con 0x7f7e101006e0 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1010c1b0 con 0x7f7e10102290 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e15859640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1010c4b0 con 0x7f7e101018d0 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49144/0 (socket says 172.21.15.17:49144) 2024-03-16T10:55:22.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 -- 172.21.15.17:0/3873321478 learned_addr learned my addr 172.21.15.17:0/3873321478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e067fc640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e1019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0f7fe640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 0x7f7e1019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 -- 172.21.15.17:0/3873321478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 msgr2=0x7f7e1019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e1019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 -- 172.21.15.17:0/3873321478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 msgr2=0x7f7e1019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 0x7f7e1019ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.639+0000 7f7e0effd640 1 -- 172.21.15.17:0/3873321478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1019f6a0 con 0x7f7e101006e0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e067fc640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e1019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e0effd640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005ab0 tx=0x7f7e00005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00041070 con 0x7f7e101006e0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e000054e0 con 0x7f7e101006e0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1019f930 con 0x7f7e101006e0 2024-03-16T10:55:22.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00034440 con 0x7f7e101006e0 2024-03-16T10:55:22.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.640+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1019fe70 con 0x7f7e101006e0 2024-03-16T10:55:22.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.641+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e10107a00 con 0x7f7e101006e0 2024-03-16T10:55:22.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.642+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7f7e00044070 con 0x7f7e101006e0 2024-03-16T10:55:22.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.642+0000 7f7e14857640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 0x7f7dfc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:22.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.643+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8583+0+0 (secure 0 0 0) 0x7f7e000f0830 con 0x7f7e101006e0 2024-03-16T10:55:22.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.643+0000 7f7e067fc640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 0x7f7dfc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:22.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.643+0000 7f7e067fc640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 0x7f7dfc0a4d40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7e10069280 tx=0x7f7df800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:22.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.647+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7f7e000bd770 con 0x7f7e101006e0 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: pgmap v487: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-16T10:55:22.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:22 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:55:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:22.832+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7e1002d1b0 con 0x7f7e101006e0 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: pgmap v487: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-16T10:55:22.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:22 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:55:22.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: pgmap v487: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/994178453' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: osdmap e88: 12 total, 12 up, 12 in 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-16T10:55:22.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:22 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-16T10:55:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.509+0000 7f7e14857640 1 -- 172.21.15.17:0/3873321478 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f7e000bd070 con 0x7f7e101006e0 2024-03-16T10:55:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-03-16T10:55:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 msgr2=0x7f7dfc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 0x7f7dfc0a4d40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7e10069280 tx=0x7f7df800a5c0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 msgr2=0x7f7e10069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005ab0 tx=0x7f7e00005dc0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 shutdown_connections 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7f7dfc0a2880 0x7f7dfc0a4d40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e10102290 0x7f7e1019ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e101018d0 0x7f7e1019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 --2- 172.21.15.17:0/3873321478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e101006e0 0x7f7e10069510 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 >> 172.21.15.17:0/3873321478 conn(0x7f7e100fbc50 msgr2=0x7f7e10104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.513+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 shutdown_connections 2024-03-16T10:55:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.514+0000 7f7e15859640 1 -- 172.21.15.17:0/3873321478 wait complete. 2024-03-16T10:55:23.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- 172.21.15.17:0/1610847761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41022a0 msgr2=0x7fe1a4108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 --2- 172.21.15.17:0/1610847761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41022a0 0x7fe1a4108b30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009ca0 tx=0x7fe19c02c0f0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- 172.21.15.17:0/1610847761 shutdown_connections 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 --2- 172.21.15.17:0/1610847761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41022a0 0x7fe1a4108b30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 --2- 172.21.15.17:0/1610847761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41018e0 0x7fe1a4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 --2- 172.21.15.17:0/1610847761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41006f0 0x7fe1a4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- 172.21.15.17:0/1610847761 >> 172.21.15.17:0/1610847761 conn(0x7fe1a40fbc80 msgr2=0x7fe1a40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- 172.21.15.17:0/1610847761 shutdown_connections 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- 172.21.15.17:0/1610847761 wait complete. 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 Processor -- start 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.642+0000 7fe1ab236640 1 -- start start 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41006f0 0x7fe1a4197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41022a0 0x7fe1a419f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a410d490 con 0x7fe1a41018e0 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a410d310 con 0x7fe1a41006f0 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a410d610 con 0x7fe1a41022a0 2024-03-16T10:55:23.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49160/0 (socket says 172.21.15.17:49160) 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 -- 172.21.15.17:0/409604415 learned_addr learned my addr 172.21.15.17:0/409604415 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a8fd2640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41006f0 0x7fe1a4197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a97d3640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41022a0 0x7fe1a419f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 -- 172.21.15.17:0/409604415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41022a0 msgr2=0x7fe1a419f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41022a0 0x7fe1a419f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 -- 172.21.15.17:0/409604415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41006f0 msgr2=0x7fe1a4197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41006f0 0x7fe1a4197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 -- 172.21.15.17:0/409604415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a419f6e0 con 0x7fe1a41018e0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a3fff640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d950 tx=0x7fe19000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190017070 con 0x7fe1a41018e0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe190009c30 con 0x7fe1a41018e0 2024-03-16T10:55:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19000f6b0 con 0x7fe1a41018e0 2024-03-16T10:55:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.643+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a419f9d0 con 0x7fe1a41018e0 2024-03-16T10:55:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.644+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a419ff20 con 0x7fe1a41018e0 2024-03-16T10:55:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.645+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a4107a60 con 0x7fe1a41018e0 2024-03-16T10:55:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.646+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 20) ==== 137290+0+0 (secure 0 0 0) 0x7fe1900109d0 con 0x7fe1a41018e0 2024-03-16T10:55:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.646+0000 7fe1a1ffb640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 0x7fe1940a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T10:55:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.646+0000 7fe1a8fd2640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 0x7fe1940a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T10:55:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.646+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8087+0+0 (secure 0 0 0) 0x7fe1900ce620 con 0x7fe1a41018e0 2024-03-16T10:55:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.647+0000 7fe1a8fd2640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 0x7fe1940a4cc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe198005fd0 tx=0x7fe19800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T10:55:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.651+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186149 (secure 0 0 0) 0x7fe190009de0 con 0x7fe1a41018e0 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: Cluster is now healthy 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6836/3379406064,v1:172.21.15.174:6837/3379406064] up:boot 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6838/3134174131,v1:172.21.15.174:6839/3134174131] up:boot 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6838/2793796027,v1:172.21.15.17:6839/2793796027] up:boot 2024-03-16T10:55:23.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6832/3756476572,v1:172.21.15.174:6834/3756476572] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.174:6833/4067157066,v1:172.21.15.174:6835/4067157066] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6834/144063034,v1:172.21.15.111:6835/144063034] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6836/1235038115,v1:172.21.15.111:6837/1235038115] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.17:6840/2184324902,v1:172.21.15.17:6841/2184324902] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6832/599521992,v1:172.21.15.111:6833/599521992] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: mds.? [v2:172.21.15.111:6838/2549217363,v1:172.21.15.111:6839/2549217363] up:boot 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: fsmap 12 up:standby 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:55:23.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:55:23.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:55:23.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:55:23.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:55:23.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:55:23.815 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:23 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:23.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:23.834+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1a402d1b0 con 0x7fe1a41018e0 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: Cluster is now healthy 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6836/3379406064,v1:172.21.15.174:6837/3379406064] up:boot 2024-03-16T10:55:23.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6838/3134174131,v1:172.21.15.174:6839/3134174131] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6838/2793796027,v1:172.21.15.17:6839/2793796027] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6832/3756476572,v1:172.21.15.174:6834/3756476572] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.174:6833/4067157066,v1:172.21.15.174:6835/4067157066] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6834/144063034,v1:172.21.15.111:6835/144063034] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6836/1235038115,v1:172.21.15.111:6837/1235038115] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.17:6840/2184324902,v1:172.21.15.17:6841/2184324902] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6832/599521992,v1:172.21.15.111:6833/599521992] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: mds.? [v2:172.21.15.111:6838/2549217363,v1:172.21.15.111:6839/2549217363] up:boot 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: fsmap 12 up:standby 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:55:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:55:23.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:23 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: Cluster is now healthy 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/2223262713' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6836/3379406064,v1:172.21.15.174:6837/3379406064] up:boot 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6838/3134174131,v1:172.21.15.174:6839/3134174131] up:boot 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6838/2793796027,v1:172.21.15.17:6839/2793796027] up:boot 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6832/3756476572,v1:172.21.15.174:6834/3756476572] up:boot 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.174:6833/4067157066,v1:172.21.15.174:6835/4067157066] up:boot 2024-03-16T10:55:23.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6834/144063034,v1:172.21.15.111:6835/144063034] up:boot 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6836/1235038115,v1:172.21.15.111:6837/1235038115] up:boot 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.17:6840/2184324902,v1:172.21.15.17:6841/2184324902] up:boot 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6832/599521992,v1:172.21.15.111:6833/599521992] up:boot 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: mds.? [v2:172.21.15.111:6838/2549217363,v1:172.21.15.111:6839/2549217363] up:boot 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: fsmap 12 up:standby 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-16T10:55:23.913 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-16T10:55:23.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='mgr.14150 172.21.15.17:0/240713073' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-16T10:55:23.914 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:23 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:24.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.514+0000 7fe1a1ffb640 1 -- 172.21.15.17:0/409604415 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7fe19009b0b0 con 0x7fe1a41018e0 2024-03-16T10:55:24.515 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-03-16T10:55:24.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.518+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 msgr2=0x7fe1940a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:24.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.518+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 0x7fe1940a4cc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe198005fd0 tx=0x7fe19800b390 comp rx=0 tx=0).stop 2024-03-16T10:55:24.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.518+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 msgr2=0x7fe1a4198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T10:55:24.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.518+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d950 tx=0x7fe19000de10 comp rx=0 tx=0).stop 2024-03-16T10:55:24.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 shutdown_connections 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:6800/3813203524,v1:172.21.15.17:6801/3813203524] conn(0x7fe1940a2800 0x7fe1940a4cc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a41022a0 0x7fe1a419f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a41018e0 0x7fe1a4198000 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 --2- 172.21.15.17:0/409604415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe1a41006f0 0x7fe1a4197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 >> 172.21.15.17:0/409604415 conn(0x7fe1a40fbc80 msgr2=0x7fe1a4104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 shutdown_connections 2024-03-16T10:55:24.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-16T10:55:24.519+0000 7fe1ab236640 1 -- 172.21.15.17:0/409604415 wait complete. 2024-03-16T10:55:24.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:55:24.570 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:55:24.602 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:55:24.635 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-16T10:55:24.635 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T10:55:24.650 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T10:55:24.666 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-16T10:55:24.691 INFO:tasks.cephadm:Stopping all daemons... 2024-03-16T10:55:24.691 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-16T10:55:24.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:24 smithi174 ceph-mon[36202]: pgmap v489: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:24 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:24 smithi174 ceph-mon[36202]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:24 smithi174 ceph-mon[36202]: from='client.? 172.21.15.17:0/409604415' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:24 smithi111 ceph-mon[36315]: pgmap v489: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:24 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:24 smithi111 ceph-mon[36315]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T10:55:24.813 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:24 smithi111 ceph-mon[36315]: from='client.? 172.21.15.17:0/409604415' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:24 smithi017 ceph-mon[32078]: pgmap v489: 97 pgs: 97 active+clean; 31 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-16T10:55:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:24 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/3873321478' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-16T10:55:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:24 smithi017 ceph-mon[32078]: osdmap e89: 12 total, 12 up, 12 in 2024-03-16T10:55:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:24 smithi017 ceph-mon[32078]: from='client.? 172.21.15.17:0/409604415' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-16T10:55:24.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:24 smithi017 systemd[1]: Stopping Ceph mon.a for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:25.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[32074]: 2024-03-16T10:55:25.009+0000 7f14704f9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:25.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a[32074]: 2024-03-16T10:55:25.009+0000 7f14704f9700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-16T10:55:25.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:25 smithi017 podman[91471]: 2024-03-16 10:55:25.122032807 +0000 UTC m=+0.245086505 container died c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-03-16T10:55:25.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:25 smithi017 podman[91471]: 2024-03-16 10:55:25.577778307 +0000 UTC m=+0.700832044 container cleanup c900f929f10a8aac99ed26d33811cefacb9003f1d4382df5d6815ece0a2ae7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a, ceph=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:55:25.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Mar 16 10:55:25 smithi017 bash[91471]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-a 2024-03-16T10:55:26.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.a.service' 2024-03-16T10:55:26.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:26.329 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-16T10:55:26.329 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-16T10:55:26.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.b 2024-03-16T10:55:26.648 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:26 smithi111 systemd[1]: Stopping Ceph mon.b for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:26.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-b[36311]: 2024-03-16T10:55:26.645+0000 7f5d12fe1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:26.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-b[36311]: 2024-03-16T10:55:26.645+0000 7f5d12fe1700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-16T10:55:26.912 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:26 smithi111 podman[70056]: 2024-03-16 10:55:26.799783747 +0000 UTC m=+0.284164105 container died e2255074d9899c570feafc9248ade079256d2c956c26fd07fd6af4dce824c313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-16T10:55:27.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:27 smithi111 podman[70056]: 2024-03-16 10:55:27.172109955 +0000 UTC m=+0.656490364 container cleanup e2255074d9899c570feafc9248ade079256d2c956c26fd07fd6af4dce824c313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-b, org.label-schema.build-date=20240307, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:55:27.411 INFO:journalctl@ceph.mon.b.smithi111.stdout:Mar 16 10:55:27 smithi111 bash[70056]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-b 2024-03-16T10:55:27.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.b.service' 2024-03-16T10:55:27.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:27.638 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-16T10:55:27.638 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-16T10:55:27.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.c 2024-03-16T10:55:27.962 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:27 smithi174 systemd[1]: Stopping Ceph mon.c for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:28.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-c[36198]: 2024-03-16T10:55:27.961+0000 7f8c3854e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:28.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-c[36198]: 2024-03-16T10:55:27.961+0000 7f8c3854e700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-16T10:55:28.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:28 smithi174 podman[70669]: 2024-03-16 10:55:28.206710847 +0000 UTC m=+0.373753626 container died 97d7f40e94450dc2e4a179df8b050c8c611f36392198b9ec82d199c833cbf407 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-c, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-16T10:55:28.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:28 smithi174 podman[70669]: 2024-03-16 10:55:28.611534709 +0000 UTC m=+0.778577487 container cleanup 97d7f40e94450dc2e4a179df8b050c8c611f36392198b9ec82d199c833cbf407 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-c, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-16T10:55:28.813 INFO:journalctl@ceph.mon.c.smithi174.stdout:Mar 16 10:55:28 smithi174 bash[70669]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mon-c 2024-03-16T10:55:29.075 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mon.c.service' 2024-03-16T10:55:29.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:29.132 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-16T10:55:29.132 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-16T10:55:29.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x 2024-03-16T10:55:29.340 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:55:29 smithi017 systemd[1]: Stopping Ceph mgr.x for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:29.741 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:55:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x[32307]: 2024-03-16T10:55:29.457+0000 7f0134911700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:29.742 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:55:29 smithi017 podman[91594]: 2024-03-16 10:55:29.489310046 +0000 UTC m=+0.167951635 container died a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:55:30.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:55:29 smithi017 podman[91594]: 2024-03-16 10:55:29.951077218 +0000 UTC m=+0.629718793 container cleanup a2ef02fdce56a5ded6a933f8e7b3bbec7ed9d21947c3398e4c0485346adfed58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d78f5ba07bf18880172c07d4d7b4ac00c9d30af, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-16T10:55:30.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Mar 16 10:55:29 smithi017 bash[91594]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-x 2024-03-16T10:55:30.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.x.service' 2024-03-16T10:55:30.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:30.567 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-16T10:55:30.567 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-16T10:55:30.567 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.y 2024-03-16T10:55:30.911 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:55:30 smithi111 systemd[1]: Stopping Ceph mgr.y for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:31.237 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:55:30 smithi111 podman[70179]: 2024-03-16 10:55:30.923104718 +0000 UTC m=+0.157981269 container died 9e1f123d317c65038359dd1b66d1740159018ad17bd01829ce4956c8960126a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-16T10:55:31.596 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:55:31 smithi111 podman[70179]: 2024-03-16 10:55:31.35347179 +0000 UTC m=+0.588348355 container cleanup 9e1f123d317c65038359dd1b66d1740159018ad17bd01829ce4956c8960126a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-03-16T10:55:31.597 INFO:journalctl@ceph.mgr.y.smithi111.stdout:Mar 16 10:55:31 smithi111 bash[70179]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-y 2024-03-16T10:55:31.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.y.service' 2024-03-16T10:55:31.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:31.847 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-16T10:55:31.847 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-16T10:55:31.847 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.z 2024-03-16T10:55:32.196 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:55:31 smithi174 systemd[1]: Stopping Ceph mgr.z for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:32.501 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:55:32 smithi174 podman[70791]: 2024-03-16 10:55:32.196013382 +0000 UTC m=+0.158702678 container died c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240307, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-16T10:55:32.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:55:32 smithi174 podman[70791]: 2024-03-16 10:55:32.609545577 +0000 UTC m=+0.572234868 container cleanup c88940e1f1035ab74991992ef154feee11338926bd7e3aa73371bc63ccfb0898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS) 2024-03-16T10:55:32.813 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Mar 16 10:55:32 smithi174 bash[70791]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mgr-z 2024-03-16T10:55:33.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mgr.z.service' 2024-03-16T10:55:33.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:33.125 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-16T10:55:33.125 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-16T10:55:33.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.0 2024-03-16T10:55:33.448 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:33 smithi017 systemd[1]: Stopping Ceph osd.0 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:33.840 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0[46836]: 2024-03-16T10:55:33.447+0000 7fb2710d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:33.840 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0[46836]: 2024-03-16T10:55:33.447+0000 7fb2710d8700 -1 osd.0 90 *** Got signal Terminated *** 2024-03-16T10:55:33.840 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0[46836]: 2024-03-16T10:55:33.447+0000 7fb2710d8700 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:55:39.250 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:38 smithi017 podman[91714]: 2024-03-16 10:55:38.984788131 +0000 UTC m=+5.660288197 container died 25141f8c59e7ddb7350dcbc6a140a26af96876f00110b21dae89ebf1d5cdfbf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-16T10:55:39.590 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:39 smithi017 podman[91714]: 2024-03-16 10:55:39.448896087 +0000 UTC m=+6.124396152 container cleanup 25141f8c59e7ddb7350dcbc6a140a26af96876f00110b21dae89ebf1d5cdfbf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:55:39.590 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:39 smithi017 bash[91714]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0 2024-03-16T10:55:40.061 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:39 smithi017 podman[91731]: 2024-03-16 10:55:39.733976806 +0000 UTC m=+0.745954579 container remove 25141f8c59e7ddb7350dcbc6a140a26af96876f00110b21dae89ebf1d5cdfbf8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-16T10:55:40.340 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:39.96441083 +0000 UTC m=+0.017591362 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:55:40.340 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:40.095002831 +0000 UTC m=+0.148183365 container create 08b76a661fa15be4f5f7837ab79a3ad954f7380de0ee75edb1d92ab60500d112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-16T10:55:40.658 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:40.354389987 +0000 UTC m=+0.407570533 container init 08b76a661fa15be4f5f7837ab79a3ad954f7380de0ee75edb1d92ab60500d112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True) 2024-03-16T10:55:40.658 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:40.357442125 +0000 UTC m=+0.410622655 container start 08b76a661fa15be4f5f7837ab79a3ad954f7380de0ee75edb1d92ab60500d112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-16T10:55:40.658 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:40.429337424 +0000 UTC m=+0.482517961 container attach 08b76a661fa15be4f5f7837ab79a3ad954f7380de0ee75edb1d92ab60500d112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux ) 2024-03-16T10:55:40.957 INFO:journalctl@ceph.osd.0.smithi017.stdout:Mar 16 10:55:40 smithi017 podman[91827]: 2024-03-16 10:55:40.657965407 +0000 UTC m=+0.711145943 container died 08b76a661fa15be4f5f7837ab79a3ad954f7380de0ee75edb1d92ab60500d112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-03-16T10:55:41.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.0.service' 2024-03-16T10:55:41.410 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:41.410 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-16T10:55:41.410 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-16T10:55:41.411 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.1 2024-03-16T10:55:41.725 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:41 smithi111 systemd[1]: Stopping Ceph osd.1 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:42.161 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:55:41.723+0000 7f7d0b3d5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:42.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:55:41.724+0000 7f7d0b3d5700 -1 osd.1 90 *** Got signal Terminated *** 2024-03-16T10:55:42.162 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1[40948]: 2024-03-16T10:55:41.724+0000 7f7d0b3d5700 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:55:47.412 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:47 smithi111 podman[70302]: 2024-03-16 10:55:47.143884354 +0000 UTC m=+5.540640128 container died 5a037479d5e25fbd911f4c7968e71756e68cabdfd3760305f40be40b40fe994d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS) 2024-03-16T10:55:47.801 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:47 smithi111 podman[70302]: 2024-03-16 10:55:47.524995466 +0000 UTC m=+5.921751239 container cleanup 5a037479d5e25fbd911f4c7968e71756e68cabdfd3760305f40be40b40fe994d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=) 2024-03-16T10:55:47.802 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:47 smithi111 bash[70302]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1 2024-03-16T10:55:48.088 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:47 smithi111 podman[70320]: 2024-03-16 10:55:47.801461629 +0000 UTC m=+0.651734794 container remove 5a037479d5e25fbd911f4c7968e71756e68cabdfd3760305f40be40b40fe994d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-16T10:55:48.346 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:47.991505074 +0000 UTC m=+0.017148436 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:55:48.347 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:48.102511231 +0000 UTC m=+0.128154590 container create 16c7f25e908f1f03901ad5d52da1539e3fec2417da0311f427bf52d2e8d0536e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-16T10:55:48.648 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:48.346614311 +0000 UTC m=+0.372257670 container init 16c7f25e908f1f03901ad5d52da1539e3fec2417da0311f427bf52d2e8d0536e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:55:48.648 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:48.349780041 +0000 UTC m=+0.375423384 container start 16c7f25e908f1f03901ad5d52da1539e3fec2417da0311f427bf52d2e8d0536e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True) 2024-03-16T10:55:48.648 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:48.446812342 +0000 UTC m=+0.472455706 container attach 16c7f25e908f1f03901ad5d52da1539e3fec2417da0311f427bf52d2e8d0536e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-03-16T10:55:48.911 INFO:journalctl@ceph.osd.1.smithi111.stdout:Mar 16 10:55:48 smithi111 podman[70413]: 2024-03-16 10:55:48.64864301 +0000 UTC m=+0.674286360 container died 16c7f25e908f1f03901ad5d52da1539e3fec2417da0311f427bf52d2e8d0536e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-16T10:55:49.254 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.1.service' 2024-03-16T10:55:49.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:49.295 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-16T10:55:49.296 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-16T10:55:49.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.2 2024-03-16T10:55:49.614 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:49 smithi174 systemd[1]: Stopping Ceph osd.2 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:50.063 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2[41373]: 2024-03-16T10:55:49.612+0000 7f8d00627700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:50.063 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2[41373]: 2024-03-16T10:55:49.612+0000 7f8d00627700 -1 osd.2 90 *** Got signal Terminated *** 2024-03-16T10:55:50.063 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2[41373]: 2024-03-16T10:55:49.612+0000 7f8d00627700 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:55:55.313 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:54 smithi174 podman[70913]: 2024-03-16 10:55:54.973414264 +0000 UTC m=+5.488926016 container died f852b9826594f480f6fad6a92fbf4e82714e413007fc95fb9b582d4eb6d4293e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:55:55.735 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:55 smithi174 podman[70913]: 2024-03-16 10:55:55.449608149 +0000 UTC m=+5.965119893 container cleanup f852b9826594f480f6fad6a92fbf4e82714e413007fc95fb9b582d4eb6d4293e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:55:55.735 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:55 smithi174 bash[70913]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2 2024-03-16T10:55:56.061 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:55 smithi174 podman[70928]: 2024-03-16 10:55:55.734725552 +0000 UTC m=+0.756980000 container remove f852b9826594f480f6fad6a92fbf4e82714e413007fc95fb9b582d4eb6d4293e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-16T10:55:56.313 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:55.963819278 +0000 UTC m=+0.017948472 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:55:56.313 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:56.094183396 +0000 UTC m=+0.148312586 container create 957413ed71b31c50d9e53536cab81fa0749f24079e8f9bc0983f2d9e7e1af2e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:55:56.660 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:56.366774148 +0000 UTC m=+0.420903343 container init 957413ed71b31c50d9e53536cab81fa0749f24079e8f9bc0983f2d9e7e1af2e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True) 2024-03-16T10:55:56.661 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:56.37014275 +0000 UTC m=+0.424271937 container start 957413ed71b31c50d9e53536cab81fa0749f24079e8f9bc0983f2d9e7e1af2e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-16T10:55:56.661 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:56.47180123 +0000 UTC m=+0.525930428 container attach 957413ed71b31c50d9e53536cab81fa0749f24079e8f9bc0983f2d9e7e1af2e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-16T10:55:56.975 INFO:journalctl@ceph.osd.2.smithi174.stdout:Mar 16 10:55:56 smithi174 podman[71022]: 2024-03-16 10:55:56.660761301 +0000 UTC m=+0.714890492 container died 957413ed71b31c50d9e53536cab81fa0749f24079e8f9bc0983f2d9e7e1af2e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-16T10:55:57.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.2.service' 2024-03-16T10:55:57.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:55:57.348 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-16T10:55:57.348 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-16T10:55:57.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.3 2024-03-16T10:55:57.662 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:55:57 smithi017 systemd[1]: Stopping Ceph osd.3 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:55:57.940 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:55:57 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:55:57.661+0000 7fa877392700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:55:57.940 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:55:57 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:55:57.661+0000 7fa877392700 -1 osd.3 90 *** Got signal Terminated *** 2024-03-16T10:55:57.940 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:55:57 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:55:57.661+0000 7fa877392700 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:00.090 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:55:59 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:55:59.795+0000 7fa873986700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:33.840167+0000 front 2024-03-16T10:55:33.840143+0000 (oldest deadline 2024-03-16T10:55:59.140386+0000) 2024-03-16T10:56:00.749 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:00 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:00.385+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:01.038 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:00.655+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:01.090 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:00 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:56:00.749+0000 7fa873986700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:33.840167+0000 front 2024-03-16T10:55:33.840143+0000 (oldest deadline 2024-03-16T10:55:59.140386+0000) 2024-03-16T10:56:01.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:01.037+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:01.714 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:01 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:01.423+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:02.052 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:01.666+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:02.090 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:01 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3[53353]: 2024-03-16T10:56:01.770+0000 7fa873986700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:33.840167+0000 front 2024-03-16T10:55:33.840143+0000 (oldest deadline 2024-03-16T10:55:59.140386+0000) 2024-03-16T10:56:02.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:01 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:01.713+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:02.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:02.051+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:02.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:01 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:01.960+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:02.747 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:02 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:02.470+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:03.012 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:02.654+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:03.077 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:02 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:02.746+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:03.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:03.011+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:03.340 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:03 smithi017 podman[91933]: 2024-03-16 10:56:03.077356401 +0000 UTC m=+5.535759299 container died 06a64a2104d8236fda1d28d3de6112a8a704168b1a855e34f5667aeb3c6817fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-16T10:56:03.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:02 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:02.966+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:03.754 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:03 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:03.505+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:03.754 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:03 smithi017 podman[91933]: 2024-03-16 10:56:03.587937792 +0000 UTC m=+6.046340735 container cleanup 06a64a2104d8236fda1d28d3de6112a8a704168b1a855e34f5667aeb3c6817fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-16T10:56:03.754 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:03 smithi017 bash[91933]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3 2024-03-16T10:56:04.045 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:03.704+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:04.090 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:03 smithi017 podman[91962]: 2024-03-16 10:56:03.814339747 +0000 UTC m=+0.732884226 container remove 06a64a2104d8236fda1d28d3de6112a8a704168b1a855e34f5667aeb3c6817fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-16T10:56:04.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:03 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:03.753+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:04.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:04.044+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:04.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:03 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:03.925+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:04.417 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.009870657 +0000 UTC m=+0.017811012 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:04.418 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.157193864 +0000 UTC m=+0.165134202 container create 4f3e6f0e79f496ddd8c73ff7c804941ed045618b4f7d9893a0f393d24c7e7b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:56:04.418 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.418102963 +0000 UTC m=+0.426043307 container init 4f3e6f0e79f496ddd8c73ff7c804941ed045618b4f7d9893a0f393d24c7e7b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:56:04.714 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:04 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:04.554+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:04.715 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.421186541 +0000 UTC m=+0.429126880 container start 4f3e6f0e79f496ddd8c73ff7c804941ed045618b4f7d9893a0f393d24c7e7b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:56:04.715 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.518050457 +0000 UTC m=+0.525990810 container attach 4f3e6f0e79f496ddd8c73ff7c804941ed045618b4f7d9893a0f393d24c7e7b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:56:05.063 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:04.751+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:05.071 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:04 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:04.770+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:05.072 INFO:journalctl@ceph.osd.3.smithi017.stdout:Mar 16 10:56:04 smithi017 podman[92054]: 2024-03-16 10:56:04.714448323 +0000 UTC m=+0.722388670 container died 4f3e6f0e79f496ddd8c73ff7c804941ed045618b4f7d9893a0f393d24c7e7b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-16T10:56:05.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.3.service' 2024-03-16T10:56:05.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:04 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:04.948+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:05.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:05.459 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-16T10:56:05.459 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-16T10:56:05.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.4 2024-03-16T10:56:05.563 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:05.078+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:05.724 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:05.594+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:05.779 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:05 smithi111 systemd[1]: Stopping Ceph osd.4 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:06.053 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:05.793+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:06.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:05 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:05.723+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:06.161 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:05 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:05.900+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:06.162 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:05 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:05.778+0000 7f88bc23d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:06.162 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:05 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:05.778+0000 7f88bc23d700 -1 osd.4 90 *** Got signal Terminated *** 2024-03-16T10:56:06.162 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:05 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:05.778+0000 7f88bc23d700 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:06.312 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:06.053+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:07.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:07 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:07.036+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:07.063 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:06.809+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:07.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:06.590+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:07.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:06 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:06.731+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:07.161 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:06 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:06.907+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:07.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:07.572+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:07.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:07 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:07.772+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:08.161 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:07 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:07.909+0000 7f88b8831700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.987510+0000 front 2024-03-16T10:55:45.987487+0000 (oldest deadline 2024-03-16T10:56:07.588375+0000) 2024-03-16T10:56:08.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:07 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:07.952+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:08.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:08 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:08.064+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:07 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:07.856+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:07 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:07.856+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:08.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:08.558+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:08.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:08.558+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:08.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:08.726+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:08.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:08 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:08.726+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:09.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:09 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:09.034+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:09.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:08 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:08.848+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:09.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:08 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:08.848+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:09.411 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:08 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:08.945+0000 7f88b8831700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.987510+0000 front 2024-03-16T10:55:45.987487+0000 (oldest deadline 2024-03-16T10:56:07.588375+0000) 2024-03-16T10:56:09.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:08 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:08.971+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:09.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:09.543+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:09.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:09.543+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:09.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:09.742+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:09.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:09.742+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:10.234 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:10 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:10.049+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:10.234 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:10 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:10.049+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:10.234 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:09 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:09.896+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:10.234 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:09 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:09.896+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:10.411 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:09 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4[47874]: 2024-03-16T10:56:09.989+0000 7f88b8831700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.987510+0000 front 2024-03-16T10:55:45.987487+0000 (oldest deadline 2024-03-16T10:56:07.588375+0000) 2024-03-16T10:56:10.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:10 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:10.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:10.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:10 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:10.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:10.562 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:10 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:10.233+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:10.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:10.546+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:10.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:10.546+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:10.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:10.702+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:10.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:10 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:10.702+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:11.248 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:11 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:11.062+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:11.248 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:11 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:11.062+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:11.248 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:10 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:10.903+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:11.248 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:10 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:10.903+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:11.411 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:11 smithi111 podman[70542]: 2024-03-16 10:56:11.246577294 +0000 UTC m=+5.590882649 container died 53071e135c83192629ee76541feb7030594832e5ef9ac5781557887f893def5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-16T10:56:11.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:11.068+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:11.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:11.028+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:11.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:11 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:11.028+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:11.562 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:11 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:11.247+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:11.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:11.507+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:11.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:11.507+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:11.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:11.752+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:11.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:11 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:11.752+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:11.889 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:11 smithi111 podman[70542]: 2024-03-16 10:56:11.637057604 +0000 UTC m=+5.981362940 container cleanup 53071e135c83192629ee76541feb7030594832e5ef9ac5781557887f893def5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:56:11.889 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:11 smithi111 bash[70542]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4 2024-03-16T10:56:12.161 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:12 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:12.115+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:12.162 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:11 smithi111 podman[70558]: 2024-03-16 10:56:11.888734906 +0000 UTC m=+0.641421751 container remove 53071e135c83192629ee76541feb7030594832e5ef9ac5781557887f893def5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-16T10:56:12.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:12 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:12.011+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:12.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:12 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:12.011+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:12.260 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:12.077+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:12.260 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:12.077+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:12.260 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:11 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:11.903+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:12.260 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:11 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:11.903+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:12.458 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.101848547 +0000 UTC m=+0.017677298 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:12.459 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.206550541 +0000 UTC m=+0.122379272 container create 445eeedc301c2240aebdbe3411c14c6c1acb9a0caa9be6b8b07dd047ab14b50f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-16T10:56:12.562 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:12.259+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:12.760 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.458847998 +0000 UTC m=+0.374676740 container init 445eeedc301c2240aebdbe3411c14c6c1acb9a0caa9be6b8b07dd047ab14b50f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-16T10:56:12.760 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.461908039 +0000 UTC m=+0.377736794 container start 445eeedc301c2240aebdbe3411c14c6c1acb9a0caa9be6b8b07dd047ab14b50f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-16T10:56:12.760 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.558989542 +0000 UTC m=+0.474818292 container attach 445eeedc301c2240aebdbe3411c14c6c1acb9a0caa9be6b8b07dd047ab14b50f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-03-16T10:56:12.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:12.548+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:12.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:12.548+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:12.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:12.730+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:12.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:12 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:12.730+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:13.032 INFO:journalctl@ceph.osd.4.smithi111.stdout:Mar 16 10:56:12 smithi111 podman[70653]: 2024-03-16 10:56:12.760340381 +0000 UTC m=+0.676169135 container died 445eeedc301c2240aebdbe3411c14c6c1acb9a0caa9be6b8b07dd047ab14b50f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-16T10:56:13.304 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:13.051+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:13.304 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:13.051+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:13.304 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:12.890+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:13.304 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:12 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:12.890+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:13.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:13 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:13.105+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:13.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:13 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:13.032+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:13.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:13 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:13.032+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:13.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.4.service' 2024-03-16T10:56:13.499 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:13.499 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-16T10:56:13.499 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-16T10:56:13.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.5 2024-03-16T10:56:13.562 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 systemd[1]: Stopping Ceph osd.5 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:13.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:13.303+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:13.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:13 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:13.540+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:13.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:13 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:13.540+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:13.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:13 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:13.753+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:13.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:13 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:13.753+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:13.906+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:13.906+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:13.811+0000 7f9c572b2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:13.811+0000 7f9c572b2700 -1 osd.5 90 *** Got signal Terminated *** 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:13 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:13.811+0000 7f9c572b2700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:14.024+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:14.063 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:14.024+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:14.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:14.112+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:14.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:14.075+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:14.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:14 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:14.075+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:14.562 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:14.270+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:14.801 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:14.542+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:14.801 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:14.542+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:15.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:14.801+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:15.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:14.801+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:15.299 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:15.001+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:15.299 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:15.001+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:15.300 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:14.885+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:15.300 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:14 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:14.885+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:15.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:15 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:15.099+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:15.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:15 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:15.079+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:15.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:15 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:15.079+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:15.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:15.299+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:15.827 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:15 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:15.532+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:15.827 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:15 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:15.532+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:16.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:15 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:15.827+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:16.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:15 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:15.827+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:15.913+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:15.913+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:15 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:15.913+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:16.016+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:16.016+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:16.297 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:16.016+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:49.133858+0000 front 2024-03-16T10:55:49.133903+0000 (oldest deadline 2024-03-16T10:56:15.034045+0000) 2024-03-16T10:56:16.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:16 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:16.148+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:16.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:16 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:16.148+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:16.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:16 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:16.129+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:16.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:16 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:16.129+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:16.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:16.296+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:16.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:16.296+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:16.814 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:16.557+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:16.814 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:16.557+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:16.814 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:16.557+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:17.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:16.814+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:17.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:16 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:16.814+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:17.273 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:16.957+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:17.273 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:16.957+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:17.273 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:16 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:16.957+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:17.274 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:17.055+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:17.274 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:17.055+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:17.274 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:17.055+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:49.133858+0000 front 2024-03-16T10:55:49.133903+0000 (oldest deadline 2024-03-16T10:56:15.034045+0000) 2024-03-16T10:56:17.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:17.127+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:17.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:17.127+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:17.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:17.098+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:17.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:17.098+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:17.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:17 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:17.098+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:17.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:17.272+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:17.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:17.272+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:17.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:17.571+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:17.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:17.571+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:17.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:17.571+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:18.057+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.232085+0000 front 2024-03-16T10:55:36.232072+0000 (oldest deadline 2024-03-16T10:56:00.932108+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:18.057+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.233257+0000 front 2024-03-16T10:55:46.233335+0000 (oldest deadline 2024-03-16T10:56:09.133347+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5[48203]: 2024-03-16T10:56:18.057+0000 7f9c4f89e700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:49.133858+0000 front 2024-03-16T10:55:49.133903+0000 (oldest deadline 2024-03-16T10:56:15.034045+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:17.954+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:17.954+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:18.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:17 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:17.954+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:18.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:17.841+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:18.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:17.841+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:18.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:17 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:17.841+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:18.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:18 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:18.102+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:18.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:18 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:18.102+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:18.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:18 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:18.126+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:18.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:18 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:18.126+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:18.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:18 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:18.126+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:18.812 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:18.321+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:18.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:18.321+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:19.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:18.595+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:19.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:18.595+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:19.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:18.595+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:19.091 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:18.796+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:19.091 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:18.796+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:19.091 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:18.796+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:19.298 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:18.982+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:19.298 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:18.982+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:19.298 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:18 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:18.982+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:19.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:19 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:19.130+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:19.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:19 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:19.130+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:19.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:19 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:19.108+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:19.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:19 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:19.108+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:19.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:19 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:19.108+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:19.563 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:19 smithi174 podman[71138]: 2024-03-16 10:56:19.339661377 +0000 UTC m=+5.651483595 container died d120606af1a59f7128826aaf6ab5fe2e04c46e756607b18da5ad92f13b8df64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2) 2024-03-16T10:56:19.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:19.297+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:19.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:19.297+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:19.569+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:19.569+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:19.569+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:19.784+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:19.784+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:19.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:19 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:19.784+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:19.965 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:19 smithi174 podman[71138]: 2024-03-16 10:56:19.729364774 +0000 UTC m=+6.041187002 container cleanup d120606af1a59f7128826aaf6ab5fe2e04c46e756607b18da5ad92f13b8df64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-16T10:56:19.965 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:19 smithi174 bash[71138]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5 2024-03-16T10:56:20.289 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71159]: 2024-03-16 10:56:20.005890176 +0000 UTC m=+0.661117146 container remove d120606af1a59f7128826aaf6ab5fe2e04c46e756607b18da5ad92f13b8df64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:56:20.290 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:19.964+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:20.290 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:19.964+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:20.290 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:19 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:19.964+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:20.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:20 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:20.090+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:20.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:20 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:20.090+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:20.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:20 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:20.118+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:20.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:20 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:20.118+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:20.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:20 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:20.118+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:20.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:20 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:20.289+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:20.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:20 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:20.289+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:20.563 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.245492435 +0000 UTC m=+0.017673674 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:20.563 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.35680507 +0000 UTC m=+0.128986342 container create 6c716655aa5090f2c47b2c2ae3f146eaae10bed195573a466e0dbf65aad1ccd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:56:20.919 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.635122259 +0000 UTC m=+0.407303498 container init 6c716655aa5090f2c47b2c2ae3f146eaae10bed195573a466e0dbf65aad1ccd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS) 2024-03-16T10:56:20.919 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.638472229 +0000 UTC m=+0.410653477 container start 6c716655aa5090f2c47b2c2ae3f146eaae10bed195573a466e0dbf65aad1ccd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T10:56:20.919 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.751199636 +0000 UTC m=+0.523380880 container attach 6c716655aa5090f2c47b2c2ae3f146eaae10bed195573a466e0dbf65aad1ccd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:20.607+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:20.607+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:20.607+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:20.817+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:20.817+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:21.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:20 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:20.817+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:21.280 INFO:journalctl@ceph.osd.5.smithi174.stdout:Mar 16 10:56:20 smithi174 podman[71251]: 2024-03-16 10:56:20.918740411 +0000 UTC m=+0.690921637 container died 6c716655aa5090f2c47b2c2ae3f146eaae10bed195573a466e0dbf65aad1ccd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307) 2024-03-16T10:56:21.280 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:21.001+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:21.280 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:21.001+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:21.280 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:21.001+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:21.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:21.111+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:21.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:21.111+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:21.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:21.076+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:21.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:21.076+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:21.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:21 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:21.076+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:21.562 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:21.279+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:21.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:21 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:21.279+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:21.611 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.5.service' 2024-03-16T10:56:21.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:21.652 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-16T10:56:21.652 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-16T10:56:21.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.6 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 systemd[1]: Stopping Ceph osd.6 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:21.807+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:21.807+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:21.975 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:21.807+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:22.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:22 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:22.231+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:22.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:22 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:22.231+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:22.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:22 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:22.051+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:22.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:22 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:22.051+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:22.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:22 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:22.051+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:22.340 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.974+0000 7f8976cc5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:22.340 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.974+0000 7f8976cc5700 -1 osd.6 90 *** Got signal Terminated *** 2024-03-16T10:56:22.340 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:21 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:21.974+0000 7f8976cc5700 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:22.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:22 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:22.077+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:22.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:22 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:22.077+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:22.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:22 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:22.092+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:22.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:22 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:22.092+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:22.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:22 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:22.092+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:22.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:22.576+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:22.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:22.576+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:22.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:22.576+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:22.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:22.812+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:22.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:22.812+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:22.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:22.812+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:23.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:23 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:23.186+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:23.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:23 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:23.186+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:23.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:23 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:23.029+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:23.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:23 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:23.029+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:23.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:23 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:23.029+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:23.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:23 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:23.081+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:23.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:23 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:23.081+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:23.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:23 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:23.081+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:23.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:23 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:23.081+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:23.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:23 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:23.081+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:24.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:23.620+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:24.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:23.620+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:24.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:23.620+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:24.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:23.822+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:24.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:23.822+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:24.091 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:23 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:23.822+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:24.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:24 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:24.229+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:24.313 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:24 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:24.229+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:24.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:24 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:24.023+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:24.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:24 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:24.023+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:24.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:24 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:24.023+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:24.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:24.044+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:24.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:24.044+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:24.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:24.044+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:24.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:24.087+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:24.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:24.087+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:24.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:24 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:24.087+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:24.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:24.572+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:24.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:24.572+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:24.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:24.572+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:24.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:24.806+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:24.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:24.806+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:24.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:24.806+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:24.841 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:24 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:24.806+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:25.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:25.059+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:25.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:25.059+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:25.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:25.059+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:25.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:25.058+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:25.413 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:25.058+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:25.413 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:25.058+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:25.413 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:25 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:25.058+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:25.485 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:25 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:25.266+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:25.485 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:25 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:25.266+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:25.485 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:25 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:25.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:25.485 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:25 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:25.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:25.485 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:25 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:25.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:25.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:25.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:25.600+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:25.798+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:25.798+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:25.798+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:26.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:25 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:25.798+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:26.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:26.052+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:26.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:26.052+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:26.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:26.052+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:26.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:26.077+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:26.077+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:26.077+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.019+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.019+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.019+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:26.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.019+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:26.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:26.315+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:26.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:26.315+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:26.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:26 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:26.315+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:26.845 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:26.592+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:34.436242+0000 front 2024-03-16T10:55:34.436298+0000 (oldest deadline 2024-03-16T10:56:00.236882+0000) 2024-03-16T10:56:26.845 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:26.592+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.038697+0000 front 2024-03-16T10:55:46.038758+0000 (oldest deadline 2024-03-16T10:56:08.338832+0000) 2024-03-16T10:56:26.845 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:26.592+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.540929+0000 front 2024-03-16T10:55:53.540992+0000 (oldest deadline 2024-03-16T10:56:15.840640+0000) 2024-03-16T10:56:26.845 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6[59899]: 2024-03-16T10:56:26.592+0000 7f896f2b1700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.342820+0000 front 2024-03-16T10:56:00.342849+0000 (oldest deadline 2024-03-16T10:56:25.643029+0000) 2024-03-16T10:56:27.312 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:27.024+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:27.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:27.024+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:27.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:27.024+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:27.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:26.844+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:27.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:26.844+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:27.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:26.844+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:27.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:26 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:26.844+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:27.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:27.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:27.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:27.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:27.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:27.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:27.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.976+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:27.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.976+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:27.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.976+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:27.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:26 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:26.976+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:27.792 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:27 smithi017 podman[92159]: 2024-03-16 10:56:27.519556934 +0000 UTC m=+5.674980248 container died 203a5149ac2c492f3bd454fd18fd2e9b2f1086405bace5b6a3f513411ffe51db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6, GIT_CLEAN=True, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-16T10:56:27.812 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:27.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:27.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:27.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:27.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:27 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:27.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:27 smithi017 podman[92159]: 2024-03-16 10:56:27.891244397 +0000 UTC m=+6.046667712 container cleanup 203a5149ac2c492f3bd454fd18fd2e9b2f1086405bace5b6a3f513411ffe51db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:27 smithi017 bash[92159]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:27 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:27.891+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:27 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:27.891+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:27 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:27.891+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:28.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:27 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:27.891+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:28.343 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:28.069+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:28.343 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:28.069+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:28.344 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:28.069+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:28.079+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:28.079+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:28.079+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:27.980+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:27.980+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:27.980+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:28.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:27.980+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:28.560 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92177]: 2024-03-16 10:56:28.20963644 +0000 UTC m=+0.685935957 container remove 203a5149ac2c492f3bd454fd18fd2e9b2f1086405bace5b6a3f513411ffe51db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-03-16T10:56:28.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:28.343+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:28.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:28.343+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:28.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:28 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:28.343+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:28.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92271]: 2024-03-16 10:56:28.463008037 +0000 UTC m=+0.017684208 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:28.840 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92271]: 2024-03-16 10:56:28.568798236 +0000 UTC m=+0.123474438 container create fbb43fdea7e60f651bad32bd29c2ef1411ce366f2dff361c954f2857b2391eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6-deactivate, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True, org.label-schema.vendor=CentOS) 2024-03-16T10:56:29.229 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:28 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:28.893+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:29.229 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:28 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:28.893+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:29.230 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:28 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:28.893+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:29.230 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:28 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:28.893+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:29.230 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92271]: 2024-03-16 10:56:28.92963764 +0000 UTC m=+0.484313815 container init fbb43fdea7e60f651bad32bd29c2ef1411ce366f2dff361c954f2857b2391eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6-deactivate, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-16T10:56:29.230 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92271]: 2024-03-16 10:56:28.932701773 +0000 UTC m=+0.487377941 container start fbb43fdea7e60f651bad32bd29c2ef1411ce366f2dff361c954f2857b2391eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307) 2024-03-16T10:56:29.230 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:28 smithi017 podman[92271]: 2024-03-16 10:56:28.996035659 +0000 UTC m=+0.550711818 container attach fbb43fdea7e60f651bad32bd29c2ef1411ce366f2dff361c954f2857b2391eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-16T10:56:29.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:29 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:29.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:29 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:29.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:29 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:29.036+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:28.986+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:28.986+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:28.986+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:29.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:28 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:28.986+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:29.517 INFO:journalctl@ceph.osd.6.smithi017.stdout:Mar 16 10:56:29 smithi017 podman[92271]: 2024-03-16 10:56:29.229791201 +0000 UTC m=+0.784467367 container died fbb43fdea7e60f651bad32bd29c2ef1411ce366f2dff361c954f2857b2391eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-6-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:29.083+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:29.083+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:29.083+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:29.299+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:29.299+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:29.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:29 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:29.299+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:29.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.6.service' 2024-03-16T10:56:29.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:29.928 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-16T10:56:29.928 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-16T10:56:29.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.7 2024-03-16T10:56:30.243 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:30.012+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:30.243 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:30.012+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:30.243 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:30.012+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:30.243 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:30.012+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:30.243 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:29 smithi111 systemd[1]: Stopping Ceph osd.7 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.009+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.009+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.009+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.241+0000 7f1ebcb4d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.241+0000 7f1ebcb4d700 -1 osd.7 90 *** Got signal Terminated *** 2024-03-16T10:56:30.244 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.241+0000 7f1ebcb4d700 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:30.312 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:30.041+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:30.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:30.041+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:30.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:30.041+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:30.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:29.923+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:30.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:29.923+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:30.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:29.923+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:30.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:29 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:29.923+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:30.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:30.344+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:30.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:30.344+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:30.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:30 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:30.344+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:31.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.010+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:31.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.010+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:31.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.010+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:31.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:30 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:30.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:31.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:30 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:30.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:31.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:30 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:30.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:31.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:30 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:30.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:31.414 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.974+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:31.414 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.974+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:31.414 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:30.974+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:31.415 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:31.036+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:31.415 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:31.036+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:31.415 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:31.036+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:31.415 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:31.036+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:31.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:31.381+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:31.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:31.381+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:31.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:31.381+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:32.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.994+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:32.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.994+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:32.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.994+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:32.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:31 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:31.994+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:32.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:31 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:31.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:32.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:31 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:31.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:32.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:31 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:31.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:32.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:31 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:31.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:32.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:32 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:32.054+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:32 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:32.054+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:32 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:32.054+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:32 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:32.054+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:31.975+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:31.975+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:32.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:31 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:31.975+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:32.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:32.359+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:33.058 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:32.359+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:33.058 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:32.359+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:33.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:32.985+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:33.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:32.985+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:33.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:32.985+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:33.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:32 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:32.985+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:33.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:32 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:32.972+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:33.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:32 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:32.972+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:33.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:32 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:32.972+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:33.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:32 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:32.972+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:33.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:33.007+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:33.007+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:33.007+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:33.007+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.661931+0000 front 2024-03-16T10:56:08.661954+0000 (oldest deadline 2024-03-16T10:56:32.162049+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:33.068+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:33.068+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:33.068+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:33.068+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:33.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:33 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:33.068+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:33.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:33 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:33.370+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:33.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:33 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:33.370+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:33.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:33 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:33.370+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:33.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:33 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:33.370+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:34.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:34.025+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:34.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:34.025+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:34.314 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:34.025+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:34.314 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:34.025+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:34.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:33.965+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:34.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:33.965+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:34.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:33.965+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:34.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:33 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:33.965+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:34.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:34.028+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:34.028+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:34.028+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:34.028+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.661931+0000 front 2024-03-16T10:56:08.661954+0000 (oldest deadline 2024-03-16T10:56:32.162049+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:34.040+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:34.040+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:34.040+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:34.040+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:34.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:34.040+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:34.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:34.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:34.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:34.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:34.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:34.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:34.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:34 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:34.331+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:35.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:35.054+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:35.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:35.054+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:35.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:35.054+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:35.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:35.054+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:35.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:34.996+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:35.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:34.996+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:35.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:34.996+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:35.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:34.996+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:35.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:34 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:34.996+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:35.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:35.021+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.357669+0000 front 2024-03-16T10:55:45.357647+0000 (oldest deadline 2024-03-16T10:56:10.057741+0000) 2024-03-16T10:56:35.411 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:35.021+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.159024+0000 front 2024-03-16T10:55:51.159099+0000 (oldest deadline 2024-03-16T10:56:15.859087+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:35.021+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.660947+0000 front 2024-03-16T10:56:01.660960+0000 (oldest deadline 2024-03-16T10:56:23.960965+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7[54605]: 2024-03-16T10:56:35.021+0000 7f1eb5139700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.661931+0000 front 2024-03-16T10:56:08.661954+0000 (oldest deadline 2024-03-16T10:56:32.162049+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:35.043+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:35.043+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:35.043+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:35.043+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:35.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:35 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:35.043+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:35.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:35.353+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:35.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:35.353+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:35.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:35.353+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:35.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:35 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:35.353+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:35.911 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:35 smithi111 podman[70759]: 2024-03-16 10:56:35.651641733 +0000 UTC m=+5.531377736 container died c2154d251f836c0a606b02076a50ff31a9fa45825cec99cb69676a5f563b919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-16T10:56:36.301 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70759]: 2024-03-16 10:56:36.00038479 +0000 UTC m=+5.880120790 container cleanup c2154d251f836c0a606b02076a50ff31a9fa45825cec99cb69676a5f563b919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-16T10:56:36.301 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 bash[70759]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7 2024-03-16T10:56:36.302 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:36 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:36.088+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:36.302 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:36 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:36.088+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:36.302 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:36 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:36.088+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:36.302 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:36 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:36.088+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:36.302 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:36 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:36.088+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:36.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:36.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:36.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:36.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:36.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:36.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:36.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:36.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:36.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:35.984+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:36.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:35.984+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:36.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:35.984+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:36.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:35.984+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:36.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:35 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:35.984+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:36.622 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70789]: 2024-03-16 10:56:36.301543554 +0000 UTC m=+0.648150809 container remove c2154d251f836c0a606b02076a50ff31a9fa45825cec99cb69676a5f563b919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, ceph=True) 2024-03-16T10:56:36.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:36.354+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:36.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:36.354+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:36.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:36.354+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:36.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:36 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:36.354+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:36.888 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70882]: 2024-03-16 10:56:36.525735148 +0000 UTC m=+0.017538131 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:36.888 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70882]: 2024-03-16 10:56:36.652695622 +0000 UTC m=+0.144498601 container create 2c2773f0d94814e25310bc4bff585b2554ab613d859ce5f648ac7d0c9aabb005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-16T10:56:36.888 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70882]: 2024-03-16 10:56:36.888586346 +0000 UTC m=+0.380389334 container init 2c2773f0d94814e25310bc4bff585b2554ab613d859ce5f648ac7d0c9aabb005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70882]: 2024-03-16 10:56:36.891915424 +0000 UTC m=+0.383718400 container start 2c2773f0d94814e25310bc4bff585b2554ab613d859ce5f648ac7d0c9aabb005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:36 smithi111 podman[70882]: 2024-03-16 10:56:36.997281178 +0000 UTC m=+0.489084177 container attach 2c2773f0d94814e25310bc4bff585b2554ab613d859ce5f648ac7d0c9aabb005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:37 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:37.072+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:37 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:37.072+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:37 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:37.072+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:37 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:37.072+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:37.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:37 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:37.072+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:37.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:36.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:37.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:36.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:37.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:36.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:37.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:36.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:37.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:36 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:36.958+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:37.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:37.107+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:37.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:37.107+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:37.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:37.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:37.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:37.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:37.491 INFO:journalctl@ceph.osd.7.smithi111.stdout:Mar 16 10:56:37 smithi111 podman[70882]: 2024-03-16 10:56:37.183050083 +0000 UTC m=+0.674853072 container died 2c2773f0d94814e25310bc4bff585b2554ab613d859ce5f648ac7d0c9aabb005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-16T10:56:37.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:37.378+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:37.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:37.378+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:37.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:37.378+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:37.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:37 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:37.378+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:37.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.7.service' 2024-03-16T10:56:37.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:37.871 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-16T10:56:37.871 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-16T10:56:37.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.8 2024-03-16T10:56:38.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:38.049+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:38.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:38.049+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:38.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:38.049+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:38.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:38.049+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:38.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:38.049+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:38.193 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:37 smithi174 systemd[1]: Stopping Ceph osd.8 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:38.193 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:38.116+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:38.193 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:38.116+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:38.193 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:38.116+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:38.193 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:38.116+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:38.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:37.929+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:38.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:37.929+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:38.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:37.929+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:38.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:37.929+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:38.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:37 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:37.929+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.191+0000 7feb20c47700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.191+0000 7feb20c47700 -1 osd.8 90 *** Got signal Terminated *** 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.191+0000 7feb20c47700 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.416+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.416+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.416+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:38.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:38 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:38.416+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:39.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:38.973+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:39.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:38.973+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:39.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:38.973+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:39.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:38.973+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:39.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:38 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:38.973+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:39.397 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:39.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:39.397 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:39.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:39.397 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:39.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:39.397 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:39.084+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:39.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:39 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:39.027+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:39.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:39 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:39.027+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:39.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:39 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:39.027+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:39.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:39 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:39.027+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:39.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:39 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:39.027+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:39.812 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:39.396+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:39.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:39.396+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:39.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:39.396+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:39.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:39 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:39.396+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:40.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:39 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:39.969+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:40.388 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:40.087+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:40.388 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:40.087+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:40.388 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:40.087+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:40.388 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:40.087+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:40.388 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:40.087+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:40.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:40.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:40.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:40.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:40.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:40.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:40.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:40.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:40.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:40 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:40.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:40.812 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:40.388+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:40.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:40.388+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:40.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:40.388+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:40.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:40 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:40.388+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:41.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:41.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:41.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:41.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:41.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:41.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:40 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:40.945+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:41.362 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:41.071+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:41.362 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:41.071+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:41.362 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:41.071+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:41.362 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:41.071+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:41.362 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:41.071+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:41.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:41.046+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:41.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:41.046+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:41.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:41.046+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:41.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:41.046+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:41.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:41 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:41.046+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:41.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:41.362+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:41.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:41.362+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:41.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:41.362+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:41.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:41.362+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:41.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:41 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:41.362+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:15.711405+0000 front 2024-03-16T10:56:15.711438+0000 (oldest deadline 2024-03-16T10:56:41.011527+0000) 2024-03-16T10:56:42.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:42.050+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:42.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:42.050+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:42.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:42.050+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:42.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:42.050+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:42.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:42.050+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:42.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:41 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:41.951+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:42.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:42 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:42.020+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:42.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:42 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:42.020+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:42.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:42 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:42.020+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:42.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:42 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:42.020+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:42.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:42 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:42.020+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:42.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:42.385+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.806928+0000 front 2024-03-16T10:55:44.806944+0000 (oldest deadline 2024-03-16T10:56:10.106825+0000) 2024-03-16T10:56:42.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:42.385+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:51.807976+0000 front 2024-03-16T10:55:51.807909+0000 (oldest deadline 2024-03-16T10:56:15.908035+0000) 2024-03-16T10:56:42.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:42.385+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:01.109587+0000 front 2024-03-16T10:56:01.109579+0000 (oldest deadline 2024-03-16T10:56:25.809487+0000) 2024-03-16T10:56:42.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:42.385+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:08.110570+0000 front 2024-03-16T10:56:08.110560+0000 (oldest deadline 2024-03-16T10:56:32.810515+0000) 2024-03-16T10:56:42.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8[54786]: 2024-03-16T10:56:42.385+0000 7feb1d23b700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:15.711405+0000 front 2024-03-16T10:56:15.711438+0000 (oldest deadline 2024-03-16T10:56:41.011527+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:43.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:42 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:42.916+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:43.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:43 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:43.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:43.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:43 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:43.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:43.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:43 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:43.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:43.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:43 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:43.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:43.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:43 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:43.002+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:43.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:43 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:43.069+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:43.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:43 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:43.070+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:43.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:43 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:43.070+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:43.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:43 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:43.070+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:43.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:43 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:43.070+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:43.925 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:43 smithi174 podman[71369]: 2024-03-16 10:56:43.659390629 +0000 UTC m=+5.591692928 container died 16f8c34547bc1145f1e36632460c686497a2d2212a11c6d66708d27706bf75e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71369]: 2024-03-16 10:56:44.024940031 +0000 UTC m=+5.957242322 container cleanup 16f8c34547bc1145f1e36632460c686497a2d2212a11c6d66708d27706bf75e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8, org.label-schema.build-date=20240307, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 bash[71369]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:44 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:44.065+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:44 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:44.065+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:44 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:44.065+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:44.301 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:44 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:44.065+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:44.302 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:44 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:44.065+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:44.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:44.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:44.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:44.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:44.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:44.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:43 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:43.930+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:44.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:44.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:44.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:44.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:44.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:44.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:44 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:44.047+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:44.563 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71387]: 2024-03-16 10:56:44.301185434 +0000 UTC m=+0.636865562 container remove 16f8c34547bc1145f1e36632460c686497a2d2212a11c6d66708d27706bf75e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-16T10:56:44.888 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71481]: 2024-03-16 10:56:44.540675222 +0000 UTC m=+0.018017631 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:44.888 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71481]: 2024-03-16 10:56:44.669013955 +0000 UTC m=+0.146356349 container create 878cbfd62d56f7d7dabf566f0265c8649cd90ac79591f354391aac56bd4a4fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-16T10:56:45.183 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71481]: 2024-03-16 10:56:44.887953821 +0000 UTC m=+0.365296238 container init 878cbfd62d56f7d7dabf566f0265c8649cd90ac79591f354391aac56bd4a4fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-03-16T10:56:45.183 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71481]: 2024-03-16 10:56:44.89134583 +0000 UTC m=+0.368688221 container start 878cbfd62d56f7d7dabf566f0265c8649cd90ac79591f354391aac56bd4a4fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8-deactivate, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux ) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:44 smithi174 podman[71481]: 2024-03-16 10:56:44.987885699 +0000 UTC m=+0.465228111 container attach 878cbfd62d56f7d7dabf566f0265c8649cd90ac79591f354391aac56bd4a4fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:45 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:45.055+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:45 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:45.055+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:45 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:45.055+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:45 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:45.055+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:45.184 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:45 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:45.055+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:45.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:44 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:44.979+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:45.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:45.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:45.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:45.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:45.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:45.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:45 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:45.056+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:45.448 INFO:journalctl@ceph.osd.8.smithi174.stdout:Mar 16 10:56:45 smithi174 podman[71481]: 2024-03-16 10:56:45.183645915 +0000 UTC m=+0.660988315 container died 878cbfd62d56f7d7dabf566f0265c8649cd90ac79591f354391aac56bd4a4fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-8-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-16T10:56:45.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.8.service' 2024-03-16T10:56:45.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:45.806 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-16T10:56:45.806 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-16T10:56:45.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.9 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:45 smithi017 systemd[1]: Stopping Ceph osd.9 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:46.090 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.028+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:46.376 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:46.063+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:46.376 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:46.063+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:46.376 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:46.063+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:46.376 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:46.063+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:46.376 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:46.063+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:46.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:46.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:46.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:46.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:46.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:46.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:46 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:46.060+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:46.590 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.127+0000 7f6da6efb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:46.590 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.127+0000 7f6da6efb700 -1 osd.9 90 *** Got signal Terminated *** 2024-03-16T10:56:46.590 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.127+0000 7f6da6efb700 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:47.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:47.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:47.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:47.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:47.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:47.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:46 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:46.989+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:47.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:47.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:47.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:47.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:47.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:47.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:47 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:47.078+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:47.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:47 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:47.061+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:47.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:47 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:47.061+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:47.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:47 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:47.061+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:47.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:47 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:47.061+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:47.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:47 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:47.061+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:48.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:48.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:48.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:48.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:48.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:48.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:48.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:47 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:47.966+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:21.651298+0000 front 2024-03-16T10:56:21.651328+0000 (oldest deadline 2024-03-16T10:56:47.551622+0000) 2024-03-16T10:56:48.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:48.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:48.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:48.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:48.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:48.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:48 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:48.128+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:48.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:48 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:48.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:48.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:48 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:48.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:48.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:48 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:48.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:48.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:48 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:48.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:48.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:48 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:48.108+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:49.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:48 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:48.948+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:21.651298+0000 front 2024-03-16T10:56:21.651328+0000 (oldest deadline 2024-03-16T10:56:47.551622+0000) 2024-03-16T10:56:49.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:49.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:49 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:49.156+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:49.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:49.134+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:49.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:49.134+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:49.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:49.134+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:49.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:49.134+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:49.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:49 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:49.134+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:50.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:49 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:49.977+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:21.651298+0000 front 2024-03-16T10:56:21.651328+0000 (oldest deadline 2024-03-16T10:56:47.551622+0000) 2024-03-16T10:56:50.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:50.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:50.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:50.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:50.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:50.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:50.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:50 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:50.119+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:50.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:50.163+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:50.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:50.163+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:50.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:50.163+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:50.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:50.163+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:50.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:50.163+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:51.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:36.243936+0000 front 2024-03-16T10:55:36.243768+0000 (oldest deadline 2024-03-16T10:56:00.943938+0000) 2024-03-16T10:56:51.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:46.145882+0000 front 2024-03-16T10:55:46.145933+0000 (oldest deadline 2024-03-16T10:56:07.845856+0000) 2024-03-16T10:56:51.340 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:54.247565+0000 front 2024-03-16T10:55:54.247466+0000 (oldest deadline 2024-03-16T10:56:17.747579+0000) 2024-03-16T10:56:51.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:55:58.248419+0000 front 2024-03-16T10:55:58.248280+0000 (oldest deadline 2024-03-16T10:56:24.148464+0000) 2024-03-16T10:56:51.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:09.950126+0000 front 2024-03-16T10:56:09.950003+0000 (oldest deadline 2024-03-16T10:56:34.649965+0000) 2024-03-16T10:56:51.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:14.650483+0000 front 2024-03-16T10:56:14.650451+0000 (oldest deadline 2024-03-16T10:56:39.950483+0000) 2024-03-16T10:56:51.341 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:50 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9[66968]: 2024-03-16T10:56:50.952+0000 7f6da34ef700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:21.651298+0000 front 2024-03-16T10:56:21.651328+0000 (oldest deadline 2024-03-16T10:56:47.551622+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:51.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:51 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:51.187+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:51.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:51.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:51 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:51.167+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:51.854 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:51 smithi017 podman[92389]: 2024-03-16 10:56:51.59838568 +0000 UTC m=+5.596694806 container died c26de81707466442bca3789eeed3ce07115068a04e33530415cb79c88913e286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:56:52.112 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:51 smithi017 podman[92389]: 2024-03-16 10:56:51.944219775 +0000 UTC m=+5.942528903 container cleanup c26de81707466442bca3789eeed3ce07115068a04e33530415cb79c88913e286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307) 2024-03-16T10:56:52.112 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:51 smithi017 bash[92389]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9 2024-03-16T10:56:52.555 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92405]: 2024-03-16 10:56:52.112020234 +0000 UTC m=+0.512629056 container remove c26de81707466442bca3789eeed3ce07115068a04e33530415cb79c88913e286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:52.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:52 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:52.216+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:52.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:52.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:52 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:52.182+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:52.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92496]: 2024-03-16 10:56:52.458131663 +0000 UTC m=+0.017922071 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:56:52.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92496]: 2024-03-16 10:56:52.562802533 +0000 UTC m=+0.122592927 container create 8b85b39bd64251cc5d6bb6982fc29bfc5e16688f7e94aa08a5a21b70f5f8014e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD) 2024-03-16T10:56:52.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92496]: 2024-03-16 10:56:52.790649241 +0000 UTC m=+0.350439641 container init 8b85b39bd64251cc5d6bb6982fc29bfc5e16688f7e94aa08a5a21b70f5f8014e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-16T10:56:52.840 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92496]: 2024-03-16 10:56:52.793756713 +0000 UTC m=+0.353547103 container start 8b85b39bd64251cc5d6bb6982fc29bfc5e16688f7e94aa08a5a21b70f5f8014e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-16T10:56:53.094 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:52 smithi017 podman[92496]: 2024-03-16 10:56:52.88176884 +0000 UTC m=+0.441559245 container attach 8b85b39bd64251cc5d6bb6982fc29bfc5e16688f7e94aa08a5a21b70f5f8014e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-16T10:56:53.381 INFO:journalctl@ceph.osd.9.smithi017.stdout:Mar 16 10:56:53 smithi017 podman[92496]: 2024-03-16 10:56:53.094200977 +0000 UTC m=+0.653991359 container died 8b85b39bd64251cc5d6bb6982fc29bfc5e16688f7e94aa08a5a21b70f5f8014e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-16T10:56:53.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:53.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:53.155+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:53.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:53 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:53.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:53.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.9.service' 2024-03-16T10:56:53.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:56:53.722 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-16T10:56:53.722 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-16T10:56:53.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.10 2024-03-16T10:56:54.045 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:53 smithi111 systemd[1]: Stopping Ceph osd.10 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.044+0000 7f32f6212700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.044+0000 7f32f6212700 -1 osd.10 90 *** Got signal Terminated *** 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.044+0000 7f32f6212700 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:54.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:54 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:54.168+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:54.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:54.189+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:55.464 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:55.464 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:55.464 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:55.464 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:55.464 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:55.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:55 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:55.142+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:55.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:55.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:55 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:55.213+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:56.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:56 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:56.102+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:56.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:56 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:56.177+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:57.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:57 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:57.113+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:56:57.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:57.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:57.661 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:57.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:57.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:57.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:57.662 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:57 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:57.169+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:58.411 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:38.200905+0000 front 2024-03-16T10:55:38.201115+0000 (oldest deadline 2024-03-16T10:56:01.101028+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:45.702805+0000 front 2024-03-16T10:55:45.702837+0000 (oldest deadline 2024-03-16T10:56:09.202924+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:53.303719+0000 front 2024-03-16T10:55:53.303685+0000 (oldest deadline 2024-03-16T10:56:16.803810+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-03-16T10:56:00.606425+0000 front 2024-03-16T10:56:00.606410+0000 (oldest deadline 2024-03-16T10:56:24.706467+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:10.007572+0000 front 2024-03-16T10:56:10.007599+0000 (oldest deadline 2024-03-16T10:56:32.907728+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.208842+0000 front 2024-03-16T10:56:18.208822+0000 (oldest deadline 2024-03-16T10:56:43.508654+0000) 2024-03-16T10:56:58.412 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:58 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10[61594]: 2024-03-16T10:56:58.127+0000 7f32ee7fe700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:23.509357+0000 front 2024-03-16T10:56:23.509480+0000 (oldest deadline 2024-03-16T10:56:48.209269+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:58.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:58 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:58.073+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:56:59.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:56:59 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:56:59.080+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:56:59.820 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:59 smithi111 podman[70986]: 2024-03-16 10:56:59.53045879 +0000 UTC m=+5.614694002 container died dab26ef0a8e45f47cd230972a15161b4af5af02c13b752a1c0910bd51d93d069 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:57:00.161 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:59 smithi111 podman[70986]: 2024-03-16 10:56:59.919813374 +0000 UTC m=+6.004048579 container cleanup dab26ef0a8e45f47cd230972a15161b4af5af02c13b752a1c0910bd51d93d069 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-16T10:57:00.161 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:56:59 smithi111 bash[70986]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10 2024-03-16T10:57:00.463 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71004]: 2024-03-16 10:57:00.162383949 +0000 UTC m=+0.632995694 container remove dab26ef0a8e45f47cd230972a15161b4af5af02c13b752a1c0910bd51d93d069 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:00.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:00 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:00.066+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:00.732 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.463189757 +0000 UTC m=+0.098726897 container create 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-16T10:57:00.732 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.381810935 +0000 UTC m=+0.017348097 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:57:00.732 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.657697181 +0000 UTC m=+0.293234338 container init 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:57:00.732 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.661072407 +0000 UTC m=+0.296609563 container start 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-16T10:57:00.732 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.73213811 +0000 UTC m=+0.367675267 container attach 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=) 2024-03-16T10:57:01.162 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:00 smithi111 podman[71100]: 2024-03-16 10:57:00.94475443 +0000 UTC m=+0.580291569 container died 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:57:01.466 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.10.service' 2024-03-16T10:57:01.490 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:01 smithi111 podman[71125]: 2024-03-16 10:57:01.443935768 +0000 UTC m=+0.490893680 container remove 52bcfbebc2cfa83dd58b57f97a259d1d867ce97af2e2313b74a8f9c173af4040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-10-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:57:01.490 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:01 smithi111 systemd[1]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.10.service: Deactivated successfully. 2024-03-16T10:57:01.490 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:01 smithi111 systemd[1]: Stopped Ceph osd.10 for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:57:01.490 INFO:journalctl@ceph.osd.10.smithi111.stdout:Mar 16 10:57:01 smithi111 systemd[1]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.10.service: Consumed 25.141s CPU time. 2024-03-16T10:57:01.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:01.505 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-16T10:57:01.505 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-16T10:57:01.505 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.11 2024-03-16T10:57:01.534 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:01.535 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.067+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:01.795 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 systemd[1]: Stopping Ceph osd.11 for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:01.795 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.792+0000 7f6c55f06700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:01.795 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.793+0000 7f6c55f06700 -1 osd.11 90 *** Got signal Terminated *** 2024-03-16T10:57:01.795 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:01 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:01.793+0000 7f6c55f06700 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:02.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:02 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:02.058+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:03.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:03 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:03.097+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:04.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:04 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:04.141+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:05.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:05 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:05.169+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-03-16T10:56:42.751594+0000 front 2024-03-16T10:56:42.751617+0000 (oldest deadline 2024-03-16T10:57:04.952236+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-03-16T10:55:37.540443+0000 front 2024-03-16T10:55:37.540564+0000 (oldest deadline 2024-03-16T10:55:59.840671+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6804 osd.1 since back 2024-03-16T10:55:44.343455+0000 front 2024-03-16T10:55:44.343573+0000 (oldest deadline 2024-03-16T10:56:07.243503+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-03-16T10:55:52.544561+0000 front 2024-03-16T10:55:52.544536+0000 (oldest deadline 2024-03-16T10:56:15.444782+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6812 osd.4 since back 2024-03-16T10:56:06.546968+0000 front 2024-03-16T10:56:06.546984+0000 (oldest deadline 2024-03-16T10:56:31.846881+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-03-16T10:56:18.248392+0000 front 2024-03-16T10:56:18.248140+0000 (oldest deadline 2024-03-16T10:56:39.948257+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-03-16T10:56:26.949808+0000 front 2024-03-16T10:56:26.949845+0000 (oldest deadline 2024-03-16T10:56:50.449661+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.111:6820 osd.7 since back 2024-03-16T10:56:30.950583+0000 front 2024-03-16T10:56:30.950624+0000 (oldest deadline 2024-03-16T10:56:56.850579+0000) 2024-03-16T10:57:06.563 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:06 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11[61413]: 2024-03-16T10:57:06.172+0000 7f6c524fa700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-03-16T10:56:42.751594+0000 front 2024-03-16T10:56:42.751617+0000 (oldest deadline 2024-03-16T10:57:04.952236+0000) 2024-03-16T10:57:07.361 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:07 smithi174 podman[71603]: 2024-03-16 10:57:07.110526159 +0000 UTC m=+5.412272286 container died da516dc2e8d30731736c95f55b50e16b5dae6448fbb901e66b3e0132c99fee81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b) 2024-03-16T10:57:07.744 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:07 smithi174 podman[71603]: 2024-03-16 10:57:07.460088294 +0000 UTC m=+5.761834399 container cleanup da516dc2e8d30731736c95f55b50e16b5dae6448fbb901e66b3e0132c99fee81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_CLEAN=True) 2024-03-16T10:57:07.744 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:07 smithi174 bash[71603]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11 2024-03-16T10:57:08.058 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:07 smithi174 podman[71623]: 2024-03-16 10:57:07.744487357 +0000 UTC m=+0.633391849 container remove da516dc2e8d30731736c95f55b50e16b5dae6448fbb901e66b3e0132c99fee81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240307) 2024-03-16T10:57:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:07.962213109 +0000 UTC m=+0.017825579 image pull be86dc8cb22b274cd03b7f0beb3c2008b61e12c6812f73ca001a16ae92cb3dae quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513 2024-03-16T10:57:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:08.061844888 +0000 UTC m=+0.117457377 container create 0098c476791d4cd44739c6a4cd17587d46424b63126a177f01d15bf6e796329d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-16T10:57:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:08.289049442 +0000 UTC m=+0.344661897 container init 0098c476791d4cd44739c6a4cd17587d46424b63126a177f01d15bf6e796329d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:57:08.313 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:08.292627396 +0000 UTC m=+0.348239843 container start 0098c476791d4cd44739c6a4cd17587d46424b63126a177f01d15bf6e796329d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-16T10:57:08.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:08.405818885 +0000 UTC m=+0.461431358 container attach 0098c476791d4cd44739c6a4cd17587d46424b63126a177f01d15bf6e796329d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:57:08.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Mar 16 10:57:08 smithi174 podman[71713]: 2024-03-16 10:57:08.57671853 +0000 UTC m=+0.632330998 container died 0098c476791d4cd44739c6a4cd17587d46424b63126a177f01d15bf6e796329d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-16T10:57:09.141 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@osd.11.service' 2024-03-16T10:57:09.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:09.221 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-16T10:57:09.221 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-16T10:57:09.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.a 2024-03-16T10:57:09.590 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:09 smithi017 systemd[1]: Stopping Ceph mds.a for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:10.090 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:57:09.670+0000 7f1b2eaff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:10.090 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:09 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a[73523]: 2024-03-16T10:57:09.670+0000 7f1b2eaff700 -1 mds.a *** got signal Terminated *** 2024-03-16T10:57:13.840 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:13 smithi017 podman[92618]: 2024-03-16 10:57:13.568440469 +0000 UTC m=+4.151955134 container died 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-03-16T10:57:14.152 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:13 smithi017 podman[92618]: 2024-03-16 10:57:13.937818917 +0000 UTC m=+4.521333581 container cleanup 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-16T10:57:14.152 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:13 smithi017 bash[92618]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a 2024-03-16T10:57:14.405 INFO:journalctl@ceph.mds.a.smithi017.stdout:Mar 16 10:57:14 smithi017 podman[92632]: 2024-03-16 10:57:14.255366021 +0000 UTC m=+0.681174838 container remove 0b95be7646ab9e9ea0c085eaea5490d47d6c0c2807703f5817965ac797600eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True) 2024-03-16T10:57:14.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.a.service' 2024-03-16T10:57:14.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:14.464 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-16T10:57:14.464 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-16T10:57:14.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.d 2024-03-16T10:57:14.734 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:14 smithi017 systemd[1]: Stopping Ceph mds.d for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:15.090 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d[72564]: 2024-03-16T10:57:14.799+0000 7f033b3df700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:15.090 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:14 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d[72564]: 2024-03-16T10:57:14.799+0000 7f033b3df700 -1 mds.d *** got signal Terminated *** 2024-03-16T10:57:17.716 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:17 smithi017 podman[92740]: 2024-03-16 10:57:17.404627356 +0000 UTC m=+2.711004467 container died 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:57:17.716 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:17 smithi017 podman[92740]: 2024-03-16 10:57:17.716205509 +0000 UTC m=+3.022582623 container cleanup 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:57:18.030 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:17 smithi017 bash[92740]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d 2024-03-16T10:57:18.030 INFO:journalctl@ceph.mds.d.smithi017.stdout:Mar 16 10:57:17 smithi017 podman[92754]: 2024-03-16 10:57:17.930438593 +0000 UTC m=+0.526210203 container remove 68d2d9d0c98bedd49d890589e23bcb61ad446cfbd136102940d1ba100c376191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-16T10:57:18.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.d.service' 2024-03-16T10:57:18.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:18.085 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-16T10:57:18.086 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-16T10:57:18.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.g 2024-03-16T10:57:18.340 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:18 smithi017 systemd[1]: Stopping Ceph mds.g for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:18.841 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: 2024-03-16T10:57:18.423+0000 7f3cb0496700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:18.842 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:18 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g[73165]: 2024-03-16T10:57:18.423+0000 7f3cb0496700 -1 mds.g *** got signal Terminated *** 2024-03-16T10:57:21.840 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:21 smithi017 podman[92861]: 2024-03-16 10:57:21.5627186 +0000 UTC m=+3.259722709 container died 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0) 2024-03-16T10:57:22.180 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:21 smithi017 podman[92861]: 2024-03-16 10:57:21.841053905 +0000 UTC m=+3.538058014 container cleanup 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-16T10:57:22.180 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:21 smithi017 bash[92861]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g 2024-03-16T10:57:22.180 INFO:journalctl@ceph.mds.g.smithi017.stdout:Mar 16 10:57:22 smithi017 podman[92875]: 2024-03-16 10:57:22.058885241 +0000 UTC m=+0.488289842 container remove 5dad0ff0304c957c2ee5dbb76f740d50d62d7a439c848973cda859418ccb8f3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-g, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-16T10:57:22.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.g.service' 2024-03-16T10:57:22.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:22.237 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-16T10:57:22.237 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-16T10:57:22.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.j 2024-03-16T10:57:22.562 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:22 smithi017 systemd[1]: Stopping Ceph mds.j for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:22.840 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j[72174]: 2024-03-16T10:57:22.561+0000 7f77e3ff9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:22.840 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:22 smithi017 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j[72174]: 2024-03-16T10:57:22.561+0000 7f77e3ff9700 -1 mds.j *** got signal Terminated *** 2024-03-16T10:57:26.841 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:26 smithi017 podman[92980]: 2024-03-16 10:57:26.571561428 +0000 UTC m=+4.114462043 container died db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-16T10:57:27.340 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:27 smithi017 podman[92980]: 2024-03-16 10:57:27.052892376 +0000 UTC m=+4.595792989 container cleanup db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-16T10:57:27.340 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:27 smithi017 bash[92980]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j 2024-03-16T10:57:27.340 INFO:journalctl@ceph.mds.j.smithi017.stdout:Mar 16 10:57:27 smithi017 podman[92992]: 2024-03-16 10:57:27.295423332 +0000 UTC m=+0.718984748 container remove db13e56010fc95a8e5097398976259407eb65049dbe822b9d45f1f95126838da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-16T10:57:27.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.j.service' 2024-03-16T10:57:27.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:27.455 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-16T10:57:27.455 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-16T10:57:27.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.b 2024-03-16T10:57:27.745 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:27 smithi111 systemd[1]: Stopping Ceph mds.b for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:28.161 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:57:27.744+0000 7f21fd506700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:28.161 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:27 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b[66838]: 2024-03-16T10:57:27.744+0000 7f21fd506700 -1 mds.b *** got signal Terminated *** 2024-03-16T10:57:29.911 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:29 smithi111 podman[71215]: 2024-03-16 10:57:29.588585221 +0000 UTC m=+1.943079693 container died 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-16T10:57:30.328 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:30 smithi111 podman[71215]: 2024-03-16 10:57:30.069095587 +0000 UTC m=+2.423590060 container cleanup 1e259e6c336d774c7afbc6d383ad61df37a1cb9ce080c38684b19304be7dc0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-16T10:57:30.329 INFO:journalctl@ceph.mds.b.smithi111.stdout:Mar 16 10:57:30 smithi111 bash[71215]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-b 2024-03-16T10:57:30.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.b.service' 2024-03-16T10:57:30.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:30.519 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-16T10:57:30.519 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-16T10:57:30.519 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.e 2024-03-16T10:57:30.839 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:30 smithi111 systemd[1]: Stopping Ceph mds.e for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:31.161 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:57:30.838+0000 7ff0c2b33700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:31.161 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:30 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e[66224]: 2024-03-16T10:57:30.838+0000 7ff0c2b33700 -1 mds.e *** got signal Terminated *** 2024-03-16T10:57:33.898 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:33 smithi111 podman[71338]: 2024-03-16 10:57:33.58562457 +0000 UTC m=+2.850648806 container died 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-16T10:57:33.898 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:33 smithi111 podman[71338]: 2024-03-16 10:57:33.897761468 +0000 UTC m=+3.162785737 container cleanup 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-16T10:57:34.161 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:33 smithi111 bash[71338]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e 2024-03-16T10:57:34.161 INFO:journalctl@ceph.mds.e.smithi111.stdout:Mar 16 10:57:34 smithi111 podman[71364]: 2024-03-16 10:57:34.10713732 +0000 UTC m=+0.522656821 container remove 27bfb38bbbb0affe12a09648964ece463bace2e4458058ee14c2ded39c04cf97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0) 2024-03-16T10:57:34.324 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.e.service' 2024-03-16T10:57:34.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:34.362 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-16T10:57:34.362 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-16T10:57:34.363 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.h 2024-03-16T10:57:34.661 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:34 smithi111 systemd[1]: Stopping Ceph mds.h for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:35.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:57:34.687+0000 7fc5d1652700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:35.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:34 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h[66528]: 2024-03-16T10:57:34.687+0000 7fc5d1652700 -1 mds.h *** got signal Terminated *** 2024-03-16T10:57:37.902 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:37 smithi111 podman[71471]: 2024-03-16 10:57:37.579091409 +0000 UTC m=+3.005027081 container died 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-16T10:57:38.161 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:37 smithi111 podman[71471]: 2024-03-16 10:57:37.976097671 +0000 UTC m=+3.402033338 container cleanup 12094577a144899e8ead00f295e19813293a6d9404df51ce3f9f9d32cf8aa63f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-03-16T10:57:38.162 INFO:journalctl@ceph.mds.h.smithi111.stdout:Mar 16 10:57:37 smithi111 bash[71471]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-h 2024-03-16T10:57:38.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.h.service' 2024-03-16T10:57:38.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:38.379 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-16T10:57:38.379 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-16T10:57:38.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.k 2024-03-16T10:57:38.912 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:38 smithi111 systemd[1]: Stopping Ceph mds.k for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:38.912 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: 2024-03-16T10:57:38.704+0000 7f0fd1693700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:38.912 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:38 smithi111 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k[65902]: 2024-03-16T10:57:38.704+0000 7f0fd1693700 -1 mds.k *** got signal Terminated *** 2024-03-16T10:57:41.847 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:41 smithi111 podman[71593]: 2024-03-16 10:57:41.578313086 +0000 UTC m=+2.975251226 container died 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-16T10:57:42.161 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:41 smithi111 podman[71593]: 2024-03-16 10:57:41.929919634 +0000 UTC m=+3.326857763 container cleanup 5b199dc513b0a3d8bea3959131373efdcbce94e39f5275ac82cabefd03360ab7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-16T10:57:42.161 INFO:journalctl@ceph.mds.k.smithi111.stdout:Mar 16 10:57:41 smithi111 bash[71593]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-k 2024-03-16T10:57:42.404 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.k.service' 2024-03-16T10:57:42.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:42.437 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-16T10:57:42.438 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-16T10:57:42.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.c 2024-03-16T10:57:42.733 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:42 smithi174 systemd[1]: Stopping Ceph mds.c for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:42.989 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: 2024-03-16T10:57:42.732+0000 7f75fefd0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:42.990 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:42 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c[66860]: 2024-03-16T10:57:42.732+0000 7f75fefd0700 -1 mds.c *** got signal Terminated *** 2024-03-16T10:57:45.833 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:45 smithi174 podman[71817]: 2024-03-16 10:57:45.567497053 +0000 UTC m=+2.941019253 container died 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True) 2024-03-16T10:57:46.200 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:45 smithi174 podman[71817]: 2024-03-16 10:57:45.932312364 +0000 UTC m=+3.305834544 container cleanup 9b54497e9522370ab760c9fbd0a86e78a9f6796f1499059f09a9de00faeddfd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-16T10:57:46.200 INFO:journalctl@ceph.mds.c.smithi174.stdout:Mar 16 10:57:45 smithi174 bash[71817]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-c 2024-03-16T10:57:46.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.c.service' 2024-03-16T10:57:46.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:46.397 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-16T10:57:46.397 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-16T10:57:46.397 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.f 2024-03-16T10:57:46.729 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:46 smithi174 systemd[1]: Stopping Ceph mds.f for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:47.063 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: 2024-03-16T10:57:46.728+0000 7fd410fe4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:47.063 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:46 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f[66554]: 2024-03-16T10:57:46.728+0000 7fd410fe4700 -1 mds.f *** got signal Terminated *** 2024-03-16T10:57:49.837 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:49 smithi174 podman[71950]: 2024-03-16 10:57:49.569511816 +0000 UTC m=+2.958613668 container died 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240307) 2024-03-16T10:57:50.087 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:49 smithi174 podman[71950]: 2024-03-16 10:57:49.91140408 +0000 UTC m=+3.300505935 container cleanup 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:57:50.087 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:49 smithi174 bash[71950]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f 2024-03-16T10:57:50.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.f.service' 2024-03-16T10:57:50.352 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:50 smithi174 podman[71964]: 2024-03-16 10:57:50.087406898 +0000 UTC m=+0.512954500 container remove 947abf66148ca4515729e95043ded2ba75bdbb75f7bf7f678ab219b6006067d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-16T10:57:50.353 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:50 smithi174 systemd[1]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.f.service: Deactivated successfully. 2024-03-16T10:57:50.353 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:50 smithi174 systemd[1]: Stopped Ceph mds.f for 811ebd0c-e381-11ee-95c9-87774f69a715. 2024-03-16T10:57:50.353 INFO:journalctl@ceph.mds.f.smithi174.stdout:Mar 16 10:57:50 smithi174 systemd[1]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.f.service: Consumed 1.969s CPU time. 2024-03-16T10:57:50.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:50.365 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-16T10:57:50.365 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-16T10:57:50.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.i 2024-03-16T10:57:50.681 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:50 smithi174 systemd[1]: Stopping Ceph mds.i for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:51.063 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:57:50.681+0000 7fbd31e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:51.063 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:50 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i[67172]: 2024-03-16T10:57:50.681+0000 7fbd31e00700 -1 mds.i *** got signal Terminated *** 2024-03-16T10:57:53.813 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:53 smithi174 podman[72072]: 2024-03-16 10:57:53.571298347 +0000 UTC m=+2.994928524 container died 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:57:54.199 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:53 smithi174 podman[72072]: 2024-03-16 10:57:53.964849637 +0000 UTC m=+3.388479797 container cleanup 736267ec3201e23309e54396042b6a7f77f5ef1671673849281ec399e29d0c6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-16T10:57:54.199 INFO:journalctl@ceph.mds.i.smithi174.stdout:Mar 16 10:57:53 smithi174 bash[72072]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-i 2024-03-16T10:57:54.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.i.service' 2024-03-16T10:57:54.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:54.356 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-16T10:57:54.356 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-16T10:57:54.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.l 2024-03-16T10:57:54.562 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:54 smithi174 systemd[1]: Stopping Ceph mds.l for 811ebd0c-e381-11ee-95c9-87774f69a715... 2024-03-16T10:57:55.062 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: 2024-03-16T10:57:54.651+0000 7fcd6b9b5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-16T10:57:55.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:54 smithi174 ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l[66239]: 2024-03-16T10:57:54.651+0000 7fcd6b9b5700 -1 mds.l *** got signal Terminated *** 2024-03-16T10:57:57.894 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:57 smithi174 podman[72193]: 2024-03-16 10:57:57.580890437 +0000 UTC m=+3.008043070 container died 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307) 2024-03-16T10:57:58.219 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:57 smithi174 podman[72193]: 2024-03-16 10:57:57.952108363 +0000 UTC m=+3.379260985 container cleanup 429a37357321c97eba89cbe8373975989337d2175f32789ca8372d5fddd0c665 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f23dacf9be3936dccb4fcc712e538df27762e9b507b84b5cef1b0402d46f6513, name=ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240314.183243-3d78f5b, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-16T10:57:58.219 INFO:journalctl@ceph.mds.l.smithi174.stdout:Mar 16 10:57:57 smithi174 bash[72193]: ceph-811ebd0c-e381-11ee-95c9-87774f69a715-mds-l 2024-03-16T10:57:58.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-811ebd0c-e381-11ee-95c9-87774f69a715@mds.l.service' 2024-03-16T10:57:58.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-16T10:57:58.403 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-16T10:57:58.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T10:57:58.600 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:58:00.980 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T10:58:01.170 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:58:03.664 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-16T10:58:03.854 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:58:06.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:58:06.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:58:06.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-16T10:58:06.393 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-16T10:58:06.396 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi017/crash 2024-03-16T10:58:06.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash -- . 2024-03-16T10:58:06.426 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T10:58:06.426 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-03-16T10:58:06.428 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi111/crash 2024-03-16T10:58:06.429 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash -- . 2024-03-16T10:58:06.470 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T10:58:06.470 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now 2024-03-16T10:58:06.472 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi174/crash 2024-03-16T10:58:06.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash -- . 2024-03-16T10:58:06.512 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-16T10:58:06.512 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-03-16T10:58:06.514 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-16T10:58:06.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-16T10:58:06.551 INFO:teuthology.orchestra.run.smithi017.stdout:2024-03-16T10:53:11.578382+0000 mds.e (mds.3) 11 : cluster [WRN] Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/2ecde2e9-9064-4313-8af9-9af36bbaaa28/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/watchdog) see mds.e log and `damage ls` output for details 2024-03-16T10:58:06.552 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-16T10:58:06.552 INFO:tasks.cephadm:Compressing logs... 2024-03-16T10:58:06.552 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T10:58:06.595 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T10:58:06.597 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T10:58:06.621 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T10:58:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:: No such file or directory 2024-03-16T10:58:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.6.log 2024-03-16T10:58:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.a.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.g.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.j.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log: /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.3.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.x.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.0.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.x.log: 90.2% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.0.log: 94.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.j.log.gz 2024-03-16T10:58:06.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log: 83.1% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.9.log 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log: 89.6% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T10:58:06.641 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.d.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:: No such file or directory 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.10.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.b.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.4.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.1.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.b.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.k.log 2024-03-16T10:58:06.643 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.h.log 2024-03-16T10:58:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.7.log 2024-03-16T10:58:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.e.log 2024-03-16T10:58:06.644 INFO:teuthology.orchestra.run.smithi111.stderr: 90.3% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T10:58:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.y.log 2024-03-16T10:58:06.644 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.a.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.l.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.i.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.11.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.z.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.i.log: /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.8.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.5.log 2024-03-16T10:58:06.645 INFO:teuthology.orchestra.run.smithi174.stderr:gzip/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.8.log: -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.f.log 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.f.log: 90.3% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.2.log 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log: 92.3% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.z.log.gz 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.c.log 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.2.log: 89.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T10:58:06.646 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T10:58:06.647 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-16T10:58:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T10:58:06.650 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.y.log.gz 2024-03-16T10:58:06.651 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log 2024-03-16T10:58:06.652 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-16T10:58:06.652 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.c.log 2024-03-16T10:58:06.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.a.log: 94.6% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.d.log.gz 2024-03-16T10:58:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-16T10:58:06.668 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log: 89.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-16T10:58:06.675 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log: 90.9% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T10:58:06.683 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.b.log 2024-03-16T10:58:06.702 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-16T10:58:06.842 INFO:teuthology.orchestra.run.smithi017.stderr: 89.7% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mgr.x.log.gz 2024-03-16T10:58:06.928 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.g.log.gz 2024-03-16T10:58:06.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.c.log: 94.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.l.log.gz 2024-03-16T10:58:07.010 INFO:teuthology.orchestra.run.smithi174.stderr: 94.4% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.f.log.gz 2024-03-16T10:58:07.034 INFO:teuthology.orchestra.run.smithi174.stderr: 91.9% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.c.log.gz 2024-03-16T10:58:07.208 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.b.log.gz 2024-03-16T10:58:07.300 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mon.a.log.gz 2024-03-16T10:58:07.307 INFO:teuthology.orchestra.run.smithi111.stderr: 94.4% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.k.log.gz 2024-03-16T10:58:08.770 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.a.log.gz 2024-03-16T10:58:09.481 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.h.log.gz 2024-03-16T10:58:10.013 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.e.log.gz 2024-03-16T10:58:10.084 INFO:teuthology.orchestra.run.smithi017.stderr: 92.4% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.9.log.gz 2024-03-16T10:58:10.131 INFO:teuthology.orchestra.run.smithi174.stderr: 95.1% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.c.log.gz 2024-03-16T10:58:10.760 INFO:teuthology.orchestra.run.smithi111.stderr: 92.4% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.4.log.gz 2024-03-16T10:58:11.384 INFO:teuthology.orchestra.run.smithi174.stderr: 92.1% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.11.log.gz 2024-03-16T10:58:11.666 INFO:teuthology.orchestra.run.smithi174.stderr: 92.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.8.log.gz 2024-03-16T10:58:11.700 INFO:teuthology.orchestra.run.smithi017.stderr: 92.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.3.log.gz 2024-03-16T10:58:11.701 INFO:teuthology.orchestra.run.smithi017.stderr: 92.3% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.0.log.gz 2024-03-16T10:58:11.840 INFO:teuthology.orchestra.run.smithi174.stderr: 92.1% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.2.log.gz 2024-03-16T10:58:12.151 INFO:teuthology.orchestra.run.smithi017.stderr: 92.2% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.6.log.gz 2024-03-16T10:58:12.153 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-03-16T10:58:12.153 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m5.545s 2024-03-16T10:58:12.153 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m21.813s 2024-03-16T10:58:12.153 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.666s 2024-03-16T10:58:12.417 INFO:teuthology.orchestra.run.smithi111.stderr: 92.3% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.10.log.gz 2024-03-16T10:58:12.438 INFO:teuthology.orchestra.run.smithi174.stderr: 93.8% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.i.log.gz 2024-03-16T10:58:12.659 INFO:teuthology.orchestra.run.smithi111.stderr: 92.4% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.1.log.gz 2024-03-16T10:58:12.889 INFO:teuthology.orchestra.run.smithi111.stderr: 92.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.7.log.gz 2024-03-16T10:58:13.646 INFO:teuthology.orchestra.run.smithi174.stderr: 92.0% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-osd.5.log.gz 2024-03-16T10:58:13.648 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-03-16T10:58:13.648 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m7.037s 2024-03-16T10:58:13.648 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m31.196s 2024-03-16T10:58:13.648 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.917s 2024-03-16T10:58:53.972 INFO:teuthology.orchestra.run.smithi111.stderr: 93.2% -- replaced with /var/log/ceph/811ebd0c-e381-11ee-95c9-87774f69a715/ceph-mds.b.log.gz 2024-03-16T10:58:53.973 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-03-16T10:58:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m47.363s 2024-03-16T10:58:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:user 1m14.053s 2024-03-16T10:58:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m2.307s 2024-03-16T10:58:53.974 INFO:tasks.cephadm:Archiving logs... 2024-03-16T10:58:53.975 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi017/log 2024-03-16T10:58:53.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T10:58:57.200 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi111/log 2024-03-16T10:58:57.201 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T10:59:08.490 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi174/log 2024-03-16T10:59:08.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T10:59:12.606 INFO:tasks.cephadm:Removing cluster... 2024-03-16T10:59:12.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force 2024-03-16T10:59:12.806 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:59:13.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force 2024-03-16T10:59:13.278 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:59:13.683 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 811ebd0c-e381-11ee-95c9-87774f69a715 --force 2024-03-16T10:59:13.872 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: 811ebd0c-e381-11ee-95c9-87774f69a715 2024-03-16T10:59:14.164 INFO:tasks.cephadm:Removing cephadm ... 2024-03-16T10:59:14.164 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T10:59:14.183 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T10:59:14.200 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-16T10:59:14.215 INFO:tasks.cephadm:Teardown complete 2024-03-16T10:59:14.215 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-16T10:59:14.228 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-16T10:59:14.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T10:59:14.231 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T10:59:14.243 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T10:59:14.356 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-16T10:59:14.374 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-16T10:59:14.374 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:59:14.377 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:59:14.380 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T10:59:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:59:14.391 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:59:14.394 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-03-16T10:59:14.395 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:59:14.395 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-16T10:59:14.396 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 61 +999us[ +999us] +/- 107ms 2024-03-16T10:59:14.396 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 -581us[ -571us] +/- 63ms 2024-03-16T10:59:14.396 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +48us[ +58us] +/- 77ms 2024-03-16T10:59:14.396 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:59:14.397 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:59:14.397 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-03-16T10:59:14.397 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +1006us[+1006us] +/- 107ms 2024-03-16T10:59:14.397 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -579us[ -584us] +/- 63ms 2024-03-16T10:59:14.398 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +57us[ +57us] +/- 77ms 2024-03-16T10:59:14.398 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:59:14.398 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T10:59:14.398 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-03-16T10:59:14.399 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 +1010us[+1002us] +/- 107ms 2024-03-16T10:59:14.399 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -595us[ -603us] +/- 63ms 2024-03-16T10:59:14.399 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +47us[ +47us] +/- 77ms 2024-03-16T10:59:14.399 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T10:59:14.400 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-16T10:59:14.411 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-16T10:59:14.411 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-16T10:59:14.421 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T10:59:14.522 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T10:59:14.592 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T10:59:14.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:59:14.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:14.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:59:14.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:14.725 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T10:59:14.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:14.756 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-16T10:59:14.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-16T10:59:14.790 INFO:teuthology.task.internal:Duration was 1560.843487 seconds 2024-03-16T10:59:14.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-16T10:59:14.801 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-16T10:59:14.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T10:59:14.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T10:59:14.806 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T10:59:14.846 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:59:14.847 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:59:14.848 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T10:59:15.192 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-16T10:59:15.192 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-03-16T10:59:15.192 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T10:59:15.213 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-03-16T10:59:15.213 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T10:59:15.256 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-03-16T10:59:15.257 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T10:59:15.282 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-16T10:59:15.282 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T10:59:15.285 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T10:59:15.299 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T10:59:15.352 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-16T10:59:15.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T10:59:15.354 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T10:59:15.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T10:59:15.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-16T10:59:15.762 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-16T10:59:15.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T10:59:15.789 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T10:59:15.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T10:59:15.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-16T10:59:15.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.858 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.881 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-03-16T10:59:15.883 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-03-16T10:59:15.909 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-03-16T10:59:15.927 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:15.950 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:15.974 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T10:59:15.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T10:59:15.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-16T10:59:16.002 INFO:teuthology.task.internal:Transferring archived files... 2024-03-16T10:59:16.003 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi017 2024-03-16T10:59:16.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T10:59:16.057 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi111 2024-03-16T10:59:16.058 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T10:59:16.100 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377/remote/smithi174 2024-03-16T10:59:16.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T10:59:16.142 INFO:teuthology.task.internal:Removing archive directory... 2024-03-16T10:59:16.143 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T10:59:16.145 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T10:59:16.147 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T10:59:16.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-16T10:59:16.209 INFO:teuthology.task.internal:Not uploading archives. 2024-03-16T10:59:16.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-16T10:59:16.226 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-16T10:59:16.226 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T10:59:16.229 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T10:59:16.233 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T10:59:16.241 INFO:teuthology.orchestra.run.smithi017.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 10:59 /home/ubuntu/cephtest 2024-03-16T10:59:16.244 INFO:teuthology.orchestra.run.smithi111.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 10:59 /home/ubuntu/cephtest 2024-03-16T10:59:16.247 INFO:teuthology.orchestra.run.smithi174.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 10:59 /home/ubuntu/cephtest 2024-03-16T10:59:16.248 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-16T10:59:16.263 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-16T10:59:16.293 INFO:teuthology.nuke:Checking targets against current locks 2024-03-16T10:59:16.319 DEBUG:teuthology.nuke:shortname: smithi017 2024-03-16T10:59:16.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T10:59:16.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.496602', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuzEP5H8SHZUjHpZ/XNFSDpHuaKT5tHEZWA89c82svb603Z6wzd2dkcgzW0lxQsByy45AqAC/BepRB3zwuT3XY='} 2024-03-16T10:59:16.349 DEBUG:teuthology.nuke:shortname: smithi111 2024-03-16T10:59:16.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T10:59:16.370 DEBUG:teuthology.nuke:shortname: smithi174 2024-03-16T10:59:16.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T10:59:16.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.498693', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD8C8ZB6JKYQSZOEQ/BYt2EaWJAOVOWqcWsxExKzJDp4QrX3R4bP3/hYCdHq3eCG8dZj6oOul0ADa4UVUUoBXE='} 2024-03-16T10:59:16.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602377', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 10:21:55.497783', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNgsp1hh4JDU1bOzX8H+6zcjKfuVRdD2K8RmR7DJugvIyY8TyjN+DcX7jWOyDw7ReopySg1qzWRXgmcsjqMV6s8='} 2024-03-16T10:59:16.402 INFO:teuthology.orchestra.console.smithi017:Power off 2024-03-16T10:59:16.402 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T10:59:16.426 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-03-16T10:59:16.426 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:16.446 INFO:teuthology.orchestra.console.smithi111:Power off 2024-03-16T10:59:16.447 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T10:59:16.457 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-16T10:59:16.476 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-03-16T10:59:16.476 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:16.491 INFO:teuthology.orchestra.console.smithi174:Power off 2024-03-16T10:59:16.491 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T10:59:16.500 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-16T10:59:16.513 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-03-16T10:59:16.514 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:16.537 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-03-16T10:59:20.459 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:20.501 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:20.538 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:20.569 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-16T10:59:20.611 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-16T10:59:20.648 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-03-16T10:59:24.574 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:24.612 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:24.649 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:24.683 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-16T10:59:24.722 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-03-16T10:59:24.760 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-03-16T10:59:24.784 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-03-16T10:59:24.822 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-03-16T10:59:28.762 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T10:59:28.872 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-03-16T10:59:28.973 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-03-16T10:59:29.078 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} duration: 1560.8434870243073 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-03-16T10:59:29.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T10:59:29.164 INFO:teuthology.run:FAIL